Data Engineer
Job Location:
Monthly Salary:
Posted on:
5 hours ago
Posted on:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Job Description
As a Data Engineer you will independently design build and operate reliable data pipelines and platforms that power analytics experimentation and product decision-making across the organisation. You take ownership of the quality and reliability of the workflows you build and you work closely with software engineers data scientists analysts and business stakeholders to ensure high-quality well-modeled and trustworthy data is available at scale.
This role sits within the Product Security department and helps build software to protect the worlds largest travel platform against attacks to its account & authorisation system.
- Design build and operate data pipelines and Airflow workflows (DAGs) (batch and/or streaming) to ingest transform and deliver data from diverse sources into analytics and operational data stores
- Develop and maintain data models (e.g. dimensional vault or other analytical models) that are consistent well-documented and optimised for downstream use cases
- Ensure data quality and reliability end-to-end by implementing validation monitoring testing and alerting across pipelines Airflow workflows and datasets with clear SLOs and error budgets where applicable
- Own the operational excellence of the workflows you develop including on-call participation where relevant incident triage troubleshooting and driving root-cause analysis and follow-ups to prevent regressions
- Collaborate with cross-functional teams to understand data needs translate them into technical solutions and enable self-service access to data where appropriate
- Operate and improve big data platforms and tooling following modern data engineering best practices version control and CI/CD workflows
- Manage data governance aspects within your scope: ownership of datasets documentation access control and alignment with security and privacy requirements
- Contribute to craft standards and frameworks sharing best practices improving shared Airflow patterns and libraries and mentoring more junior engineers where relevant.
- Proven experience (3 years) as a Data Engineer or in a similar data-focused engineering role working with large-scale or complex datasets
- Strong skills in at least one programming language commonly used for data engineering (preferably Python Java is also acceptable)
- Hands-on experience with data processing frameworks (e.g. Spark Flink Beam or similar) and SQL for working with relational and analytical databases
- Practical experience designing implementing and operating Airflow DAGs (or similar workflow orchestration tools) including dependency management scheduling and observability
- Experience building and operating ETL/ELT pipelines on modern data platforms (e.g. cloud data warehouses data lakes or lakehouses)
- Experience with stream processing and real-time data products (e.g. Kafka Kinesis or similar)
- Understanding of data modeling concepts (e.g. dimensional modeling Data Vault star/snowflake schemas) and how they support analytics and reporting
- Familiarity with version control testing and CI/CD practices for data workflows including automated validation and deployment of Airflow changes
- Ability to communicate clearly with both technical and non-technical stakeholders explaining trade-offs and data design decisions.
Critical Thinking:
- Find solutions to difficult or complex issues by applying different skills and techniques like analytical thinking lateral thinking and logical reasoning
- Constructively improve existing ideas plans and solutions by reviewing them in a critical yet constructive manner initiating concrete improvements and articulating their rationale
- Continuous Quality and Process Improvement
- Identify opportunities for process system and/or structural improvements by applying an understanding of process flows and the methods that can be used to boost effectiveness and efficiency.
Effective Communication:
- Deliver clear well-structured and meaningful information to a target audience by using suitable communication mediums and language tailored to the audience
- Achieve mutually agreeable solutions by staying adaptable communicating ideas in clear coherent language and practicing active listening.
The preceding job description had been designed to indicate the general nature and level of work performed by employees within this classification. It is not designed to contain or be interpreted as a comprehensive inventory of all duties and responsibilities required of employees assigned to this job.
What we offer
You will find here not only a challenging and interesting workplace but also a rewarding work experience with competitive compensation and benefit packages:
- A dynamic and multinational environment with dedicated professionals who are ready to share their knowledge with you;
- Soft skills and technical training for current and emerging products and technologies;
- Career development: opportunity to grow within the team;
- Special referral bonuses for recommending your friends;
- Private Medical subscription;
- Meal tickets;
- Extra vacation days;
- Flexible working hours and work from home aligned with project needs;
- Friendly team who is eager to meet you.
Diversity & Inclusion
Here at the Stefanini Group we value plurality and equity regardless of race sexual orientation disability age ancestry religion gender and nationality. We understand and encourage the importance of being you!
Whats next
Its best to apply today because job postings can be taken down and we wouldnt want you to miss this opportunity.
The recruitment process starts with an HR discussion followed by a technical test and a final talk with the hiring manager.
About us
We are the Stefanini group a global tech consulting company of Brazilian origin that believes in the power of people to transform businesses through technology.
We are present in over 40 countries and operate with the purpose of co-creating solutions TOGETHER WITH OUR CLIENTS that accelerate results and improve the experience of people and organizations.
Here we like to say that technology is not the end but the means: what really matters are the people who drive it all.
Our mindset is AI First meaning we invest in cutting-edge technology in everything we do focusing on results for our clients.
We are a company A GROUP that breathes collaboration and offers a dynamic environment where you will learn by doing grow alongside the team and have space to contribute with ideas and projects.
More than just talking about digital transformation we believe in real transformation that starts with people and impacts real businesses.
If you are looking for a place to develop innovate and be part of something bigger the Stefanini Group is your place.
We want to inform you that there are currently scams targeting job seekers by falsely using our companys name Stefanini. We sincerely apologize for any confusion or inconvenience this may have caused.
Please remember that legitimate job offers from Stefanini will always come through official channels including direct communication with our trained recruiters. If you receive any unsolicited messages requesting payment or personal information please disregard them.
If you suspect youve been targeted please contact us immediately at for verification.
Key Points to Remember:
* Legitimate job offers only follow interviews conducted with our hiring managers or clients.
* We will never ask for payment at any stage of the recruitment process.
Stay vigilant and feel free to reach out for verification. Your safety and security are our top priorities. Thank you for your understanding and cooperation!
Required Experience:
IC
