Senior Data Engineer
Senior Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Our data team has expertise across engineering analysis architecture modeling machine learning artificial intelligence and data science. This discipline is responsible for transforming raw data into actionable insights building robust data infrastructures and enabling datadriven decisionmaking and innovation through advanced analytics and predictive modeling.
Responsibilities:
- Work closely with the Data Analyst/Data Scientist to understand evolving needs and define the data processing flow or interactive reports.
- Discuss with the stakeholders from other teams to better understand how data flows are used within the existing environment.
- Propose solutions for the cloudbased architecture and deployment flow.
- Design and build processes data transformation and metadata to meet business requirements and platform needs.
- Design and propose solutions for the Relational and Dimensional Model based on platform capabilities.
- Develop maintain test and evaluate big data solutions.
- Focus on production status and data quality of the data environment.
- Pioneer initiatives around data quality integrity and security.
Qualifications :
- 5 years of experience in Data Engineering.
- Proficiency in Apache Spark
- Proficiency in Python.
- Experience building data pipelines with Azure
- Some experience leading IT projects and stakeholder management.
- Experience implementing ETL/ELT process and Data pipelines.
- Experience with Snowflake.
- Strong SQL scripting experience.
- Background and experience with cloud data technologies and tools.
- Familiar with data tools and technologies like:
- Spark Hadoop Apache beam Dataproc or similar.
- BigQuery Redshift or other Data warehouse tools.
- Realtime pipelines with Kinesis or Kafka.
- Batch processing.
- Serverless processing.
- Strong analytic skills related to working with structured and unstructured data sensibilities.
Additional Information :
Discover some of the global benefits that empower our people to become the best version of themselves:
- Finance: Competitive salary package share plan company performance bonuses valuebased recognition awards referral bonus;
- Career Development: Career coaching global career opportunities nonlinear career paths internal development programmes for management and technical leadership;
- Learning Opportunities: Complex projects rotations internal tech communities training certifications coaching online learning platforms subscriptions passiton sessions workshops conferences;
- WorkLife Balance: Hybrid work and flexible working hours employee assistance programme;
- Health: Global internal wellbeing programme access to wellbeing apps;
- Community: Global internal tech communities hobby clubs and interest groups inclusion and diversity programmes events and celebrations.
In compliance with the Law 1581 of 2012 Endava S.A.S. / Endava Colombia S.A.S identified with NIT. N 900.955.6793 / N 900.594.5219 with an address at Street 96 No. 10 38 floor 7th in the city of Bogot and Career 48 No. 18A 14 Floor 19 with telephone number(hereinafter referred as ENDAVA or the Organization) as RESPONSIBLE for the processing of personal information informs:
Keep in mind that once you decide to participate in ENDAVA COLOMBIAs recruitment processes the physical delivery or sending via email your resume implies the express acceptance through conclusive behavior of authorizing ENDAVA to process your data with the purpose to participate in the recruitment processes in the Organization. In particular the personal data provided shall be part of our Talent Bank for a maximum term of two 2 years which shall be stored on servers located outside the country and may be processed for the purpose of; verifying compliance with the requirements to participate in the Organizations current and/or future recruitment processes; execute interviews and in general send notifications related to the recruitment processes. In case your resume is not preselected it shall be permanently deleted. ENDAVA guarantees that the personal data obtained shall be used only for the announced purposes and shall be kept for the time required by law.
You and every personal information owner have the right to: know update and rectify your personal data; access to it free of charge; to be informed about its use; request proof of authorization; file complaints for violations of the provisions of current regulations before the Superintendence of Industry and Commerce. Finally in some applicable cases modify and revoke the consent given and/or request the deletion of your personal information.
For any additional information related to the processing of your personal data our Personal Information Processing Policy and/or exercising of your right to the habeas data you can contact us through the service channel provided by ENDAVA: .
Our diversity makes us stronger it drives meaningful change and enables us to build innovative technology solutions. We are committed to creating an inclusive community where all of us regardless of background identity or personal characteristics feels valued respected and free from discrimination. As an equal opportunity employer we welcome applications from all individuals and base hiring decisions on merit skills qualifications and potential.
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
