Data Engineer AWS
Data Engineer AWS
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job description
Addepto is a leading consulting and technology company specializing in AI and Big Data helping clients deliver innovative data projects. We partner with toptier global enterprises and pioneering startups including Rolls Royce Continental Porsche ABB and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top 10 AI companies.
As a Data Engineer you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries leveraging cuttingedge technologies. Here are some of the projects we are seeking talented individuals to join:
Design and development of a universal data platform for global aerospace companies. This Azure and Databricks powered initiative combines diverse enterprise and public data sources. The data platform is at the early stages of the development covering design of architecture and processes as well as giving freedom for technology selection.
Development and maintenance of a large platform for processing automotive data. A significant amount of data is processed in both streaming and batch modes. The technology stack includes Spark Cloudera Airflow Iceberg Python and AWS.
Design of the data transformation and following data ops pipelines for global car manufacturer. This project aims to build a data processing system for both realtime streaming and batch data. Well handle data for business uses like process monitoring analysis and reporting while also exploring LLMs for chatbots and data analysis. Key tasks include data cleaning normalization and optimizing the data model for performance and accuracy.
Your main responsibilities:
Build and scale reliable data pipelines for both realtime and batch processing using technologies like Airflow andAWS Step Functions.
Develop automated data workflows that power analytics reporting and AI/ML models using services such as S3 Glue EMR Lambda Redshift and SageMaker.
Work with diverse data sources ensuring consistent quality integrity and readiness for analysis across platforms.
Ingest transform and manage data from structured and semistructured sources (including relational databases cloud APIs XML JSON and Hadoop/Spark.
Partner closely with data science and business teams to align technical solutions with realworld use cases.
Contribute to MLOps and CI/CD pipelines helping streamline the deployment and monitoring of data products and models.
Continuously evaluate and improve existing processes for speed efficiency and scalability in a cloud environment.
Turn business problems into datadriven solutions ensuring high performance security and scalability.
Job requirements
What youll need to succeed in this role:
At least 3 years of professional programming experience implementing developing or maintaining Big Data systems ideally in a business or enterprise setting.
Strong proficiency in Python and SQL for data engineering tasks.
Solid understanding of cloud data ecosystems especially AWS.
Familiarity with automation tools such as Airflow AWS Step Functions or similar workflow orchestrators.
Experience working in Unix environments and using Git for version control.
Excellent communication skills and consulting experience with direct interaction with clients.
Ability to work independently and take ownership of project deliverables.
Fluent in English (at least C1 level).
Masters in Computer Science Big Data Data Science Mathematics Physics or a related field.
Nice to have:
Experience with cloud data warehouses like Redshift or Snowflake.
Exposure to Generative AI tools and concepts (e.g. LLMs RAG prompt engineering).
Experience with Databricks.
Discover our perks & benefits:
Work in a supportive team of passionate enthusiasts of AI & Big Data.
Engage with toptier global enterprises and cuttingedge startups on international projects.
Enjoy flexible work arrangements allowing you to work remotely or from modern offices and coworking spaces.
Accelerate your professional growth through career paths knowledgesharing initiatives language classes and sponsored training or conferences including a partnership with Databricks which offers industryleading training materials and certifications.
Choose from various employment options: B2B employment contracts or contracts of mandate.
Make use of 20 fully paid days off available for B2B contractors and individuals under contracts of mandate.
Participate in teambuilding events and utilize the integration budget.
Celebrate work anniversaries birthdays and milestones.
Access medical and sports packages eye care and wellbeing support services including psychotherapy and coaching.
Get full work equipment for optimal productivity including a laptop and other necessary devices.
With our backing you can boost your personal brand by speaking at conferences writing for our blog or participating in meetups.
Experience a smooth onboarding with a dedicated buddy and start your journey in our friendly supportive and autonomous culture.
All done!
Your application has been successfully submitted!
Employment Type
Full-Time
