AWS Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
9 hours ago
Vacancies:
1 Vacancy
Job Summary
Our Client
Our client is a fintech-software company part of a leading European financial group delivering advanced software solutions and data-driven services. They specialise in banking-tech platforms and data engineering supporting the groups digital-transformation ambitions.
Responsibilities:
Data Pipeline Development
- Design and implement cloud-based data pipelines to transform raw data from multiple sources (e.g. APIs FTP SFTP) into structured and consumable formats.
- Architect and deploy high-performance data pipelines (batch and streaming) including monitoring and alerting mechanisms for data analysts and business users.
Data Management
- Build and manage large-scale complex datasets that meet functional and non-functional business requirements.
- Support data governance initiatives including metadata cataloguing and documentation.
- Implement functional and non-functional data tests to ensure quality and reliability.
Data Modelling and Analysis
- Design data models and create appropriate database objects such as tables views procedures and scripts.
- Analyze and optimize queries to ensure performance and scalability.
Collaboration & Production Support
- Contribute to monitoring troubleshooting and user support activities.
- Collaborate with cross-functional teams to gather requirements and deliver effective solutions.
Continuous Improvement
- Develop code in line with established architectural standards continuously improving scalability and performance.
- Stay current with industry trends and emerging technologies to evolve data engineering practices.
Requirements:
Mandatory Skills
-
University degree in Engineering or a related field.
- Proven experience in data pipeline development on AWS including S3 ECS Lambda RDS SNS/SQS IAM and CloudWatch.
- Strong experience with analytical databases (SQL) and unstructured or graph data stores.
- Ability to write complex SQL queries; experience with DBT Core is a plus.
- Proficiency in Python and data-focused libraries such as Pandas and Boto3.
- Solid understanding of data platform architecture and data governance principles.
- Fluent in English Portuguese and/or French is a plus
Additional Assets
-
Strong experience developing solutions on Snowflake.
-
Hands-on experience with CI/CD practices.
- Experience using orchestration tools (e.g. Step Functions Airflow Prefect).
- Familiarity with version control systems such as GitHub or GitLab.
-
Exposure to data visualization tools (e.g. Tableau) is a plus.
- Knowledge of Infrastructure as Code (e.g. CloudFormation Terraform).
- AWS certification (e.g. Solutions Architect or equivalent) is preferred.
-
Snowflake certification (e.g. SnowPro Core) is preferred.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
