AWS Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
03-11-2025
Vacancies:
1 Vacancy
Job Summary
Collaborate with Product teams ensuring that raw data is cleansed and transformed
and useable by downstream consumers (ML Engineers BI analytics)
Expect level PL-SQL
Assist and advise on the re-development and modernisation of end-to-end ETL
pipelines and introduce new technologies where appropriate in a real-time streaming
environment dealing with very large data volumes
Working with AWS cloud infrastructure (specifically SQS SNS Redshift
OpenSearch Athena Kinesis AWS code pipeline) to develop innovate and maintain
data flowing through various queues and data warehouses
Working with a variety of data repository platforms (including SQL stores such as
Oracle) as well as implementing data visualisation and network analysis (e.g
GraphdB)
Maintain and productionise machine learning and AI models
Assist in the creation of next generation data ingestion platforms sourcing data
using Webscrapes APIs Email and flat file (FTP) methods
Understanding conflict resolution methods and assist subject matter experts in the
debugging on data ingestion and managing overall feed uptimes across a large set of
data collectors.
Create and maintain detailed documentation and functional design specifications
including data flows and data conversion
Provide technical information to assist in the development of client facing product
documentation
Adhere to change management protocols and version control
Present advanced technical designs with non-technical stakeholders
and useable by downstream consumers (ML Engineers BI analytics)
Expect level PL-SQL
Assist and advise on the re-development and modernisation of end-to-end ETL
pipelines and introduce new technologies where appropriate in a real-time streaming
environment dealing with very large data volumes
Working with AWS cloud infrastructure (specifically SQS SNS Redshift
OpenSearch Athena Kinesis AWS code pipeline) to develop innovate and maintain
data flowing through various queues and data warehouses
Working with a variety of data repository platforms (including SQL stores such as
Oracle) as well as implementing data visualisation and network analysis (e.g
GraphdB)
Maintain and productionise machine learning and AI models
Assist in the creation of next generation data ingestion platforms sourcing data
using Webscrapes APIs Email and flat file (FTP) methods
Understanding conflict resolution methods and assist subject matter experts in the
debugging on data ingestion and managing overall feed uptimes across a large set of
data collectors.
Create and maintain detailed documentation and functional design specifications
including data flows and data conversion
Provide technical information to assist in the development of client facing product
documentation
Adhere to change management protocols and version control
Present advanced technical designs with non-technical stakeholders
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
