AWS Data Engineer

Job Description:

As an AWS Data Engineer you will be responsible for designing implementing and managing data pipelines and architectures on Amazon Web Services (AWS) to support our datadriven initiatives. You will work closely with crossfunctional teams including data scientists analysts and software engineers to deliver scalable and reliable solutions that enable us to derive insights and value from our data assets.

Responsibilities:

• Design and implement scalable and reliable data architectures on AWS leveraging services such as Amazon S3 Amazon Redshift Amazon EMR and AWS Glue.
  
• Develop and maintain data pipelines for ingesting processing and transforming data from various sources into AWS.
  
• Implement data governance and quality control measures to ensure the integrity and consistency of our data.
  
• Collaborate with data scientists and analysts to provide them with access to clean and wellorganized data for analysis and modeling.
  
• Optimize data pipelines and infrastructure for performance costeffectiveness and scalability.
  
• Ensure compliance with data security and privacy regulations implementing encryption access controls and monitoring mechanisms as needed.
  
• Document designs processes and best practices for knowledge sharing and future reference.
  
• Stay updated on the latest AWS services and technologies and recommend innovative solutions to enhance our data capabilities.
  

AWS Spark and Spark Streaming

AWS Redshift

AWS S3

AWS DMS for Data Replication Nice to Have

AWS Step Functions Airflow

AWS Glue is preferred

Good understanding of AWS Data and Analytics solutions.

Able to understand the clients requirements and project requirements and develop low latency (near real time and batch) data integration solutions.