AWS Data Engineer

Job Title:AWS Data Engineer
Location:Remote
Employment Type:Contract / Full-Time

Job Summary
We are seeking a highly skilledAWS Data Engineerwith strong experience in building scalable cloud-native data platforms and ETL pipelines on AWS. The ideal candidate should have hands-on expertise withAWS Glue Spark ETL Step Functions Amazon EKS Kubernetes Lambda S3 Data Lake architectures SQS KEDA Glue Data Catalog Glue Data Quality and CloudWatch.

Key Responsibilities

Design develop and maintain scalable ETL pipelines usingAWS GlueandApache Spark (PySpark).

Build and orchestrate data workflows usingAWS Step Functions.

Design and implementS3 Data Lakearchitectures following AWS best practices.

Develop and deploy containerized applications onAmazon EKSusingKubernetes.

Build event-driven data processing solutions usingAmazon SQSAWS Lambda andKEDAfor auto-scaling.

Manage metadata usingAWS Glue Data Catalog.

Implement data validation and governance usingAWS Glue Data Quality.

Monitor applications and data pipelines usingAmazon CloudWatch.

Optimize ETL jobs Spark workloads and Kubernetes deployments for performance and scalability.

Collaborate with architects developers DevOps and business stakeholders to deliver robust cloud data solutions.

Participate in Agile ceremonies including sprint planning code reviews and production deployments.

Required Skills

5 years of experience in Data Engineering or Cloud Engineering.

Strong hands-on experience withAWS Glue.

Experience buildingSpark ETLpipelines usingPySpark.

Experience withAWS Step Functions.

Strong knowledge ofAmazon S3 Data Lakearchitecture and storage patterns.

Hands-on experience withAmazon EKSandKubernetes.

Experience implementing event-driven architectures usingAmazon SQSAWS Lambda andKEDA.

Experience withAWS Glue Data CatalogandGlue Data Quality.

Strong experience monitoring AWS workloads usingAmazon CloudWatch.

Good understanding of distributed data processing and cloud-native application design.

Experience working in Agile/Scrum environments.

Preferred Skills

Python / PySpark

SQL

Terraform or CloudFormation

Docker

Git

CI/CD (Jenkins GitHub Actions CodePipeline)

Kafka

Apache Airflow

Delta Lake / Iceberg / Lake Formation

IAM VPC CloudTrail

Education

Bachelors degree in Computer Science Information Technology Engineering or a related field.

Mandatory Skills

AWS Glue

Spark ETL / PySpark

AWS Step Functions

Amazon S3 Data Lake

Amazon EKS

Kubernetes

Amazon SQS

KEDA

AWS Lambda

Glue Data Catalog

Glue Data Quality

Amazon CloudWatch

Nice to Have

Terraform

Docker

Python

SQL

CI/CD

Kafka

AWS Certifications (Solutions Architect Developer Data Engineer or DevOps Engineer)