Job Title: AWS Data Engineer SME
Location: Boston MA (Hybrid)
Long Term Contract W2 / C2C
Skills AWS Python Pyspark and Databricks
Job Summary:
We are looking for an experienced AWS Data Engineer (Overall IT Experience: at least 10 Years) to design build and maintain scalable and efficient data pipelines and platforms in the AWS cloud environment. You will work closely with data scientists analysts and business stakeholders to enable data-driven decision-making by ensuring reliable secure and high-quality data delivery.
Key Responsibilities:
- Design develop and optimize scalable ETL/ELT pipelines using AWS services (Glue EMR Lambda Step Functions etc.)
- Build and maintain data lakes and data warehouses using AWS tools such as S3 Redshift Athena and Lake Formation.
- Collaborate with data architects and business stakeholders to understand data requirements and implement solutions that support analytics and reporting needs.
- Automate ingestion transformation and validation of large-scale datasets from diverse sources.
- Ensure data quality security and compliance with governance policies.
- Monitor data pipelines and infrastructure performance troubleshoot issues and optimize for speed and efficiency.
- Write clean reusable and well-documented code for data engineering tasks using Python SQL or Scala.
- Implement CI/CD practices and infrastructure as code using tools like CloudFormation or Terraform.
- Participate in Agile/Scrum ceremonies and contribute to technical planning and decision-making.