Data Engineer II AWS Infrastructure Supply Chain Automation

AWS Infrastructure Services owns the design planning delivery and operation of all AWS global infrastructure. In other words were the people who keep the cloud running. We support all AWS data centers and all of the servers storage networking power and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems with thousands of variables impacting the supply chain and were looking for talented people who want to help.

Youll join a diverse team of software hardware and network engineers supply chain specialists security experts operations managers and other vital roles. Youll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. Youll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion.

Were looking for Data Engineers to help us grow our Data Lake and Data Warehouse Systems which is being built using a serverless architecture with 100 native AWS components including Redshift Spectrum Athena S3 Lambda Glue EMR Kinesis SNS CloudWatch and more! We own a worldclass data lake that is used to drive multibillion dollar decisions on a regular cadence and were looking to improve on filling the lake quickly with as little human intervention needed and democratize the data in the lake.

Our Data Engineers build the ETL and analytics solutions for our internal customers to answer questions with data and drive critical improvements for the business. Our Data Engineers use best practices in software engineering data management data storage data compute and distributed systems. We are passionate about solving business problems with data!



Key job responsibilities
Develop and maintain automated ETL pipelines (with monitoring) using scripting languages such as Python Spark SQL and AWS services such as S3 Glue Lambda SNS SQS KMS.
Implement and support reporting and analytics infrastructure for internal business customers.
Develop and maintain data security and permissions solutions for enterprise scale data warehouse and data lake implementations including data encryption and database user access controls and logging.
Develop data objects for business analytics using data modeling techniques.
Develop and optimize data warehouse and data lake tables using best practices for DDL physical and logical tables data partitioning compression and parallelization.
Develop and maintain data warehouse and data lake metadata data catalog and user documentation for internal business customers.
Work with internal business customers and software development teams to gather and document requirements for data publishing and data consumption via data warehouse data lake and analytics solutions.


About the team
About AWS

Diverse Experiences
AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description we encourage candidates to apply. If your career is just starting hasnt followed a traditional path or includes alternative experiences dont let it stop you from applying.

Why AWS
Amazon Web Services (AWS) is the worlds most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating thats why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.

Inclusive Team Culture
Here at AWS its in our nature to learn and be curious. Our employeeled affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences inspire us to never stop embracing our uniqueness.

Mentorship & Career Growth
Were continuously raising our performance bar as we strive to become Earths Best Employer. Thats why youll find endless knowledgesharing mentorship and other careeradvancing resources here to help you develop into a betterrounded professional.

Work/Life Balance
We value worklife harmony. Achieving success at work should never come at the expense of sacrifices at home which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home theres nothing we cant achieve in the cloud.

4 years of data engineering experience
Experience with data modeling warehousing and building ETL pipelines

Experience with AWS technologies like Redshift S3 AWS Glue EMR Kinesis FireHose Lambda and IAM roles and permissions

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race national origin gender gender identity sexual orientation protected veteran status disability age or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $118900/year in our lowest geographic market up to $205600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on jobrelated knowledge skills and experience. Amazon is a total compensation company. Dependent on the position offered equity signon payments and other forms of compensation may be provided as part of a total compensation package in addition to a full range of medical financial and/or other benefits. For more information please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.