Are you passionate about developing the next generation of data infrastructure capable of handling complex missioncritical data pipelines and analytics workloads Do you want to build next generation data engineering solutions that leverage the latest AWS technologies to process a broad range of business and customer data
Join our Pricing & Promotions Science Data and Insights team where youll have the opportunity to continuously improve the systems that enable Amazons annual worldwide revenue of billions of dollars.
Key job responsibilities
Design build and operate highly scalable faulttolerant data processing systems using modern AWS services like Redshift S3 Glue EMR Kinesis and Lambda and orchestration systems using Airflow
Leverage your expertise in Python Scala or other modern programming languages to develop custom data processing frameworks and automation tools
Collaborate closely with data scientists analysts and product managers to understand business requirements and translate them into technical solutions
Continuously optimize data pipeline performance reliability and costefficiency using best practices in CI/CD and infrastructureascode
Mentor junior engineers and share your knowledge of data engineering best practices
Stay uptodate with the latest big data technologies and architectural patterns and drive the adoption of innovative solutions
A day in the life
You will:
Identify key areas of concerns/limitations with current architecture and build next generation frameworks and systems that enable data teams to deliver on future needs
Build automated data quality monitoring audit and reconciliation mechanisms
Develop and maintain core infrastructure and services for multiple data engineering teams
Improve efficiency of operations in terms of cost effort and reliability
About the team
The Pricing and Promotions Science Data and Insights Org strives to accelerate Customer Seller and overall Amazon success through the proactive development of automated intelligent pricing and promotions science and analytics systems. We facilitate making trustworthy datadriven decision making at scale. We look around corners for both longterm and shortterm flywheel causal impacts and think holistically from sourcing to CX and all customer journey touch points in between.
4 years of data engineering experience
Experience building/operating highly available distributed systems of data extraction ingestion and processing of large data sets
Experience in at least one modern scripting or programming language such as Python Java Scala or NodeJS
Experience with AWS technologies like Redshift S3 AWS Glue EMR Kinesis FireHose Lambda and IAM roles and permissions
Experience with SQL
Experience with data audit and reconciliation strategies.
Experience with data pipeline orchestration frameworks such as Airflow.
Experience with streaming data processing technologies.
Experience with nonrelational databases / data stores (object storage document or keyvalue stores graph databases columnfamily databases)
Experience providing technical leadership and mentoring other engineers for best practices on data engineering
Masters degree in computer science engineering analytics mathematics statistics IT or equivalent
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit
for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.
The base salary for this position ranges from $103300/year up to $172600/year. Salary is based on a number of factors and may vary depending on jobrelated knowledge skills and experience. Amazon is a total compensation company. Dependent on the position offered equity signon payments and other forms of compensation may be provided as part of a total compensation package in addition to a full range of medical financial and/or other benefits. Applicants should apply via our internal or external career site.