Big Data Engineer III

Amazons Profit Intelligence is seeking a talented Big Data Engineer to join the Profit Intelligence team. We develop software solutions that are revolutionizing Amazon business intelligence through advanced algorithms running on big data technologies. The ideal candidate thrives in a fast-paced environment and relishes working with petabytes of extremely complex and dynamic this role you will be part of a team of high caliber data and software engineers to build data pipelines using big data technologies such as Apache Spark Hive/Hadoop and distributed query engines. You should be passionate about working with big data and have the aptitude to incorporate new technologies and evaluate them critically. You must possess excellent business and communication skills and be able to work with business owners to analyze requirements and build solutions. You are a self-starter has a proven track record of dealing with ambiguity and working in a fast-paced highly dynamic environment. Working experience of any one of the programming languages such as Java C# Scala etc. is a big plus.

Key job responsibilities
Interface with PMs business customers and software developers to understand requirements and implement solutions
Collaborate with both Retail Finance and central FP&A teams to understand the interdependence and deliverables
Design develop and operate highly-scalable high-performance low-cost and accurate data pipelines in distributed data processing platforms with AWS technologies
Recognize and adopt best practices in data processing reporting and analysis: data integrity test design analysis validation and documentation
Keep up to date with big data technologies evaluate and make decisions around the use of new or existing software products to design the data architecture

About the team
Profit intelligence systems measures predicts true profit(/loss) for each item as a result of a specific shipment to an Amazon customer. Profit Intelligence is all about providing intelligent ways for Amazon to understand profitability across retail business. What are the hidden factors driving the growth or profitability across millions of shipments each day

We compute the profitability of each and every shipment that gets shipped out of Amazon. Guess what we predict the profitability of future possible shipments too. We are a team of agile can-do engineers who believe that not only are moon shots possible but that they can be done before lunch. All it takes is finding new ideas that challenge our preconceived notions of how things should be done. Process and procedure matter less than ideas and the practical work of getting stuff done. This is a place for exploring the new and taking risks.

We push the envelope in using cloud services in AWS as well as the latest in distributed systems forecasting algorithms and data mining.

- 5 years of data engineering experience
- Experience with data modeling warehousing and building ETL pipelines
- Experience with SQL
- Experience in at least one modern scripting or programming language such as Python Java Scala or NodeJS
- Experience mentoring team members on best practices

- Experience with big data technologies such as: Hadoop Hive Spark EMR
- Experience operating large data warehouses
- Masters degree in computer science engineering analytics mathematics statistics IT or equivalent
- Knowledge of distributed systems as it pertains to data storage and computing
- Experience communicating with users other technical teams and management to collect requirements describe data modeling decisions and data engineering strategy
- Experience building complex software systems that have been successfully delivered to customers

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.