Data Engineer II, Shopbop Data

As a Data Engineer at Shopbop team you will routinely solve complex data problems unblocking critical projects that drive Shopbops Mission to be the daily destination for style inspiration and discovery. Whether you are optimizing analysis for marketing to tune their strategies building new pipelines to drive down shipping speeds or helping accounting drill down to track our business - your work will empower meaningful change for your customers. You will partner closely with stakeholders across our business and partners on the Data Engineering team to deliver new features or pitch in to migrate legacy features to a modern AWS-based platform. You will be an active partner in Amazons (Shopbops parent company) data engineering group taking part in learning series and operational reviews with industry-leading engineers.

Shopbop is part of Amazons Fashion and Fitness team but with a unique vibe and mission to service fashion-oriented customers. The data engineering team frequently collaborates with all parts of the business providing opportunities to learn about the Fashion industry and E-Commerce (and employee discounts). We are looking for a candidate willing to be in person at a Shopbop location in New York. Expect 1/year travel to Madison WI.

Key job responsibilities
You will own projects that build new data pipelines migrate pipelines form our legacy Informatica system to a modern AWS-based system or refine existing pipelines to deliver more value for our customers. You will partner with colleagues across Shopbop to understand their business domains and build solutions that meet their needs. You will also be an active participant within the data team at Shopbop suggesting improvements that improve the teams operational health and reduce errors for customers. You will participate in Amazons active engineering culture learning and teaching the best.- Architecture design and implementation of next generation complex data pipelines and BI solutions based out of AWS. Some of your tasks will include
- Manage AWS resources including S3 EC2 RDS Redshift Kinesis EMR Lambda Glue Apache Airflow etc.
- Build and deliver high quality data architecture and pipelines to support business analyst data scientists and customer reporting needs.
- Interface with other technology teams to extract transform and load data from a wide variety of data sources
- Continually improve ongoing reporting and analysis processes automating or simplifying self-service support for customers
- Actively participate in the code review process design discussions team planning operational excellence and constructively identifies problems and proposes solutions.

A day in the life
You start the day responding to an email and start a brief chat to align on requirements with a stakeholder. You hop into a code review accepting most of the feedback but noting an area to discuss. You go heads down for a while working on your current story. After standup you help a peer struggling with a dataset you know and discuss their CR the afternoon you attend a presentation on how to implement effective data models for Machine Learning spurring ideas for how to improve Shopbops personalization data feed. You attend the weekly operational review and are pleased to see a fix you made has reduced total run time on a critical job by 40%. You finish up the day by working on your primary deliverable before signing off.

- 3 years of data engineering experience
- Bachelors degree
- Experience with data modeling warehousing and building ETL pipelines
- Experience programming with at least one modern language such as Python Ruby Golang Java C C# Rust
- Experience in designing implementing and overseeing data processing systems tailored for extensive datasets.
- Experience in at least one scripting or programming language such as Python or JavaScript or TypeScript

- Demonstrated aptitude in independently managing and delivering end-to-end projects.
- Experience with complex SQL data modeling data warehousing and building ETL pipelines.
- Relevance in areas such as Data Engineering Database Engineering Business Intelligence or Business Analytics.
- Practical familiarity with AWS Big Data Technologies encompassing EMR Athena EC2 Redshift IAM and S3 to name a few.
- Prior engagement with Redshift PostgreSQL SQL Server or MySQL.
- Experience with non-relational databases / data stores (object storage document or key-value stores graph databases etc)
- Proficiency in navigating both Batch and Real-Time data processing systems.
- Comprehensive comprehension of software coding practices throughout the development lifecycle inclusive of agile methodologies coding standards code reviews source management build processes testing and operations.
- Usage of generative AI tools to enhance workflow efficiency with a willingness to learn effective prompting and evaluation practices.
- Ability to recognize opportunities where generative AI could enhance products workflows or customer experiences.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience qualifications and location. Amazon also offers comprehensive benefits including health insurance (medical dental vision prescription Basic Life & AD&D insurance and option for Supplemental life plans EAP Mental Health Support Medical Advice Line Flexible Spending Accounts Adoption and Surrogacy Reimbursement coverage) 401(k) matching paid time off and parental leave. Learn more about our benefits at NY New York - 145300.00 - 196600.00 USD annually