Senior Data Engineer
Senior Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Help empower our global customers to connect to culture through their passions.
Technology at StockX
Our Technology Team is on a mission to build the next generation e-commerce platform for the next generation customer. We build world-class innovative experiences and products that give our users access to the worlds most-coveted products and unlock economic opportunity by turning reselling into a business for anyone. Our team uses cutting edge technologies that handle massive scale globally. Were an internet-native cloud-native company from day 1 - you wont find legacy technology here. If youre a curious leader who loves solving problems wearing multiple hats and learning new things join us!
About the role
As a Senior Data Engineer you will be empowered to leverage data to drive amazing customer experiences and business results. You will own the end to end development of data engineering solutions to support analytical needs of the business. The ideal candidate will be passionate about working with disparate datasets and be someone who loves to bring data together to answer business questions at speed. You should have deep expertise in the creation and management of datasets and the proven ability to translate the data into meaningful insights through collaboration with analysts data scientists and business stakeholders.
What youll do
- Design and build mission critical data pipelines with a highly scalable distributed architecture - including data ingestion (streaming events and batch) data integration data curation
- Help continually improve ongoing reporting and analysis processes simplifying self-service support for business stakeholders
- Build and support reusable framework to ingest integration and provision data
- Automation of end to end data pipeline with metadata data quality checks and audit
- Build and support a big data platform on the cloud
- Define and implement automation of jobs and testing
- Optimize the data pipeline to support ML workloads and use cases
- Support mission critical applications and near real time data needs from the data platform
- Capture and publish metadata and new data to subscribed users
- Work collaboratively with business analysts product managers data scientists as well as business partners and actively participate in design thinking session
- Participate in design and code reviews
- Motivate coach and serve as a role model and mentor for other development team associates/members that leverage the platform
About you
- Minimum of 5 years experience in data warehouse / data lake technical architecture
- 3 years of experience in using programming languages (Python / Scala / Java / C#) to build data pipelines
- Minimum 3 years of Big Data and Big Data tools in one or more of the following: Batch Processing (e.g. Hadoop distributions Spark) Real time processing (e.g. Kafka Flink/Spark Streaming)
- Minimum of 2 years experience with AWS or engineering in other cloud environments
- Experience with Database Architecture/Schema design
- Strong familiarity with batch processing and workflow tools such as AirFlow NiFi
- Ability to work independently with business partners and management to understand their needs and exceed expectations in delivering tools/solutions
- Strong interpersonal verbal and written communication skills and ability to present complex technical/analytical concepts to executive audience
- Strong business mindset with customer obsession; ability to collaborate with business partners to identify needs and opportunities for improved data management and delivery
- Experience providing technical leadership and mentoring other engineers for best practices on data engineering
- Bachelors degree in Computer Science or a related technical field
Nice to have:
- Masters in Computer Science or related quantitative field
StockX is proud to be a Detroit-based technology leader focused on the large and growing online market for sneakers apparel accessories electronics collectibles trading cards and more. StockXs powerful platform connects buyers and sellers of high-demand consumer goods from around the world using dynamic pricing mechanics. This approach affords access and market visibility powered by real-time data that empowers buyers and sellers to determine and transact based on market value. The StockX platform features hundreds of brands across verticals including Jordan Brand adidas Nike Supreme BAPE Off-White Louis Vuitton Gucci; collectibles from brands including LEGO KAWS Bearbrick and Pop Mart; and electronics from industry-leading manufacturers Sony Microsoft Meta and Apple. Launched in 2016 StockX employs 1000 people across offices and verification centers around the world. Learn more at .
Required Experience:
Senior IC
Employment Type
Full Time
