Sr Data Engineer I

Job Posting Title:

Req ID:

Job Description:

Disney Entertainment and ESPN Product & Technology Technology is at the heart of Disneys past present and future. Disney Entertainment and ESPN Product & Technology is a global organization of engineers product developers designers technologists data scientists and more all working to build and advance the technological backbone for Disneys media business globally.

The team marries technology with creativity to build world-class products enhance storytelling and drive velocity innovation and scalability for our businesses. We are Storytellers and Innovators. Creators and Builders. Entertainers and Engineers. We work with every part of The Walt Disney Companys media portfolio to advance the technological foundation and consumer media touch points serving millions of people around the world.

Here are a few reasons why we think youd love working here:
1. Building the future of Disneys media: Our Technologists are designing and building the products and platforms that will power our media advertising and distribution businesses for years to come.

2. Reach Scale & Impact: More than ever Disneys technology and products serve as a signature doorway for fans connections with the companys brands and stories. Disney. Hulu. ESPN. ABC. ABC Newsand many more. These products and brands and the unmatched stories storytellers and events they carry matter to millions of people globally.

3. Innovation: We develop and implement groundbreaking products and techniques that shape industry norms and solve complex and distinctive technical problems.

Commerce Data & Identity provides the core product management functions for areas crucial to Disneys media businesses. These include initiatives and products that power digital commerce identity and growth as well as those that reach uniquely across The Walt Disney Company enterprise such as messaging and privacy among others. Additionally it is responsible for the data engineering science and products for Disney Entertainment & ESPN along with their interconnection with other parts of The Walt Disney Company.

Job Summary:
The Application Data Engineering organization within the DEET organization is in search of a Senior Data Engineer. As a member of the Application Data Engineering team you will establish the foundational set of data pipelines and datasets which are a vital key to success enabling dozens of engineering and analytical teams to unlock the power of data to drive key business decisions and provide engineering analytics and operational teams the critical information necessary to scale the largest streaming service. Expanding scaling and standardizing the core foundational principles through consistent observability lineage data quality logging and alerting across all engineering teams in the Data organization is imperative to the creation of a single pane of glass. The Application Data Engineering team is seeking to grow their team of world class Data Engineers that share their charisma and enthusiasm for making a positive impact!

Responsibilities and Duties of the Role
Contribute to maintaining updating and expanding existing Application Data Engineering data pipelines in Scala Python and SQL using Spark while maintaining strict uptime SLAs

Gaining an in-depth understanding of domain subject areas including Subscription Application Performance Experimentation and Session data to support our customers.

Make modifications to both batch and streaming data pipelines using Scala Databricks and Airflow

Improve observability alerting and maintain existing spark jobs that power key business metrics.

Tech stack includes Airflow Spark Databricks Delta Lake Snowflake Scala Python

Collaborate with product managers architects and other engineers to drive the success of the Core Data platform

Contribute to debugging complex customer scenarios across different subject matter areas determining if bug fixes and backfills are needed.

Ensure high operational efficiency and quality of the Application Data platform datasets to ensure our solutions meet SLAs and project reliability and accuracy to all our stakeholders (Engineering Data Science Operations and Analytics teams)

Be an active participant and advocate of agile/scrum ceremonies to collaborate and improve processes for our team

Engage with and understand our customers forming relationships that allow us to understand and prioritize both innovative new offerings and incremental platform improvements

Maintain detailed documentation of your work and changes to support data quality and data governance requirements

Required Education Experience/Skills/Training:
Basic Qualifications

5 years of data engineering experience developing large data pipelines

Strong algorithmic problem-solving expertise

Strong fundamental Scala and Python programming skills

Basic understanding of AWS or other cloud provider resources (S3)

Strong SQL skills and ability to create queries to analyze complex datasets

Hands-on production environment experience with distributed processing systems such as Spark

Hands-on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelines

Some scripting language experience

Willingness and ability to learn and pick up new skillsets

Self-starting problem solver with an eye for detail and excellent analytical and communication skills

Preferred Qualifications

Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake Redshift Big Query)

Experience in developing APIs with GraphQL

Deep Understanding of AWS or other cloud providers as well as infrastructure as code

Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices

Familiar with Scrum and Agile methodologies

Required Education

Bachelors or masters degree in computer science Information Systems equivalent industry experience

Job Posting Segment:

Job Posting Primary Business:

Primary Job Posting Category:

Employment Type:

Primary City State Region Postal Code:

Alternate City State Region Postal Code:

Date Posted: