drjobs Sr Data Engineer

Sr Data Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Glendale - Australia

Monthly Salary drjobs

INR 7000000 - 8500000

Vacancy

1 Vacancy

Job Description

Sr Data Engineer
Experience: 7 - 25 Years
Location: Glendale CA Onsite 3-4 days a week W2
Contract Role Duration 18 months W2
Experience on the below skills Mandatory :
- Airflow
- Apache Spark
- Snowflake OR Databricks
- Data Modeling
-Candidates should have a depth of experience in PySpark and data bricks

The Company
Headquartered in Los Angeles this leader in the Entertainment & Media space is focused on delivering world-class stories and experiences to its global audience. To offer the best entertainment experiences their technology teams focus on continued innovation and utilization of cutting edge technology.
Platform / Stack
You will work with technologies that include Python AWS Snowflake Databricks and Airflow.

What Youll Do As a Sr Data Engineer:
  • Contribute to maintaining updating and expanding existing Core Data platform data pipelines
  • Build and maintain APIs to expose data to downstream applications
  • Develop real-time streaming data pipelines
  • Tech stack includes Airflow Spark Databricks Delta Lake and Snowflake
  • Collaborate with product managers architects and other engineers to drive the success of the Core Data platform
  • Contribute to developing and documenting both internal and external standards and best practices for pipeline configurations naming conventions and more
  • Ensure high operational efficiency and quality of the Core Data platform datasets to ensure our solutions meet SLAs and project reliability and accuracy to all our stakeholders (Engineering Data Science Operations and Analytics teams)
Qualifications:
You could be a great fit if you have:
  • 7 years of data engineering experience developing large data pipelines
  • Proficiency in at least one major programming language (e.g. Python Java Scala)
  • Hands-on production environment experience with distributed processing systems such as Spark
  • Hands-on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelines
  • Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake Databricks Big Query).
  • Experience in developing APIs with GraphQL
  • Advance understanding of OLTP vs OLAP environments
  • Graph Database experience a plus
  • Realtime Event Streaming experience a plus

pipelines,aws,apis,core data,database,delta lake,graphql,pyspark,snowflake,data modeling,data,airflow,apache spark,databricks,spark,python

Employment Type

Full Time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.