Databricks Tech Lead

Eden Prairie, MN - USA

Monthly Salary: Not Disclosed

Posted on: 30+ days ago

Vacancies: 1 Vacancy

Job Summary

Title: Databricks Tech Lead
Location: Eden Prairie MN (Onsite)
Duration: 6 Months
Experience: 10 Years

Role Description

8 years of hands-on experience in Data Engineering with Databricks and Apache Spark.
Strong understanding of Databricks architecture tools and capabilities.
Proven experience in designing developing and optimizing ETL/ELT data pipelines using Databricks on AWS.
Solid knowledge of AWS native services such as S3 DataSync DMS Lambda SNS and SQS.
Proficiency in SQL and PySpark for database querying and data transformation.
Experience with Delta Lake and building scalable data lakes.
Familiarity with CI/CD pipelines and version control tools (e.g. GitLab).
Excellent communication presentation and collaboration skills.
Working knowledge of Agile methodology and tools such as JIRA.

Key Responsibilities

Serve as the Technical Lead for medium to large-scale projects and feature enhancements.
Take ownership of design development and delivery of high-quality data solutions.
Collaborate with Product Management Project Management Business and UX teams to define and prioritize initiatives.
Participate in grooming and estimation sessions; accountable for project sizing and planning.
Partner with cross-functional teams to troubleshoot issues perform performance tuning and ensure seamless system integration.
Work closely with the Production Support team to provide training guidance and issue resolution.
Mentor and provide technical guidance to Software Engineers at various experience levels.

Must-Have Skills

Databricks (Lead-level expertise)
Databases: Teradata SQL Server etc.
Cloud Data Platforms: AWS RDS Redshift etc.
Data Warehousing and AWS Cloud expertise
Experience in Supply Chain domain (preferred)

Title: Databricks Tech Lead Location: Eden Prairie MN (Onsite) Duration: 6 Months Experience: 10 Years Role Description 8 years of hands-on experience in Data Engineering with Databricks and Apache Spark. Strong understanding of Databricks architecture tools and capabilities. Proven...