Analyst Developer Specialist 4

Austin, TX - USA

Monthly Salary: Not Disclosed

Posted on: 30+ days ago

Vacancies: 1 Vacancy

Department:

Manufacturing

Job Summary

About the Role

We are looking for a highly experienced Data Engineer with a strong background in building production-grade data pipelines working with

complex automotive or time-series data formats (especially MF4/MDF4) and deploying large-scale solutions in Databricks.

The ideal candidate is fluent in Python and Data Storage formats comfortable working at the intersection of data engineering and data

analytics. This is a senior technical role requiring deep expertise independence and the ability to drive end-to-end delivery of data

Key Responsibilities

* Design and build robust data pipelines in Python to extract transform and load data from MF4/MDF4 files(e.g. automotive telemetry

sensor logs).

* Architect scalable ETL/ELT workflows in Databricks leveraging Delta Lake and cloud-native storage.

* Optimize performance and ensure reliability of pipelines handling large-scale high-frequency time-series datasets.

* Mentor junior engineers and contribute to technical design reviews architecture discussions and code quality.

* Stay ahead of industry trends data lake house architecture and data workflows.

Required Qualifications

* 5 years of experience in data engineering and software development.

* Advanced proficiency in Python with experience in performance tuning and large-scale data processing.

* Strong experience with Databricks Delta Lake and Spark (PySpark or Scala).

* Demonstrated ability to design and implement high-throughput fault-tolerant pipelines in production environments.

* Familiarity with cloud platforms (AWS Azure or GCP) including data storage compute and security best practices.

Preferred Qualifications

* Experience in automotive IoT or telemetry-heavy industries.

* Hands-on experience parsing and processing MF4/MDF4 files (ASAM standards).

* Prior exposure to Databricks Unity Catalog Delta Live Tables.

* Understanding of GitOps and CI/CD in software engineering

#PSSMSPT

Required Experience:

About the RoleWe are looking for a highly experienced Data Engineer with a strong background in building production-grade data pipelines working withcomplex automotive or time-series data formats (especially MF4/MDF4) and deploying large-scale solutions in Databricks.The ideal candidate is fluent in...