Lead Azure Data Engineer
Share
Job Location:
Fountain Valley, CA - USA
Monthly Salary:
Not Disclosed
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
Job Summary (List Format):
- Serve as Lead Data Engineer for a new Azure-based cloud data platform reporting to the Director of Data Engineering and Governance.
- Design build and maintain Azure-centric data pipelines (Data Lake Databricks Synapse Analytics) for multi-cloud and on-premises environments.
- Develop and optimize ETL workflows for efficient data integration from various sources (SaaS APIs databases).
- Perform complex data transformations and manage data models/tables to support analytics reporting and business intelligence.
- Write and optimize advanced SQL Python Java JSON and Spark code for high-performance data processing.
- Mentor junior ETL and data modeling team members to ensure consistency and delivery of project objectives.
- Collaborate with data visualization analytics and business teams to deliver actionable insights and support reporting needs.
- Participate in developing and optimizing the Azure data warehouse and support AI/ML initiatives to enhance predictive data capabilities.
- Ensure data governance through quality checks data lineage security and role-based access control.
- Monitor and manage cloud infrastructure for scalability security and cost efficiency including collaboration with AWS and Oracle Cloud.
- Prepare documentation and summary reports for project progress and operational status for leadership and stakeholders.
- Foster innovation by staying updated with industry trends and applying new data tools and best practices.
- Preferred: Familiarity with LIMS systems (e.g. Sunquest Antrim Sysmex MOLIS).
Other Requirements:
- Must be local and available to work onsite 5 days per week; no sponsorship available.
- Serve as Lead Data Engineer for a new Azure-based cloud data platform reporting to the Director of Data Engineering and Governance.
- Design build and maintain Azure-centric data pipelines (Data Lake Databricks Synapse Analytics) for multi-cloud and on-premises environments.
- Develop and optimize ETL workflows for efficient data integration from various sources (SaaS APIs databases).
- Perform complex data transformations and manage data models/tables to support analytics reporting and business intelligence.
- Write and optimize advanced SQL Python Java JSON and Spark code for high-performance data processing.
- Mentor junior ETL and data modeling team members to ensure consistency and delivery of project objectives.
- Collaborate with data visualization analytics and business teams to deliver actionable insights and support reporting needs.
- Participate in developing and optimizing the Azure data warehouse and support AI/ML initiatives to enhance predictive data capabilities.
- Ensure data governance through quality checks data lineage security and role-based access control.
- Monitor and manage cloud infrastructure for scalability security and cost efficiency including collaboration with AWS and Oracle Cloud.
- Prepare documentation and summary reports for project progress and operational status for leadership and stakeholders.
- Foster innovation by staying updated with industry trends and applying new data tools and best practices.
- Preferred: Familiarity with LIMS systems (e.g. Sunquest Antrim Sysmex MOLIS).
Other Requirements:
- Must be local and available to work onsite 5 days per week; no sponsorship available.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
