Data Engineer

Job Title: Data Engineer

Location: Irvine CA
Job Type:Full-Time Opportunity

Job Summary

We are seeking a highly skilled Data Engineer with strong platform engineering and data pipeline expertise to support enterprise-scale delivery initiatives. The ideal candidate should have deep hands-on experience with Databricks Airflow/Astronomer DevOps automation and scalable data engineering solutions.

This role requires senior-level engineers capable of owning technical delivery driving platform reliability and collaborating with highly technical engineering teams.

Required Skills

• Strong hands-on expertise in:
  • Databricks
  • Apache Spark
  • Airflow / Astronomer
  • Data Engineering and pipeline orchestration
• Experience with:
  • Spark performance tuning
  • Databricks platform administration
  • DAG design and enterprise orchestration
  • Data quality and scalable pipeline architecture
• Strong DevOps knowledge including:
  • CI/CD pipelines
  • Infrastructure as Code (IaC)
  • Automation frameworks
• Experience managing:
  • Platform stability
  • Monitoring and observability
  • Operational readiness and support

Key Responsibilities

• Design develop and optimize scalable data pipelines and workflows
• Build and maintain enterprise orchestration solutions using Airflow/Astronomer
• Perform Spark optimization and Databricks platform tuning
• Support platform engineering initiatives focused on scalability reliability and automation
• Implement CI/CD and infrastructure automation for data platforms
• Monitor platform health and ensure operational stability
• Collaborate with cross-functional engineering teams to deliver technical solutions
• Own technical delivery for assigned scope timelines and outcomes

Preferred Qualifications

• Experience in cloud-based data engineering environments
• Strong troubleshooting and performance optimization skills
• Experience working in highly technical Agile engineering teams