Data Engineer

Not Interested
Bookmark
Report This Job

profile Job Location:

Irvine, CA - USA

profile Monthly Salary: Not Disclosed
Posted on: 4 hours ago
Vacancies: 1 Vacancy

Job Summary

Position: Data Engineer

Location: Irvine CA Onsite

Duration: Long Term Contract

1. Data Engineering & Architecture

  • Strong experience in Databricks (Lakehouse spark delta tables)
  • Expertise in dbt for data modeling transformations and testing
  • Proficiency in airflow for orchestration and scheduling pipelines
  • Solid understanding of data ingestion patterns (batch streaming MFT file handling)
  • Knowledge of data lineage Governance and Security (AD groups RBAC)

2. Cloud and infrastructure

  • Hands on AWS preferred Databricks with AWS
  • Familiarity with CI/CD for data workflows (Databricks with Active bundle deployments)
  • Docker and Kubernetes Containerization Experience

understanding for Financial Asset and Portfolio Management

4. Programming & Scripting

  • Python (Airflow DAGS Databricks notebooks)
  • SQL (advanced dbt models and transformations with jinja notation)
Position: Data Engineer Location: Irvine CA Onsite Duration: Long Term Contract 1. Data Engineering & Architecture Strong experience in Databricks (Lakehouse spark delta tables) Expertise in dbt for data modeling transformations and testing Proficiency in airflow for orchestration and scheduling...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala