Position: Data Engineer
Location: Irvine CA Onsite
Duration: Long Term Contract
1. Data Engineering & Architecture
- Strong experience in Databricks (Lakehouse spark delta tables)
- Expertise in dbt for data modeling transformations and testing
- Proficiency in airflow for orchestration and scheduling pipelines
- Solid understanding of data ingestion patterns (batch streaming MFT file handling)
- Knowledge of data lineage Governance and Security (AD groups RBAC)
2. Cloud and infrastructure
- Hands on AWS preferred Databricks with AWS
- Familiarity with CI/CD for data workflows (Databricks with Active bundle deployments)
- Docker and Kubernetes Containerization Experience
understanding for Financial Asset and Portfolio Management
4. Programming & Scripting
- Python (Airflow DAGS Databricks notebooks)
- SQL (advanced dbt models and transformations with jinja notation)
Position: Data Engineer Location: Irvine CA Onsite Duration: Long Term Contract 1. Data Engineering & Architecture Strong experience in Databricks (Lakehouse spark delta tables) Expertise in dbt for data modeling transformations and testing Proficiency in airflow for orchestration and scheduling...
Position: Data Engineer
Location: Irvine CA Onsite
Duration: Long Term Contract
1. Data Engineering & Architecture
- Strong experience in Databricks (Lakehouse spark delta tables)
- Expertise in dbt for data modeling transformations and testing
- Proficiency in airflow for orchestration and scheduling pipelines
- Solid understanding of data ingestion patterns (batch streaming MFT file handling)
- Knowledge of data lineage Governance and Security (AD groups RBAC)
2. Cloud and infrastructure
- Hands on AWS preferred Databricks with AWS
- Familiarity with CI/CD for data workflows (Databricks with Active bundle deployments)
- Docker and Kubernetes Containerization Experience
understanding for Financial Asset and Portfolio Management
4. Programming & Scripting
- Python (Airflow DAGS Databricks notebooks)
- SQL (advanced dbt models and transformations with jinja notation)
View more
View less