IT Technology Architect | ETL & Data Quality | ETL & Data Quality ALL
Job Location:
Job Location:
Houston, TX - USA
Monthly Salary:
Not Disclosed
Monthly Salary:
Posted on:
23 hours ago
Posted on:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Job Title: ADF Data Engineer
Work Location & Reporting Address: Houston TX 77079
Vendor Rate: $60/Hr.
Contract duration: 6
Mandatory skills ADF Azure Databricks Python SQL
Detailed Job Description:
Experience: 5 8 years in data engineering with at least 3 years on Azure.
Azure Data Factory: Pipelines data flows (mapping/wrangling) triggers integration runtimes parameterization error handling & retries.
Azure Databricks: Databricks Notebooks Jobs/Workflows PySpark/Scala Delta Lake cluster configuration and optimization.
Programming: Advanced Python or Scala (at least one) strong coding standards modularization and unit testing (e.g. pytest).
SQL: Expert-level SQL (CTEs window functions query tuning) working with large datasets.
Data Storage & Formats: ADLS Gen2 Delta Lake Parquet partitioning Z-Ordering OPTIMIZE/VACUUM.
Ops & CI/CD: Git branching strategies CI/CD for ADF/Databricks; environment promotion; Infrastructure-as-Code exposure is a plus.
Minimum years of experience: >10 years
Certifications Needed: No
Top 3 responsibilities you would expect the Subcon to shoulder and execute:
Coding AND Development
Migration activities
Unit testing
Interview Process (Is face to face required) No Project Code :GPTI core India
Work Location & Reporting Address: Houston TX 77079
Vendor Rate: $60/Hr.
Contract duration: 6
Mandatory skills ADF Azure Databricks Python SQL
Detailed Job Description:
Experience: 5 8 years in data engineering with at least 3 years on Azure.
Azure Data Factory: Pipelines data flows (mapping/wrangling) triggers integration runtimes parameterization error handling & retries.
Azure Databricks: Databricks Notebooks Jobs/Workflows PySpark/Scala Delta Lake cluster configuration and optimization.
Programming: Advanced Python or Scala (at least one) strong coding standards modularization and unit testing (e.g. pytest).
SQL: Expert-level SQL (CTEs window functions query tuning) working with large datasets.
Data Storage & Formats: ADLS Gen2 Delta Lake Parquet partitioning Z-Ordering OPTIMIZE/VACUUM.
Ops & CI/CD: Git branching strategies CI/CD for ADF/Databricks; environment promotion; Infrastructure-as-Code exposure is a plus.
Minimum years of experience: >10 years
Certifications Needed: No
Top 3 responsibilities you would expect the Subcon to shoulder and execute:
Coding AND Development
Migration activities
Unit testing
Interview Process (Is face to face required) No Project Code :GPTI core India
