Azure Data Engineer
Share
Job Location:
Irving, TX - USA
Monthly Salary:
Not Disclosed
Posted on:
Yesterday
Vacancies:
1 Vacancy
Job Summary
Job Title: Azure Data Engineer
Location: Irving TX
Domain: Telecommunications
Long Term Contract
Looking for W2 Candidates. No C2C
Location: Irving TX
Domain: Telecommunications
Long Term Contract
Looking for W2 Candidates. No C2C
Job Description:
Azure Data Engineer with strong development experience in Python and containerized environments. Youll be building modular ETL pipelines using APIs and SQL in an Azure-native setup with a strong focus on data governance secure service account usage and automation. This role is perfect for someone passionate about scalable architecture and responsible data practices.
Azure Data Engineer with strong development experience in Python and containerized environments. Youll be building modular ETL pipelines using APIs and SQL in an Azure-native setup with a strong focus on data governance secure service account usage and automation. This role is perfect for someone passionate about scalable architecture and responsible data practices.
Key Responsibilities:
Design and implement data ingestion pipelines using Python targeting JDBC/ODBC/API/Batch sources
Create and orchestrate Apache Airflow DAGs using modular/factory-based patterns
Build containerized solutions using Docker with local dev setups and AKS-based deployment strategies
Work with SQL Server (MI)to extract metadata define classifications and manage access control
Use Microsoft Purview for classification tagging and metadata management
Configure and manage Azure resources(Blob Storage Key Vault Azure Monitor Functions AKS)
Develop and deploy using CI/CD pipelines via Azure DevOps
Apply access controls using service accounts adhering to minimum privilege principles and masking policies
Analyze audit logs and build dashboards for usage tracking and masking compliance
Write reusable code and documentation to support automation and knowledge transfer
Design and implement data ingestion pipelines using Python targeting JDBC/ODBC/API/Batch sources
Create and orchestrate Apache Airflow DAGs using modular/factory-based patterns
Build containerized solutions using Docker with local dev setups and AKS-based deployment strategies
Work with SQL Server (MI)to extract metadata define classifications and manage access control
Use Microsoft Purview for classification tagging and metadata management
Configure and manage Azure resources(Blob Storage Key Vault Azure Monitor Functions AKS)
Develop and deploy using CI/CD pipelines via Azure DevOps
Apply access controls using service accounts adhering to minimum privilege principles and masking policies
Analyze audit logs and build dashboards for usage tracking and masking compliance
Write reusable code and documentation to support automation and knowledge transfer
Qualifications:
5 years of hands-on experience in data engineering with Python development
Strong in:
Python(ETL scripting logging error handling)
SQL development and performance tuning
Azure ecosystem: AKS Blob Key Vault Service Principles Azure Monitor etc.
REST APIs and ingestion from diverse sources
Docker and container lifecycle management
Service account management and data security enforcement
Familiar with Terraform Git and modern CI/CD best practices
Understanding of data governance PII/PCI classification and compliance (SOX GDPR etc.)
5 years of hands-on experience in data engineering with Python development
Strong in:
Python(ETL scripting logging error handling)
SQL development and performance tuning
Azure ecosystem: AKS Blob Key Vault Service Principles Azure Monitor etc.
REST APIs and ingestion from diverse sources
Docker and container lifecycle management
Service account management and data security enforcement
Familiar with Terraform Git and modern CI/CD best practices
Understanding of data governance PII/PCI classification and compliance (SOX GDPR etc.)
Best Regards
Tarun K
Phone: 1-
Email:
Tarun K
Phone: 1-
Email:
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
