Devops engineer W2
Dallas, IA - USA
Job Summary
Job Summary:
- Role: Analytics Platform Engineer (Azure & AWS Databricks DevOps focus)
- Location: Applicants must be local to specified locations - san Francisco CA or Dallas TX or Hopkins MN or Charlotte NC or Atlanta GA locals - Employment Type: W2 only (No Sponsorship available)
Responsibilities:
- Design implement and maintain CI/CD pipelines for data pipelines and infrastructure using Gitlab Azure DevOps or GitHub Actions.
- Develop automation using Terraform modules or other IaC tools to deploy and manage Databricks Workspaces and other cloud resources.
- Provision and manage Azure Analytics services (Databricks Synapse Analytics Data Factory ADLS Azure Monitor) using Infrastructure as Code (Terraform ARM Bicep).
- Deploy operate and optimize Azure data services including performance tuning monitoring and troubleshooting.
- Automate routine operational tasks and deployments using scripting languages (Python PowerShell Bash).
- Implement security best practices including IAM encryption and data governance compliance (e.g. GDPR).
- Collaborate with data engineers data scientists and business analysts to deliver robust technical solutions and foster a DevOps culture.
Key Skills & Qualifications:
- Deep expertise in Microsoft Azure and/or AWS cloud services especially Databricks.
- Proficiency with DevOps tools: Gitlab Azure DevOps GitHub Actions Git and branching strategies.
- Strong experience with Infrastructure as Code (Terraform ARM Bicep).
- Experience with Docker and container orchestration (AKS) highly beneficial.
- Proficiency in programming and scripting languages (Python SQL PowerShell Bash).
- Understanding of Data Engineering fundamentals (ETL/ELT data modeling data warehousing big data).
- Experience with monitoring logging and alerting tools (Azure Monitor Log Analytics App Insights).
- Excellent problem-solving analytical and communication skills; ability to work in agile environments.
- Preferred certifications: Azure Data Engineer Associate (DP-203) or Azure DevOps Engineer Expert (AZ-400).
- Role: Analytics Platform Engineer (Azure & AWS Databricks DevOps focus)
- Location: Applicants must be local to specified locations - san Francisco CA or Dallas TX or Hopkins MN or Charlotte NC or Atlanta GA locals
Responsibilities:
- Design implement and maintain CI/CD pipelines for data pipelines and infrastructure using Gitlab Azure DevOps or GitHub Actions.
- Develop automation using Terraform modules or other IaC tools to deploy and manage Databricks Workspaces and other cloud resources.
- Provision and manage Azure Analytics services (Databricks Synapse Analytics Data Factory ADLS Azure Monitor) using Infrastructure as Code (Terraform ARM Bicep).
- Deploy operate and optimize Azure data services including performance tuning monitoring and troubleshooting.
- Automate routine operational tasks and deployments using scripting languages (Python PowerShell Bash).
- Implement security best practices including IAM encryption and data governance compliance (e.g. GDPR).
- Collaborate with data engineers data scientists and business analysts to deliver robust technical solutions and foster a DevOps culture.
Key Skills & Qualifications:
- Deep expertise in Microsoft Azure and/or AWS cloud services especially Databricks.
- Proficiency with DevOps tools: Gitlab Azure DevOps GitHub Actions Git and branching strategies.
- Strong experience with Infrastructure as Code (Terraform ARM Bicep).
- Experience with Docker and container orchestration (AKS) highly beneficial.
- Proficiency in programming and scripting languages (Python SQL PowerShell Bash).
- Understanding of Data Engineering fundamentals (ETL/ELT data modeling data warehousing big data).
- Experience with monitoring logging and alerting tools (Azure Monitor Log Analytics App Insights).
- Excellent problem-solving analytical and communication skills; ability to work in agile environments.
- Preferred certifications: Azure Data Engineer Associate (DP-203) or Azure DevOps Engineer Expert (AZ-400).