Data Bricks Developer

Job Description:

1. We are looking for a skilled Operations Engineer to support our Azure-based Data Engineering platform powered by Databricks.
2. This role blends DevOps practices system reliability and security auditing to ensure our data infrastructure is robust secure and scalable.
3. Youll be instrumental in automating workflows monitoring system health and enforcing security best practices across our data ecosystem.

Key Responsibilities:   

1. Maintain and monitor Databricks-based data pipelines and Azure data services (e.g. Data Lake Synapse Key Vault).
2. Implement CI/CD pipelines using Azure DevOps for data engineering workflows
3. Conduct regular system health checks and performance tuning of clusters and jobs.
4. Automate infrastructure provisioning using tools like Terraform or ARM templates.
5. Use monitoring tools (e.g. Azure Monitor Log Analytics Prometheus) to track system metrics and alert on anomalies.
6. Perform security audits using tools like Databricks Security Analysis Tool (SAT) to ensure compliance with best practices.
7. Manage secrets and credentials securely using Azure Key Vault and Databricks secret scopes.
8. Collaborate with security teams to enforce network security access control and data encryption policies.
9. Maintain operational runbooks and incident response documentation.

Qualifications: 

Bachelors degree in computer science Engineering or related field.

1.     5 years of experience in DevOps cloud operations or data platform support.
2.     Proficiency in Azure services Databricks and scripting languages (Python Bash).
3.     Experience with CI/CD tools (Azure DevOps GitHub Actions) and infrastructure-as-code.
4.     Familiarity with security frameworks and auditing tools in cloud environments.
5.     Strong troubleshooting skills and a proactive approach to system reliability. Preferred Skills:
6.     Experience with Databricks SAT for security posture assessments.
7.     Knowledge of Unity Catalog RBAC and data governance in Azure Databricks.
8.     Exposure to MLOps and operationalizing machine learning pipelines.
9.     Understanding of cost optimization strategies in Azure.

Additional Information :

Please Note: Fraudulent job postings/job scams are increasingly common. Beware of misleading advertisements and fraudulent communication issuing offer letters on behalf of T-Systems in exchange for a fee. Please look for an authentic T-Systems email id - .

Stay vigilant. Protect yourself from recruitment fraud!

To know more please visit : Fraud Alert

Remote Work :

No

Employment Type :

Full-time