Senior Data Engineer (Azure Databricks Python APIs)
Department:
Job Summary
We are looking for a Senior Data Engineer > Azure Databricks with a strong focus on data processing platform engineering and API development.
- Design and implement scalable data pipelines and data platforms on Azure using Databricks and Spark
- Develop and maintain Python-based services and APIs (FastAPI / Flask) to expose and operationalize data
- Build infrastructure using Infrastructure as Code (IaC) (BICEP/Terraform) for reliable and repeatable deployments
- Work with large-scale datasets ensuring performance scalability and data quality
- Collaborate closely with data scientists and stakeholders to support data-driven use cases
- Implement best practices around code quality testing and deployment automation
- Support data governance security and cataloging using Unity Catalog
Qualifications :
- 5 years of experience with Azure Databricks: Unity Catalog Apache Spark / PySpark Databricks Asset Bundles.
- Advanced Python (OOP) skills.
- Experience building backend APIs using FastAPI and/or Flask.
- Strong experience with Infrastructure as Code (IaC): BICEP and/or Terraform
- Solid experience with data processing at scale.
- Strong knowledge of SQL.
- Experience with NumPy and Pandas.
Good To Have Skills:
- Experience with broader Azure ecosystem (Data Lake Key Vault etc.).
- CI/CD pipelines (Azure DevOps GitHub Actions).
- Understanding of data governance (Unity Catalog best practices).
- Exposure to microservices architecture.
- Monitoring & observability (Azure Monitor or similar).
- Experience working in analytics / data science environments.
Additional Information :
Data Engineer Platform Backend hybrid with strong emphasis on:
- Databricks ecosystem
- IaC (unusual but important here)
- API layer exposure
Remote Work :
Yes
Employment Type :
Full-time
About Company
Nagarro helps future-proof your business through a forward-thinking, fluidic, and CARING mindset. We excel at digital engineering and help our clients become human-centric, digital-first organizations, augmenting their ability to be responsive, efficient, intimate, creative, and susta ... View more