Lead Data EngineerData PlatformsAzure
Required skills:
- Design and implement scalable data pipelines and architectures on Azure Databricks.
- Optimize ETL/ELT workflows ensuring efficiency in data processing storage and retrieval.
- Leverage Apache Spark Delta Lake and Azurenative services to build highperformance data solutions.
- Ensure best practices in data governance security and compliance within Azure environments.
- Troubleshoot and finetune Spark jobs for optimal performance and cost efficiency.