We are seeking Data Architect with expertise in Azure and Databricks to design scalable high-performance data architectures for real-time and batch processing. This role involves building ETL pipelines integrating data from multiple sources and ensuring data security and governance to support analytics and Power BI applications.
Key responsibilities include designing data lakehouse architectures (bronze silver gold layers) developing real-time pipelines using Azure Event Hub Stream Analytics and Databricks Structured Streaming and optimizing data models for efficient analytics. The role also ensures data security access control compliance and governance while enhancing performance and scalability.
Required skills: 8 years of experience proficiency in Azure Data Services SQL Python and ETL development and hands-on expertise in real-time data processing. Preferred qualifications include experience in machine learning CI/CD for data engineering and cloud cost optimization.
etl,architect,azure,databricks