Azure Tech Lead

Key Responsibilities

Participate and provide technical leadership in all phases of BI projects

Technical Leadership: Lead the design development and implementation of Azure and .NET core solutions ensuring alignment with business objectives and best practices.

Architecture and Design: Architect robust and scalable data pipelines on Azure Databricks

Data Engineering: Develop ETL processes data ingestion pipelines and data transformations to support data integration and analytics requirements.

Design and implemented realtime data integration pipeline to process semistructured data across multiple DBMS. RDBMS and NoSQL using Kafka and PySpark

Implement and design web and data solutions that use the following Azure services: Azure function App Azure queue Azure Web App Azure storage Azure Cosmos DB Azure Data Factory.

Excellent knowledge of Python PySpark SQL/SSIS C# etc.

Performance Optimization: Optimize Azure Databricks workloads for performance reliability and costefficiency utilizing techniques such as partitioning caching and resource management.

Collaboration: Collaborate with data scientists analysts and business stakeholders to understand requirements translate them into technical solutions and deliver actionable insights.

Experience with data modeling is a plus with building data warehouse from scratch identifying Dimension and Fact entities using Star and Snowflake schema.

Mentorship and Training: Provide guidance mentorship and technical expertise to team members fostering a culture of continuous learning and development.

Documentation and Best Practices: Document architecture design decisions and technical guidelines ensuring adherence to best practices and standards

Discovery and documentation of processes asis and tobe

Creating and executing test plans to ensure the highest quality of products.

Creating data quality rules and ensuring verification

Creating and maintaining detailed documentation for all projects. Qualifications

Bachelors degree in computer science/information technology or related field.

Minimum 5 years of experience in Azure and .NET core MS SQL and Azure SQL and over 7 year of experience overall

Excellent knowledge of different software testing practices and techniques specifically as it relates data pipelines data integration and building up of a data foundational architecture.

Excellent verbal and written communication skills.

Strong problemsolving and critical thinking skills.

Highly organised and detailoriented.