Employer Active
- India
Not Disclosed
Salary Not Disclosed
1 Vacancy
Key Responsibilities
Participate and provide technical leadership in all phases of BI projects
Technical Leadership: Lead the design development and implementation of Azure and .NET core solutions ensuring alignment with business objectives and best practices.
Architecture and Design: Architect robust and scalable data pipelines on Azure Databricks
Data Engineering: Develop ETL processes data ingestion pipelines and data transformations to support data integration and analytics requirements.
Design and implemented realtime data integration pipeline to process semistructured data across multiple DBMS. RDBMS and NoSQL using Kafka and PySpark
Implement and design web and data solutions that use the following Azure services: Azure function App Azure queue Azure Web App Azure storage Azure Cosmos DB Azure Data Factory.
Excellent knowledge of Python PySpark SQL/SSIS C# etc.
Performance Optimization: Optimize Azure Databricks workloads for performance reliability and costefficiency utilizing techniques such as partitioning caching and resource management.
Collaboration: Collaborate with data scientists analysts and business stakeholders to understand requirements translate them into technical solutions and deliver actionable insights.
Experience with data modeling is a plus with building data warehouse from scratch identifying Dimension and Fact entities using Star and Snowflake schema.
Mentorship and Training: Provide guidance mentorship and technical expertise to team members fostering a culture of continuous learning and development.
Documentation and Best Practices: Document architecture design decisions and technical guidelines ensuring adherence to best practices and standards
Discovery and documentation of processes asis and tobe
Creating and executing test plans to ensure the highest quality of products.
Creating data quality rules and ensuring verification
Creating and maintaining detailed documentation for all projects. Qualifications
Bachelors degree in computer science/information technology or related field.
Minimum 5 years of experience in Azure and .NET core MS SQL and Azure SQL and over 7 year of experience overall
Excellent knowledge of different software testing practices and techniques specifically as it relates data pipelines data integration and building up of a data foundational architecture.
Excellent verbal and written communication skills.
Strong problemsolving and critical thinking skills.
Highly organised and detailoriented.
Full Time