Azure Databricks

Data Engineer Azure Databricks & SQL

Job Summary

We are seeking an experienced Data Engineer with strong expertise in Azure Databricks and SQL to join our growing data team. The ideal candidate will be responsible for designing developing and optimizing scalable data pipelines and supporting the migration of legacy data platforms into Azure Databricks.

The role requires hands-on experience in data warehousing ETL development data modeling and Azure cloud technologies.

Key Responsibilities

• Design develop and maintain scalable ETL/data pipelines.
• Build and optimize batch and streaming data processing solutions using Databricks and Apache Spark.
• Support migration of legacy data platforms into Azure Databricks.
• Develop and maintain enterprise data warehouse solutions.
• Create and optimize SQL queries for large-scale datasets.
• Implement data models including dimensional modeling and star schema design.
• Work with Azure Data Factory (ADF) SSIS and related ETL tools.
• Manage data governance lineage and security using Unity Catalog.
• Implement CI/CD pipelines using Git and Azure DevOps.
• Ensure data quality reliability performance and compliance standards.
• Collaborate with cross-functional teams including BI analytics and business stakeholders.
• Stay updated with latest Databricks and Azure platform enhancements.

Required Skills

• 58 years of experience as a Data Engineer.
• Strong hands-on experience in SQL development and performance tuning.
• Extensive experience with Azure Databricks and Apache Spark.
• Strong experience in Data Warehousing and Data Modeling.
• Hands-on experience with:
  • Azure Data Factory (ADF)
  • Databricks
  • SSIS
  • ETL Development
• Experience with Unity Catalog for governance and security.
• Knowledge of Azure Data Lake and Azure Storage.
• Experience building both batch and streaming pipelines.
• Familiarity with Azure DevOps Git and CI/CD processes.
• Good understanding of data governance and security best practices.
• Power BI knowledge is an added advantage.
• Excellent communication and problem-solving skills.

Preferred Qualifications

• Bachelors degree in Computer Science Engineering IT or related field.
• Experience working in enterprise-scale cloud data platforms.
• Exposure to Agile methodologies.

Additional Information :

At Tech Vedika we are looking for talented individuals who want to work with driven people. Attain success while working on interesting projects with a culturally diverse group of individuals.

Perks & Benefits: 

• Health Insurance
• Meal Vouchers
• Learning Aids
• Client/Customer Interactions
• Working with great minds 

If you want an exciting and dynamic career with unlimited growth potential then Tech Vedika is the place for you!

Remote Work :

No

Employment Type :

Full-time