Microsoft Azure Databricks

Summary: As a Custom Software Engineer you will develop custom software solutions to design code and enhance components across systems or applications. Your typical day will involve collaborating with cross-functional teams to understand business requirements utilizing modern frameworks and agile practices to deliver scalable and high-performing solutions tailored to meet specific business needs. You will engage in coding testing and debugging activities while ensuring that the software components integrate seamlessly with existing systems. Additionally you will participate in code reviews and contribute to the continuous improvement of development processes ensuring that the solutions you create are efficient and ideal candidate has strong expertise in Databricks Azure services and data pipeline development along with hands-on experience in building scalable data solutions within an enterprise setting. Roles & Responsibilities: Design develop and optimize large-scale data workflows on Azure Databricks using PySpark and Scala. Architect and implement ETL/ELT pipelines to ingest transform and load data from various sources into the Azure environment. Develop and maintain data lakes and warehouses in Azure leveraging tools such as Azure Data Lake Storage and Azure Synapse Analytics. Collaborate with cross-functional teams to integrate Databricks with Azure services including Azure Data Factory Azure SQL Database Azure DevOps and Power BI. Professional & Technical Skills: - Must To Have Skills: Proficiency in Microsoft Azure Databricks.- Experience with cloud computing platforms and services.- Strong understanding of software development methodologies particularly Agile.- Familiarity with programming languages such as Python or Scala.- Knowledge of data processing frameworks and tools. Additional Information: - The candidate should have minimum 5 years of experience in Microsoft Azure Databricks.- This position is based at our Pune office.- A 15 years full time education is required.