Data EngineerSenior Consultant Specialist

Some careers shine brighter than others.

If youre looking for a career that will help you stand out join HSBC and fulfil your potential. Whether you want a career that could take you to the top or simply take you in an exciting new direction HSBC offers opportunities support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world with operations in 64 countries and territories. We aim to be where the growth is enabling businesses to thrive and economies to prosper and ultimately helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of Senior Consultant Specialist

In this role you will:

• Architect and deploy scalable Databricks solutions on and implement data pipelines ETL processes and machine learning workflows using Databricks and Azure services.
• Monitor Databricks performance and optimize configurations for efficiency and cost-effectiveness.
• Implement best practices for data storage processing and analysis to ensure optimal performance.
• Ensure Databricks environments comply with security standards and regulatory and manage data encryption access controls and other security measures.
• Perform regular maintenance tasks including updates patches and advanced technical support for Databricks-related issues and act as the escalation point for complex problems.
• Collaborate with data engineers data scientists and analysts to design and optimize data workflows.
• Work with IT and DevOps teams to integrate Databricks with other Azure services and and deliver training sessions for internal teams on Databricks best practices and new features.
• Document architectures configurations and procedures for knowledge sharing and future reference.

To be successful in this role you should meet the following requirements:

• In-depth knowledge of Databricks architecture Spark and Delta Lake.
• Proficiency in managing and optimizing Databricks clusters and jobs.
• Experience with deploying and managing Databricks on Azure including integration with Azure Data Lake Azure SQL Database and other Azure services.
• Strong programming skills in languages such as Python SQL and Scala.
• Familiarity with data warehousing concepts and ETL processes.
• Strong understanding of Azure infrastructure and services such as Azure Virtual Machines Azure Storage and Azure Database and data platform
• DevOps Tooling: AzureDevOps Nexus GitHub JIRA
• Database Services including Azure SQL and Cosmos Practices with Azure Diagnostics and Analytics with Azure Monitor

Youll achieve more when you join HSBC.

is committed to building a culture where all employees are valued respected and opinions count. We take pride in providing a workplace that fosters continuous professional development flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement which is available on our website.

Issued by HSBC Software Development India