Specialisation: Data Platform Modernisation:Azure DatabricksWe are looking for a Senior Technology Architect with advanced hands-on expertise in Databricks and Azure to architect and deliver modern cloud data solutions. The role involves leading migration efforts and designing high-performance secure environments tailored for the financial services sector.Key Responsibilities
- Architecting implementing and optimising scalable data solutions using Databricks Azure MS Fabric for data warehousing lakes and analytics.
- Leading migrations from legacy platforms to Databricks MS Fabric leveraging automation tools and best practices for code and workload transformation.
- Developing Databricks features such as Delta Lake Unity Catalog MLflow and secure collaboration capabilities.
- Automating pipelines using Databricks Workflows and orchestrating data workflows with Delta Live Tables.
- Configuring and enforcing data security RBAC and compliance using Databricks governance features (Unity Catalog data lineage audit).
- Monitoring and tuning Databricks clusters and jobs for cost and performance efficiency.
- Integrating Databricks with Azure services including Data Factory Data Lake Storage and Azure Synapse.
- Staying up to date with Databricks and Azure platform releases and best practices.
Required Skills and Certifications
- 15 Years of total experience in Data platforms/ETL/BI with minimum 5-7 years of Experience in architecting modernizing implementing cloud data platforms.
- Bachelors or Masters degree in Computer Science Engineering or a related field.
- Expert-level hands-on experience with the Databricks including security automation performance optimization and migration strategies.
- Advanced certifications in Databricks and/or Azure data solutions.
- Strong background in data modelling governance and compliance within financial domains.
- Excellent problem-solving and communication skills.
Desirable Experience
- Experience with Mainframe systems.
- Experience with reporting tools such as PowerBI SAS etc.
- Experience with ETL tools such as Informatica ADF etc.
- Exposure to Gen-AI solutions for code conversion or migration.
- Certifications in Informatica Snowflake or other advanced data technologies.
- Knowledge of industry data standards regulatory audits and privacy regulations.
- Background in Data Governance Data Catalog Lineage and Master Data Management (MDM).
Join us to help redefine the data landscape for the banking and financial services industry using advanced Databricks/Azure solutions and modernisation strategies. Required Experience:
Senior IC
Specialisation: Data Platform Modernisation:Azure DatabricksWe are looking for a Senior Technology Architect with advanced hands-on expertise in Databricks and Azure to architect and deliver modern cloud data solutions. The role involves leading migration efforts and designing high-performance secur...
Specialisation: Data Platform Modernisation:Azure DatabricksWe are looking for a Senior Technology Architect with advanced hands-on expertise in Databricks and Azure to architect and deliver modern cloud data solutions. The role involves leading migration efforts and designing high-performance secure environments tailored for the financial services sector.Key Responsibilities
- Architecting implementing and optimising scalable data solutions using Databricks Azure MS Fabric for data warehousing lakes and analytics.
- Leading migrations from legacy platforms to Databricks MS Fabric leveraging automation tools and best practices for code and workload transformation.
- Developing Databricks features such as Delta Lake Unity Catalog MLflow and secure collaboration capabilities.
- Automating pipelines using Databricks Workflows and orchestrating data workflows with Delta Live Tables.
- Configuring and enforcing data security RBAC and compliance using Databricks governance features (Unity Catalog data lineage audit).
- Monitoring and tuning Databricks clusters and jobs for cost and performance efficiency.
- Integrating Databricks with Azure services including Data Factory Data Lake Storage and Azure Synapse.
- Staying up to date with Databricks and Azure platform releases and best practices.
Required Skills and Certifications
- 15 Years of total experience in Data platforms/ETL/BI with minimum 5-7 years of Experience in architecting modernizing implementing cloud data platforms.
- Bachelors or Masters degree in Computer Science Engineering or a related field.
- Expert-level hands-on experience with the Databricks including security automation performance optimization and migration strategies.
- Advanced certifications in Databricks and/or Azure data solutions.
- Strong background in data modelling governance and compliance within financial domains.
- Excellent problem-solving and communication skills.
Desirable Experience
- Experience with Mainframe systems.
- Experience with reporting tools such as PowerBI SAS etc.
- Experience with ETL tools such as Informatica ADF etc.
- Exposure to Gen-AI solutions for code conversion or migration.
- Certifications in Informatica Snowflake or other advanced data technologies.
- Knowledge of industry data standards regulatory audits and privacy regulations.
- Background in Data Governance Data Catalog Lineage and Master Data Management (MDM).
Join us to help redefine the data landscape for the banking and financial services industry using advanced Databricks/Azure solutions and modernisation strategies. Required Experience:
Senior IC
View more
View less