Databricks Architect

15 years of experience in architecture design implementation and analytics solutions. Indepth knowledge Data processing techniques and handling large data sets. Hands on development Design and Develop applications using Databricks and Experience with Azure cloud technologies. Indepth knowledge Data processing techniques and handling large data sets Hands on experience using Azure Blob storage and Azure Data Lake Services for storing data Hands on experience using Databricks in at least 2 projects creating notebooks using Scala/Python. Exposure to using Pyspark Spark SQL & Spark streaming for processing data for various use cases. In depth understanding of Spark Architecture including Spark Core Spark SQL Data Frames Spark Streaming RDD caching Spark MLib. Good to have any of programming language experience with Python/ SQL or Spark/Scala. Good understanding of Delta lake and how it can be used in conjunction with Blob or ADLS Experience using Azure Synapse as source or target for the data pipelines in at least 1 project Knowledge of Azure Data Factory or Databricks scheduling features to automate Databricks jobs Selfstarter who can pick up any other relevant Azure Services in the Analytics space Strong understanding of Data Modeling and defining conceptual logical and physical data models. Ability to design and demonstrate system Architecture with different environments Ability to to deal with both Onperm and Cloud systems Problemsolving skills along with good interpersonal & communication skills Excellent communications presentation articulation and relation building skills Team player with ability to work in a dynamic environment.

GoodtoHave

Provisioning and managing Databricks cluster and Knowledge of HDInsight Azure Functions and Azure DevOps is a big plus Understanding of Data Modeling & Other ETL tools is desirable On Prem Legacy MSBI tools to Azure platform migration experience is desirable Exposure to Databricks on Azure is desirable