Must have at least 8 years of extensive Data Engineering Experience in Databricks ETLELT using Data pipelines SQLProcedure experience.
Must have 8 Years of hands-on development proficiency in implementing Databricks solutions using Scala and Spark with Data frames and NotebooksSQL
Must have 8 Years of hands-on development and performance tuningenhancement experience in ScalaPySpark and SQL.
Must have 8 Years of hands-on development experience in working on Azure Cloud.
Must have strong experience with Databricks including developing and optimizing Spark jobs data transformations and data processing workflows.
Must have experience and a good understanding on the below topicsDatabricks Delta Lake storageUnity CatalogAutoloader Lakehouse ArchitectureMedallion Architecture
Databricks Serverless Options.
Dataset and Data frameDatabricks Clusters Configuration and SizingDatabricks Job OrchestrationSpark Structured Streaming
Must have experience with complex and large volume data streaming and data transformations using Azure Databricks.
Must have extensive experience in DatawarehouseData Lakehouse implementations.
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.