Job Role: Databricks Engineer
Location: San Francisco CA
As a Databricks Engineer you will play a pivotal role in crafting and optimizing Microsoft Azure solutions to meet dynamic client needs. This position offers the opportunity to leverage your expertise in Azure technologies to drive impactful projects that align with the companys strategic objectives. Your work will significantly contribute to enhancing data-driven decision-making and operational efficiency across diverse business units.
DETAILED RESPONSIBILITIES:
- Design and develop software solutions to implement innovative features and support existing applications.
- Ingest and integrate data from various source systems into the Azure Analytics Platform using Azure Databricks and Azure Data Factory.
- Construct robust Azure Data Factory (ADF) pipelines to facilitate efficient data ingestion and transformation processes.
- Collaborate with the technical team to provide design and coding support ensuring project deliverables are met.
- Engage with clients to gather and interpret business requirements translating them into actionable solutions.
SKILL REQUIREMENTS:
- Demonstrated technical proficiency with the Microsoft Azure Stack (T-SQL SSIS SSAS SSRS).
- Expertise in Azure Data Factory Azure Databricks Azure Synapse Analytics Azure DevOps and Azure Storage/Data Lake.
- Experience with ETL processes and strong analytical skills for report development.
- Proficiency in relational databases and SQL language.
- Bachelors degree in Computer Science Information Technology or a related field.
OTHER REQUIREMENTS (OPTIONAL):
- Experience with Python scripting and Spark APIs is highly desirable.
- Previous experience in a client-facing role will be advantageous.
- Familiarity with agile development methodologies and practices.