As a Data Access Layer Engineer you will:
- Create and maintain the Data Access Layer (DAL) application ensuring it is effectively built around Unity Catalog.
- Support legacy access stores and ensure smooth integration with the existing infrastructure.
- Manage the Unity Catalog metastore through Azure pipelines (YAML) ensuring a seamless deployment process.
- Collaborate with crossfunctional teams to ensure the scalability reliability and performance of the DAL system.
- Provide support in the administration of Databricks leveraging your expertise in both Unity Catalog and Databricks as a user.
What You Bring to the Table:
- 810 years of experience in developing maintaining and optimizing Data Access Layer applications.
- Proficiency in Azure (Intermediate level) including Azure Architecture and managing Azure DevOps Pipelines using YAML (Advanced level).
- Strong skills in Terraform (Intermediate) enabling you to manage and provision infrastructure as code.
- Extensive experience with Python Programming (Intermediate) and Python Testing with pytest (Intermediate).
- Adept in Bash Scripting (Intermediate) to automate tasks and streamline operations.
- Solid knowledge of Databricks (Intermediate) with expertise in Unity Catalog Databricks Administration and handson experience as a user (Beginner to Intermediate).
You should possess the ability to:
- Design implement and maintain scalable data access solutions using Unity Catalog.
- Work efficiently with Azure DevOps Pipelines to manage deployment workflows.
- Troubleshoot and optimize code and infrastructure to improve performance and reliability.
- Collaborate effectively with both technical and nontechnical teams to ensure requirements are met.
- Work with legacy systems and modern technologies ensuring smooth transitions and integrations.
What We Bring to the Table:
- A challenging and rewarding role that allows you to contribute to the modernization of data access architecture.
- A dynamic and collaborative environment where your skills and expertise will be highly valued.
- The opportunity to work with cuttingedge technologies including Azure Terraform Python Databricks and Unity Catalog.
As a Data Access Layer Engineer, you will: Create and maintain the Data Access Layer (DAL) application, ensuring it is effectively built around Unity Catalog. Support legacy access stores and ensure smooth integration with the existing infrastructure. Manage the Unity Catalog metastore through Azure pipelines (YAML), ensuring a seamless deployment process. Collaborate with cross-functional teams to ensure the scalability, reliability, and performance of the DAL system. Provide support in the administration of Databricks, leveraging your expertise in both Unity Catalog and Databricks as a user. What You Bring to the Table: 8-10 years of experience in developing, maintaining, and optimizing Data Access Layer applications. Proficiency in Azure (Intermediate level), including Azure Architecture and managing Azure DevOps Pipelines using YAML (Advanced level). Strong skills in Terraform (Intermediate), enabling you to manage and provision infrastructure as code. Extensive experience with Python Programming (Intermediate) and Python Testing with pytest (Intermediate). Adept in Bash Scripting (Intermediate) to automate tasks and streamline operations. Solid knowledge of Databricks (Intermediate) with expertise in Unity Catalog, Databricks Administration, and hands-on experience as a user (Beginner to Intermediate). You should possess the ability to: Design, implement, and maintain scalable data access solutions using Unity Catalog. Work efficiently with Azure DevOps Pipelines to manage deployment workflows. Troubleshoot and optimize code and infrastructure to improve performance and reliability. Collaborate effectively with both technical and non-technical teams to ensure requirements are met. Work with legacy systems and modern technologies, ensuring smooth transitions and integrations. What We Bring to the Table: A challenging and rewarding role that allows you to contribute to the modernization of data access architecture. A dynamic and collaborative environment where your skills and expertise will be highly valued. The opportunity to work with cutting-edge technologies, including Azure, Terraform, Python, Databricks, and Unity Catalog. A competitive compensation package with the potential for career growth and advancement.