Azure Hyperscale SQL & Databricks Engineer
Azure Hyperscale SQL & Databricks Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Location: Weehawken NJ (onsite)
Duration: 12 months
Job Type: W2 contract
In this role you will design build and optimize large-scale data solutions on Microsoft Azure with a focus on Azure SQL Hyperscale Databricks and PySpark.
You will collaborate with data scientists analysts and other engineers to deliver high-performance secure and scalable data platforms that drive business insights and decision-making
-
Design & Development:
-
Architect deploy and manage Azure SQL Hyperscale databases for high availability and performance.
-
Develop and optimize Databricks workflows (PySpark Delta Lake) for large-scale data processing and analytics.
-
Implement data pipelines (ETL/ELT) using Azure Data Factory Synapse Analytics and Databricks.
-
Automate infrastructure deployment using Terraform ARM templates or Bicep.
-
-
Performance & Optimization:
-
Tune SQL queries indexing strategies and partitioning for Azure SQL Hyperscale.
-
Optimize Spark jobs (Databricks) for efficiency and cost-effectiveness.
-
Monitor and troubleshoot performance bottlenecks in data pipelines.
-
-
Security & Compliance:
-
Implement RBAC encryption and data masking in Azure and Databricks.
-
Ensure compliance with UBS data governance and regulatory policies.
-
-
Collaboration & Leadership:
-
Work with data scientists analysts and business stakeholders to translate requirements into scalable solutions.
-
Mentor junior engineers and promote best practices in cloud data engineering.
-
-
5 years of hands-on experience with Azure data services (SQL Hyperscale Databricks Synapse Data Factory).
-
Strong expertise in SQL PySpark and Python for data processing.
-
Azure certifications (e.g. Azure Data Engineer Azure Solutions Architect).
-
Experience in financial services or regulated industries.
-
Familiarity with machine learning workflows in Databricks
- Experience with big data architectures (Delta Lake Parquet distributed computing).
-
Proficiency in IaC tools (Terraform ARM/Bicep) and CI/CD (Azure DevOps).
-
Knowledge of data security networking and compliance in financial services.
-
Bachelors or Masters degree in Computer Science Engineering or related field.
Employment Type
Full Time
