Azure Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
18 hours ago
Vacancies:
1 Vacancy
Job Summary
Req number:
R6811Employment type:
Full timeWorksite flexibility:
HybridWho we are
CAI is a global technology services firm with over 8500 associates worldwide and a yearly revenue of $1 billion. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients colleagues and communities. As a privately held company we have the freedom and focus to do what is rightwhatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors and we are trailblazers in bringing neurodiversity to the enterprise.
Job Summary
We are looking for a motivated Data Engineer ready to take us to the next level! If you understand Databricks Python Azure Data Services Azure DevOps and API integrations and are looking forward to your next career move apply nowJob Description
We are looking for Data Engineer.This position willbefull-timeand Hybrid Bangalore.
What Youll Do
- Design build and optimize data ingestion and ETL/ELT pipelines using Azure Databricks and Azure Data Factory.
- Work extensively with Delta Lake Structured Streaming and Lakehouse architecture.
- Develop scalable PySpark and Python transformation logic for batch and streaming workloads.
- Design and maintain data models (Dimensional SCD Types 1 & 2 Lakehouse schemas).
- Manage data storage using Azure Data Lake Gen2 Delta tables and Parquet formats.
- Integrate with REST/Graph/Custom APIs for data access and ingestion including OAuth or managed authentication flows.
- Implement CI/CD pipelines for data solutions using Azure DevOps (Repos Pipelines Release automation).
- Implement strong security practices RBAC Key Vault managed identities network security.
- Maintain documentation knowledge sharing and best practices across the team.
- Knowledge of CI/CD for Databricks using Databricks Asset Bundles / DABs.
What Youll Need
Required:
- 78 years of total experience in Data Engineering.
- Azure Databricks (Jobs Workflows SQL Warehouses Unity Catalog).
- Python / PySpark.
- Azure Data Factory & Azure Data Lake Storage.
- Azure DevOps (Git branching CI/CD pipelines).
- API integration (REST Graph API token-based auth).
- Strong command of SQL performance tuning CTEs window functions.
- Knowledge of distributed systems partitioning and big data processing.
- Experience with Delta Lake principles (ACID time travel vacuum Z-ordering).
- Understanding of Data Governance concepts.
Preferred Skills (Nice to Have):
- Experience with Event-driven architecture (Kafka/Event Hub).
- Knowledge of python backend.
Physical Demands
- Sedentary work that involves sitting or remaining stationery most of the time with occasional need to move around the office to attend meetings etc.
- Ability to conduct repetitive tasks on a computer utilizing a mouse keyboard and monitor.
Reasonable accommodation statement
If you require a reasonable accommodation in completing this application interviewing completing any pre-employment testing or otherwise participating in the employment selection process please direct your inquiries to or (888).
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
CAI helps organizations leverage technology, people, and processes to solve business problems, enable savings, and spur innovation.
