Databricks Data Engineer Contract-to-Hire
Share
Job Location:
Monthly Salary:
Posted on:
6 hours ago
Vacancies:
1 Vacancy
Department:
Job Summary
We are seeking a Databricks Data Engineer to join our growing data engineering team in Pune India. This role will play a key part in a large-scale modernization initiative to migrate a complex enterprise-grade Microsoft SQL Server data warehouse ecosystem to the Databricks Lakehouse Platform. The ideal candidate has strong hands-on experience across Databricks data engineering capabilities with exposure to AI/ML features being a plus while maintaining a core focus on scalable reliable data pipelines and analytics workloads.
Key Responsibilities
- Design build and optimize scalable data pipelines using Databricks (Apache Spark Delta Lake Unity Catalog).
- Participate in the migration of a 20TB compressed on-prem Microsoft SQL Server data warehouse to Databricks.
- Convert and modernize hundreds of SQL Server tables thousands of SSIS jobs and downstream SSRS/SSAS workloads.
- Re-engineer SSIS ETL processes into Databricks notebooks workflows and orchestration frameworks.
- Support migration or redesign of cube-based analytics (SSAS) into Databricks SQL Delta tables and modern semantic models.
- Implement data quality validation reconciliation and audit controls during migration.
- Optimize performance and cost through efficient Spark usage partitioning and query tuning.
- Collaborate with analytics BI and AI/ML teams to enable downstream reporting and advanced analytics.
- Apply data governance security and access-control standards using Unity Catalog.
- Contribute to reusable frameworks documentation and platform best practices.
Qualifications :
- Bachelors degree in Computer Science Engineering or a related field.
- 47 years of overall data engineering experience.
- Hands-on experience with Databricks on AWS (preferred); Azure experience acceptable.
- Strong proficiency in Spark (PySpark and/or Scala) and SQL.
- Proven experience migrating on-prem SQL Server data warehouses to cloud-based data platforms.
- Experience converting SSIS-based ETL pipelines into Spark-based data engineering solutions.
- Solid understanding of data warehousing concepts dimensional modeling and analytical workloads.
- Experience with Delta Lake incremental processing patterns and data versioning.
- Familiarity with Databricks Workflows Jobs and production-grade deployments.
- Practical experience with performance tuning and large-volume data processing.
Preferred Skills
- Experience modernizing SSAS cube-based reporting solutions.
- Exposure to Databricks SQL Warehouses and BI integrations (Power BI preferred).
- Working knowledge of cloud-native data engineering practices aligned with Databricks best practices.
- Familiarity with MLflow feature engineering or AI-enablement within Databricks.
- Experience working in environments that follow Databricks-recommended data engineering patterns.
- Databricks certification is a plus.
Additional Information :
This position is structured as a contract-to-hire opportunity with Customized Energy Solutions India Pvt. Ltd. Compensation will be market-aligned and commensurate with experience. During the contract phase compensation and statutory benefits will be provided in accordance with applicable company policy and local regulations.
Subject to performance and business requirements associates may be considered for full-time employment following the initial contract period at which time company-sponsored benefits and performance incentive programs would apply in line with company policy.
At CES You Will Gain:
- Meaningful responsibility within complex energy market and data environments
- Exposure to enterprise-scale platform transformation initiatives
- Collaboration with global teams
- Ongoing opportunities to strengthen technical and analytical skills
Customized Energy Solutions provides equal employment opportunities to all applicants without regard to race color religion sex sexual orientation gender identity national origin disability or status as a protected veteran.
Remote Work :
No
Employment Type :
Contract
Key Skills
- IVR
- SOAP
- Avaya
- Solaris
- Cost Accounting Standards
- Database Design
- Hibernate
- ITIL
- Weblogic
- Express.js
- Contracts
- ASP
About Company
Customized Energy Solutions (CES), a privately-held company, is a leading service provider of market intelligence and operational support services to companies participating in the retail and wholesale electric and natural gas markets. Utilizing deep know-how developed since the incep ... View more
