Data Engineer Azure Databricks
Share
Job Location:
Monthly Salary:
Posted on:
2 days ago
Vacancies:
1 Vacancy
Job Summary
Position Description:
We are looking for a Data Engineer to join a strategic data platform modernization initiative focused on migrating a legacy SQL Server Data Warehouse to a modern Azure Databricks Lakehouse architecture.
The platform will serve as a central enterprise data hub supporting advanced analytics BI data science and machine learning across multiple business this role you will work with modern cloud-native technologies to build scalable governed and high-quality data pipelines integrating multiple internal and external data sources.
Your future duties and responsibilities:
Designing developing and optimizing scalable data pipelines using Azure Databricks and Apache Spark
Developing and maintaining Databricks notebooks using Python (PySpark) and Databricks SQL
Building ingestion pipelines for structured semi-structured and streaming data
Implementing ETL / ELT frameworks and Medallion architecture (Bronze / Silver / Gold layers)
Optimizing Spark workloads and improving Delta Lake performance
Implementing data quality validation and monitoring mechanisms
Supporting migration from legacy SQL-based Data Warehouse environments
Collaborating with data architects analysts and business stakeholders to deliver reliable data solutions
Required qualifications to be successful in this role:
3 years of experience in Data Engineering
Hands-on experience with Azure Databricks Python / PySpark and SQL
Experience working with Azure Data Lake Storage and Delta Lake
Practical experience with ETL / ELT frameworks and modern data processing pipelines
Good understanding of modern data architectures (Data Lake Lakehouse Data Warehouse)
Experience integrating data from multiple enterprise systems
Nice to have:
Experience with streaming data pipelines (Spark Streaming / CDC)
Familiarity with Unity Catalog or data governance frameworks
Experience with Power BI SQL Server or Azure Data Factory
#LI-MC2
Skills:
- English
- Polish
- Azure Data Lake
- Data Engineering
- SQL Server
What you can expect from us:
Together as owners lets turn meaningful insights into action.
Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because
You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.
Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.
Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our teamone of the largest IT and business consulting services firms in the world.
Required Experience:
IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
The COMPANY is one of the few end-to-end consulting firms with the scale, reach, capabilities and commitment to meet clients’ enterprise digital transformation needs. Our 77,500 consultants and professionals work side-by-side with clients in 10 industries across more than 400 location ... View more
