Data Engineer Azure
Share
Job Location:
Monthly Salary:
Posted on:
16 hours ago
Vacancies:
1 Vacancy
Job Summary
Position Description:
We are seeking an experienced Data Engineer with 7 years of professional expertise in designing developing and optimizing large-scale data pipelines and data processing systems. The ideal candidate is highly skilled in Python PySpark ETL development and modern cloud data engineering tools particularly Databricks and Azure Data Factory (ADF). Experience in data ingestion transformation and extraction workflows is essential. Knowledge of Wealth Management domain data is a strong plus.
Your future duties and responsibilities:
Design build and maintain scalable and robust data pipelines to support data ingestion transformation and analytics needs.
Develop ETL/ELT processes using Python PySpark Databricks and cloud-native tools.
Build and optimize data ingestion frameworks from multiple structured and unstructured data sources.
Implement and maintain data processing workflows in Azure Data Factory.
Work with Databricks notebooks and clusters to process large datasets efficiently.
Ensure data quality consistency and governance across data pipelines.
Collaborate with cross-functional teams including Data Analysts BI Developers and Data Scientists.
Troubleshoot and optimize existing data workflows for performance and cost efficiency.
Participate in solution design discussions providing data engineering expertise.
Document pipeline architecture data flows and technical processes.
Required qualifications to be successful in this role:
7 years of professional experience as a Data Engineer or in a similar role.
Strong proficiency in Python for data transformation and automation.
Hands-on experience with PySpark for distributed data processing.
Proven expertise in developing and managing ETL pipelines.
Practical experience using Databricks for big data processing and analytics.
Hands-on experience with Azure Data Factory for pipeline orchestration and workflow management.
Solid understanding of data ingestion extraction and transformation techniques.
Experience working with Azure cloud ecosystems and data services.
Strong problem solving skills and the ability to optimize complex data workflows
Preferred / Good-to-Have Skills
Wealth Management domain experience including familiarity with financial instruments transactions or client reporting datasets.
Experience with Delta Lake Lakehouse architectures or Azure Synapse.
Knowledge of SQL optimization and performance tuning.
Understanding of data governance security and compliance best practices
CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level geographic market experience and training and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $60000.00 $120000.00. This role is an existing vacancy.
#LI - OA1
Use of the term engineering in this job posting refers to the technical sense related to Information Technology (IT) and does not imply that the individual practices engineering or possesses the requisite license as prescribed by the applicable provincial or territorial engineering regulator. We are seeking individuals with expertise in IT engineering-related functions but licensure from an engineering regulator is not a prerequisite for this position. Engineering is a regulated profession in Canada which is restricted in terms of use of titles and designation.
Skills:
- English
- ETL
- Python
What you can expect from us:
Together as owners lets turn meaningful insights into action.
Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because
You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.
Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.
Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
At CGI we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all CGI partners to thrive. As an equal-opportunity employer being able to perform your best during the recruitment process is important to us. If you require an accommodation please inform your recruiter.
To learn more about accessibility at CGI contact us via email. Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.
Come join our teamone of the largest IT and business consulting services firms in the world.
Required Experience:
IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
The COMPANY is one of the few end-to-end consulting firms with the scale, reach, capabilities and commitment to meet clients’ enterprise digital transformation needs. Our 77,500 consultants and professionals work side-by-side with clients in 10 industries across more than 400 location ... View more
