Senior Developer Python PySpark

Position Description:

This role is hybrid and requires you to work from our downtown Toronto office and/or the client office a minimum of four (4) days per week. This requirement is subject to change based on business and client needs.

CGI is seeking a highly skilled Senior Developer with expertise in Python PySpark and enterprise data engineering to join our Capital Markets technology team.

In this role you will design develop and optimize scalable data engineering solutions that support critical business functions across trading risk finance and regulatory reporting. You will collaborate with business stakeholders solution architects and engineering teams to deliver cloud-native data platforms using modern Azure technologies.

If you enjoy solving complex data challenges building high-performance data pipelines and working in a fast-paced financial services environment wed like to hear from you.

Your future duties and responsibilities:

Design develop and maintain scalable data engineering solutions using Python and PySpark.
Build and optimize enterprise ETL/ELT pipelines for processing large volumes of market trade risk and reference data.
Develop high-performance data processing solutions using Apache Spark and Azure Databricks.
Design and implement reliable data ingestion frameworks for internal and external data sources.
Develop reusable data transformation validation and reconciliation frameworks.
Optimize Spark applications for scalability reliability and performance.
Implement data quality controls monitoring and governance best practices.
Troubleshoot production issues and perform root cause analysis for data pipelines.
Participate in architecture discussions solution design and code reviews.
Contribute to CI/CD automation DevOps practices and release management.
Collaborate closely with business stakeholders data architects analysts and development teams to deliver strategic Capital Markets initiatives.
Ensure all solutions comply with enterprise security governance and regulatory standards.

Required qualifications to be successful in this role:

Bachelors degree in Computer Science Engineering Information Technology or a related discipline.
6 years of software development and data engineering experience.
4 years of hands-on experience developing applications using Python and PySpark.
Experience building large-scale distributed data processing solutions.
Experience working with cloud-based data platforms and modern data architectures.
Strong analytical problem-solving and communication skills.
Technical Skills
Programming & Data Engineering
Python
PySpark
Apache Spark / Spark SQL
Advanced SQL
Object-Oriented Programming (OOP)
Data Structures & Algorithms
ETL/ELT development
Data Modeling
Data Warehousing concepts
Performance tuning and optimization
Batch and real-time data processing
Databases
SQL Server
Oracle
PostgreSQL
Snowflake
Cloud & DevOps
Azure Databricks
Azure DevOps
Git
CI/CD pipelines
Unit Testing
Agile/Scrum methodologies
Code review best practices
Nice to Have
Experience working in Capital Markets or Financial Services.
Experience supporting Trading Risk Finance or Regulatory Reporting platforms.
Experience with enterprise data governance and data quality frameworks.
Knowledge of Azure cloud-native services and modern data architecture patterns.

CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level geographic market experience and training and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $80000-$130000. This role is an existing vacancy.

#LI-GS!

Skills:

• Data Modeling
• ETL
• Financial Services
• Microsoft SQL Server
• Object Oriented Programming
• Python
• Spark SQL

What you can expect from us:

Together as owners lets turn meaningful insights into action.

Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because

You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.

Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.

Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

At CGI we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all CGI partners to thrive. As an equal-opportunity employer being able to perform your best during the recruitment process is important to us. If you require an accommodation please inform your recruiter.

That same commitment to fairness extends to how we use technology. To support our recruitment team AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.

To learn more about accessibility at CGI contact us via email. Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.

Come join our teamone of the largest IT and business consulting services firms in the world.