ETL Test Engineer (Python)

Position Description:

Company Profile:
Founded in 1976 CGI is among the largest independent IT and business consulting services firms in the world. With 94000 consultants and professionals across the globe CGI delivers an end-to-end portfolio of capabilities from strategic IT and business consulting to systems integration managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at .
Job Title: ETL Test Engineer
Position: Senior Software Engineer
Experience: 3-9 years
Category: Senior Software Development/ Engineering
Shift: 1PM to 10PM EST Time
Main location: Bangalore/Chennai
Position ID: J1225-0043

Employment Type: Full Time
Education Qualification: Any graduation or related field or higher with minimum 3 years of relevant experience.
Position Description:
We are seeking an experienced ETL/SQL/Python Testing Engineer to design develop and execute test cases for data pipelines ETL processes and database systems. The ideal candidate will have strong expertise in SQL querying ETL validation Python scripting and test automation to ensure data accuracy completeness and optimal performance.

Your future duties and responsibilities:

Develop and execute ETL test cases to validate data extraction transformation and loading processes.
Perform ETL pipeline testing in Azure Databricks (ADB) environments.
Write complex SQL queries to verify data integrity consistency and correctness across source and target systems.
Automate ETL testing workflows using Python PyTest or similar frameworks.
Conduct data reconciliation schema validation and comprehensive data quality checks.
Identify and report data anomalies performance issues and defects.
Collaborate with Data Engineers Analysts and Business Teams to understand data requirements.
Design and maintain test datasets for validation activities.
Implement CI/CD pipelines for automated ETL testing (e.g. Jenkins GitLab CI).
Document test results defects and detailed validation reports.

Required qualifications to be successful in this role:

ETL Tools Expertise: Hands-on experience with Informatica Talend SSIS Databricks or similar ETL platforms.
SQL Mastery: Advanced SQL skills including complex joins aggregations subqueries stored procedures and performance tuning.
Python Automation: Strong proficiency in Python with libraries/frameworks such as Pandas PySpark PyTest for automation and data validation.
Database Knowledge: Experience with both RDBMS (Oracle SQL Server PostgreSQL) and NoSQL databases (MongoDB Cassandra).
CI/CD & DevOps: Familiarity with Jenkins GitLab CI/CD Azure DevOps for automated testing pipelines.
Version Control: Proficient in Git GitHub/GitLab for collaborative development and code management.
Big Data Ecosystem (Good to Have): Exposure to Hadoop Hive Spark Kafka for large-scale data testing.
Testing Tools (Good to Have): Knowledge of Airflow Great Expectations Selenium or similar frameworks for workflow orchestration and validation.
Agile Practices: Experience working in agile environments with sprint-based delivery and in-sprint automation.
Communication & Leadership: Excellent communication skills to interact with business analysts line-of-business stakeholders and ability to lead testing initiatives and drive innovation.

Must-Have Skills:
ETL Testing: Strong hands-on experience with tools such as Informatica Talend SSIS Databricks.
SQL Expertise: Advanced SQL skills (joins aggregations subqueries stored procedures).
Python Automation: Proficiency in Python with libraries/frameworks like Pandas PySpark PyTest.
Databases: Experience with RDBMS (Oracle SQL Server PostgreSQL) and NoSQL (MongoDB Cassandra).
CI/CD: Practical experience with Jenkins Azure DevOps GitLab CI/CD.
Version Control: Strong knowledge of Git GitHub/GitLab.

Good-to-Have Skills:
Big Data Ecosystem: Exposure to Hadoop Hive Spark Kafka.
Testing Tools: Familiarity with Selenium Airflow Great Expectations or similar frameworks.
Cloud & Data Engineering: Understanding of cloud-based data platforms and orchestration tools.
Agile Practices: Experience working in agile testing environments with sprint-based delivery.
Communication & Collaboration: Ability to interact effectively with business analysts and cross-functional teams.

Skills:

• ETL
• SQLite

What you can expect from us:

Together as owners lets turn meaningful insights into action.

Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because

You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.

Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.

Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

Come join our teamone of the largest IT and business consulting services firms in the world.