ETL Testing with Python
ETL Testing with Python
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Position Description:
Job Title: ETL Testing Engineer
Experience: 5-12 Years
Location: Bangalore
Employment Type: Full-time
Job Summary:
We are looking for an experienced ETL/SQL/Python Testing Engineer to design develop and execute test cases for data pipelines ETL processes and database systems. The ideal candidate should have strong expertise in SQL querying ETL validation Python scripting and test automation to ensure data accuracy completeness and performance.
Technical Skills Required:
- ETL Testing: Strong experience in testing Informatica Talend SSIS Databricks or similar ETL tools.
- SQL: Advanced SQL skills (joins aggregations subqueries stored procedures).
- Python: Proficiency in Python for test automation (Pandas PySpark PyTest).
- Databases: Hands-on experience with RDBMS (Oracle SQL Server PostgreSQL) & NoSQL (MongoDB Cassandra).
- Big Data Testing (Good to Have): Hadoop Hive Spark Kafka.
- Testing Tools: Knowledge of Selenium Airflow Great Expectations or similar frameworks.
- Version Control: Git GitHub/GitLab.
- CI/CD: Jenkins Azure DevOps or similar.
Soft Skills:
- Strong analytical and problem-solving skills.
- Ability to work in Agile/Scrum environments.
- Good communication skills for cross-functional collaboration.
#LI-AD11
Your future duties and responsibilities:
- Develop and execute ETL test cases to validate data extraction transformation and loading processes.
- Write complex SQL queries to verify data integrity consistency and correctness across source and target systems.
- Automate ETL testing workflows using Python PyTest or other testing frameworks.
- Perform data reconciliation schema validation and data quality checks.
- Identify and report data anomalies performance bottlenecks and defects.
- Work closely with Data Engineers Analysts and Business Teams to understand data requirements.
- Design and maintain test data sets for validation.
- Implement CI/CD pipelines for automated ETL testing (Jenkins GitLab CI etc.).
- Document test results defects and validation reports.
Required qualifications to be successful in this role:
- Experience with cloud platforms (AWS Azure).
- Knowledge of Data Warehousing concepts (Star Schema Snowflake Schema).
- Certification in ETL Testing SQL or Python is a plus.
Skills:
- Data Warehousing
- MS SQL Server
- Python
What you can expect from us:
Together as owners lets turn meaningful insights into action.
Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because
You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.
Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.
Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our teamone of the largest IT and business consulting services firms in the world.
Employment Type
Full-Time
