Test Engineer Data QE
Share
Job Location:
Monthly Salary:
Posted on:
Yesterday
Vacancies:
1 Vacancy
Job Summary
Position Description:
Company Profile:
Were Hiring at CGI for our GCC - Right Here in Hyderabad!
Join us at the intersection of technology finance and innovation. You will be working to support the PNC Financial Services Group one of the top-tier financial institutions in the U.S. Youll help shape digital solutions for a global enterprisefrom the ground up.
This is more than a job. Its your opportunity to:
Work on cutting-edge technologies
Collaborate with global teams
Build a career with purpose and impact
Ready to build the future of banking Lets talk.
Job Title: Test Engineer
Position: Test Engineer - Data QE
Experience: 2-3 Years
Category: Software Testing/ Engineering
Shift: 11AM to 8PM
Main location: India Telangana Hyderabad
Position ID: J0925-0585
Employment Type: Full Time
Job Overview:
CGI is looking for a talented and motivated Data QE with strong expertise in Data QE using Python Hadoop QE Pyspark to Test and manage scalable efficient and reliable data pipelines and infrastructure.
Your future duties and responsibilities:
-Develop and execute data quality checks and validation frameworks using Python to ensure accuracy completeness and consistency of large-scale datasets.
-Perform data profiling anomaly detection and reconciliation on structured and semi-structured data stored in Hadoop (HDFS Hive HBase) environments.
-Write and optimize SQL/HiveQL queries to validate source-to-target data mappings and business rules.
-Design and automate data quality test cases for batch and streaming data pipelines built on Hadoop ecosystems.
-Validate ETL/ELT workflows developed using Spark Hive Sqoop and Oozie/Airflow.
-Identify data defects perform root cause analysis and collaborate with data engineers to resolve pipeline or transformation issues.
-Implement data quality metrics dashboards and alerts using Python-based frameworks.
-Validate data ingestion from multiple sources (RDBMS flat files APIs) into Hadoop platforms.-
-Perform regression testing for data pipelines after code schema or configuration changes.
-Monitor production data jobs analyze failures and ensure data SLAs are met.
-Ensure compliance with data governance security and audit requirements within Hadoop ecosystems.
-Document data quality rules validation logic and test results for audits and knowledge transfer.
Required qualifications to be successful in this role:
Primary Skills: Hadoop Python Spark SQL
Years of experience: 2-3 Years
Location: Hyderabad only
Work model: Initial 8 weeks WFO continued with Hybrid
Notice period: Immediate to 60 days
Skills:
- Oracle
- Python
What you can expect from us:
Together as owners lets turn meaningful insights into action.
Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because
You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.
Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.
Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our teamone of the largest IT and business consulting services firms in the world.
Required Experience:
IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
The COMPANY is one of the few end-to-end consulting firms with the scale, reach, capabilities and commitment to meet clients’ enterprise digital transformation needs. Our 77,500 consultants and professionals work side-by-side with clients in 10 industries across more than 400 location ... View more
