We are looking for a highly skilled SDET (Software Development Engineer in Test) with strong expertise in automation testing for data integration and transformation systems. The role involves close collaboration with data engineers developers and DevOps teams to ensure data quality accuracy and integrity across complex ETL pipelines and microservices-based integrations. The ideal candidate will be hands-on in automation with a strong focus on non-UI testing and data validation frameworks such as Great Expectations.
Key Responsibilities
Design develop and maintain automated test frameworks for data integration and transformation workflows
Collaborate with data engineers to understand data flows business rules and transformation logic
Create and execute test cases for ETL/ELT processes data pipelines and API-based microservices (without UI)
Validate data quality schema completeness accuracy and consistency across multiple source and target systems
Automate regression integration and end-to-end testing for data-driven applications
Implement validations for data accuracy duplication data loss and format transformations (JSON XML XML)
Leverage Great Expectations for automated data quality checks and validation rules
Integrate automated tests into CI/CD pipelines in collaboration with DevOps teams
Participate in requirements analysis risk assessment and test planning
Log defects clearly and support root cause analysis and resolution
Requirements
Mandatory Skills & Experience
Strong experience in automation testing for data integration and transformation environments
Hands-on expertise in Java-based test automation
Proven experience in ETL testing and API / Microservices testing (non-UI)
Strong understanding of data format transformations (JSON XML XML-to-XML)
Proficiency in writing SQL queries for data validation and profiling
Experience using Great Expectations for data quality validation and automation
Familiarity with test frameworks such as JUnit TestNG PyTest or similar
Working knowledge of CI/CD tools like Jenkins GitLab CI or CircleCI
Good to Have
Exposure to data integration tools such as Apache NiFi Talend Informatica etc.
Experience with Kafka Spark Hadoop or distributed data platforms
Understanding of additional data formats such as Avro and Parquet
Exposure to cloud data platforms (AWS Glue S3 Redshift EMR GCP BigQuery)
Preferred Qualifications
Experience with cloud-based data ecosystems
Familiarity with data cataloging data lineage governance and security compliance
Strong communication and collaboration skills with cross-functional stakeholders
Skills:etl testingjavaapi testingdatabase testing
Required Skills:
Strong experience in automation testing for data integration and transformation environments Hands-on expertise in Java-based test automation Proven experience in ETL testing and API / Microservices testing (non-UI) Strong understanding of data format transformations (JSON XML XML-to-XML) Proficiency in writing SQL queries for data validation and profiling Experience using Great Expectations for data quality validation and automation Familiarity with test frameworks such as JUnit TestNG PyTest or similar Working knowledge of CI/CD tools like Jenkins GitLab CI or CircleCI
We are looking for a highly skilled SDET (Software Development Engineer in Test) with strong expertise in automation testing for data integration and transformation systems. The role involves close collaboration with data engineers developers and DevOps teams to ensure data quality accuracy and inte...
We are looking for a highly skilled SDET (Software Development Engineer in Test) with strong expertise in automation testing for data integration and transformation systems. The role involves close collaboration with data engineers developers and DevOps teams to ensure data quality accuracy and integrity across complex ETL pipelines and microservices-based integrations. The ideal candidate will be hands-on in automation with a strong focus on non-UI testing and data validation frameworks such as Great Expectations.
Key Responsibilities
Design develop and maintain automated test frameworks for data integration and transformation workflows
Collaborate with data engineers to understand data flows business rules and transformation logic
Create and execute test cases for ETL/ELT processes data pipelines and API-based microservices (without UI)
Validate data quality schema completeness accuracy and consistency across multiple source and target systems
Automate regression integration and end-to-end testing for data-driven applications
Implement validations for data accuracy duplication data loss and format transformations (JSON XML XML)
Leverage Great Expectations for automated data quality checks and validation rules
Integrate automated tests into CI/CD pipelines in collaboration with DevOps teams
Participate in requirements analysis risk assessment and test planning
Log defects clearly and support root cause analysis and resolution
Requirements
Mandatory Skills & Experience
Strong experience in automation testing for data integration and transformation environments
Hands-on expertise in Java-based test automation
Proven experience in ETL testing and API / Microservices testing (non-UI)
Strong understanding of data format transformations (JSON XML XML-to-XML)
Proficiency in writing SQL queries for data validation and profiling
Experience using Great Expectations for data quality validation and automation
Familiarity with test frameworks such as JUnit TestNG PyTest or similar
Working knowledge of CI/CD tools like Jenkins GitLab CI or CircleCI
Good to Have
Exposure to data integration tools such as Apache NiFi Talend Informatica etc.
Experience with Kafka Spark Hadoop or distributed data platforms
Understanding of additional data formats such as Avro and Parquet
Exposure to cloud data platforms (AWS Glue S3 Redshift EMR GCP BigQuery)
Preferred Qualifications
Experience with cloud-based data ecosystems
Familiarity with data cataloging data lineage governance and security compliance
Strong communication and collaboration skills with cross-functional stakeholders
Skills:etl testingjavaapi testingdatabase testing
Required Skills:
Strong experience in automation testing for data integration and transformation environments Hands-on expertise in Java-based test automation Proven experience in ETL testing and API / Microservices testing (non-UI) Strong understanding of data format transformations (JSON XML XML-to-XML) Proficiency in writing SQL queries for data validation and profiling Experience using Great Expectations for data quality validation and automation Familiarity with test frameworks such as JUnit TestNG PyTest or similar Working knowledge of CI/CD tools like Jenkins GitLab CI or CircleCI
View more
View less