Senior ETL Test Engineer | AWS to GCP Migration
Job Summary
Greetings of the day!!
I am Arumugam Veera reaching out to you regarding an exciting career opportunity with Naveera Technology LLC. I would be happy to connect and discuss the opportunity further. You can also connect with me on LinkedIn: Naveera Technology LLC
Naveera Technology LLC is a trusted global engineering partner delivering Data Engineering Generative AI Application Development and IT Infrastructure solutions. With over 15 years of experience in IT services and consulting we help organizations transform raw data into actionable business value.
With a team of 100 employees and successful delivery of 3 global projects Naveera serves clients across multiple industries and geographies through agile delivery models and proven engineering practices.
From Digital Health and Financial Services to E-Commerce and Technology we support a diverse client base and back every engagement with proven frameworks low-attrition teams and scalable global delivery capabilities. At Naveera we empower organizations to turn challenges into opportunities data into insights and innovative ideas into enterprise-grade platforms.
Specialties
Data Engineering & Modern Data Stack Generative AI Solutions & Model Deployment Application Development (Web Mobile & Enterprise) Artificial Intelligence (Predictive Conversational Computer Vision) IT Infrastructure Services (Cloud & On-Prem) Security DR Cloud Transformation & Microservices DevOps API & Systems Integration Extended Technology Teams & Dedicated Delivery Real-Time Streaming & Analytics and BI & Data Warehousing
Were Hiring: Senior ETL Test Engineer
Key Skills: ETL Testing DWH Testing Writing Complex SQL Queries AWS (Glue S3 Redshift DBT) & GCP (BigQuery GCS) API Testing Data pipeline Python.
Experience: 6 to 15 Yrs
Location: Madurai
After Noon Shift: 2 PM to 11.30 PM
Extended working hours: May be required based on project/business needs
Mode : Remote (Monthly once travel required to madurai)
Domain: Custom Brokerage Trade & Logistics
About the Role
We are looking for an experienced Senior ETL Test Engineer with strong expertise in ETL Testing Data Warehouse Testing Complex SQL Data Pipeline Validation API Testing Python AWS and GCP.
The ideal candidate should have hands-on experience validating large-scale data pipelines data transformations data warehouses and cloud-based data platforms. The role will involve working closely with Data Engineers Developers Business Analysts and client stakeholders to ensure the accuracy completeness consistency and reliability of enterprise data.
Experience in the Customs Brokerage Trade Logistics Transportation or Supply Chain domain will be highly preferred.
Key Responsibilities
- Execute ETL and Data Warehouse testing for enterprise data platforms and migration projects.
- Develop comprehensive test strategies test plans test scenarios test cases and test scripts for data pipelines.
- Validate end-to-end data flow from source systems to staging transformation layers data warehouses and downstream applications.
- Write and execute complex SQL queries to validate data accuracy transformation logic aggregations joins reconciliations and business rules.
- Perform source-to-target data validation and identify data mismatches missing records duplicates and transformation issues.
- Validate data pipelines and workflows implemented using AWS and GCP cloud services.
- Perform testing of AWS-based data platforms involving AWS Glue S3 Redshift and DBT.
- Perform testing and validation of GCP-based data platforms involving BigQuery and Google Cloud Storage (GCS).
- Validate DBT models transformations dependencies and data quality.
- Perform API testing to validate data exchanged between applications and data platforms.
- Validate REST APIs request/response payloads status codes data mappings and business rules.
- Develop and execute Python-based test scripts and data validation utilities where required.
- Perform data reconciliation between multiple systems and platforms.
- Validate data migration and cloud-to-cloud data movement across AWS and GCP environments.
- Identify data quality issues and work closely with engineering teams to perform root-cause analysis.
- Track defects provide detailed defect documentation and coordinate with development teams for resolution and retesting.
- Perform regression integration system functional and end-to-end testing of data pipelines.
- Validate data completeness accuracy consistency uniqueness integrity and timeliness.
- Review technical requirements mapping documents source-to-target specifications and transformation logic.
- Collaborate with Data Engineers and Architects to understand pipeline architecture and testing requirements.
- Participate in client discussions requirement clarification defect triage and project status meetings.
- Prepare test execution reports defect metrics testing status and quality dashboards.
Required Technical Skills
ETL & Data Warehouse Testing
- Strong hands-on experience in ETL Testing and Data Warehouse Testing.
- Strong understanding of ETL/ELT concepts and data pipeline architecture.
- Experience with source-to-target validation and data reconciliation.
- Strong understanding of dimensional data models fact and dimension tables and data transformations.
- Experience testing large-volume datasets and complex data processing workflows.
SQL
Strong proficiency in complex SQL queries.
Hands-on experience with:
Complex Joins
CTEs
Subqueries
Window Functions
Aggregations
Stored Procedures
Data reconciliation
Data validation and profiling
Ability to independently troubleshoot data discrepancies using SQL.
AWS
Hands-on experience testing data solutions using:
- AWS Glue
- Amazon S3
- Amazon Redshift
- DBT
- AWS-based ETL/data pipelines
GCP
Experience with:
- Google BigQuery
- Google Cloud Storage (GCS)
- GCP-based data pipelines and data validation
- Data migration/testing between cloud environments is an added advantage.
API Testing
- Experience with REST API testing.
- Understanding of API request/response validation.
- Experience validating JSON/XML payloads and data mappings.
- Familiarity with tools such as Postman or similar API testing tools.
Python
- Good hands-on knowledge of Python for data validation and test automation.
- Experience using Python for data comparison reconciliation validation and test utilities.
- Familiarity with Pandas and other data-processing libraries is an advantage.
- Flexible Remote/Hybrid work environment.
- Exposure to global enterprise customers.
- Collaborative innovation-driven engineering culture.
- Continuous learning and certification opportunities.
Join Naveera Technology LLC and play a pivotal role in delivering enterprise-scale AWS-to-GCP cloud transformation programs. Lead the modernization of data platforms ETL pipelines and analytics ecosystems while driving innovation across cloud-native data engineering Data Lakehouse architectures and next-generation Business Intelligence solutions.
About Company
Naveera Technology LLC is a trusted global engineering partner delivering Data Engineering Generative AI Application Development and IT Infrastructure solutions. With over 15 years of IT services and consulting experience and a team of 400 expert engineers we help organizations transf ... View more