Title: Data QA Engineer
Location: Warren NJ (Onsite)
Type: Contract
- A Data QA Engineer ensures data reliability and accuracy by testing data pipelines ETL processes and warehouses focusing on completeness consistency and validity for business use using tools like SQL and Python to build automated tests and find issues crucial for trustworthy analytics and decisions.
- They work across the data lifecycle defining quality rules profiling data and collaborating with data engineers and analysts to maintain high data integrity.
Core Responsibilities:
- Testing & Validation: Designing and running tests for data ingestion transformation (ETL/ELT) and storage (data warehouses/lakes).
- Data Profiling & Monitoring: Analyzing data structure identifying anomalies and setting up continuous monitoring for quality issues.
- Automation: Building automated test frameworks using Python Pytest and SQL to catch defects early.
- Rule Definition: Creating and implementing data quality rules and metrics (e.g. completeness accuracy).
- Collaboration: Working with data engineers analysts and business stakeholders to understand needs and resolve defects.
Key Skills & Tools:
- Technical: 6-10 years experience with SQL (complex queries) Python (Pandas PySpark) Data Warehousing (DWH) Cloud Platforms (AWS Azure GCP) BI Tools (Tableau Power BI).
- Analytical: 6-10 years experience with strong problem-solving attention to detail understanding data modeling data lifecycle and governance.
- Methodologies: 6 - 10 years familiarity with data testing processes data governance and CI/CD.
Title: Data QA Engineer Location: Warren NJ (Onsite) Type: Contract A Data QA Engineer ensures data reliability and accuracy by testing data pipelines ETL processes and warehouses focusing on completeness consistency and validity for business use using tools like SQL and Python to build automated ...
Title: Data QA Engineer
Location: Warren NJ (Onsite)
Type: Contract
- A Data QA Engineer ensures data reliability and accuracy by testing data pipelines ETL processes and warehouses focusing on completeness consistency and validity for business use using tools like SQL and Python to build automated tests and find issues crucial for trustworthy analytics and decisions.
- They work across the data lifecycle defining quality rules profiling data and collaborating with data engineers and analysts to maintain high data integrity.
Core Responsibilities:
- Testing & Validation: Designing and running tests for data ingestion transformation (ETL/ELT) and storage (data warehouses/lakes).
- Data Profiling & Monitoring: Analyzing data structure identifying anomalies and setting up continuous monitoring for quality issues.
- Automation: Building automated test frameworks using Python Pytest and SQL to catch defects early.
- Rule Definition: Creating and implementing data quality rules and metrics (e.g. completeness accuracy).
- Collaboration: Working with data engineers analysts and business stakeholders to understand needs and resolve defects.
Key Skills & Tools:
- Technical: 6-10 years experience with SQL (complex queries) Python (Pandas PySpark) Data Warehousing (DWH) Cloud Platforms (AWS Azure GCP) BI Tools (Tableau Power BI).
- Analytical: 6-10 years experience with strong problem-solving attention to detail understanding data modeling data lifecycle and governance.
- Methodologies: 6 - 10 years familiarity with data testing processes data governance and CI/CD.
View more
View less