We are seeking a Senior Data Quality Engineer with strong experience in Python SQL and automated data testing frameworks. This role focuses on building scalable data quality and validation frameworks for modern data pipelines in a Databricks environment.
Key Responsibilities:
Build and maintain automated testing frameworks for data pipelines
Validate data ingestion transformations and data quality across multiple sources
Implement data quality tools such as Great Expectations dbt tests or similar
Integrate testing into CI/CD pipelines
Collaborate with engineering teams to improve data reliability and observability
Required Skills:
5 years of experience in Data Quality Engineering Data Engineering or related field
Strong hands-on experience with Python and SQL
Experience with automated testing frameworks and pipeline validation
Familiarity with Databricks data transformation workflows and CI/CD tools
Strong problem-solving and communication skills
Preferred:
Experience with PySpark Delta Lake Kafka or Azure cloud technologies
Exposure to AI-assisted development tools and data observability practices
We are seeking a Senior Data Quality Engineer with strong experience in Python SQL and automated data testing frameworks. This role focuses on building scalable data quality and validation frameworks for modern data pipelines in a Databricks environment. Key Responsibilities: Build and maintain ...
We are seeking a Senior Data Quality Engineer with strong experience in Python SQL and automated data testing frameworks. This role focuses on building scalable data quality and validation frameworks for modern data pipelines in a Databricks environment.
Key Responsibilities:
Build and maintain automated testing frameworks for data pipelines
Validate data ingestion transformations and data quality across multiple sources
Implement data quality tools such as Great Expectations dbt tests or similar
Integrate testing into CI/CD pipelines
Collaborate with engineering teams to improve data reliability and observability
Required Skills:
5 years of experience in Data Quality Engineering Data Engineering or related field
Strong hands-on experience with Python and SQL
Experience with automated testing frameworks and pipeline validation
Familiarity with Databricks data transformation workflows and CI/CD tools
Strong problem-solving and communication skills
Preferred:
Experience with PySpark Delta Lake Kafka or Azure cloud technologies
Exposure to AI-assisted development tools and data observability practices
View more
View less