We are seeking a Senior Data Quality Engineer with strong experience in Python SQL and automated data testing frameworks. This role focuses on building scalable data quality and validation frameworks for modern data pipelines in a Databricks environment.
Key Responsibilities: Build and maintain automated testing frameworks for data pipelines Validate data ingestion transformations and data quality across multiple sources Implement data quality tools such as Great Expectations dbt tests or similar Integrate testing into CI/CD pipelines Collaborate with engineering teams to improve data reliability and observability
Required Skills: 5 years of experience in Data Quality Engineering Data Engineering or related field Strong hands-on experience with Python and SQL Experience with automated testing frameworks and pipeline validation Familiarity with Databricks data transformation workflows and CI/CD tools Strong problem-solving and communication skills
Preferred: Experience with PySpark Delta Lake Kafka or Azure cloud technologies Exposure to AI-assisted development tools and data observability practices
We are seeking a Senior Data Quality Engineer with strong experience in Python SQL and automated data testing frameworks. This role focuses on building scalable data quality and validation frameworks for modern data pipelines in a Databricks environment. Key Responsibilities: Build and maintain ...
We are seeking a Senior Data Quality Engineer with strong experience in Python SQL and automated data testing frameworks. This role focuses on building scalable data quality and validation frameworks for modern data pipelines in a Databricks environment.
Key Responsibilities: Build and maintain automated testing frameworks for data pipelines Validate data ingestion transformations and data quality across multiple sources Implement data quality tools such as Great Expectations dbt tests or similar Integrate testing into CI/CD pipelines Collaborate with engineering teams to improve data reliability and observability
Required Skills: 5 years of experience in Data Quality Engineering Data Engineering or related field Strong hands-on experience with Python and SQL Experience with automated testing frameworks and pipeline validation Familiarity with Databricks data transformation workflows and CI/CD tools Strong problem-solving and communication skills
Preferred: Experience with PySpark Delta Lake Kafka or Azure cloud technologies Exposure to AI-assisted development tools and data observability practices