Senior Python Data Engineer

Convo is looking for Python Data Engineers with 3 years of experience in production data engineering and pipeline operations. The ideal candidate should have strong expertise in Python SQL Airflow/Azure Data Factory Spark data quality schema validation and monitoring with the ability to troubleshoot pipeline issues maintain reliable data workflows and ensure data quality freshness and operational stability.

Maintain data pipelines implement schema-validation automation and resolve operational incidents within the approved platform architecture.

• Maintain and enhance Python/SQL pipelines orchestrated through Airflow Azure Data Factory or equivalent.

• Implement schema completeness freshness and reconciliation checks.

• Diagnose and resolve pipeline failures data-quality incidents and performance regressions.

• Support Spark jobs and incremental data-processing patterns.

• Add monitoring structured logging and actionable alerts.

• Document fixes recurring failure patterns and operational procedures.

• Minimum experience: 3 years in production data engineering or data-pipeline operations using Python and SQL.

• Production Python and SQL for data engineering.

• Airflow Azure Data Factory or comparable workflow orchestration.

• Working knowledge of Spark and distributed data-processing concepts.

• Data-quality and schema-validation implementation.

• Monitoring incident triage and root-cause analysis.

• Version control automated testing and controlled deployment practices.

• Databricks Delta Lake and cloud storage patterns.

• On-call or production-support experience for data platforms.

• CPG retail or enterprise-source data.

• Stable pipelines meeting agreed freshness and quality thresholds.

• Automated validation and monitoring coverage.

• Closed incidents with documented root cause and preventive action.

• Updated runbooks and maintainable handover documentation.

Works with Senior Data Engineers Telemetry Support connector teams and platform operations.

• Great compensation package medical benefit for you and your family free lunch annual performance-tied increments & performance recognition awards and a great lean and agile work culture!
• Convo endorses a culture of diversity in all aspects and aims to build a diverse team of amazing individuals!