Senior Data Engineer to develop and maintain repeatable scripts that enable efficient and reproducible data extraction analysis and pipeline monitoring. The role involves performing deep dives into dbt models to identify and resolve discrepancies in outputs compared to legacy PySpark scripts migrated from the previous environment. The candidate will also assist in debugging and implementing logic enhancements to ensure data accuracy and consistency across systems. The ideal candidate will be strong in Azure SQL Python Databricks Airflow any RDBMS and other Azure services with the ability to design robust maintainable data workflows. Experience with Kafka dbt and Snowflake is a plus. This role requires strong problem-solving skills attention to detail and the ability to drive data reliability and efficiency across analytical and operational processes
Senior Data Engineer to develop and maintain repeatable scripts that enable efficient and reproducible data extraction analysis and pipeline monitoring. The role involves performing deep dives into dbt models to identify and resolve discrepancies in outputs compared to legacy PySpark scripts migrate...
Senior Data Engineer to develop and maintain repeatable scripts that enable efficient and reproducible data extraction analysis and pipeline monitoring. The role involves performing deep dives into dbt models to identify and resolve discrepancies in outputs compared to legacy PySpark scripts migrated from the previous environment. The candidate will also assist in debugging and implementing logic enhancements to ensure data accuracy and consistency across systems. The ideal candidate will be strong in Azure SQL Python Databricks Airflow any RDBMS and other Azure services with the ability to design robust maintainable data workflows. Experience with Kafka dbt and Snowflake is a plus. This role requires strong problem-solving skills attention to detail and the ability to drive data reliability and efficiency across analytical and operational processes
View more
View less