Role Overview
We are looking for an Intermediate Data Engineer to join the Enterprise Data Platform (EDP) team. The role focuses on building maintaining and optimizing scalable data pipelines that power investment risk research and analytics use cases across the organization.
Key Responsibilities
Data Pipeline Engineering
- Design and develop robust ETL/ELT pipelines using Python Airflow and DBT.
- Build and optimize Snowflake data models for performance scalability and cost efficiency.
- Implement ingestion pipelines for internal and external financial datasets (Market Securities Pricing ESG Ratings).
Data Modeling & Transformation
- Develop DBT models using best practices (sources staging marts).
- Apply data quality checks tests and documentation within DBT.
- Ensure consistent data transformations aligned with EDP standards.
Orchestration & Monitoring
- Create and manage Airflow DAGs with dependency handling retries and alerting.
- Monitor pipeline health and troubleshoot failures proactively.
- Support incremental loads backfills and SLA-driven workflows.
Data Quality & Governance
- Implement validation reconciliation and completeness checks.
- Ensure adherence to data governance security and access control policies.
- Collaborate with stakeholders to resolve data discrepancies.
Collaboration & Delivery
- Work closely with data analysts platform teams and upstream data providers.
- Participate in design reviews code reviews and sprint planning.
- Contribute to reusable frameworks and EDP accelerators.
Qualifications :
Required Skills & Qualifications
- 35 years of experience in Data Engineering.
- Strong hands-on experience with Python Snowflake DBT and Apache Airflow.
- Solid understanding of SQL data warehousing concepts and ELT patterns.
- Experience working with large-scale structured financial datasets.
- Familiarity with Git CI/CD and agile delivery practices.
Good to Have
- Experience in investment risk or financial data domains.
- Knowledge of performance tuning and cost optimization in Snowflake.
- Exposure to data quality frameworks and metadata management.
- Understanding of cloud platforms (AWS/Azure/GCP).
Additional Information :
We offer:
- Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
- Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package including health insurance and a relocation program.
- Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
- Growth Mindset: reap the benefits of a range of professional development opportunities including certification programs mentorship and talent investment programs internal mobility and internship opportunities.
- Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
- Welcoming Multicultural Environment: be a part of a dynamic global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
- Social Sustainability Values: join our sustainable business practices focused on five pillars including IT education community empowerment fair operating practices environmental sustainability and gender equality.
* Miratech is an equal opportunity employer and does not discriminate against any employee or applicant for employment on the basis of race color religion sex national origin age disability veteran status sexual orientation gender identity or any other protected status under applicable law.
Remote Work :
Yes
Employment Type :
Full-time
Role OverviewWe are looking for an Intermediate Data Engineer to join the Enterprise Data Platform (EDP) team. The role focuses on building maintaining and optimizing scalable data pipelines that power investment risk research and analytics use cases across the organization.Key ResponsibilitiesData ...
Role Overview
We are looking for an Intermediate Data Engineer to join the Enterprise Data Platform (EDP) team. The role focuses on building maintaining and optimizing scalable data pipelines that power investment risk research and analytics use cases across the organization.
Key Responsibilities
Data Pipeline Engineering
- Design and develop robust ETL/ELT pipelines using Python Airflow and DBT.
- Build and optimize Snowflake data models for performance scalability and cost efficiency.
- Implement ingestion pipelines for internal and external financial datasets (Market Securities Pricing ESG Ratings).
Data Modeling & Transformation
- Develop DBT models using best practices (sources staging marts).
- Apply data quality checks tests and documentation within DBT.
- Ensure consistent data transformations aligned with EDP standards.
Orchestration & Monitoring
- Create and manage Airflow DAGs with dependency handling retries and alerting.
- Monitor pipeline health and troubleshoot failures proactively.
- Support incremental loads backfills and SLA-driven workflows.
Data Quality & Governance
- Implement validation reconciliation and completeness checks.
- Ensure adherence to data governance security and access control policies.
- Collaborate with stakeholders to resolve data discrepancies.
Collaboration & Delivery
- Work closely with data analysts platform teams and upstream data providers.
- Participate in design reviews code reviews and sprint planning.
- Contribute to reusable frameworks and EDP accelerators.
Qualifications :
Required Skills & Qualifications
- 35 years of experience in Data Engineering.
- Strong hands-on experience with Python Snowflake DBT and Apache Airflow.
- Solid understanding of SQL data warehousing concepts and ELT patterns.
- Experience working with large-scale structured financial datasets.
- Familiarity with Git CI/CD and agile delivery practices.
Good to Have
- Experience in investment risk or financial data domains.
- Knowledge of performance tuning and cost optimization in Snowflake.
- Exposure to data quality frameworks and metadata management.
- Understanding of cloud platforms (AWS/Azure/GCP).
Additional Information :
We offer:
- Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
- Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package including health insurance and a relocation program.
- Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
- Growth Mindset: reap the benefits of a range of professional development opportunities including certification programs mentorship and talent investment programs internal mobility and internship opportunities.
- Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
- Welcoming Multicultural Environment: be a part of a dynamic global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
- Social Sustainability Values: join our sustainable business practices focused on five pillars including IT education community empowerment fair operating practices environmental sustainability and gender equality.
* Miratech is an equal opportunity employer and does not discriminate against any employee or applicant for employment on the basis of race color religion sex national origin age disability veteran status sexual orientation gender identity or any other protected status under applicable law.
Remote Work :
Yes
Employment Type :
Full-time
View more
View less