Senior Data Engineer
Share
Job Location:
Mexico City - Mexico
Monthly Salary:
Not Disclosed
Posted on:
22 hours ago
Vacancies:
1 Vacancy
Job Summary
Company:
MMC CorporateDescription:
Senior Data Engineer
We are seeking a Senior Data Engineer to join our team at Marsh. This role will be based in Mexico City. This is a hybrid role that has a requirement of working at least three days a week in the office. As a Senior Data Engineer at Marsh you will design build and maintain Databricks pipelines and CI/CD workflows. The role primary focus is Databricks and Spark: you will deploy and operate scalable Spark-based data pipelines and ML workflows on a cloud platform ensuring production-grade reliability governance and data security. Unity Catalog knowledge is essential.
We will count on you to:
- Design implement and operate Databricks-based data ingestion transformation and ML pipelines on a cloud platform.
- Optimize Spark performance and manage large-scale data workflows for reliability and cost-effectiveness.
- Build and maintain CI/CD for Databricks artifacts (notebooks jobs Repos Git integration) across dev/UAT/prod environments.
- Apply ETL/ELT best practices ensure data quality security and compliance.
- Partner with business units to refine data collection integration and retention strategies.
- Monitor and improve data reliability and system efficiency.
What you need to have:
- Minimum 5 years of experience in data engineering or a related role.
- Advanced degree in Computer Science Engineering or a related field.
- Strong proficiency in Python SQL and Spark.
- Practical experience with Databricks on a cloud platform.
- Unity Catalog experience (essential).
- Proven track record of deploying Databricks pipelines to production.
- Experience building CI/CD workflows for Databricks (Git integration Repos environment promotion).
- Excellent English communication skills (C1 level).
What makes you stand out:
- Orchestration (Airflow/Dagster) feature stores event buses.
- Kubernetes/Docker API gateways OAuth.
- Finance domain exposure (forecasting anomalies reconciliation commentary) useful context not mandatory.
Why join our team:
- We help you be your best through professional development opportunities interesting work and supportive leaders.
- We foster a vibrant and inclusive culture where you can work with talented colleagues to create new solutions and have impact for colleagues clients and communities.
- Our scale enables us to provide a range of career opportunities as well as benefits and rewards to enhance your well-being.
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Veritas provides commodity trading and risk advisory to optimize trading strategies and operations by harnessing CTRM systems, advanced analytics, and AI.
