Senior Data Management Professional Data Engineer Commodities Data
Job Summary
Description & Requirements
- Build and maintain highly scalable resilient and observable data pipelines supporting critical Commodities datasets
- Modernize legacy workflows reduce technical debt and improve performance reliability and maintainability.
- Design automated pipeline controls for validation monitoring schema change exception handling and data integrity.
- Develop workflow orchestration alerting observability and remediation processes.
- Translate business and client needs into engineering-ready requirements and scalable technical solutions.
- Partner with Engineering on platform evolution architecture tooling system design and reliability.
- Apply automation AI machine learning or statistical techniques to improve ingestion enrichment validation and monitoring.
- Own data migrations workflow redesigns and technical transformation initiatives.
- Establish standard methodologies for pipeline design code quality testing documentation version control and operational handover.
- Influence data modelling metadata lineage and lifecycle management practices from a technical implementation perspective.
- Mentor team members and set the standard for technical execution design thinking and engineering rigor
- A bachelors degree or above in Statistics Computer Science Quantitative Finance or other STEM related field or degree-equivalent qualifications
- 4 years of experience designing and building scalable data solutions ETL pipelines data workflows and monitoring frameworks.
- Strong hands-on experience with Python or similar programming/scripting languages.
- Experience with querying structured semi-structured and unstructured datasets.
- Experience with workflow orchestration observability monitoring alerting and scalable architecture design.
- Ability to analyze refactor and modernize legacy systems.
- Strong understanding of data lifecycle management data integration data modelling data profiling and data governance.
- Experience building automated controls and reliability frameworks into data pipelines.
- Strong communication skills with the ability to collaborate across Data Engineering Product Vendors and other stakeholders.
- Bloomberg Terminal BQL Enterprise or Bloomberg data workflow experience.
- Experience productionizing AI machine learning anomaly detection NLP classification or LLM-assisted workflows.
- Experience with cloud platforms CI/CD automated testing version control metadata management lineage or modern DataOps practices.
- Project management experience with Agile delivery backlog management JIRA or similar tools.
- CDMP certification or progress toward it is a plus.
Required Experience:
Senior IC
About Company
Bloomberg is the world's primary distributor of financial data and a top news provider of the 21st century. A global information and technology company, we use our dynamic network of data, ideas and analysis to solve difficult problems every day. Our customers around the world rely on ... View more