Data Engineer
Data Engineer
Posted on :
22-08-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
The Role:
As a Data Engineer you will play a crucial role in creating and managing the dataflows used by production machine learning models and data scientists. You will be responsible for collaborating with cross-functional teams engineers product managers and data scientists to understand requirements and deliver high-quality solutions. You will be expected to implement best practices in data management coding testing and deployment ensuring scalability performance and security. Strong problem-solving skills excellent communication and the ability to adapt to new challenges in a fast-paced environment is essential for this role.
Key Responsibilities:
- Design build and maintain large-scale data pipelines to ingest process and transform complex financial data
- Develop data ingestion frameworks to handle high-volume and high-variety data feeds
- Implement data quality control measures to detect and handle data anomalies duplicates and inconsistencies
- Optimize data pipeline performance for scalability reliability and latency
- Collaborate with data scientists to integrate machine learning models into the data pipeline and ensure seamless data flow
- Develop and maintain model serving infrastructure to support real-time predictions and batch scoring
- Implement model monitoring and logging to track performance data quality and model drift
- Manage cloud-based infrastructure to support data pipeline and model serving workloads
- Troubleshoot data pipeline issues data quality problems and model performance degradation
- Collaborate with cross-functional teams including data science product and engineering teams to ensure alignment and effective communication
Required Skills Experience and Qualifications:
- 5 years of experience in a data engineering or similar role with a focus on building and deploying data pipelines and machine learning models
- 3 years of experience with Databricks PySpark and Apache Spark
- 2 year of experience with Apache Airflow Apache Kafka and Kubernetes
- Strong Python skills with 3 years of experience
- Experience with production machine learning model deployment and management
- Knowledge of cloud-based infrastructure and services AWS and Azure
- Experience with data warehousing data lakes and data marts
- Familiarity with containerization using Docker and orchestration using Kubernetes
- Understanding of messaging and streaming using Apache Kafka
- Experience with workflow management using Apache Airflow
- Strong problem-solving skills with the ability to troubleshoot complex data pipeline and machine learning model issues
- Excellent communication and collaboration skills with the ability to work with data scientists engineers and senior stakeholders
- Degree educated in Computer Science or relevant subject
- Excellent spoken and written English
- Experience of driving innovation within teams
- Positive can-do approach to work delivering on commitments
- Able to earn respect and build trust through high-quality delivery and by demonstrating value added
- Act with integrity with the ability to make decisions taking accountability for the consequences of these decisions
- Creative approach to problem solving can look at existing situations and problems in novel ways and propose innovative solutions
About us
We are a diverse group of visionary innovators who provide trading and workflow automation software high-value analytics and strategic consulting to corporations central banks financial institutions and governments. Founded in 1999 we have achieved tremendous growth by bringing together some of the best and most successful financial technology companies in the world.
Over 2000 of the worlds leading corporations including 50% of the Fortune 500 and 30% of the worlds central banks trust ION solutions to manage their cash in-house banking commodity supply chain trading and risk.
Over 800 of the worlds leading banks and broker-dealers use our electronic trading platforms to operate the worlds financial market infrastructure.
ION is a rapidly expanding and dynamic group with 13000 employees and offices in more than 40 cities around the globe
Our ever-expanding global footprint innovative products and over 40000 customers worldwide provide an unparalleled career experience for those who share our vision. Learn more at .
Employment Type
Full-Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
