As a pioneer for digital transformation GFT develops sustainable solutions across new technologies from cloud engineering and artificial intelligence to blockchain/DLT. With its deep technological expertise strong partnerships and comprehensive market know-how GFT offers advice to the financial and insurance sectors as well as the manufacturing industry. Through the intelligent use of IT solutions GFT increases productivity and creates added value for clients. Companies gain easy and safe access to scalable IT applications and innovative business models.
Having started in Germany in 1987 GFT Technologies has grown to become a trusted Software Engineering and Consulting specialist for the international financial industry counting many of the worlds largest and best-known banks as our clients. We are an organization that empowers you to not only explore but also raise your potential and seek out opportunities that add value. At GFT diversity equality and inclusion are at the core of who we are. Ensuring a diverse and inclusive working environment for all communities is one of the main pillars of our diversity strategy based on our core values and culture. We have been certified for 2022/23 as a Great Place to Work in the APAC region. So if you want to have the opportunity to work with an outstanding and progressive organization this position could be right for you.
We are seeking a pragmatic Senior Machine Learning Engineer toaccelerate our MLOps roadmap. Your primary mission will be to own the design andimplementation of our V1 LLM Evaluation Platform a critical system that will serve as the qualitygate for all our AI features. You will be a key builder on a new initiative working alongsidededicated Data Engineering and DevOps experts to deliver a tangible high-impact role is for a hands-on engineer who thrives on building robust systems that provideleverage. You will be fully empowered to own the implementation and success of this project.
Sign-on Bonus: Eligible for candidates who are currently employed elsewhere and able to join GFTwithin 30 daysof offer acceptance.
Key Responsibilities
- Build the V1 Evaluation Platform: Proactively own the end-to-end process of designing and building the core backend systems for our new LLM Evaluation Platform leveraging Arize Phoenix as the foundational framework for traces evaluations and experiments.
- Implement Production Observability: Architect and implement the observability backbone for our AI services integrating Phoenix with OpenTelemetry to create a centralized system for logging tracing and evaluating LLM behavior in production.
- Standardize LLM Deployment Pipeline: Design and implement the CI/CD framework for versioning testing and deploying prompt-based logic and LLM configurations ensuring reproducible and auditable deployments across all AI features.
- Deliver Pragmatic Solutions: Consistently make pragmatic technical decisions that prioritize business value and speed of delivery in line with our early-stage startup environment.
- Cross-functional Collaboration: Work closely with our Data Science team to understand their workflow and ensure the platform you build meets their core needs for experiment tracking and validation.
- Establish Core Patterns: Help establish and document the initial technical patterns for MLOps and model evaluation that will serve as the foundation for future development.
Required Qualifications
- 5 years of dedicated software engineering experience with a strong focus on backend or platform systems.
- Expertise in Python: You have a proven track record of building robust testable and maintainable production systems.
- Deep MLOps/LLMOps Experience: You have hands-on experience with the unique challenges of productionizing and evaluating modern ML/LLM systems ideally with exposure to evaluation frameworks like Arize Phoenix LangSmith or similar platforms.
- Observability Expertise: Practical experience with modern observability frameworks especially OpenTelemetry is essential.
- Pragmatic Problem-Solving: A demonstrated ability to choose the right solution for the problem at hand avoiding over-engineering while ensuring robustness.
- Arize Phoenix Experience: Hands-on experience with Phoenix for LLM observability including setting up custom evaluators managing datasets and implementing trace-based debugging.
- AWS Experience: Familiarity with core AWS services used in a platform context (Kubernetes/EKS RDS S3 IAM).
- Experience in a Startup Environment: Comfortable with ambiguity and a fast-paced setting.
(Note: Due to the high volume of applications we receive we are unable to respond to every candidate individually. If you have not received a response from GFT regarding your application within 10 workdays please consider that we have decided to proceed with other candidates. We truly appreciate your interest in GFT and thank you for your understanding.)
Required Experience:
Senior IC
What do we doAs a pioneer for digital transformation GFT develops sustainable solutions across new technologies from cloud engineering and artificial intelligence to blockchain/DLT. With its deep technological expertise strong partnerships and comprehensive market know-how GFT offers advice to the ...
As a pioneer for digital transformation GFT develops sustainable solutions across new technologies from cloud engineering and artificial intelligence to blockchain/DLT. With its deep technological expertise strong partnerships and comprehensive market know-how GFT offers advice to the financial and insurance sectors as well as the manufacturing industry. Through the intelligent use of IT solutions GFT increases productivity and creates added value for clients. Companies gain easy and safe access to scalable IT applications and innovative business models.
Having started in Germany in 1987 GFT Technologies has grown to become a trusted Software Engineering and Consulting specialist for the international financial industry counting many of the worlds largest and best-known banks as our clients. We are an organization that empowers you to not only explore but also raise your potential and seek out opportunities that add value. At GFT diversity equality and inclusion are at the core of who we are. Ensuring a diverse and inclusive working environment for all communities is one of the main pillars of our diversity strategy based on our core values and culture. We have been certified for 2022/23 as a Great Place to Work in the APAC region. So if you want to have the opportunity to work with an outstanding and progressive organization this position could be right for you.
We are seeking a pragmatic Senior Machine Learning Engineer toaccelerate our MLOps roadmap. Your primary mission will be to own the design andimplementation of our V1 LLM Evaluation Platform a critical system that will serve as the qualitygate for all our AI features. You will be a key builder on a new initiative working alongsidededicated Data Engineering and DevOps experts to deliver a tangible high-impact role is for a hands-on engineer who thrives on building robust systems that provideleverage. You will be fully empowered to own the implementation and success of this project.
Sign-on Bonus: Eligible for candidates who are currently employed elsewhere and able to join GFTwithin 30 daysof offer acceptance.
Key Responsibilities
- Build the V1 Evaluation Platform: Proactively own the end-to-end process of designing and building the core backend systems for our new LLM Evaluation Platform leveraging Arize Phoenix as the foundational framework for traces evaluations and experiments.
- Implement Production Observability: Architect and implement the observability backbone for our AI services integrating Phoenix with OpenTelemetry to create a centralized system for logging tracing and evaluating LLM behavior in production.
- Standardize LLM Deployment Pipeline: Design and implement the CI/CD framework for versioning testing and deploying prompt-based logic and LLM configurations ensuring reproducible and auditable deployments across all AI features.
- Deliver Pragmatic Solutions: Consistently make pragmatic technical decisions that prioritize business value and speed of delivery in line with our early-stage startup environment.
- Cross-functional Collaboration: Work closely with our Data Science team to understand their workflow and ensure the platform you build meets their core needs for experiment tracking and validation.
- Establish Core Patterns: Help establish and document the initial technical patterns for MLOps and model evaluation that will serve as the foundation for future development.
Required Qualifications
- 5 years of dedicated software engineering experience with a strong focus on backend or platform systems.
- Expertise in Python: You have a proven track record of building robust testable and maintainable production systems.
- Deep MLOps/LLMOps Experience: You have hands-on experience with the unique challenges of productionizing and evaluating modern ML/LLM systems ideally with exposure to evaluation frameworks like Arize Phoenix LangSmith or similar platforms.
- Observability Expertise: Practical experience with modern observability frameworks especially OpenTelemetry is essential.
- Pragmatic Problem-Solving: A demonstrated ability to choose the right solution for the problem at hand avoiding over-engineering while ensuring robustness.
- Arize Phoenix Experience: Hands-on experience with Phoenix for LLM observability including setting up custom evaluators managing datasets and implementing trace-based debugging.
- AWS Experience: Familiarity with core AWS services used in a platform context (Kubernetes/EKS RDS S3 IAM).
- Experience in a Startup Environment: Comfortable with ambiguity and a fast-paced setting.
(Note: Due to the high volume of applications we receive we are unable to respond to every candidate individually. If you have not received a response from GFT regarding your application within 10 workdays please consider that we have decided to proceed with other candidates. We truly appreciate your interest in GFT and thank you for your understanding.)
Required Experience:
Senior IC
View more
View less