The engineer will participate in the scientific validation of AI models by measuring their accuracy robustness and consistency. His role will be to:
- Design and execute AI model testing and evaluation protocols (LLM classification models NLP etc.)
- Analyze performance and identify biases or weaknesses
- Propose improvements through prompt engineering
- Produce performance reports and recommendations for improvement
- Collaborate with Full Stack Developers to integrate AI functionalities into production systems.
- Maintain documentation experiment tracking and performance benchmarks.
- Ensure compliance with privacy security and data governance requirements.
- Develop pipelines for inference and model testing.
Qualifications :
- Proven experience of more than 4 years in Artificial Intelligence.
- Experience deploying or integrating AI services in production environments.
- Fluency in prompt engineering techniques dealing with hallucinations tuning LLM parameters
- Understanding of RAG pattern and basic search relevancy optimization
- AI Agents MCP Servers Hybrid Search are beneficial
- Evaluate AI model performance accuracy reliability and scalability - understanding of quality optimization processes
- Strong analytical thinking and scientific mindset.
- Good understanding of AI/ML research pipelines for quality optimization experiments benchmarking and tracking cooperation with subject matter experts
- Experience in experiments scaling and monitoring in production is a plus
-
- Proficient in Python development and development best practices
- Hugging Face Transformers - Nice to have vectorization and other libraries
- LangChain LlamaIndex is a plus
- Experience in Cloud Platforms (Azure AWS) is beneficial
- Good written and oral communication in English (Fluent English mandatory)
Informations supplémentaires :
Looking forward to hearing from you !
Remote Work :
Yes
Employment Type :
Full-time
The engineer will participate in the scientific validation of AI models by measuring their accuracy robustness and consistency. His role will be to:Design and execute AI model testing and evaluation protocols (LLM classification models NLP etc.)Analyze performance and identify biases or weaknessesPr...
The engineer will participate in the scientific validation of AI models by measuring their accuracy robustness and consistency. His role will be to:
- Design and execute AI model testing and evaluation protocols (LLM classification models NLP etc.)
- Analyze performance and identify biases or weaknesses
- Propose improvements through prompt engineering
- Produce performance reports and recommendations for improvement
- Collaborate with Full Stack Developers to integrate AI functionalities into production systems.
- Maintain documentation experiment tracking and performance benchmarks.
- Ensure compliance with privacy security and data governance requirements.
- Develop pipelines for inference and model testing.
Qualifications :
- Proven experience of more than 4 years in Artificial Intelligence.
- Experience deploying or integrating AI services in production environments.
- Fluency in prompt engineering techniques dealing with hallucinations tuning LLM parameters
- Understanding of RAG pattern and basic search relevancy optimization
- AI Agents MCP Servers Hybrid Search are beneficial
- Evaluate AI model performance accuracy reliability and scalability - understanding of quality optimization processes
- Strong analytical thinking and scientific mindset.
- Good understanding of AI/ML research pipelines for quality optimization experiments benchmarking and tracking cooperation with subject matter experts
- Experience in experiments scaling and monitoring in production is a plus
-
- Proficient in Python development and development best practices
- Hugging Face Transformers - Nice to have vectorization and other libraries
- LangChain LlamaIndex is a plus
- Experience in Cloud Platforms (Azure AWS) is beneficial
- Good written and oral communication in English (Fluent English mandatory)
Informations supplémentaires :
Looking forward to hearing from you !
Remote Work :
Yes
Employment Type :
Full-time
View more
View less