Software Engineer - GenAI Evaluations, AiDP
Software Engineer - GenAI Evaluations, AiDP
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
- Bachelors in Computer Science Artificial Intelligence Machine Learning or a related field or experience
- 2 years of software engineering experience
- Programming skills in Python
- Experience developing scalable and robust services with FastAPI or similar frameworks.
- Experience in Machine Learning with a particular emphasis on Large Language Models (LLMs) Retrieval Augmented Generation (RAG) or GenAI Agents
- Experience with evaluating and optimizing Generative AI platforms or applications
- Experience with GenAI RAG and Agent evaluation frameworks like RAGAS DeepEvals OpenEvals AgentEvals or OpenAI Evals
- Familiarity with LLM Observability techniques and best practices
- Proven ability to comprehend interpret and apply cutting-edge research into tangible applications
- Proven problem-solving and leadership abilities with the capacity to steer the teams research and build practical applications in a collaborative and fast-paced environment
- Customer-focused with strong business acumen capable of translating business needs into impactful technical solutions and a proven history of successfully shipping products that drive significant outcomes
- Experience with cloud platforms like AWS GCP or Azure
- Knowledge of containerization and orchestration tools like Docker and Kubernetes
- Creative collaborative and project focused with an ability to work hands-on in multi-functional teams
- Excellent communication skills with the ability to communicate with all stakeholders effectively including senior leadership
- Masters in Computer Science Artificial Intelligence Machine Learning or a related field
Employment Type
Full-Time
