AI Evaluation Data Scientist - Health
AI Evaluation Data Scientist - Health
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
- Bachelors degree (or equivalent experience) in a empirical field with emphasis on quantitative methodologies of human behavior including HCI Psychometrics Quantitative or Experimental Psychology Educational Measurement Language Assessment or a relevant field
- Proficiency in Python and ability to write clean performant code and collaborate using standard software development practices (e.g. Git)
- Strong statistical analysis skills and experience in crafting experiments validating data quality and model performance
- Experience in building and extending data and inference pipelines to process large scale datasets
- MS and a minimum of 3 years of relevant industry experience or PhD in relevant fields
- Real-world experience with LLM-based evaluation systems and human annotation and human evaluation methodologies
- Experience in rigorous evidence-based approaches to test development e.g. quantitative and qualitative test design reliability and validity analysis
- Customer-focused mindset with experience or strong interest in building consumer digital health and wellness products
- Strong communication skills and ability to work cross-functionally with technical and non-technical stakeholders
Employment Type
Full Time
