To measure our progress on this front we need to track the state of our dataset composition accuracy of llm-judges human expert review results in a central and visual representation. A DRI for Metrics and Reporting will:
B.S. M.S. or Ph.D. in Computer Science Data Science Data Engineering
3 years in data-science and/or data-engineering (iceberg pandas python Tableau or equivalent data collection and visualization)
Good understanding of metrics crowd science annotation analysis statistics
Ability to work independently and cross-functionally to integrate in partner team reporting systems and pipelines
Excellent communication skills and the ability to thrive in a highly collaborative work environment
Good engineering practices to create sustainable and easy to use metric reporting pipelines
Attunement to computational linguistics language quality is a plus
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.