Expert Rater
Expert Rater
Posted on :
11-04-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
If you have a Candidate Login already but have forgotten your password please use the steps to reset your password. If you have forgotten your email login please contact subject Workday Candidate Login
When creating your Workday account and entering personal information like name address please do not use ALL CAPS.
Thank you!
NOTICE:For EMEA Jobs please review the Privacy Policy here
Job Responsibilities:
Welo Data is an awardwinning localization and AI data company. We run some of the worlds largest AI model relevance rating programs. This will play a crucial role in analyzing and improving AIdriven online advertising platforms.This role will help establish benchmarks and guidelines for data used to train AI models particularly in areas lacking defined standards. That means you will be shaping the future of webbased advertising and AI models.
MAIN DUTIES
The following is a nonexhaustive list of responsibilities and areas of ownership of an Expert Rater
- Rate Clientprovided ads following predefined guidelines
- Evaluate advertisements based on specific quality relevance and compliance criteria provided by the client.
- Ensure ratings are objective consistent and aligned with the predefined rating standards.
- Identify any guideline ambiguities and apply critical thinking when assessing borderline cases.
- Maintain a high level of accuracy and efficiency meeting daily/weekly rating quotas.
- Review and refine rating guidelines identifying areas for improvement and recommending updates to enhance accuracy consistency and overall rating quality.
- Curate highquality datasets (golden sets) by selecting and validating toptier rated ads which can serve as benchmarks for AI model training and human rater calibration.
- Collaborate with crossfunctional teams (e.g. quality assurance data analysts and AI training teams) to ensure rating processes align with evolving industry and client needs.
- Analyse trends and patterns in ad ratings providing insights that contribute to guideline optimizations and overall rating effectiveness.
- Assist in training and mentoring new raters ensuring they understand guidelines and best practices for accurate evaluations.
REQUIREMENTS
Experience
- Have experience in AI model relevance such as data labeling linguistic annotation relevance rating etc.
- Are analytical and datadriven with a proven trackrecord of databased decision making
- Have a strong interest and understanding of digital marketing and advertising especially as it relates to artificial intelligence
- Can effectively summarize complex information questions and solutions for various audiences Have experience researching and gathering insights and understanding complex problems across a variety of topics
- Can defining explain and defend their points of view in group discussions
- Are comfortable reviewing and discussing a variety of topics you do not need to have expertise on the topics but willingness to research and understand to support consensus decisions is vital
- Are comfortable with ambiguity in guidelines workflows and processes and are motivated to help establish those systems
Requirements
- Native level fluency in the target language
- Excellent understanding of both written & spoken English
- A 4 year university degree and/or or at least 2 years work experience in one or more of the following: AIbased relevance rating marketing/advertising linguistics content creation writing techrelated quality assurance data labeling or linguistic annotation.
Additional Job Details:
Employment Type
Full-Time
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
