German-Speaking AI Data Evaluation Specialist

CloserHire is partnering with a leading global customer experience company to recruit German-speaking AI Data Evaluation Specialists for an innovative artificial intelligence project based in Lisbon Portugal. If youre passionate about AI language technology and data quality this is a unique opportunity to contribute to the development of next-generation Large Language Models (LLMs). Youll work with cutting-edge AI systems by reviewing evaluating and improving AI-generated responses helping create safer more accurate and more reliable conversational experiences for millions of users worldwide.

Language required: German

Highlights:

• Relocation support included
• Salary up to 1300 EUR
• Private health insurance

Responsibilities:

• Review and evaluate AI-generated responses using detailed annotation and quality guidelines
• Label and annotate language model outputs with accuracy and consistency
• Assess AI-generated content for quality relevance factual accuracy safety and policy compliance
• Apply complex annotation guidelines across a wide variety of scenarios and content types
• Identify inconsistencies edge cases and potential model issues escalating when appropriate
• Analyze structured text datasets and AI-generated content to support model improvement
• Deliver high-quality work while consistently meeting productivity quality and accuracy targets
• Maintain strict confidentiality and comply with all project standards security requirements and internal procedures
• Contribute directly to the ongoing training and improvement of advanced AI systems through detailed evaluations and feedback 24/7 rotating schedule (Monday to Sunday) with 2 rotational days off

Qualifications:

• Native-level fluency in German
• Good command of English (B2 level or above)
• Strong understanding of Generative AI Large Language Models (LLMs) and AI evaluation methodologies
• Previous experience in AI data annotation LLM evaluation Reinforcement Learning from Human Feedback (RLHF) Supervised Fine-Tuning (SFT) Quality Assurance Content
• Labeling Trust & Safety or similar analytical roles is highly desirable
• Excellent analytical thinking and attention to detail
• Ability to interpret and consistently apply complex written guidelines and policies
• Strong reading comprehension and written communication skills
• Comfortable working with structured text datasets and AI-generated content
• Ability to work efficiently in a fast-paced quality-driven environment while meeting performance targets
• Professional objective and capable of handling confidential information with discretion

Benefits:

• Office-based position in Lisbon Portugal
• Comprehensive onboarding and specialized training in AI evaluation processes
• Opportunity to work on one of the worlds most advanced artificial intelligence projects
• International and multicultural working environment
• Career development opportunities within the rapidly growing AI industry
• Private health insurance
• Meal allowance Ongoing learning and professional development
• Modern office facilities with a collaborative team culture Unique opportunity to shape the future of generative AI and language technologies

Relocation:
Relocation support included: Accomodation for candidates outside of Portugal - Room in company apartment in Lisbon for 12 months for a fixed cost of 280EUR deducted from salary. Inside Portugal - only available if candidates are coming directly from a competitor Health Insurance since day 1 for small amount free after 6 months