We are seeking experienced Python developers to join an exciting AI project supporting one of the worlds top 15 companies. This role involves reviewing and validating AI-generated code to ensure quality accuracy and adherence to industry standards.
As a Python Code Reviewer you will be responsible for auditing and validating AI-generated Python code evaluations. This critical role ensures that AI outputs meet high standards for functionality clarity and correctness while adhering to specific project guidelines.
Key Responsibilities
- Code Review & Validation: Evaluate AI-generated Python code snippets for accuracy functionality and adherence to prompt instructions
- Quality Assurance: Review annotator assessments and ensure all evaluations meet internal quality benchmarks
- Feedback & Documentation: Provide clear actionable feedback on incorrect assessments and document technical issues
- Testing & Validation: Validate code functionality using proof-of-work methodologies and Docker-based sandbox environments
- Process Improvement: Identify patterns in evaluation errors and contribute to continuous quality enhancement
- Compliance: Ensure all reviews align with established project guidelines and frameworks
Qualifications :
Required Qualifications
Technical Requirements
- 5-7 years of hands-on Python development experience
- Deep Python expertise including syntax testing strategies debugging and edge case handling
- Docker experience for containerized testing and isolated code validation environments
- QA background with structured workflows annotation processes or similar review pipelines
Professional Requirements
- Excellent written communication skills with ability to document and explain technical concepts clearly
- Professional English fluency (B2 level or above)
- Independent work capability with strong attention to detail
- Immediate availability to start
Preferred Qualifications
- Experience with AI/ML model evaluation reinforcement learning (RLHF) or large language model tuning
- Familiarity with annotation tools or data labeling platforms
- Knowledge of secure coding practices and environment replication
- Previous experience in code review or technical auditing roles
Remote Work :
Yes
Employment Type :
Full-time