Software Engineer

IMPORTANT: after you apply please check your email. We send you a link to complete your application it is not considered until that last step is done. If you do not see it check your spam folder.

This is a fully remote position open to candidates based in Japan.

Pay: $50$70/hr

Role Title: Software Engineer

Role Type: Contractor

Location: Remote

We are engaging Software Engineers to contribute their technical expertise to a customer-centric project focused on enhancing development workflows and process this role youll apply your expertise to help train next-generation AI systems. Your work will shape how models learn reason and perform through high-quality real-world input. No prior experience in AI is required your domain knowledge is what matters.

Scope of Work

1. Execute structured evaluation assignments that simulate authentic developer activities including version control code review issue tracking and CI/CD workflow execution utilizing AI-powered tools.
2. Assess and grade the technical correctness of outputs verifying results hands-on within relevant development environments and tools.
3. Design seed and maintain reproducible test environmentssuch as code repositories with real commit histories and CI workflowsto ensure reliable and realistic task contexts.
4. Configure document and troubleshoot integrations and authentication flows across multiple software services ensuring seamless connectivity.
5. Investigate and document undocumented product behaviors through hands-on exploration and systematic testing.
6. Participate in calibration sessions to ensure consistent evaluation methods and grading across the contributor group.

Preferred Qualifications

1. Minimum of 3 years of professional experience in software engineering demonstrating strong command of Git/GitHub workflows (pull requests code review branching analyzing diffs CI log diagnostics).
2. Proficient with CI/CD systemsideally GitHub Actionsincluding authoring custom workflows and ensuring reproducible build processes.
3. Versed in using connectors across Claude and ChatGPT.
4. Advanced scripting abilities in Python or Bash with comfort in automating environment setup and reset tasks; solid understanding of REST APIs OAuth and webhook integrations.
5. Fluency with major enterprise SaaS platforms such as Slack Google Workspace or Microsoft 365; administrative experience in cloud workspaces is advantageous.
6. Experience leveraging AI assistants or agent tools in everyday developer tasks; any familiarity with agent tool-calling or the Model Context Protocol (MCP) is a plus.
7. Background in technical QA evaluation or data annotationdemonstrating consistency in applying rubrics and identifying nuanced edge cases.
8. Exceptional attention to detail disciplined adherence to defined processes and outstanding written and verbal communication in English.

How to apply

Apply here with your profile. We will then email you a link to complete your application on the hiring platform your application is only considered once that final step is done.