AI Evaluations Scientist, Biological AI Models

In this position you will:

• Design develop and execute national security-related evaluations of frontier biological AI models such as biological language models and biomolecular modeling and design tools.
• Adapt biological AI models for evaluation purposes.
• Curate relevant benchmarks and ground-truth datasets.
• Develop and refine scalable software workflows custom tooling and evaluation pipelines.
• Quantify uncertainty and statistical significance of evaluation results.
• Analyze biosecurity/national security implications of demonstrated model capabilities.
• Continuously adapt evaluation strategies to align with the state-of-the-art AI architectures and modalities.
• Collaborate with cross-functional teams of biology machine learning and policy subject matter experts.
• Communicate complex technical findings to technical and non-technical stakeholders.

Conditions of employment

• U.S. citizenship
• Males born aftermust be registered for Selective Service
• Suitable for Federal employment
• Completion of Confidential Financial Disclosure Form OGE-450
• Designated and/or random drug testing required
• Bargaining Unit Position: No

Qualifications

All applicants must submit a resume NOT TO EXCEED two pages on standard-size paper. If the resume exceeds two pages only the first two pages will be reviewed for qualifications or assessment determinations.

Basic Requirements: Experience must be IT related; the experience may be demonstrated by paid or unpaid experience and/or completion of specific intensive training (for example IT certification) as appropriate.

For all positions individuals must have IT-related experience demonstrating each of the four competencies listed below. The employing agency is responsible for identifying the specific level of proficiency required for each competency at each grade level based on the requirements of the position being filled.

1. Attention to Detail - Is thorough when performing work and conscientious about attending to detail.
2. Customer Service - Works with clients and customers (that is any individuals who use or receive the services or products that your work unit produces including the general public individuals who work in the agency other agencies or organizations outside the Government) to assess their needs provide information or assistance resolve their problems or satisfy their expectations; knows about available products and services; is committed to providing quality products and services.
3. Oral Communication - Expresses information (for example ideas or facts) to individuals or groups effectively taking into account the audience and nature of the information (for example technical sensitive controversial); makes clear and convincing oral presentations; listens to others attends to nonverbal cues and responds appropriately.
4. Problem Solving - Identifies problems; determines accuracy and relevance of information; uses sound judgment to generate and evaluate alternatives and to make recommendations.