Work Schedule

Environmental Conditions

Job Description

Qualifications:

Education and Experience:

Bachelors degree or equivalent and relevant formal academic / vocational qualification

Masters degree preferred

Previous experience that provides the knowledge skills and abilities to perform the job (minimum

2 years).

In some cases an equivalency consisting of a combination of appropriate education training.

and/or directly related experience will be considered sufficient for an individual to meet the

requirements of the role.

Knowledge Skills and Abilities:

• Veeva AI & SaaS AI Evaluation
  • Ability to evaluate vendor-provided AI capabilities (specifically Veeva AI) where model internals are not directly accessible.
  • Experience assessing AI behavior for quality consistency failure modes latency and operational constraints in enterprise workflows.
  • Ability to distinguish when a SaaS AI capability should be adopted as-is adapted with platform guardrails or rejected in favor of a custom internal solution.
• Generative AI Systems Understanding
  • Strong understanding of generative AI behavior including non-determinism hallucination risk prompt sensitivity and configuration-driven outcomes.
  • Experience applying lightweight evaluation techniques for generative AI (e.g. task-specific test cases accuracy checks hallucination tracking refusal behavior).
  • Ability to reason about AI suitability in regulated or high-impact decision contexts.
• AI Evaluation Validation and Documentation
  • Proficiency in documenting AI evaluations in clear audit-ready formats including data flows decision points risks and mitigations.
  • Ability to partner with AI governance functions to support model cards validation summaries and AI registry or approval artifacts.
  • Experience supporting audit and compliance reviews through evidence collection (logs configurations access controls).
• Platform Integration & AI Guardrails
  • Ability to integrate SaaS AI capabilities into enterprise platforms using approved architectural patterns.
  • Experience designing and implementing integration shims such as additional logging input/output filtering workflow controls or human-in-the-loop steps.
  • Understanding of AI telemetry requirements including latency error handling usage tracking and cost observability.
• Technical Proficiency
  • Strong proficiency in Python and modern SQL for integration analysis and validation tasks.
  • Experience working with REST APIs SaaS integrations and enterprise authentication and authorization patterns.
  • Familiarity with Databricks concepts (jobs notebooks MLflow) and cloud data storage patterns (e.g. Azure Blob or S3-equivalent).
• Operating in Regulated Environments
  • Experience working within regulated validated or compliance-driven environments (e.g. clinical research life sciences healthcare).
  • Ability to operate within defined separation of duties across build review and operate phases.
  • Comfort working in documentation-first and control-oriented delivery models.
• Collaboration and Ways of Working
  • Proven ability to work effectively in a multi-functional matrixed environment across Product Platform Engineering AI Governance and external vendors.
  • Strong written and verbal communication skills with the ability to explain technical AI behavior and risks to non-technical stakeholders.
  • Ability to manage multiple concurrent evaluations and priorities in the context of evolving vendor roadmaps and business needs.

Management Role:

No management responsibility

Working Conditions and Environment:

• Work is performed in an office environment with exposure to electrical office equipment.
• Occasional drives to site locations with occasional travel both domestic and international.

Physical Requirements:

• Frequently stationary for 6-8 hours per day.
• Repetitive hand movement of both hands with the ability to make fast simple repeated movements

• of the fingers hands and wrists.
• Frequent mobility required.
• Occasional crouching stooping bending and twisting of upper body and neck.
• Light to moderate lifting and carrying (or otherwise moves) objects including luggage and laptop
• computer with a maximum lift of 15-20 lbs.
• Ability to access and use a variety of computer software developed both in-house and off-the-shelf.
• Ability to communicate information and ideas so others will understand; with the ability to listen to
• and understand information and ideas presented through spoken words and sentences.
• Frequently interacts with others to obtain or relate information to diverse groups.
• Works independently with little guidance or reliance on oral or written instructions and plans work
• schedules to meet goals. Requires multiple periods of intense concentration.
• Performs a wide range of variable tasks as dictated by variable demands and changing conditions
• with little predictability as to the occurrence. Ability to perform under stress. Ability to multitask.
• Regular and consistent attendance.

Percent Billable:

0% - 20%