Post Doctoral Researcher, Evaluation & Standards in Clinical Operations

At Johnson & Johnsonwe believe health is everything. Our strength in healthcare innovation empowers us to build aworld where complex diseases are prevented treated and curedwhere treatments are smarter and less invasive andsolutions are our expertise in Innovative Medicine and MedTech we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow and profoundly impact health for more at .

As guided by Our Credo Johnson & Johnson is responsible to our employees who work with us throughout the world. We provide an inclusive work environment where each person is considered as an individual. At Johnson & Johnson we respect the diversity and dignity of our employees and recognize their merit.

Job Function:

Career Programs

Job Sub Function:

Post Doc Data Analytics & Computational Sciences

Job Category:

Career Program

All Job Posting Locations:

Barcelona Spain Beerse Antwerp Belgium High Wycombe Buckinghamshire United Kingdom Madrid Spain Raritan New Jersey United States of America Titusville New Jersey United States of America Toledo Spain Zug Switzerland

Job Description:

We are deploying generative AI agents across clinical operations and global development workflows: clinical data review anomaly detection in trial data protocol Q&A for site teams Informed Consent Form generation and translation and protocol element document assembly.

Each system needs rigorous specialized clinical contexts good is not a single number. It depends on the user the regulatory context the therapeutic area and the cost profile of errors. We are looking for a postdoctoral researcher to help us develop the evaluation frameworks rubrics and quality systems that determine when these AI agents are ready for our scientists clinical operations specialists and site teams to rely on.

• Develop evaluation frameworks and rubrics for AI agents operating in clinical operations and global development contexts
• Define quality dimensions for specialized outputs e.g. clinical data queries anomaly detection protocol Q&A responses ICF content regulatory documents that reflect how clinical-ops users actually judge quality
• Design and run human evaluation protocols with clinical regulatory and site-facing subject matter experts
• Build benchmark datasets and evaluation pipelines that the broader GenAI organization uses across AI applications
• Partner with our AI engineering teams to translate evaluation findings into measurable improvement
• Contribute to the methodology of how a regulated pharma organization evaluates AI in clinical work

Domain expertise

• Strong understanding of clinical operations and global development workflows e.g. clinical data management monitoring regulatory documentation site operations or related areas
• Familiarity with how clinical-ops specialists monitors regulatory authors and site teams actually do their work and assess quality
• PhD or equivalent research experience in a clinical biomedical regulatory biostatistics or closely related field

Enthusiasm for AI agents

• Genuine interest in working hands-on with generative AI and agentic systems
• Curiosity about how LLMs behave in specialized domains and where they fail
• Comfort prototyping with modern AI tooling (LLM APIs vector databases evaluation frameworks)

Aptitude for evaluation systems

• Demonstrated ability to develop frameworks rubrics and structured assessment protocols
• Experience designing evaluations with multiple quality dimensions expert raters or non-trivial inter-rater reliability considerations
• Strong analytical and writing skills; comfort with ambiguity and unsolved problems

Practical skills

• Python and the modern ML/data stack
• Comfort working across disciplines e.g. clinical operations regulatory affairs AI engineering data science

• Duration: 2-year postdoctoral appointment
• Reports to: TBD

Works closely with: Generative AI Teams Scientific Fellow clinical operations and regulatory subject matter experts across J&J global development

Required Skills:

Preferred Skills:

The anticipated pay range for this position in the primary posting location is:

60.00000 - 96.25500

The anticipated pay ranges for additional locations are:

The anticipated base pay range for this position in UK is GBP 40.100 to GBP 63.595
The anticipated base pay range for this position in SWITZERLAND is CHF 93.500 to CHF 149.615
The anticipated base pay range for this position in USA is USD 79.000 to USD 127.650
The anticipated base pay range for this position in SPAIN is EUR 43.600 to EUR 70.150

Benefits:

In addition to base pay we offer the following benefits*: an annual bonus with set target (% of pay) depending on pay grade / location where the actual amount is based on the employees and companies performance of the previous calendar year or sales commissions. Moreover we offer vacation days parental leave for a minimum of 12 weeks bereavement leave caregiver leave volunteer leave well-being reimbursement programs for financial physical and mental health. We also offer service anniversary and recognition awards and subject to the terms of their respective plans employees - and in some locations eligible dependents - can participate in several insurance plans. For more information visit Employee benefits Supporting well-being & career growth Johnson & Johnson Careers.

*This is for informative purposes only. Amounts and actual benefits may vary by location and are subject to change.