Senior Psychometrician

• Operates with minimal supervision.
• Plans and prioritizes work independently.
• Contributes to complex projects and workflows and is recognized as a subject matter expert.
• Exercises independent judgement in applying policies and solving routine to moderately complex problems.
• Contributes to department initiatives with external influence.
• Delivers outcomes that have a direct impact on the organizations reputation and audiences.

• Designs and conducts practice analysis and competency modeling studies to identify and define the knowledge skills competencies and other requirements necessary for effective occupational therapy practice.
• Develops and validates competency frameworks and related models that support certification and assessment programs.
• Develops examination specifications and content outlines based on empirical practice analysis findings.

• Establishes passing standards using appropriate psychometric methods to support valid score interpretations and defensible classification decisions.
• Performs advanced psychometric and statistical analyses including Rasch calibrations DIF analyses equating scaling and other related methodologies to support assessment quality and fairness.
• Develops and implements scoring processes and algorithms and designs and generates score reports that provide meaningful feedback to test-takers and other relevant parties.

• Designs programs and implements AI-driven tools and solutions to support psychometric analysis exam development and operational efficiency across NBCOTs assessment programs.
• Researches develops and evaluates innovative item types and assessment methods to enhance the measurement of knowledge skills abilities and competencies relevant to occupational therapy practice.
• Explores emerging technologies and advances in assessment science to identify opportunities to strengthen NBCOTs assessment programs and measurement practices.

• Conducts psychometric research to improve assessment instruments and practices and to support evidence-based decision-making.
• Prepares technical documentation and reports by summarizing complex psychometric and statistical information and clearly communicates findings to technical and nontechnical audiences orally in writing and through data visualization.
• Designs programs and implements AI-driven tools and solutions to support psychometric analysis exam development and operational efficiency supporting NBCOTs assessment programs.
• Manages large datasets and databases to support psychometric analyses reporting and research while ensuring data integrity documentation and reproducibility.

• Provides psychometric consultation on the design development interpretation and use of assessments that measure the competencies of occupational therapy professionals.
• Works collaboratively with colleagues and provides education guidance and consultation to internal teams on measurement-related principles and practices to support valid and fair certification processes tools and decisions.
• Contributes expertise to professional organizations and participates in conferences mentoring emerging professionals and supporting initiatives that advance the field of psychometrics and certification.

• Doctoral degree in a field directly related to measurement assessment psychometrics statistics educational measurement quantitative psychology industrial-organizational psychology or similar along with 3 years of experience in a psychometrician role or equivalent is required.
• Strong knowledge of psychometric theory and fundamental concepts in measurement and assessment (e.g. validity reliability classical test theory item response theory).
• Knowledge of research methods including survey design data collection and interpretation of research findings.
• Applied experience conducting job/practice analyses standard-setting and statistical and psychometric analyses to support assessment development scoring and evaluation.
• Experience supporting certification licensure credentialing assessment programs is preferred.
• Experience with practice analysis studies standard-setting activities or exam development processes is preferred.
• Knowledge of machine learning and natural language processing is an asset.

• Demonstrates expert knowledge of statistical and productivity software such as R SPSS Winsteps and Microsoft Excel.
• Able to perform expert level tasks including advanced statistical and psychometric analysis conducting research studies and facilitating psychometric meetings.

• Communication
• Analytical and critical thinking
• Data analysis and interpretation
• Attention to detail
• Research and evidence-based decision making
• Psychometric judgment
• Problem solving
• Technical writing
• Adaptability and learning agility
• Autonomy and initiative
• Planning and organization
• Accountability
• Collaboration

• Work environment Remote
  • Candidates in the following locations are preferred:AR DC MD MI MO NC NY OH PA TN VA WV.
• Work schedule 35 hours per week (full-time)
• Travel expectations 5-10% domestic travel.
• Physical demands:
  • Sitting standing and walking frequently (2.5-5.5 hours/day)
  • Fine hand manipulation and grasping/handling (typing using small tools) frequently (2.5-5.5 hours/day)
  • Reaching above shoulder level rarely (not daily)
  • Bending stooping pushing pulling lifting and carrying up to 50 lbs. rarely (not daily)

Join Our Team

The National Board for Certification in Occupational Therapy Inc. (NBCOT) is a national not-for-profit organization that provides certification to over 180000 occupational therapy professionals. NBCOT develops administers and continually reviews its certification process based on current and valid standards that provide reliable indicators of competence of occupational therapy practice. Above all else our mission is to serve the public interest. Initial certification from NBCOT is a requirement for licensure in all 50 states the District of Columbia Guam and Puerto Rico. We also work with state regulators and employers to provide information on credentials professional conduct and regulatory issues. NBCOTs certification programs have received and maintained accreditation from the American National Standards Institute (ANSI) and the National Commission for Certifying Agencies (NCCA).

Mission: Serving the public interest by advancing client care and professional practice through evidence-based certification standards and the validation of knowledge essential for effective practice in occupational therapy.

Vision: Certified occupational therapy professionals providing effective evidence-based services across all areas of practice worldwide.

At NBCOT justice equity diversity and inclusion (JEDI) are an integral part of our mission and vision and having a diverse staff and inclusive workplace is one of the ways we put our values into action. We promote a culture where employees collaborate in an energizing environment while focusing on the high-quality work that makes us stand out in the certification industry.

We also believe that life-work balance is important and demonstrate this belief with a generous benefits package that includes:

• 35-hour work week
• over 30 paid days off each year
• paid medical insurance
• matched 401K plan and discretionary profit-sharing contributions
• annual bonus and salary adjustments
• covered life insurance and short-term and long-term disability
• voluntary benefits: vision term life critical illness accident and pet insurance

NBCOT is proud to be on The NonProfit Times list of The Best Nonprofits to Work For since 2014.