Psychometrician

About Kryterion
Kryterion proudly certified as a Great Place to Work is a leader in delivering secure reliable testing solutions worldwide. Our Psychometrics team is known for its responsiveness expertise and commitment to quality earning a consistent Net Promoter Score (NPS) of 100 from clients. We enable organizations to deliver valid reliable and fair assessments that allow individuals across the globe to earn life-changing credentials.

We are seeking a Psychometrician who thrives in both analytical and client-facing work brings expertise across all phases of test development and maintenance and has a passion for helping clients succeed.

Position Overview

As a Psychometrician at Kryterion you will:

• Partner directly with clients to design and maintain credentialing programs.
• Lead and conduct psychometric analyses that ensure exam validity reliability and fairness.
• Contribute to a collaborative high-performing team while working independently on key projects.

Key Responsibilities

• Conduct job task analyses including survey design data collection analysis and reporting.
• Develop test blueprints/specifications facilitating SME meetings to ensure alignment.
• Lead and support item development technical review workshops and training sessions with SMEs.
• Oversee and maintain item banks including item edits coding and enemy item identification.
• Perform exam and item analyses using both Classical Test Theory (CTT) and Item Response Theory (IRT); provide recommendations and review results with clients.
• Facilitate standard setting studies (e.g. Modified Angoff) analyze results and prepare recommendations.
• Conduct equating studies using CTT and demonstrate familiarity with IRT methodologies.
• Prepare technical reports (e.g. job task analyses standard setting psychometric analyses).
• Recommend and oversee test maintenance activities (e.g. test form revisions beta test item sets).
• Manage multiple projects creating timelines and ensuring delivery within scope schedule and budget.
• Communicate complex psychometric concepts to both technical and non-technical audiences.
• Provide support for accreditation applications (e.g. NCCA ANSI/ANAB).
• Represent Kryterion at industry conferences as a psychometric resource.

Qualifications

• Masters or Doctorate in Educational Measurement Educational Statistics Industrial/Organizational Psychology or a related field.
• Minimum 3 years of experience in the certification/licensure testing industry.
• Strong analytical and problem-solving skills with proven expertise in psychometrics.
• Proficiency in SPSS (experience with R Winsteps or other statistical software is a plus).
• Advanced skills in Microsoft Excel and Word.
• Excellent oral and written communication skills.
• Strong project management and time management abilities.
• Exceptional attention to detail and commitment to accuracy.
• Ability to work independently with minimal supervision.
• Willingness to travel up to 2025% including some weekends for client workshops.

Our Values

At Kryterion our culture is driven by collaboration accountability and continuous improvement. We live our values every day:

• We Own It
• We Are One Team
• We Listen and Learn From Each Other
• We Face Challenges with Optimism
• We Continuously Improve
• We Build Trust
• We Help Our Customers Succeed

What We Offer

• Competitive salary commensurate with experience.
• Comprehensive benefits package including medical dental vision life insurance short- and long-term disability and 401(k) with company match.
• Generous PTO and holiday pay.
• A people-centered culture that supports learning growth and career development.

Additional Information

• Applicants must be authorized to work in the U.S. without sponsorship.
• We are an Equal Opportunity Employer committed to building a diverse and inclusive workplace.