Psychometrician

Term: Temporary Full-Time (ending Jan 2028)
Work Location: Hybrid Vancouver B.C. (a combination of in-office and remote work)

Who we are

Inspire Global Assessments (Inspire) formally known as the Nursing Community Assessment Services (NCAS) is a branded service of the BC College of Nurses and Midwives. Were working with nursing regulators and governments across the country to address the acute nursing shortage. Inspire is a unique assessment service that supports the transition of internationally educated health care professionals into the global work force.

The British Columbia College of Nurses & Midwives (BCCNM) is the college empowered under the Health Professions Act to regulate the practice of all licensed practical nurses nurse practitioners registered midwives registered nurses andregistered psychiatric nurses in British Columbia. Regulation helps to protect the public by ensuring that professional care or service received by the public is competent ethical and meets the standards that society views as acceptable.

As western Canadas largest health profession regulator we believe a diverse and inclusive team enriches our efforts to protect the public. We welcome applications from all who reflect of the communities we serve and especially encourage Indigenous Peoples and members of equity-seeking groups to apply. We believe diverse perspectives and experiences bring both innovation and better outcomes to the work we do and the decisions we make.

BCCNMs commitment to Indigenous Specific Anti-Racism

BCCNM is committed to working with Indigenous Peoples and health system partners to support Indigenous-specific anti-racist practices in the health system. As the largest health regulator in Western Canada BCCNM has the opportunity to influence the health professionals we regulate as well as the broader health-care system to break the cycle of racism and improve health outcomes for Indigenous Peoples. BCCNM has pledged to become culturally safe and anti-racist and to support the health professionals we regulate to do the same.

What we offer you

We promise to provide you with rewarding work that challenges you. You will be part of a passionate team contributing to our important mandate of protecting the public. As a member of the team you can expect to be working in a collaborative team-based environment and treated in a respectful and professional manner.

The expected starting base salary for this position is $75000 - $85000 annually depending on a variety of factors including qualifications and experience.

What youll be doing:

Reporting to the Executive Director Inspire Global Assessments the Psychometrician supports the Inspire Global Assessment (INSPIRE) ongoing and future assessment activities. This position focuses on transforming the assessment delivery model into a fully virtual AI-integrated platform. The psychometrician will play a key role in shaping the future of competency-based assessments through psychometric design data analytics and innovative test methodologies.

Key responsibilities:

Virtual AI-Integrated Platform Responsibilities:

As a core contributor to the development of Inspires virtual performance-based assessment tool the Psychometrician is responsible for:

1. Leads psychometric design and analysis for immersive virtual assessments including the development of scoring frameworks indicator mapping validation models and standard setting plans.
2. Serve as the Subject Matter Expert (SME) on scoring methodology ensuring alignment with psychometric best practices and assessment goals.
3. Develop and maintaining foundational evaluation tools
4. Collaborate with technology teams and vendors to ensure appropriate data structures AI-enhanced scoring methods and integration of computational psychometrics.
5. Conduct applied research and environmental scanning to support product innovation and inform decision-making.
6. Contribute to the design and refinement of quality assurance procedures including documentation data validation and evaluation protocols.
7. Support product lifecycle activities including scenario review scoring logic alignment pilot evaluation and data reporting.
8. Facilitate vendor collaboration and providing psychometric oversight to maintain assessment fidelity and fairness.
9. Contribute to cross-functional discussions on product strategy technical feasibility and long-term innovation opportunities.

Operational Program Responsibilities

In addition to leading the virtual platform initiative the Psychometrician supports Inspires ongoing operational programs:

• Conduct classical test theory (CTT) and item response theory (IRT) analyses to support item and test-level evaluation.
• Perform item analysis reliability and validity studies equating and scoring evaluations for written and performance-based assessments.
• Support the design and facilitation of standard setting item writing and field-testing sessions in collaboration with the Assessment Developer.
• Develop psychometric documentation technical reports and quality assurance protocols to support transparency and decision-making.
• Manage data pipelines including data extraction cleaning transformation and preparation for analysis and reporting.

Qualifications:

• Masters degree in Measurement and Evaluation Quantitative Methods Educational Psychology or a closely related quantitative field; a Ph.D. is preferred. A combination of education and relevant experience may be considered.
• Minimum of 35 years of experience in psychometric analysis preferably within high-stakes testing certification or licensure assessment environments.
• Advanced knowledge of psychometric theories and statistical modeling techniques including Classical Test Theory (CTT) Item Response Theory (IRT) Generalizability Theory (G-Theory) Structural Equation Modeling (SEM) and Hierarchical Linear Modeling (HLM).
• Proficiency in designing and conducting statistical analyses simulations and psychometric research including the generation of performance reports and technical documentation.
• Demonstrated ability to write and modify code using statistical software such as R and Python (FlexMIRT preferred); experience with SAS SPSS Mplus Winsteps BILOG and/or PARSCALE is considered an asset. Experience with SQL for database querying is also desirable.
• Familiarity with virtual assessment platforms and AI/NLP-enhanced scoring applications is a strong asset.
• Working knowledge of generative AI (prompt engineering) and natural language processing to support assessment innovation and automation.
• Strong written and verbal communication skills with demonstrated ability to translate technical concepts for diverse audiences.
• Proven experience in stakeholder engagement including collaboration with internal teams vendors regulators and subject matter experts; facilitation of advisory or working group discussions is an asset.
• Demonstrated project management skills including the ability to develop analytic plans track deliverables and manage timelines in complex multi-stakeholder environments.
• Strong organizational and problem-solving skills with a demonstrated ability to work independently and collaboratively in a fast-paced evolving environment.
• Awareness of the historical and ongoing impacts of colonization on Indigenous peoples in Canada and familiarity with key reports and frameworks such as the Truth and Reconciliation Commissions 94 Calls to Action (2015) In Plain Sight (2020) and Reclaiming Power and Place (2019) is considered an asset.
• Demonstrated understanding of equity diversity inclusion and cultural humility particularly as they apply to assessment health care and regulatory practices.

How to Apply

If you are interested in this position please apply online by July 16 2025. This opportunity will remain posted until filled; however priority consideration will be given to those who apply by the deadline. To see a full list of our current opportunities or to learn more about working at the BC College of Nurses & Midwives please visit our website atCareers at BCCNM.

Collection Notice

To apply to a job posting you need to create an online account with BCCNM. To create an online account as well apply for a job posting youll be asked to provide personal information.

The BC College of Nurses and Midwives (BCCNM) collects your personal information for the purposes of creating your online account as well as for recruiting evaluating and selecting employees. The legal authority for collecting this information is under section 26 British Columbias Freedom of Information and Protection of Privacy Act. If you have any questions please contact .

Please note:BCCNM no longer requires staff contractors board and committee members and volunteers to provide an attestation of vaccination related to the Covid-19 pandemic.

In the event of a Public Health Order being issued the College is committed to full compliance with all directives and guidelines set forth by the Provincial Health Officer (PHO) to ensure the safety and well-being of our employees and the community partners we work with consistent with the duty of the College to serve and protect the public.