Research Scientist II AMZ9698004

MULTIPLE POSITIONS AVAILABLE

Employer: AMAZON WEB SERVICES INC.
Offered Position: Research Scientist II
Job Location: Seattle Washington
Job Number: AMZ9698004

Position Responsibilities:

Perform and support the main psychometric aspects of exam development and operations including but not limited to automated test assembly item and test analyses optimal item bank design job task analysis standard setting quality assurance and project planning. Conduct main aspects of psychometric analysis in operational work including performing item analysis using psychometric methods building optimal test forms and pools via optimization techniques analyzing and monitoring item bank health setting pass standards via standard setting studies and supporting Job Task Analysis (JTA) to define and refresh test blueprints. Conduct main aspects of psychometric analysis in developing and applying statistical and psychometric modeling to evaluate and ensure AWS certification exams validity reliability applicability efficiency and accuracy. Participate in research projects to improve existing operational processes and quality using advanced techniques such as Machine Learning (ML) statistical modeling Natural Language Processing (NLP) Generative Artificial Intelligence (GenAI) etc. Develop automation code using R or Python for psychometric workflow pipeline and other tasks to improve operational efficiencies. Present interpret and communicate the results of analyses to stakeholders through written and oral reports. Follow the accreditation standards set by ISO/IEC: and the National Council for Certifying Agencies (NCCA) as they relate to valid psychometric practices. Engage with the professional community through conferences and publications.

Position Requirements:

PhD or foreign equivalent degree in Statistics Psychometrics Educational Measurement Quantitative Psychology Data Science Industrial-Organizational (I/O) Psychology or a related field and one year of research or work experience in the job offered or as a Research Scientist Research Assistant Software Engineer or a related occupation. Must have 1 year of experience in the following skill(s): 1. large-scale education licensure or certification assessment programs. 2. operational psychometric tasks on large-scale education licensure or certification assessment programs including item analysis equating and scaling item response theory classical test theory form and pool assembly item bank health analysis standard setting and job task analysis. 3. at least one of the complex test designs such as linear-on-the-fly testing (LOFT) computerized adaptive testing (CAT). 4. at least one of the following areas including machine learning (ML) or natural language processing (NLP). 5. Programming skills in at least one script-based programming language (R Python).

is an Equal Opportunity-Affirmative Action Employer Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation.

40 hours / week 8:00am-5:00pm Salary Range $136000/year to $184000/ year.

Amazon is a total compensation company. Dependent on the position offered equity sign-on payments and other forms of compensation may be provided as part of a total compensation package in addition to a full range of medical financial and/or other benefits. For more information visit:
Requirements:

PhD or foreign equivalent degree in Statistics Psychometrics Educational Measurement Quantitative Psychology Data Science Industrial-Organizational (I/O) Psychology or a related field and one year of research or work experience in the job offered or as a Research Scientist Research Assistant Software Engineer or a related occupation. Must have 1 year of experience in the following skill(s): 1. large-scale education licensure or certification assessment programs. 2. operational psychometric tasks on large-scale education licensure or certification assessment programs including item analysis equating and scaling item response theory classical test theory form and pool assembly item bank health analysis standard setting and job task analysis. 3. at least one of the complex test designs such as linear-on-the-fly testing (LOFT) computerized adaptive testing (CAT). 4. at least one of the following areas including machine learning (ML) or natural language processing (NLP). 5. Programming skills in at least one script-based programming language (R Python).#0000

Please see job description and the position requirements above.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.