Research Analyst, USAFA

Summary:
Yorktown Systems Group Inc. (YSG) is seeking a highly qualified Research Analyst to provide comprehensive Warfighter Training Support Services at the United States Air Force Academy (USAFA). The purpose of this position is to support the planning development execution management and evaluation of military training for approximately 4200 cadets annually during both the academic year and summer training programs. This position will assist the USAFA in delivering a coherent progressive and operationally relevant 47-month cumulative military training continuum aligned with Department of the Air Force (DAF) readiness objectives Joint Force expectations and USAFA cadet development outcomes.

Specific duties may include but are not limited to:

• Convert execution findings into future planning inputs
• Aggregate and analyze performance data across events cohorts and training cycles within the Moodle/TUTOR VSP to identify trends systemic strengths and recurring performance gaps.
• Collaborate with USAFA stakeholders instructional designers and evaluation team members to support data collection activities evaluation requirements and performance measurement efforts.
• Collect document and organize observations rubric results AAR inputs instructor feedback participant performance data and lessons learned from training events.
• Collectively execute all program evaluation activities across the WTIS framework.
• Apply Kirkpatricks four-level training evaluation model within a repeatable process that integrates assessment tool development disciplined data capture structured AAR consolidation and performance analysis within the required environment and tools.
• Define and maintain the data structure and workflows required to capture store and export evaluation data in a manner that supports consistent analysis.
• Conducts analytical review of existing and available Program of Instruction (POI) courseware lesson materials exercise scenarios training schedules TLOs ELOs primary tasks and objectives evaluation criteria recurring training events historical planning products and after-action inputs.
• Analyze assessment data and evaluation findings to support dashboard reporting program assessments trend analysis and recommendations for continuous improvement.
• Assist with the development and administration of surveys questionnaires focus groups interviews and other data collection instruments.
• Collect clean validate and manage quantitative and qualitative data from multiple sources.
• Conduct statistical analyses and qualitative assessments to identify trends effectiveness measures and performance gaps.
• Support development of evaluation plans logic models measures of effectiveness (MOEs) and measures of performance (MOPs).
• Prepare reports dashboards data visualizations and briefing materials for USAFA leadership and stakeholders.
• Conduct literature reviews background research and document analysis to support evaluation efforts.
• Assist in consolidating and analyzing AAR results rubric scores and participant feedback.

Required Qualifications:

• Bachelor degree in Program Evaluation Education Statistics Social Science Research Methods Organizational Development or a related field.
• (Preferred) Training/certification in evaluation methodologies (e.g. ROI institute Kirkpatrick).
• Experience supporting assessment frameworks AAR methodology rubric development data analysis trend reporting and presentation of findings to stakeholders.
• Experience evaluating programs/projects; creation of evaluation plans and logic models; developing data collection tools and procedures; facilitating data collection; conducting statistical analysis of data; writing evaluation reports and providing statistical analysis of programs of similar scale and duration.
• Possess an in-depth and current understanding of program evaluation including the four major categories of standards (propriety utility feasibility and accuracy) when conducting a program evaluation.
• Ability to evaluate the implementation and effectiveness of key initiatives and programs through the use of quantitative and qualitative research methods and to provide results that inform policymakers and stakeholders decisions regarding program viability and improvement.
• Ability to collect organize analyze and interpret quantitative and qualitative data from multiple sources.
• Possess an in-depth and current understanding of research and evaluation methods and techniques.
• Experience evaluating military training leadership development education human performance organizational effectiveness or related programs is highly desired.

Clearance: Must be able to obtain a SECRET security clearance.

Location: Colorado Springs CO / Remote

Travel: Some travel will be required