Program Evaluator-IT537902

Salary Range $75k85k

JOB SUMMARY:

The Program Evaluator supports the Quality Improvement & Impact departments mission to empower program staff with datadriven insights that improve service delivery and client outcomes. The Program Evaluator will collaborate with frontline program staff program and agency leadership as well as directly with service recipients on the design and technical implementation of internal monitoring and evaluation projects that assess the efficacy and impact of ICLs direct service programs. Evaluation projects include logic modelling exercises process evaluations and outcome evaluations to answer critical questions about program effectiveness and inform program planning. The Program Evaluator will work closely with the Data Analytics team within the QII department to integrate findings from evaluation activities into program metrics monitoring reports and dashboards.

ESSENTIAL JOB FUNCTIONS:

• Collaborate with program staff and leadership to develop and refine program logic models that will inform the development of outcome metrics and performance dashboards.
• Design and implement comprehensive program evaluation projects under the leadership of the Senior Vice President for Quality Improvement & Impact including developing evaluation plans data collection instruments (e.g. surveys indepth interview and focus group protocols) and analysis plans.
• Conduct process evaluations to assess program implementation fidelity and identify areas for improvement.
• Conduct outcome evaluations to measure the impact of programs on service recipients as well as populationlevel and/or systemwide effects using appropriate statistical methods and software (e.g. R SPSS STATA) and sourcing external datasets from governmental or other institutional partners as appropriate (e.g. NYC OpenData).
• Analyze qualitative and quantitative data interpret findings and support internal presentations reports and white papers for broader dissemination and sharing across internal/external stakeholder groups.
• Contribute to discussions among program and agency leadership on utilization of evaluation findings to inform program planning resource allocation and strategic decisionmaking.
• Support presentations of evaluation findings to internal and external stakeholders including preparing and delivering presentations at sector conferences meetings and in panel discussions.
• Collaborate with the Data Analytics team to integrate evaluation findings into ongoing program monitoring reports dashboards and performance metrics.
• Support reporting for grantfunded programs requiring evaluation support including development of evaluation plans monitoring infrastructure and appraisals on program outcomes at designated intervals.
• Other duties and tasks as assigned to support the work of the Quality Improvement & Impact department.

ESSENTIAL KNOWLEDGE SKILLS AND ABILITIES:

• Deep understanding of program evaluation methodologies including both quantitative and qualitative approaches.
• Proficiency in the use of statistical software packages to analyze both qualitative and quantitative data (e.g. SPSS R STATA NVivo Python)
• Excellent written and verbal communication skills with the ability to tailor communication to different audiences.
• Attention to detail with exceptional organization and project management skills.
• Strong interpersonal skills and ability to build rapport with diverse stakeholders including program staff service recipients and organizational leadership

QUALIFICATIONS AND EXPERIENCE:

• Masters degree in a relevant field (e.g. Public Health Public Policy Public Administration Statistics Biostatistics Social Sciences). Strong candidates with a BA/BS and a minimum of four years experience in program evaluation in support of health & human services nonprofits will be considered.
• Experience working with program staff in a direct service environment preferably in a nonprofit or human services setting or related social science or policy research experience.
• Demonstrated experience with program evaluation projects (incl. process and outcome evaluations) and developing logic models/theories of change.
• Strong knowledge and technical skills of statistical analysis techniques querying languages and supportive computer software packages (e.g. R SPSS or Python).
• Experience with data visualization information design and/or workflow design.