Evaluation Associate

Position Summary

The Data and Evaluation Associates primary responsibilities are to: 1) prepare regular reports on key programs to for program leaders and administrators; 2) support the design of rigorous mixed methods program and agency evaluations (integrating qualitative and quantitative data); 3) help design and administer program evaluation tools that measure program compliance and quality; 4) monitor programs quality and compliance; 5) analyze administrative compliance and quality data; 6) design test and administer stakeholder surveys. The Associate will divide their time equally between PMT. where they will be supervised by a Data and Evaluation Manager and the Mayors Office of Education (MOE) where they will work on-site with program staff.

Essential Functions

1) Support the design and implementation of research and evaluation projects that advance program and system performance improvements for Adult Education Extended Day Extended Year and other MOE programs.

2) Clean manage and integrate data from key system sources to produce short and long-term outcome analyses. Key data sources include but are not limited to case file reviews program narratives program observations surveys and administrative data on enrollment attendance invoicing activities and outcomes.

3) Prepare and submit quarterly MOE data reports for internal and public audiences.

4) Generate graphs tables and other data visuals.

5) Assist in survey design administration and analysis.

6) Automate regular data reporting of administrative compliance and quality data.

7) Monitor contract compliance by coding and maintaining provider-specific automated monthly reports.

8) Craft novel exploratory reports of learning achievement and demographic data to support the conception and articulation of MOEs network-wide strategies.

9) Support Adult Education (AEPHL) Continuous Quality Improvement (CQ) process.

a. Monitor and support the collection Of program evaluation data using CQI tools across the AEPHL network of adult education providers. 

b. Clean analyze and disseminate provider-level CQI data for AEPHL network partners.

c. Analyze CQ and evaluation data in aggregate to communicate trends in program improvement to all MOE and AEPHL stakeholders.

10) Support the strategic planning facilitation and day-to-day management of the Continuous Program Improvement Collaborative (CPIC) a yearlong professional development initiative that equips adult education providers to collect monitor and analyze data to inform continuous program improvement and decision-making.

11) Ensure transparency and accountability in service provider communications through consistent external reporting and the solicitation of provider stakeholder input and feedback.

12) Advise teammates on measurement and evaluation processes including formulating research questions planning the scope of evaluation and developing feedback cycles between data collection and data analysis.

13) Develop written reports and presentations for a variety of audiences using clear concise language.

14) Perform related research and evaluation duties as assigned.

15) Work collaboratively with PMT team members to ensure quality implementation of performance management activities and processes.

16) Ensure data project requirements are achieved in a timely fashion.

17) Other duties as assigned.

Competencies Knowledge Skills and Abilities

Quantitative:

Knowledge of statistical and survey software such as R STATA SPSS and Qualtrics.

Knowledge of basic statistics including descriptive exploratory and inferential statistics.

Prior experience creating basic data visualizations such as charts and tables.

Knowledge of survey design programming and administration.

General:

Knowledge of program evaluation and outcomes measurement.

Strong research analysis and writing skills. Clear and concise communication of ideas program scopes and findings orally and in writing.

Ability to problem solve and identify several courses of action to make informed decisions about project development and implementation.

Ability to maintain strong working relationships with coworkers leadership AEPHL staff and service providers.

Ability to work on multiple projects at once while still meeting project deadlines.

Ability to quickly pivot to emergent tasks and project needs.

Knowledge of Microsoft Office Suite including data analysis tools like Excel and/or Open-Source tools.

Demonstrate knowledge of and experience with mixed methods research design and data analyses.

Demonstrate experience with leading multiple simultaneous data projects and with delivering such projects by the agreed deadline.

Know personal strengths weaknesses opportunities and limits.

Reflective and seeks feedback.

Exceptional cultural competency and proficiency.

Qualifications :

Qualitative:

Ability to support evaluation and monitoring tool development including conducting literature reviews for existing tools and using stakeholder input to update existing tools

Prior experience conducting interviews focus groups and observations

Prior experience analyzing qualitative data including coding interviews focus groups and observations and conducting document reviews

Quantitative:

Knowledge of statistical and survey software such as R STATA or python

Knowledge of basic statistics including descriptive exploratory and inferential statistics.

Prior experience creating basic data visualizations such as charts and tables.

Knowledge of survey design programming and administration including platforms such as Qualtrics or Cognito

General:

Knowledge of program evaluation and outcomes measurement

 Strong research analysis and writing skills

 Clear and concise communication of ideas program scopes and findings orally and in writing Ability to problem solve and identify several courses of action to make informed decisions about project development and implementation

Ability to maintain strong working relationships with coworkers OCF leadership and service providers

Ability to work on multiple projects at once while still meeting project deadlines

Ability to quickly pivot to emergent tasks and project needs

Knowledge of Microsoft Office Suite including data analysis tools like Excel and/or Open Source tools

Experience with shortand long-term research design and analysis and the delivery of research products for lay/practitioner audiences.

• Bachelors Degree in Social Policy Government Administration and/or other relevant Social Science
• At least 2 years of data analytics and cleaning programming research and evaluation design and/or other related experience
• Existing knowledge of adult education policies and best practices strongly preferred

Additional Information :

TO APPLY: Interested candidates must submit a cover letter resume and references.

Salary Range: $63000 - $75000

Discover the Perks of Being a City of Philadelphia Employee:

• Transportation: City employees get unlimited FREE public transportation all year long through SEPTAs Key Advantage program. Employees can ride on SEPTA buses subways trolleys and regional rail for their daily commute and more.
• Parental Benefits: The City offers its employees 8 weeks of paid parental leave.
• We offer Comprehensive health coverage for employees and their eligible dependents.
• Our wellness program offers eligibility into the discounted medical plan
• Employees receive paid vacation sick leave and holidays
• Generous retirement savings options are available
• Pay off your student loans faster - As a qualifying employer City of Philadelphia employees are eligible to participate in the Public Service Loan Forgiveness program. Join the ranks of hundreds of employees who have already benefited from this program and achieved student loan forgiveness.
• Unlock Tuition Discounts and Scholarships - The City of Philadelphia has forged partnerships with over a dozen esteemed colleges and universities in the area ensuring that our employees have access to a wide range of tuition discounts and scholarships. Experience savings of 10% to 40% on your educational expenses extending not only to City employees but in some cases spouse and dependents too!

Join the City of Philadelphia team today and seize these incredible benefits designed to enhance your financial well-being and personal growth!

*The successful candidate must be a city of Philadelphia resident within six months of hire

Effective May 22 2023 vaccinations are no longer required for new employees that work in non-medical non-emergency or patient facing positions with the City of Philadelphia. As a result only employees in positions providing services that are patient-facing medical care (ex: Nurses doctors emergency medical personnel) must be fully vaccinated.

The City of Philadelphia is an Equal Opportunity employer and does not permit discrimination based on race ethnicity color sex sexual orientation gender identity religion national origin ancestry age disability marital status source of income familial status genetic information or domestic or sexual violence victim status. If you believe you were discriminated against call the Philadelphia Commission on Human Relations at or send an email to

For more information go to: Human Relations Website: Work :

No

Employment Type :

Full-time