Consultant Endline Study and Final Evaluation CBCCA
OBJECTIVES
To conduct an endline evaluation of the Community-Based Climate Change Adaptation (CBCCA) Programme in accordance with the OECD-DAC evaluation criteria by comparing endline findings with baseline results and generating evidence-based conclusions and lessons to inform accountability learning and future programming.
a) To assess changes in the projects indicators including beneficiaries knowledge attitudes and practices related to climate change across baseline midline and endline phases. This includes the use of climate and weather information adaptive behaviours community-led climate actions and perceptions of climate adaptation policies at village sub-district and district levels.
b) To examine the relevance and coherence of the programme in relation to the needs and priorities of target communities and schools including alignment with local and national climate adaptation frameworks and consistency with other interventions by Save the Children government entities and relevant actors.
c) To assess the effectiveness and efficiency of programme implementation in achieving intended outcomes including timeliness partner coordination resource utilization and perceived appropriateness of programme services across different population groups.
d) To evaluate programme reach inclusion and beneficiary satisfaction with particular attention to children women and other vulnerable or marginalized groups including gender sensitivity across programme design implementation and outcomes.
e) To assess the programmes contribution to changes in climate resilience at community and school levels including intended and unintended effects and key mechanisms influencing results.
f) To assess the sustainability and potential for scale-up of the programme by examining the likelihood that results and capacities will be sustained beyond the project period and identifying conditions that enable replication or expansion.
METHODOLOGY
1. Research Design and Sampling
The endline evaluation will use a mixed-methods approach combining quantitative and qualitative methods to assess programme performance against OECD-DAC evaluation criteria. Quantitative methods will measure changes over time while qualitative methods will explore implementation processes contextual factors and beneficiary experiences. Endline findings will be compared with baseline and midline data to assess progress and trends.
Quantitative data collection will focus on Knowledge Attitude and Practice (KAP) related to climate change adaptation using structured questionnaires. Qualitative methods will be used to assess aspects not captured through surveys including relevance coherence efficiency inclusion impact pathways and sustainability. Data triangulation will be applied to strengthen the validity of findings.
2. Study Area
The study will be conducted in Bandung District West Java covering 10 villages across three sub-districts: Baleendah Ibun and Rancaekek. These areas are vulnerable to hydrometeorological disasters particularly flooding and are the implementation locations of the CBCCA programme.
3. Quantitative Survey
Cluster and purposive sampling will be applied targeting programme beneficiaries in the 10 project villages. With a population of 6592 a 5% margin of error and a 95% confidence level the sample size is 364 rounded to 400 respondents to ensure comparability with baseline and midline studies. Target groups include village apparatus/champions farmer groups community members and students with gender balance and inclusion of vulnerable groups ensured.
4. Data Collection Tools and Analysis
Data will be collected using a digital questionnaire through Kobo Toolkit covering socio-demographic characteristics and KAP related to climate change adaptation. The questionnaire will piloted and validated by Save the Children Indonesia.
Quantitative data will be analysed using statistical software (SPSS) applying descriptive statistics and Chi-Square tests with a significance level of p 0.05. Qualitative data will be collected through FGDs and KIIs with community members teachers programme staff and district-level stakeholders and analysed thematically. Final details will be confirmed in the inception report.
EXPECTED ACTIVITIES AND DELIVERABLES
The evaluation deliverables and indicative timelines (subject to the evaluation commencement date) are outlined below. The Endline Team Lead will promptly inform the CBCCA Project Manager and REALM Coordinator of any risks or issues that may affect timely delivery.
Expected deliverables of the Evaluation Consultant:
REPORTING AND GOVERNANCE
The Endline evaluation will be overseen by a Steering Committee that holds final decision-making authority on key aspects of the evaluation including scope methodology analysis and reporting. The Committee will review and approve all major deliverablessuch as the inception report data collection tools draft findings and the final Endline reportto ensure alignment with programme objectives donor requirements and evaluation quality standards.
ENDLINE & FINAL EVALUATION STUDY TEAM
To be considered the Endline and Final Evaluation study team must collectively demonstrate the following skills expertise and experience:
SELECTION CRITERIA
Essential CriteriaUnderstanding of Requirements and Proposal
Demonstrated Experience
Required Experience:
Contract
Save the Children is a UK charity for children that works in over 100 countries to make sure children are fed, learning and treated fairly. Find out more.