Terms of Reference (ToR) for Mid-term Evaluation

Job Description

Terms of Reference (ToR)

Mid-term Evaluation

Supporting Climate Adaptation and Durable Solutions for Displacement Affected Communities (DACs) in the Shabelle River Basin, Networking with & Enhancing Efforts by Government & Administration in Afgoye District (NEGAAD) Project

Under Boosting Resilience and Adaptation to Climate Change

(BREACH) Programme supported by European Union

Concern Worldwide

Somalia Programme

. Introduction

1.1 Background

Since its inception in 1992, Concern has operated in Somalia, where it has recently carried out a variety of emergency response interventions in addition to longer-term resilience and durable solutions programming, facilitating sustainable integration of IDPs and host communities. In addition to emergency responses, sectoral programming also addresses health and nutrition, education, WASH, and livelihoods. Currently, Concern operates in 6 of the country’s 18 regions, including Banadir (Mogadishu), Bay, Gedo, Lower Shabelle, Awdal and Maroodi-Jeex (Gabiley), Togdheer in Somaliland, and Lower Shabelle in South-Central Somalia. Operations by Concern in Somaliland began in late 2010. Concern serves as the umbrella organization for the Somali Cash Consortium (SCC), which works with a number of national and international partners to administer emergency cash programs and social transfers throughout the whole Somalia.

1.2 Description of the Project:

Concern Worldwide under the EU NEGAAD project, is supporting Climate Adaptation and Durable Solutions for Displacement Affected Communities (DACs) in the Shabelle River Basin. Networking with & Enhancing Efforts by Government & Administration in Afgoye District (NEGAAD), Concern is working with NRC and SHACDO in close collaboration with the government authorities of South West State to ensure effective implementation. NRC and SHACDO as co-applicants in this project, brings extensive experience in similar projects in South West State, including community engagement activities, ensuring effective community participation, coordination, and advocacy. The project targets Afgoye town, Lafoole settlement, and Mareerey village in the Afgoye district.

Overall objective: to contribute to sustainable (re)integration of IDPs and strengthen the resilience of DACs through climate-resilient early and durable solutions.

To achieve this objective, the two outcomes were described.

Outcome 1: The short-term needs (food security, basic services and HLP) of displacement- and drought-affected communities in Afgoye District are addressed through Early Solutions interventions.

Outcome 2: DACs are supported to attain a durable solution to their displacement through improved land tenure security, expanded access to basic services and social protection, improved environmental protection approaches and inclusive, disaster-resilient and sustainable livelihoods interventions.

The project includes the set of specific interventions that focuses on strengthening various elements especially HLP, sustainable livelihoods, access to basic services that supports sustainable reintegration / durable solutions for IDPs, returnees and host communities. Recognising that climate change and migration affects members of the community differently, with women and girls facing higher levels of malnutrition, negative coping mechanisms and poverty, the programme addresses these unique disadvantages. It ensures inclusive participation through community sensitization and engagement especially for women, girls and people with disabilities and those from minority clans to create space for these groups to participate meaningfully in programme interventions. Wider conflict-sensitive approaches including social cohesion and conflict resolution activities under the HLP component will enhance programme acceptance and impact. This project will promote positive health-seeking behaviours amongst the DAC communities and provides women of child bearing age with access to antenatal and post-natal consultations, as well as immunizations for children under one year old, treatment for acute malnutrition and counselling on optimal infant and young child feeding (IYCF) practices. Education and skills training interventions also contribute to Specific Objective 2 under Priority Area 2, in increasing access to equitable and inclusive quality education and supporting youth and adults with training linked to employment and economic opportunities.

2.0 Purpose of the mid-term evaluation

The overall purpose of the mid-term evaluation of the project is to systematically assess the progress, effectiveness and impact of the project’s interventions to date. It aims to provide insights and recommendations to enhance implementation, ensure accountability, and optimize the outcomes for the targeted DACs. The evaluation will also determine the programme’s progress towards achieving its goals and suggest improvements, aiding in realigning interventions if necessary.

2.1 Specifics objectives of the mid-term evaluation includes:

1. Document and assess the progress towards achieving the outcomes and immediate results achieved through the project implementation.

2. Identify and capture significant and planned and unplanned changes resulting from the interventions, including the actors and processes involved.

3. Evaluate the effectiveness, efficiency, and sustainability of the Basic services (WASH, Education and Health/Nutrition), Livelihood interventions, and HLP activities implemented.

4. Capture key lessons learned, best practices, and areas for improvement in the response.

5. Provide recommendations to improve the project performance for the remaining duration of the project.

3. Scope of the Evaluation

The mid-term evaluation will cover all respective outcome and impact level indicators of the EU-NEGAAD logframe, and any cross-cutting core indicators based on the following key components of the programme (Climate-Resilient Solutions, Durable Solutions for IDPs, HLP, Employment and Economic Opportunities and Basic Services.

The mid-term evaluation shall cover all intervention areas of the EU-NEGAAD, including Afgoye town, Lafoole area and Mareerey village under afgoye district of the Lower Shebelle region in Southwest state of Somalia. The evaluation will involve representative samples of the program participants including youths, adults, children, persons with disabilities, as well as a balanced proportion of males and females. It will utilizes both quantitative and qualitative methods to include feedback from teachers, stakeholders, health workers and other relavant groups.

4. Evaluation Questions

The mid-term evaluation will address the following key questions:

4.2 Project Goals and Objectives:

4.1.1 Relevance of Goals: How well the project’s goals align with the needs of the displacement-affected community?

4.1.2 Clarity of Objectives: Are the project objectives clearly defined and communicated to all stakeholders?

4.1.3 Progress towards Goals: What progress towards the project’s goals has been achieved so far? Providing some specific examples.

4.2 Project Implementation

4.2.1 Coordination: How well is the coordination between different stakeholders (e.g., local government, partners, community leaders etc.) in implementing the project?

4.2.2 Flexibility and Adaptation: Has the project been able to adapt to any unforeseen challenges or changes in the community’s situation?

4.2.3 Inclusion: Has inclusion among the DAC communities including minority clans, people living with disability, male and female considered in the implementation.

4.3 Community Engagement and Participation

4.3.1 Community Involvement: To what extent are the displacement-affected community members involved in the planning and execution of the project?

4.3.2 Feedback Mechanisms: Are there effective mechanisms in place for the community to provide feedback on the project’s activities?

4.3.3 Cultural Sensitivity: How well does the project respect and integrate the cultural practices and norms of the displacement-affected community?

4.4 Impact and Outcomes

4.4.1 Short-Term Impact: What tangible benefits has the project provided to the displacement-affected community so far?

4.4.2 Unintended Consequences: Have there been any unintended positive or negative outcomes as a result of the project activities?

4.4.3 Sustainability: Are the project’s outcomes likely to be sustained beyond the project’s duration? Why or why not?

4.5 Challenges and Barriers

4.5.1 Identifying Challenges: What are the main challenges faced by the project so far? (e.g., logistical, cultural, political, security)

4.5.2 Overcoming Barriers: How has the project addressed these challenges? Are there any barriers that remain unresolved?

4.5.3 Lessons Learned: What key lessons have been learned from the project’s implementation up to this point?

4.6 Recommendations and Improvements

4.6.1 Improvement Areas: What areas of the project do you believe need improvement? (e.g., strategy, implementation, communication)

4.6.2 Stakeholder Recommendations: What suggestions do you have for the remaining duration of the project to enhance its effectiveness?

5. Technical Approach and Methodology

The consultant is expected to propose a relevant technical approach and methodologies to conduct the evaluation as per the objectives, addressing the evaluation questions outlined above. In addition, the evaluation will assess the program’s relevance, efficiency, appropriateness, sustainability, coordination, and lessons learned. The selected methodology should be able to demonstrate the extent to which the program achieved its intended results thus far and reached the intended target populations. The proposed methodology should also allow the program to identify and quantify the impact of contextual factors on the expected results.

5.1 Document Review

The consultant is expected to review all relevant documents in order to understand the assignment and the context beforehand. This will enable the consultant to gather secondary data that will complement the primary data that will be collected. Key documents include the program documents including the project proposal, logical framework, progress reports and baseline report.

5.2 Qualitative method:

The consultant is required to employ qualitative method including KII (Key informant Interviews), FGDs (Focus Group Discussions), observations and case studies to gather in-depth insights and contextual information. Tools designed should consider collecting data from marginalized and minority groups, i.e., women, youth, PLWD and government authorities, project teams and partners All suggested tools will be discussed with Concern and partners to finalize.

5.3: Quantitative method:

Use surveys, data tracking, and statistical analysis to collect and analyse numerical data on program performance and outcomes. These include; Household survey at household level.

5.4 Sampling strategy:

Define the sampling methods to ensure representative coverage of different population segments, such as IDPs, returnees, host communities, and other relevant groups as mentioned above. In addition, the consultant is expected to suggest other sample sizes for FGDs and interviews based on information needs.

5.5 Implementation process:

The consultant is expected to train enumerators on data collection methodologies and tools; quality assurance; confidentiality; ethics and informed consent. The consultant will develop data collection tools and will share with Concern before the training and thereafter piloted and revised accordingly after the pre-test exercise to ensure they are acceptable and match the program’s needs.

5.6 Validation and Verification:

Implement processes for validating and verifying data to ensure accuracy and reliability. This may include cross-checking data sources and using triangulation methods. In addition, the consultant will be expected to supervise data collection in the field, translation, and transcription of qualitative data, ensuring quality is maintained throughout the entire process.

5.7 Reporting:

Outline the process for compiling and presenting findings, including drafting reports, creating visualizations, and providing actionable recommendations based on the evaluation results. Consultant is also expected to present the findings, conclusions, and recommendations to Concern who will then share it with implementing partners, the donor, and other key stakeholders.

5.8 Ethical Considerations:

Address ethical issues, including informed consent, confidentiality, and sensitivity to the needs and rights of the displaced communities.

6. Deliverables

Deliverables under this consultancy will include the following:

· Inception report: Including the proposed methodology, data collection tools, analysis framework, and a detailed work plan.

· Draft Mid-term Evaluation Report: Presenting preliminary findings, analysis, and recommendations in a clear and understandable format for practitioners with updated log frame indicators.

· Complete datasets and syntax files used for analysis.

· Complete transcriptions of qualitative data and respective audio/video/photo files.

· Draft report: Will be presented to Concern for input and feedback. Concern will give feedback within seven days of receipt of the draft report.

· Final report inclusive of Concern’s and it is partner’s feedback.

· Presentation of Findings: A presentation to key stakeholders to discuss the evaluation findings and recommendations, ensuring clarity and practical application for programming

Skills and Qualifications
Consultant Qualifications

This assignment requires previous experience in conducting mid and end term evaluations of multi-sectoral and large-scale developmental programs in displacement context particularly in climate adaptation and resilience as well as durable solutions Programmes, preferably in the region and/or in Somalia. In addition, the consultant must have experience in working in fragile, conflict-affected contexts. The consultant will be required to devise appropriate strategies to generate as much information as possible within the allocated time frame, considering the ongoing crises and potential challenges to reach certain locations.

Education and background required:

· At least 8-10 years of working experience in technical design and delivery of programme evaluations, using various types of qualitative and quantitative data collection methods, conducting desk reviews, analysis and interpretations.

· Demonstrated technical expertise in the large-scale programs evaluations and use of technologies. Evidence documents like contracts of experience and sample work will be required.

· Advanced university degree in one or more of the disciplines relevant to the following areas: Evaluation expertise, economics, and social sciences.

· Excellent report writing skills in English.

· Adequate knowledge of the context.

· Previous experience of conducting Evaluation survey in Somalia, evidence documents like contracts of experience and sample of work will be required.

· Ability to roll out large-scale data collection and ensure quality in the Somalia context.

8. Core Values & Critical Key Competencies

· Strong analytical skills with strong ability to do editing and proofreading

· Ability to think critically and strategically in difficult conditions

· Excellent interpersonal communication, relationship building, and networking skills

· Ability to work under pressure and meet tight deadlines in stressful conditions

9. Timeline

· The evaluation is expected to be conducted over a period of 5 weeks, with key milestones as follows:

Week 1: Inception phase and document review

Week 2-3: Field data collection

Week 4: Data analysis and drafting of the evaluation report

Week 5: Presentation of preliminary findings

Week 5: Finalization of the evaluation report

10. Budget

The consultancy company will submit to Concern a financial proposal covering consultancy fees, operational costs, flight costs, accommodation in line with the methodology described in the technical proposal.

11. Logistics

Concern will provide the following support towards the successful execution of this consultancy:

· Provide all relevant internal documents needed during the desk review.

· Provide linkages with key stakeholders and actors at all levels to facilitate key informant interviews.

· Pay consultant’s fees upon satisfactory completion of the assignment.

12. Conditions of Work

The consultant will be supervised by the Durable Solutions Program Manager with support from DS Programme Coordinator, DS Advisor, M&E Lead, and the Field staff. The consultant will be required to abide by the organization’s applicable rules and regulations, code of conduct, and child safeguarding policy.

13. Submission of Proposals

Interested consultants or consultancy firms should submit a proposal that includes:

· A cover letter expressing interest and outlining relevant experience

· A detailed technical proposal outlining the proposed methodology and work plan

· A financial proposal detailing the budget

· CVs of the proposed evaluation team members

· Contact details for at least two references for similar evaluation work

Attachments
TOR for Midterm Evaluation for EU Negaad Evaluation_.docx
How to apply
Proposals should be submitted to Concern Worldwide, Procurement team, at procurement.mogadishu@concern.net by Wednesday 11th September 2024.

Note on Safeguading: Concern has an organisational Code of Conduct (CCoC) with three Associated Policies; the Programme Participant Protection Policy (P4), the Child Safeguarding Policy and the Anti-Trafficking in Persons Policy. These have been developed to ensure the maximum protection of programme participants from exploitation, and to clarify the responsibilities of Concern staff, consultants, visitors to the programme and partner organisation, and the standards of behaviour expected of them. In this context, staff have a responsibility to the organisation to strive for, and maintain, the highest standards in the day-to-day conduct in their workplace in accordance with Concern’s core values and mission. Any candidate offered a consultancy opportunity with Concern Worldwide will be expected to sign the Concern Code of Conduct and Associated Policies as an appendix to their consultancy contract. By signing the Concern Code of Conduct, candidates acknowledge that they have understood the content of both the Concern Code of Conduct and the Associated Policies and agree to conduct themselves in accordance with the provisions of these policies. Additionally, Concern is committed to ensuring safeguarding and protection of vulnerable adults and children in our work. We will do everything possible to ensure that only those who are suitable to work or volunteer with vulnerable adults and children are recruited by us for such roles. Subsequently, being engaged as a consultant with Concern is subject to a range of vetting checks, which may include criminal background checking.