Terms of References (ToR) for Conducting Midterm Evaluation for Children in Street Situations Project in Addis Ababa, Diredawa, and Adama town

About SOS Children’s Villages Ethiopia

SOS Children’s Villages Ethiopia (SOS CVE) is a non-governmental, non-political, non-denominational charitable child welfare organization. For the past more than 59 years, SOS CVE has been working to build families for children in need, help them shape their own future and share in the development of their communities. SOS CVE helps vulnerable families, cares for their children, and works to prevent the breakdown of families. When children lose their own families’ parental care, SOS CVE provides quality alternative care in SOS CVE families and implements family strengthening projects. Moreover, SOS CVE supports young people in their efforts to become independent adults and succeed in life. SOS Children’s Villages Ethiopia has currently seven programme locations (Mekele, Harar, Hawassa, Bahir Dar, Addis Ababa, Jimma and Gode.) The organization has planned to expand its intervention to Arbaminch, Dessie, Semera and Axum.

Description of programme location and context

SOS Children’s Village Program in Addis Ababa 

SOS Children’s Village Addis Ababa Program is one of the program locations under the SOSCVE. Currently, the program location is implementing the Children’s in Street Situation Project in Addis Ababa city and Adama town. The project, which aims to reach more than 3600 children on/of the street situation in Addis Ababa city and more than 2700 children on the street situation in Adama town. The project has been mobilizing outreach programs, providing transition center services, technical and vocational skills training, reintegration and family strengthening offers, strengthen local systems, and advocacy and social mobilization to address the ever-growing children in street situation problems in Dire Dawa.

 

SOS Children’s Village Program in Harar 

SOS Children’s Village Harar Program is one of the program locations under the SOSCVE. Currently, the program location is also implementing the Children’s in Street Situation Project in the Dire Dawa town Administration. The project, which aims to reach more than 2700 children on the street situation in Dire Dawa Administration, has been mobilizing outreach programs, providing transition center services, technical and vocational skills training, reintegration and family strengthening offers, strengthen local systems, and advocacy and social mobilization to address the ever-growing children in street situation problems in Dire Dawa.

Rationale and overall objective of the Midterm evaluation

The “Children in Street Situation Project,” is being implemented by SOSCV Ethiopia in partnership with key partners and funded by SOS Norway and Heimstaden, aims to improve the rights and welfare of 9,000 street children in Addis Ababa, Dire-Dawa, and Adama. The project seeks to achieve five outcomes: Rehabilitate children in street situations, strengthen social support systems for the rights and wellbeing of street children, ensure children in street situations are cared for and protected, equip children aged 15-17 on/of the streets with competencies and employment and Advocate for improved legal and policy frameworks to protect and empower street children. The project document and result framework will be annexed.

Since SOS Children’s Villages Ethiopia is working with four local partner NGOs: Forum on Sustainable Child Empowerment Organization, Tilahunen Charity Organization, Mary Joy Ethiopia, and Dalassa Community Development Organization. These partners provide various services in Addis Ababa, Adama, and Dire Dawa.

The project, launched in 2022 and will be closed in 2026.The project has been implemented in three locations and has now reached its midline, necessitating a mid-term evaluation. This evaluation aims to assess the project’s impact, identify strengths and gaps, and ensure that the project can maintain its strengths while addressing any gaps for the remainder of its duration. Consequently, SOS Children’s Villages Ethiopia seeks to hire an experienced and competent consulting firm to conduct a Midterm Evaluation of the progress made in the Children in Street Situations project.

Objectives of the evaluation/assessment:

 Overall objective

The main purpose of this Midterm Evaluation is to assess the progress made towards the five project outcomes outlined in the RF. This assessment will assist both SOS CVE and the donor in understanding whether the project is on the right track or not.  Additionally, the evaluation will provide critical insights that may influence the donor’s decisions regarding the project’s future based on its findings.

Specific objectives

• The specific objectives of the Midterm Evaluation are to determine:
• Whether the project has created a positive impact on the lives of the target group and met its objectives.
• If the results/outputs are leading to the achievement of the specific objectives.
• The alignment of the project’s specific objectives with the needs of the project participants and the organization’s policy.
• The extent to which children in street situations, our target group, are being reached.
• The access project participants have to provide essential services necessary for their healthy development.
• The empowerment of service providers to respond effectively to the needs of children in street situations.
• The development of partnerships aimed at achieving shared goals.
• The effectiveness of planning, monitoring, and evaluation processes in making the project relevant and impactful.

Scope of the midterm evaluation:

• Geographically, the assessment is limited, the midterm evaluation is limited to the entire Children in Street Situations project implemented in Addis Ababa, Adama, and Dire Dawa. It will involve government offices, key implementation partners, communities, and other stakeholders closely working with the project. The midterm evaluation will scientifically select participants from each stakeholder category.

Methodology:

• The consultant is expected to develop relevant and standard quantitative and qualitative methodologies that can generate the highest quality and most credible evidence. The commissioned consultant should use a mixed method approaches (quantitative and qualitative methods) to answer the midterm evaluation questions. The methodology for this midterm evaluation requires a comprehensive understanding of the project’s objectives and the midterm evaluation objectives. The consultant should design an approach that addresses these objectives effectively. It is crucial to outline the evaluation procedure clearly and explain the technical approach and methodology that will be used to carry out the evaluation.
• To collect information, a mix of quantitative and qualitative methods will be utilized. This approach will provide a detailed and meaningful description of the situation of children in street situations. Qualitative methods, such as focus group discussions and interviews, will be used to gather perceptions and views on the existing situation of vulnerable individuals. On the other hand, quantitative methods, including surveys,
• will be employed for aspects involving numerical data such as percentages and ratios. The choice of method for each aspect will be explained based on its suitability and relevance.
• The primary data collection process will involve structured questionnaires, focus group discussions, and interviews with government and non-governmental resource persons. Additionally, program records and documents will be reviewed to gather relevant data. The sample size for the study will be determined based on the estimated magnitude of the situation and the size of the project area, taking into consideration available resources and time constraints.
• Furthermore, the evaluation will include a review of secondary data sources, such as policies, guidelines, and conventions related to the evaluation indicators. In cases where it is necessary, documents and tools from SOS Children’s Villages Ethiopia will be utilized to supplement the data collection process.

Sample

• The Commissioned consultant is expected to use appropriate sampling techniques and set acceptable sample size for both qualitative and quantitative data collection methods. Based on the project objectives, results/outcomes, midterm evaluation equations and street children’s project result framework, the consultant should produce best sampling methods and ensure representativeness of the sampled households or respondents, and the sampling frame is from the project targets.

Major midterm evaluation questions (the consultant will add more relevant questions):

1. How was the project process to achieve desired outcomes and objectives? What were the major deviations and actions to keep the right project track?
2. What are the immediate outcomes of the project observed until midterm evaluation?
3. What looks like the partnership collaboration with key stakeholders andpartners, relationship and management?
4. To what extent the project was efficient in terms of utilizing budget, staff management and timely procuring materials?
5. What are lessons learned, good practices and challenges?

• Additionally, the midterm evaluation will assess project progress base on evaluation questions.

Relevance:

• To what extent was the project relevant to target people and community
• How well does the program target children in street situations?
• To what extent does the program address the needs and priorities of program participants?
• To what extent are stakeholders (community, partners, local authorities) involved in the program’s design and implementation?
• How is the program designed to develop the necessary local institutional capacity (governmental and/or non-governmental) to address the problem?

Effectiveness:

• To what extent are the program’s objectives being achieved or likely to be achieved?
• How has the quality of life improved for children in street situations?
• What is the success rate of children in street situations leaving the program and becoming self-reliant?
• How many children in street situations have been reached throughout the program?

Efficiency:

• Is the relationship between resources input and results achieved appropriate and justifiable (cost-benefit ratio)?
• Are there alternative approaches that could achieve the same results with fewer resources?

Impact:

• Are there observed impacts of the project? intended or unintended?

Sustainability:

• To what extent are activities, results, and effects expected to continue after SOS’s involvement has ended?
• Is there progress toward SOS withdrawing from direct involvement and handing over full responsibility to an implementation partner?
• How has the capacity of the implementation partner been developed, and in what areas?

Work plan and expected deliverables:

work plan/timetable:

• The midterm evaluation study task is expected to be finalized within 45 days after the contractual agreement is signed. The consultant is expected to develop her/his detailed work plan based on the following table.

• Activities	Dates	Time farme	Location

work plan/timetable:

• The midterm evaluation study task is expected to be finalized within 45 days after the contractual agreement is signed. The consultant is expected to develop her/his detailed work plan based on the following table

.Deliverables:

• The commissioned external consultant must deliver the midterm evaluation study findings within 45 days of the contract signing. Based on the work plans, SOS Children’s Villages of Addis Ababa location, SOS Children’s Villages of Harar location and the National office MEAL and CiSS teams expect the following deliverables:

• Deliverables	Format	Length (Pages, duration)	Deadlines
  Draft Inception Report: This report will include the methodology, sampling details, data collection tools, data analysis methods, fieldwork schedule, ethical considerations/safeguarding measures, consent forms, and any other relevant information.	Word document	15 pages 1week
  Final Inception Report: This report will be the finalized version of the Inception Report, incorporating all feedback and comments from stakeholders.	Word document	15 Pages 1 weeks
  Data Collection and Initial Midterm Evaluation Report with ITT: This deliverable includes the data collection process and the initial draft of the Midterm Evaluation Report, along with an Indicator Tracking Table containing baseline data.	Word document	25Pages 1 weeks
  Validation Workshop Presentation: Conducting a workshop to present key findings and recommendations for stakeholder feedback and validation.	Power point/slides	1 PPT 1 day
  Final Midterm Evaluation Report, Final Data Collection Tools (incl. consent forms): Comprehensive report of the midterm evaluation, including an executive summary, and finalized data collection tools.	PDF document	25 Pages 1 week
  Cleaned Data for Analysis and Dissemination: Data files, transcripts, codification, and other materials used for statistical analysis and dissemination.	STATA/SP SS	All NA

Report criteria:

• The reporting criteria for Children in Street Situations project Midterm evaluation study shall be in line with the SOS Children’s Villages Ethiopia result based management (RBM) toolkit and should be shared with the winner consultant along with the data review process and/or for the preparation of the inception report.

Logistical arrangements:

• The awarded consultant shall show feasible logistical arrangements for the assignment as part of the technical proposal. SOSCVE No, SOSCVE Addis Ababa PL and SOSCVE Harar PL will be available to help organize the interviews including contacting SOS, announcing and local preparation of evaluation, and linking to community duty bearers and relevant authorities if required.

Duration of the contract and terms of payment:

• Duration of contract: the contract is effective from the moment it was signed until the acceptance of work by the SOS Children’s Villages in Ethiopia management team based on the contractual agreement.

Notice of delay:

• Shall the successful bidder encounter a delay in the performance of the contract which may be excusable under unavoidable circumstances; the contractor shall notify SOS Children’s Villages in writing about the causes of any such delays within one (1) week from the beginning of the delay. After receipt of the Contractor’s notice of delay, SOS Children’s Villages in Ethiopia shall analyze the facts and extent of the delay and extend the time for performance when in its judgment the facts justify such an extension.

Copyright and other proprietary rights:

• SOS Children’s Villages shall be entitled to all intellectual property and other proprietary rights including, but not limited to, copyrights, and trademarks, with regard to products, processes, inventions, ideas, know-how, or documents and other materials which the Contractor has developed for SOS Children’s Villages under the Contract and which bear a direct relation to or are produced or prepared or collected in consequence of, or during the course of, the performance of the Contract. The Contractor acknowledges and agrees that such products, documents, and other materials constitute works made for hire for SOS Children’s Villages.
• All materials: interviews, reports, recommendations, and all other data compiled by or received by the Contractor under the Contract shall be the property of SOS Children’s Villages and shall be treated as confidential and shall be delivered only to SOS Children’s Villages authorized officials on completion of work under the Contract. The external consultant is obliged to hand over all raw data collected during the assessment to SOS Children’s Villages in Ethiopia.
• Termination:
• The termination of the service agreement for the assignment will be in accordance with the contractual agreement to be included at the formal agreement’s actual signing.

Child safeguarding and ethical issues.

• SOS Children’s Villages is committed to ensuring that all research, evaluation and data collection processes (i.e. evidence-generating activities) undertaken by SOS Children’s Villages and its partners are ethical and respect child safeguarding policy and procedure.
• The consultant must respect the rights, dignity and protection of children and other vulnerable population groups and should ensure special protection for children and other vulnerable groups during any data-generating activities to minimize any potential risks. Any research, evaluation and data collection SOS Children’s Villages is directly carrying out or is involved in as a partner.

Ethical practices need to be ensured in the following circumstances: 

• Any research, baseline, midterm or final evaluations and data collection SOS Children’s Villages has commissioned for ethical oversight of these processes.
• Any research, evaluation and data collection carried out by researchers/consultants on SOS Children’s Villages programmes and participants.
• Hence, relevant manager in Jimma and Awassa will ensure that any researchers, evaluators and data collectors should receive awareness training on, sign and adhere to SOS Children’s Villages core policies:

Child safeguarding and ethical issues.

• SOS Children’s Villages is committed to ensuring that all research, evaluation and data collection processes (i.e. evidence-generating activities) undertaken by SOS Children’s Villages and its partners are ethical and respect child safeguarding policy and procedure.
• The consultant must respect the rights, dignity and protection of children and other vulnerable population groups and should ensure special protection for children and other vulnerable groups during any data-generating activities to minimize any potential risks. Any research, evaluation and data collection SOS Children’s Villages is directly carrying out or is involved in as a partner.

Ethical practices need to be ensured in the following circumstances: 

• Any research, baseline, midterm or final evaluations and data collection SOS Children’s Villages has commissioned for ethical oversight of these processes.
• Any research, evaluation and data collection carried out by researchers/consultants on SOS Children’s Villages programmes and participants.
• Hence, relevant manager in Jimma and Awassa will ensure that any researchers, evaluators and data collectors should receive awareness training on, sign and adhere to SOS Children’s Villages core policies: