External Evaluation of “Addressing the Water, Sanitation and Hygiene and Protection Concerns of Hard-to-Reach, Conflict Affected Populations in Iraq"

Jun 29, 2020 | Terre des Hommes
View Original

Terre des hommes Foundation (Tdh) is the leading Swiss child relief agency. The Foundation has been helping children in need for over 50 years, defending their rights regardless of their race, creed or political affiliation. In over 35 countries, Tdh protects children against exploitation and violence, improves children’s and their mother’s health and responds to emergencies in humanitarian crises.

Tdh has been active in the Kurdistan Region of Iraq since October 2014. A fact-finding assessment took place in October 2014 and was immediately followed by an emergency response in Dohuk governorate (Zakho district). After the first intervention in Dohuk governorate, Tdh launched a first assessment in Kirkuk Governorate in January 2015, which was followed by the implementation of a cash grant program and the opening of an office in Kirkuk town and in Erbil in June 2015 in order to intervene in areas less (un)covered by humanitarian aid. Additional assessments have been carried out in Kirkuk, Anbar, Ninawa, Baghdad and Salah al Din governorates and led to the implementation of Wash, NFI distribution, CCCM, Child Protection and Education activities in the various districts of those governorates.

Terre des hommes Foundation is seeking to contract a consultant to conduct a summative evaluation for the project « Addressing the Water, Sanitation and Hygiene (WaSH) and Protection concerns of hard-to-reach, conflict affected populations in Anbar, Kirkuk and Salah al Din Governorates, Iraq » implemented since August 2019 under funding from USAID/OFDA. The goal of the project is to contribute to the recovery of basic living conditions of the conflict-affected population in Anbar, Salah al Din and Kirkuk governorates. This will be achieved by addressing some of the WaSH and child protection service gaps, as well as building the local capacities to fill these gaps as part of recovery process.

1. Project Basic Information

Strategy/Project/Activity Name : Addressing the Water, Sanitation and Hygiene (WaSH) and Protection concerns of hard-to-reach, conflict affected populations in Anbar, Kirkuk and Salah al Din Governorates, Iraq

Implementer: Terre des hommes Fondation - Lausanne

Cooperative Agreement/Contract # : Award No. 720FDA19CA00057

Life of Strategy, Project, or Activity : Start Date: 1st of August 2019, End Date: 31st of July 2020

Active Geographic Regions

  • Al Qaim District - Anbar Governorate
  • Tuz District - Salah al Din Governorate
  • Hawija District - Kirkuk Governorate

Focal point: (Only for the query.) , don't send a proposal to this email. Ganesh Bahadur Thapa, Contact: +964 7834467461, Email : irq.erb.meal.mgr@tdh.ch

2. Evaluation Context

Under the OFDA award, Tdh is currently responding in three governorates – Anbar, Salah al Din and Kirkuk, in hard to reach areas. Populations in these locations face a multitude of problems stemming from the past conflict, which continues to have negative impacts on the population to this day. For Tdh, it is important to shift its focus mainly to returnees, who are facing a shortage of services in the areas of their origin, often leading to secondary displacement. To respond to these needs, the OFDA project focuses on two main sectors WASH (water, sanitation and hygiene), and child protection:

WASH: the proposed project focuses on durable solutions to the problems by revitalizing existing WASH infrastructure and building the capacities of local authorities. The goal will be to improve access to safe drinking water (water quality and quantity), and enhance the overall sanitation and hygiene for IDPs, returnees and conflict affected people in Iraq.

Objective: To improve access to safe drinking water and sanitation at the household level and in public facilities in conflict affected districts of Iraq

WASH

Water Supply Infrastructure

  • Outcome Indicator 1 : % of health centers and schools with rehabilitated water facilities providing water in adequate quantity and quality, 100%

Sanitation

  • Outcome Indicator 2: % of HC and schools with at least one usable toilet that is accessible to those with limited mobility or vision, 100%
  • Output Indicator 2.1: Number of people directly utilizing improved sanitation services provided with USAID/OFDA funding, 0
  • Output Indicator 2.2: Average number of users per functioning toilet (30 girls: 1 latrine and 60 boys: 1 latrine), 12
  • Output Indicator 2.3: Percentage of latrines/defecation sites in the target population with hand Washing facilities that are functional and in use, 100%

Hygiene Promotion

  • Outcome Indicator 3: Percentage of health facilities (HF) appropriately disposing of hazardous wastes,100%
  • Output Indicator 3.2: Percentage of children targeted by the hygiene promotion program who know at least three (3) of the five (5) critical times to wash hands, 80%
  • Output Indicator 3.3: Percentage of schools targeted by the hygiene promotion program with no evidence of feces around the latrines, 80%
  • Child protection: Tdh focuses on both direct provision of services as well as building the capacity of community-based structures. The goal is to provide access to psychosocial support and case management for conflict affected children. Children, adolescents and caregivers facing protection risks and concerns are identified; have access to integrated child protection services and structured, group psychosocial support activities; and community-based mechanisms to improve the protective environment are established / strengthened.
  • Objective: To improve the protection, well-being and protective environment of vulnerable, conflict affected children and adolescents in conflict affected districts of Iraq

2.1. Child Protection

  • Indicator 2.1.1: Number of individuals participating in child protection services,1920
  • Indicator 2.1.2: Number of dollars allocated for child protection programming
  • Indicator 2.1.3: Percentage of targeted children and adolescents reporting an improvement in their sense of well-being at the close of the program, 60%
  • Indicator 2.1.4: Number of individuals trained in protection,450
  • Indicator 2.1.5: Percentage of individuals trained with improved knowledge of protection related topics, 60%
  • Indicator 2.1.6: Number of individuals accessing community-led information and awareness raising initiatives, 800

3. Purpose of the Evaluation

The purpose of the project end external evaluation of the OFDA project is to support learning based on current project performance, identify best practice approaches, accountability and substantiate actions and tools which could be improved and adapted for the next OFDA projects. Through this evaluation, Tdh aims to foster learning and ensure that existing good practices are documented, positive and negative impacts of the intervention are explored and that, lessons learned are analyzed and incorporated in future programming.

The intended audience of the evaluation is the project implementing staff in the 3 field offices as well as the coordination team based in Erbil / Baghdad. On a second level, the management / support team based in Lausanne, Tdh-HQ: Desks and WASH and CP humanitarian experts, Logistic and Finance expert and the Quality and Accountability unit will also be a key user group.

The evaluation will be useful to better define future Tdh humanitarian projects. The existing models, policies and guidelines will be updated with the successes and the lessons learned from this evaluation. Not only in the Iraq intervention but all the existing and future interventions of Tdh in emergency or humanitarian contexts will benefit from this evaluation.

Finally, recommendations derived from the final evaluation report will be incorporated into future proposals for various donors.

4. Audience

The primary users of the evaluation findings are the Tdh Iraq Mission staff together with the funding partners; other users include the key clusters in the targeted areas (such as WASH and protection clusters, as well as child protection sub-cluster) and other national and international stakeholders Tdh actively collaborates with.

5. Evaluation Questions

The performance of the project will be evaluated following the OECD-DAC criteria. The evaluator will mainly analyze the following questions:

Criteria-Questions

Appropriateness and Coverage

  • To what extent were WASH and CP activities established by Tdh adapted to beneficiaries’ needs and capacities?

Effectiveness

  • Did projects achieve the planned objectives and results in all (WASH and Protection) the sectors?
  • Have Tdh activities responded in a timely manner to the needs of the targeted population?
  • How well integrated were the activities (WASH, CP) into a Comprehensive and coherent (from the point of view of the beneficiaries) response?

Efficiency

  • How efficient are project team set up and management modalities?
  • How cost effective were the projects activities assessed in this evaluation? (value for money)

Sustainability

  • Are the positive outcomes of the projects sustainable for a longer period beyond project duration?
  • What identified results appear to be less sustainable and why?

Coordination

  • How well has Tdh been coordinating with the sub-sectors WASH and CP partners? What have been the effects of this coordination with regards to the achievement of the results?

Gender and people with disabilities (PWD) Consideration

  • Has the project integrated gender and people with disabilities (PWD) considerations into its activities?
  • Has the project developed any measures to enhance women’s and people with disabilities (PWD) participation in governance?

6. Methodology of the evaluation

The evaluation must apply mixed method approach i.e. a combination of both quantitative and qualitative methods, with a focus on triangulation of information sources. The consultant must submit the methodology of the evaluation in the inception report, which will include but will not be limited to the following:

  • In-country briefings with Tdh Iraq team and regular feedback during the field work;
  • Desk review (project proposal, quarterly reports, monitoring plan, budget and narrative, articles, cluster’s documentation, workplan, organizational chart, training curricula, technical tools, sources of verification and any other document produced in the frame of the project);
  • Observation of finished and ongoing activities in the field bases;
  • Interviews and group discussions with relevant stakeholders, including key staff (remotely if needed), partners, and mostly beneficiaries.

The consultant will ensure that different data collection methods will be combined, and the information triangulated. As much as possible, participatory methods will be used to involve project actors and staff, therefore ensuring optimal learning by the team and partners.

The methodology described in these terms of reference is suggested as a proposition. In order to facilitate the induction of the consultant and to activate existing knowledge of the Tdh Iraq team about the context, steering committee and focal points will be mobilized to support the consultant throughout the duration of the consultancy:

  • In Iraq : WASH Coordinator, Child Protection Coordinator, Deputy Country Representative, Program and MEAL Manager, Project PM/DPM and if needed other program staff
  • In Switzerland : Desk Officer, Humanitarian Technical Experts, Monitoring and Evaluation advisor.

Regular contacts with Tdh Evaluation Focal Point will be established throughout the duration of the evaluation work in order to share updates on the progress of the work. In case of difficulties, reorientation shall be considered during the evaluation, but only with approval of Tdh.

7. Deliverables

The consultant will provide deliverables in a timely manner and in electronic format.

Essential deliverables required are:

Following desk review and briefings, and before the start of the fieldwork:

1) inception report, which will include:

  • the detailed suggested methodology, including the evaluation matrix highlighting how evaluation questions will be addressed, data collection method and source, analysis sub-question
  • the draft data collection tools,
  • work plan, including the list of people and sites to be visited
  • the Initial questions-thoughts derived from the desk review, including risks and limitations analysis

2) intermediate (draft final report) and 3) the final evaluation report, which will include:

  • An executive summary (max. 3-4 pages) focused on the methodology, the main evaluation questions, conclusions and relevant recommendations
  • A table of contents
  • A list of annexes, abbreviations, tables, figures, pictures, etc.
  • An introduction
  • The presentation of the methodology, scope and limitations
  • The findings of the evaluation including lessons learned
  • Detailed recommendations for the next projects including good practices in general and per sector
  • An evidence-based conclusion
  • Annexes (ToR, data collection tools, updated work plan and list of people interviewed)
  • A PowerPoint presentation

Reports must be provided in Word format and the report pages numbered. Reports must be written and submitted in English. Results of this evaluation will be intended for both Tdh and for the donors.

8. Intellectual Property Rights

Intellectual Property Rights

All documentation related to the Assignment (whether or not in the course of your duties) shall remain the sole and exclusive property of the Terre des hommes (Tdh) Foundation. Consultant must submit all the collected data and means of verification.

9. Evaluation Schedule

The assignment should be carried out in a period of time to be defined with the consultant, ideally between the 21st of July and the 17th of September 2020.

10. Profile of Consultant

The consultant (team) must have a strong background in the design, implementation and evaluation of humanitarian projects.

Other requirements are:

  • Knowledge of the Middle East, especially the Iraqi context
  • Demonstrated previous experience in leading humanitarian evaluations, using a range of different evaluation methods (impact evaluation, process evaluation, etc.)
  • Expertise in project cycle management, humanitarian project monitoring, and accountability issues
  • Experience in working in the emergency humanitarian sector, with a focus on the WASH and Child Protection sector
  • Expertise in Humanitarian standards
  • Strong conceptual and analytical thinking
  • Excellent communication and writing skills
  • Gender mixed team would be an asset
  • Excellent knowledge English ; Arabic would be a strong asset (a translator shall be provided if needed).
  • Successful experience in implementing and / or evaluating OFDA-funded projects would be an asset.
  • Valid visa for Iraq could be an asset

11. Roles and Responsibility

Tdh team will provide support to the consultants in terms of:

  • Responding inquiries and questions about the task
  • Briefing about security conditions
  • Logistics: Facilitate contact with / gathering staff and people to be interviewed
  • Providing equipment / space needed for kick-off meeting and debriefing session in Tdh office meeting room
  • Providing internet access, printer and office furniture if needed with in Tdh office
  • Providing translation if needed
  • Reviewing and commenting on deliverables (inception report, draft report)

The consultant will be responsible for:

  • Consulting with Tdh for any inquiries / questions
  • Ensuring that the consultant team is aware about security conditions as per Tdh briefing
  • Behave in a culturally, gender and child sensitive manner.
  • Abide by ethical principles when collecting data from beneficiaries, in particular from children and women (inform consent, confidentiality)
  • Develop the data collection tools, test them and review them upon Tdh recommendation, data collection, data quality assurance, analysis
  • Prepare quality reports and deliver them as planned in the work plan and schedule.
  • Consultant is responsible to ensure all safety and security considerations for their evaluation team
  • Consultant is responsible to manage all travel and logistics of their team.

All consultant team members are required to sign and abide by Tdh CSP and PSEA (Child Safeguarding and Prevention of Sexual Exploitation and Abuse Policies). The consultant will be required to adhere to and follow Tdh administrative and logistical regulations and procedures.

12. Selection Criteria and score

Criteria-Score

  • Expertise in Humanitarian standards – WaSH and Child Protection Strong conceptual and analytical thinking, 20
  • Excellent knowledge English ; Arabic and Excellent communication and writing skills, 10
  • Successful experience in implementing and / or evaluating USAID/OFDA-funded child protection and WaSH projects,10
  • Methodological proposal highlighting understanding of the ToR, tools, the context of the evaluation and the proposed approach to the evaluation tasks, 40
  • Two sample evaluation report highlighting previous experience relevant to this evaluation, 20

Total Score: 100

13. Security and Responsibilities

Everyone is responsible for his/her own safety. Risks can be minimized with some caution and common sense by everyone. However, the Tdh Country Representative has responsibility for security rules. At any given time, all movements and activities outside Erbil must be endorsed by the mission and its security focal points for each sub-office.

Visitors and all persons under Tdh contract (employees, trainees, volunteers, contractors, etc.) must comply with the standards and rules of security of the delegation. However, they must also adapt their way of being and acting according to the circumstances in order to maximize their own safety.

They should not rely entirely on the organization: security depends largely on the behavior of each person. Everyone has an obligation to be consistently informed of the local security situation. In reference to the country security SoPs and security plans for all bases, the evaluator and the evaluation’s team will be briefed at their arrival in Iraq and when deployed in Tdh sub offices.

The compliance with Tdh Iraq security rules is mandatory and expected for the entire duration of the evaluation and for every staff, national and expatriate involved in it.

14. Total budget and Modalities of payment

Tdh will pay the consultant in two installments:

  • First installment (30 % of total fee) upon acceptance of the inception report,
  • Second installment (remaining % of the total fee) upon acceptance of the final report.

How to apply

Please submit your application exclusively via email to irq.tenders@tdh.ch

Deadline for submissions: 8rd July 2020.

Application and Mandatory documents

To be considered, the applicant must submit the following documentation:

  • Methodological proposal highlighting understanding of the ToR, the context of the evaluation and the proposed approach to the evaluation tasks
  • A detailed quotation including all cost (in Excel format).
  • Letter from the bank confirming the bank account information and mentioning the financial standing
  • A Curriculum Vitae (max. 3 to 4 pages highlighting work experience and qualifications relevant to this consultancy)
  • Iraq Visa status / residency / on arrival visa
  • Company's registration and License
  • ID card of the representative
  • Power of Attorney from the owner of the company to the legal representative (if different)
  • Tax compliance certificate
  • Litigation history of the company (both court and arbitration cases)
  • Full contact details of at least two references from recent clients
  • A criminal record extract as required for any staff/contractor working for Tdh
  • Two sample evaluation report highlighting previous experience relevant to this evaluation (Mandatory)
  • Passport copy of team leader
  • Up-to-date banking details (only for individual contractor)