Procurement Notices

The interested offeror must submit the application via the following link

https://jobs.undp.org/cj_view_job.cfm?cur_job_id=101552

Terms of reference for Individual Contractor

1. Background and context

With a rapidly growing population of presently close to 32 million, the Kingdom of Saudi Arabia faces a number of challenges including growing urbanization and environmental change. While urbanization poses great pressure on regional water and sewage infrastructure and bears pollution risks, environmental challenges include depletion of aquifers and increasing torrential flood risks. Earning relatively high annual revenues from natural resources, Saudi Arabia has invested heavily in development and upgrading infrastructure during the past few decades, including in water and sewage infrastructure, road networks, housing, hospitals, and schools.

Due to Ministry of Environment, Water and Agriculture’s (MEWA) recent initiatives, efficient water use and governance in the municipal and irrigation subsector, reuse of wastewater and exploitation of shallow aquifers caused significant reduction of groundwater abstractions.

Nevertheless, a set of bolstering measures towards sustainable water supply even in stress and emergency situations and minimizing the climatically induced environmental risks needs to be formulated. These actions or interventions simultaneously should target the supply side; curtail water demands in various productive sectors; and mitigate the environmental risks.

However, to make a transition from the current patterns of water administration to sound water management mode, two prerequisites are required. First, there is strong need to strengthen the technical and organizational capacities of the MEWA to deal with the triple challenge of water exploitation and distribution (operational side), research for additional resources and cutting-edge technologies to satisfy the increasing demand (research side), and rigid control and administration of all water-related aspects (control side). Second, a sound information base covering data on groundwater availability, quality, withdrawal, and usage is about to be put in place.

The transformation of this information into an all-encompassing water resources management requires sustained long-term efforts, especially since the MEWA has limited capacity and experience in this field. It needs to go a long way in terms of development and strengthening its technical capacities in order to be able to meet its mandates.

To this effect MEWA partnered with UNDP Country Office to address challenges being faced in capacity development and strengthening institutional role of the Ministry. The project has been designed to initiate a systematic process of capacity development to help in sustainable development of water resources and management of water-related affairs in the Kingdom. This approach is meant to ensure permanent and sufficient supply, achieving the key directions of the Saudi Vision 2030 which includes maintaining security of vital resources of the KSA, safeguarding the environment and natural resources; as well as promoting the national implementation of the Sustainable Development Goals (SDGs). 

Annual evaluations are set within this project document to ensure targets are met and course of action corrected when needed during the lifetime of the project. A first evaluation was conducted in 2019 which resulted in a list of recommendations by the evaluator. Since then, all recommendations have been addressed. As of 11 March 2020, the World Health Organization (WHO) declared COVID-19 a global pandemic as the new coronavirus rapidly spread to all regions of the world. Travel to the country is limited and travel in the country is also restricted to those who are fully vaccinated.

And due to this ongoing global pandemic of coronavirus disease all subsequent planned annual evaluations have been halted; however, a final evaluation will be taking place. The evaluation will be taking place with in-country field visit as per required by the national partner. And if for any reason the in-country visit is restricted the evaluation will be postponed.

This intervention requires working with all heads of departments involved with the various outcomes as well as all consultants on the project and other relevant project and ministry staff.

The evaluation will take place in Riyadh, within the offices of MEWA but may require meetings with various national stakeholders.

1. Evaluation purpose, scope and objectives

This evaluation is the final evaluation for the afore mentioned project aimed at re-positioning the project to help MEWA meet its new mandate.  The evaluation and ensuing recommendations will help build a new project document serving MEWA better deliver its intended task and learn lessons from previous activities. 

Scope and objectives of the evaluation:

• Strengthening and optimizing the technical and organizational capacities of the MEWA with respect to water resources and water supply management of the Kingdom

• Implementation of IWIS
• Integrated Water Resources and Supply Management
• Establishing an all-encompassing monitoring system for the surface water and groundwater processes
• The effects of climate change
• Secondary Water Resources
• Environmental Risk
• Investigating Hydrothermal Energy
• Establishing an Environmental Awareness Center for public awareness

• This evaluation will cover all outcomes of the project documents.  It will delve into the details of the achievements, how these feed into the final target (or fail to do so). 
• Coordination amongst all project components has also been a matter of concern
• This evaluation will cover all activities held during the span of the project and highlight issues and recommendations in all aspects (technical, financial, management, structural and operational), including the effective use of resources and delivery outputs in the signed project document and workplan
• The evaluation will suggest recommendations which will help build a new project document.

The evaluator needs to address how the Project sought to mainstream gender in development efforts, considered disability issues and applied the rights-based approach.

1. Evaluation criteria and key guiding questions

Evaluation questions define the information that the evaluation will generate. This section proposes the questions that, when answered, will give intended users of the evaluation the information they seek in order to make decisions, take action or add to knowledge. Questions should be grouped according to the four OECD-DAC evaluation criteria: (a) relevance; (b) effectiveness; (c) efficiency; and (d) sustainability (and/or other criteria used).  

1. Methodology

Evaluation should employ a combination of qualitative and quantitative evaluation methods and instruments. The evaluator is expected to follow a participatory and consultative approach that ensures close engagement with the evaluation managers, implementing partners and male and female direct beneficiaries.  Methodological tools and approaches may include: 

• Document review. This would include a review of all relevant documentation, inter alia
  • Project document (contribution agreement).
  • Theory of change and results framework.
  • Programme and project quality assurance reports.
  • Annual workplans.
  • Activity designs.
  • Consolidated quarterly and annual reports.
  • Results-oriented monitoring report.
  • Highlights of project board meetings. 
  • Technical/financial monitoring reports.
• Interviews and meetings with key stakeholders (men and women) such as key government counterparts, donor community members, representatives of key civil society organizations, United Nations country team (UNCT) members and implementing partners: 
  • Semi-structured interviews, based on questions designed for different stakeholders based on evaluation questions around relevance, coherence, effectiveness, efficiency, and sustainability.
  • Key informant and focus group discussions with men and women, beneficiaries and stakeholders.
  • All interviews with men and women should be undertaken in full confidence and anonymity. The final evaluation report should not assign specific comments to individuals.
• Surveys and questionnaires including male and female participants in development programmes, UNCT members and/or surveys and questionnaires to other stakeholders at strategic and programmatic levels.
• Field visits and on-site validation of key tangible outputs and interventions.
• The evaluator is expected to follow a participatory and consultative approach that ensures close engagement with the evaluation managers, implementing partners and direct beneficiaries.
• Other methods such as outcome mapping, observational visits, group discussions, etc.
• Data review and analysis of monitoring and other data sources and methods. To ensure maximum validity, reliability of data (quality) and promote use, the evaluation team will ensure triangulation of the various data sources.
• Gender and human rights lens. All evaluation products need to address gender, disability, and human right issues. 

The final methodological approach including interview schedule, field visits and data to be used in the evaluation should be clearly outlined in the inception report and fully discussed and agreed between UNDP, key stakeholders, and the evaluator.

1. Evaluation products (deliverables)

• Evaluation inception report (10-15 pages). The inception report should be carried out following and based on preliminary discussions with UNDP after the desk review and should be produced before the evaluation starts (before any formal evaluation interviews, survey distribution or field visits) and prior to the country visit in the case of international evaluators.
• Evaluation debriefings. Immediately following the evaluation, UNDP expects a preliminary debriefing and findings.
• Draft evaluation report (within an agreed length).[2] A length of 40 to 60 pages including executive summary is suggested. 
• Evaluation report audit trail. The programme unit and key stakeholders in the evaluation should review the draft evaluation report and provide an amalgamated set of comments to the evaluator within one week of submission of the draft, as outlined in these guidelines. Comments and changes by the evaluator in response to the draft report should be retained by the evaluator to show how they have addressed comments.
• Final evaluation report. With a one-page evaluation summary to be presented to HE the Minister. The one pager is to highlight key achievements of the project and their impact. 
• Presentations to stakeholders and/or the evaluation reference group (if required).
• Evaluation brief and other knowledge products or participation in knowledge-sharing events, if relevant.

Due to the current COVID-19 situation and its implications, a pre field visit partial payment will be given if an in-country field visit is not possible.

1. Required competencies

The evaluation will be carried out by an international consultant. The consultant shall be responsible for carrying out and performing all the duties and responsibilities as defined in the implementation arrangements section and required by the evaluation.

• Required qualifications:
  • Academic qualification:
    • PHD degree in relevant discipline
  • Work Experience:
    • minimum 10 years’ experience in evaluations, preferable in the field of Water Resources Management.
    • Knowledge of Saudi, region or similar context, a plus.
    • Extensive background in Evaluation Filed;
    • Previous experience working for the UN or other international organization is a plus.
• Technical competencies: Team leadership skills and experience, technical knowledge in UNDP thematic areas, with specifics depending on the focus of the evaluation, data analysis and report writing etc.
• Technical knowledge and experience: Gender and disability inclusion competencies preferable. Technical knowledge and experience in other cross-cutting areas such equality, disability issues, rights-based approach, and capacity development. 
• Language skills required: Fluent English, knowledge of Arabic considered an asset

Evidence to be presented: 

• resume 
• work samples 
• references 

To support claims of knowledge, skills and experience.  

The evaluators should be independent from any organizations that have been involved in designing, executing, or advising any aspect of the project that is the subject of the evaluation.3   

1. Evaluation ethics

Evaluations in UNDP will be conducted in accordance with the principles outlined in the UNEG ‘Ethical Guidelines for Evaluation’.[3]

This evaluation will be conducted in accordance with the principles outlined in the UNEG ‘Ethical Guidelines for Evaluation’. The consultant must safeguard the rights and confidentiality of information providers, interviewees and stakeholders through measures to ensure compliance with legal and other relevant codes governing collection of data and reporting on data. The consultant must also ensure security of collected information before and after the evaluation and protocols to ensure anonymity and confidentiality of sources of information where that is expected. The information knowledge and data gathered in the evaluation process must also be solely used for the evaluation and not for other uses with the express authorization of UNDP and partners.

1. Implementation arrangements

The section describes the specific roles and responsibilities of all involved in this evaluation: 

1. Evaluation commissioner: The Resident Representative who will approve the inception report and the final evaluation report.

1. Evaluation manager: Lead the evaluation process and participate in all of its stages - evaluability assessment, preparation, implementation, management and use. Ensure quality assurance and manage the ERC portal 

1. Evaluator:  

1. Fulfil the contractual arrangements under the TOR 

1. Develop the evaluation inception report, including an evaluation matrix and a gender responsive methodology and evaluation, in line with the TOR, UNEG norms and standards and ethical guidelines  

1. Conduct data collection and field visits according to the TOR and inception report  

1. Produce draft reports adhering to UNDP evaluation templates, UNDP Evaluation guidelines including the required quality criteria, and brief the evaluation manager, programme/ project managers and stakeholders on the progress and key findings and recommendations  

1. Consider gender equality and women’s empowerment and other cross-cutting issues, check if all and respective evaluation questions are answered, and relevant data, disaggregated by sex, is presented, analysed and interpreted. The evaluator needs to ensure that all the evaluation sections are gender responsive. 

1. Finalize the evaluation report, incorporating comments and questions from the feedback/ audit trail. Record own feedback in the audit trail including those of the members of the team, the evaluation manager, the commissioning programme unit, and key stakeholders.  

1. Project manager:  

1. Provide inputs/ advice to the evaluation manager and evaluation reference group on the detail and scope of the TOR for the evaluation and how the findings will be used 

1. Ensure and safeguard the independence of evaluations 

1. Provide the evaluation manager with all required data (e.g. relevant monitoring data) and documentation (reports, minutes, reviews, studies, etc.), contacts/ stakeholder list etc. 

1. Ensure that data and documentation in general, but in particular related to gender equality and women’s empowerment and other cross-cutting issues, are made available to the evaluation manager 

1. Provide comments and clarification on the TOR, inception report and draft evaluation reports 

1. Respond to evaluation recommendations by providing management responses and key actions to all recommendations addressed to UNDP 

1. Ensure dissemination of the evaluation report to all the stakeholders including the project board 

1. Implement relevant key actions on evaluation recommendations 

5.            Evaluation reference group

1. Time frame for the evaluation process

The consultancy should be conducted and completed within 26 days over 2.5 months between ( November 2021 – Jan 2022).

This section lists and describes all tasks and deliverables for which the evaluator will be responsible and accountable, as well as those involving the commissioning office (e.g. workplan, agreements, briefings, draft report, final report).  

• Desk review. 
• Briefings of evaluator. 
• Finalizing the evaluation design and methods and preparing the detailed inception report. 
• In-country data collection and analysis (visits to the field, interviews, questionnaires). 

• Preparing the draft report. 
• Stakeholder meeting and review of the draft report (for quality assurance). 
• Incorporating comments and finalizing the evaluation report. 

In addition, the evaluator may be expected to support UNDP efforts in knowledge sharing and dissemination.  

Working day allocation and schedule for an evaluation