Link to Atlas Project

Documents

Overview

Overview :

The interested offeror must submit the application via the following link

 https://jobs.undp.org/cj_view_job.cfm?cur_job_id=107129

Final Project Evaluation Terms of Reference

UNDP Country Office and Ministry of Foreign Affairs

Kingdom of Saudi Arabia

1. Background and context

The Kingdom of Saudi Arabia (KSA) spans the vast majority of the Arabian Peninsula, with a land area of approximately 2,150,000 km2 (830,000 sq mi). Saudi Arabia is the largest country in the Middle East, and the second-largest country in the Arab world with a rapidly growing population of 35,013,414 in 2020. The Ministry of Foreign Affairs is responsible for the Kingdom of Saudi Arabia's diplomatic relations, to achieve and preserve national interests, and to promote the Kingdom's role in establishing security, stability, and prosperity in the region and the world. MOFA derives its core values from the Islamic social and professional principles as a key element in its organizational philosophy and inculcate the values in employees and organizational units at all levels.

In April 2016, the Saudi Vision 2030, an ambitious blueprint for development, was launched. Vision 2030 is the forward-thinking initiative of Crown Prince Mohammed bin Salman. It sets down a plan for the Kingdom of Saudi Arabia’s future with several goals aimed at inspiring economic, political, and social development. And in 2016 the National Transformation Programme 2020 (NTP 2020) was launched across 24 governmental bodies, operating in the economic and development sectors.

In achieving this vision, it is expected that all ministries and Government bodies would strive for organizational excellence, improving their services, personnel, and building high-performing manpower. The vision urges Saudi Arabia to open up to the external world, and to improve the consular services, as well as strengthening the positive image of the Kingdom, enhancing the regional relations. This accentuates the role of the Ministry of Foreign Affairs in realization of the Vision 2030. The Umbrella Programme for Advisory Services to MOFA project is a national project benefiting the whole of the Kingdom and all governmental agencies in addition to contributing to the UNDP CPD (2017- 2021) Outcome 1 (Improved knowledge-based equitable and sustainable development, underpinned by innovation and improved infrastructure) and CPD output 1.1 (National policies developed to promote economic diversification with a focus on increased employment of nationals). It also contributes to SDG 16. Target:16. a Strengthen relevant national institutions, including through international cooperation, for building capacity at all levels, in particular in developing countries, to prevent violence and combat terrorism and crime.

The project is implemented by the Ministry of Foreign Affairs.

On the basis of the outputs of MOFA Strategic Plans and UNDP Projects, as well as considering the UN and Saudi strategy and policy documents, the final evaluation will look into the progress of the following outputs:

1. Strengthening the public diplomacy
2. Supporting Prince Saudi Al-Faisal institute of Diplomatic Studies
3. Providing advisory services to the organizational units at MOFA: political, economic, specialized, consular, general affairs, technical affairs, planning and development, legal unit, and human resources unit.
4. Promoting the international representation of Saudi Arabia.
5. Supporting recruitment of Saudi nationals in the UN System.
6. Enhanced capacity of the Strategic Planning and Development Directorate (SPDD) to deepen MoFA reforms based on change management, systematic analysis, and strategic planning.
7. Technical and Administrative Support to the General Directorate for Human Resources (GDHR)

 The project benefits youth in the third output per the revision: Output 3: Increasing Saudi Representation in the UN- which specifically target the Saudi youth.

The evaluation requires working with all heads of departments involved with the various outcomes as well as all consultants on the project and other relevant project and authority staff. 

The project duration was originally for 4 years (2018- 2021). The project extension period (August 2021 to December 2022) provides the necessary time for the project to complete ongoing activities and deliver the revised outputs to achieve a more significant impact. The aim of the revision was to expand the scope of the project by including outputs relevant to the support of the Strategic Development and Planning Directorate (SPDD), and to the General Directorate for Human Resources (GDHR). The revised project prioritizes the provision of technical support and capacity development interventions to enable both departments to guide and facilitate MOFA reform and restructuring process.

The Revised Outputs are:

Output 1: Enhanced Capacity of the strategic Planning and Development Directorate (SPDD)to deepen MOFA based on change management, systematic analysis, and strategic planning.

Output 2: Technical and administrative support to the General Directorate for Human Resources (GDHR)

Output 3: Advisory services to MOFA: Including the key pillars under the ambarella programme.

COVID 19 had impacted the project by delaying some planned activities and official needed approvals from MOFA on certain proposals.

Basic Project information can also be included in table format as follows:

1. Evaluation purpose, scope and objectives

Evaluation purpose and objectives:

This final evaluation is conducted as part of a planned intervention aimed at re-positioning the project to help MOFA meet its mandate. The project has been ongoing since September 2018 and has, thus far, never been evaluated. In view of the pandemic and the drastic changes that has been taking place in the country, the project has had to adapt to the changes over recent years. To ensure the project has delivered its intended objectives and to provide recommendations for the way forward, it is imperative to conduct a final evaluation and ensure the project has delivered. This evaluation will benefit the Ministry of Foreign Affairs in their planning for future years to meet Saudi Vision 2030 and highlight the impacts this project has had over the past few years. The evaluation and ensuing recommendations will help build a new project document serving MOFA to better deliver its intended task and learn lessons from previous activities.   

Scope of the evaluation:

• The final evaluation will look into the progress of the following outputs:

1. Strengthening the public diplomacy
2. Supporting Prince Saudi Al-Faisal institute of Diplomatic Studies
3. Providing advisory services to the organizational units at MOFA: political, economic, specialized, consular, general affairs, technical affairs, planning and development, legal unit, and human resources unit.
4. Promoting the international representation of Saudi Arabia.
5. Supporting recruitment of Saudi nationals in the UN System.
6. Enhanced capacity of the Strategic Planning and Development Directorate (SPDD) to deepen MoFA reforms based on change management, systematic analysis, and strategic planning.
7. Technical and Administrative Support to the General Directorate for Human Resources (GDHR)

• This evaluation will cover all activities held during the span of the project between (1 September 2018 - 31st of Dec 2022) and highlight issues and recommendations in all aspects (technical, financial, management, structural and operational), including the effective use of resources and delivery outputs in the signed project document and workplan.

Issues relate directly to the questions of the evaluation must be answered so that users will have the information they need for pending decisions or action. An issue may concern the relevance, coherence, efficiency, effectiveness, or sustainability of the intervention. In addition, UNDP evaluations must address how the intervention sought to mainstream gender in development efforts, considered disability issues and applied the rights-based approach. 

1. Evaluation criteria and key guiding questions

Referencing and adopting from Organization for Economic Cooperation and Development (OECD) Development Assistance Committee (DAC) evaluation criteria ((a) relevance/ coherence; (b) effectiveness; (c) efficiency; and (d) sustainability (and/or other criteria used), the evaluation will answer the following questions:

Guiding evaluation questions will be further refined in the inception report by the evaluation team and agreed with UNDP evaluation stakeholders.

1. Methodology

The evaluation should employ a combination of qualitative and quantitative evaluation methods and instruments. The evaluator is expected to follow a participatory and consultative approach that ensures close engagement with the evaluation managers, implementing partners and male and female direct beneficiaries.  Methodological tools and approaches may include:   

• Document review. This would include a review of all relevant documentation, inter alia 

• Project document (contribution agreement).  
• Theory of change and results framework. 

• Programme and project quality assurance reports. 
• Annual workplans. 
• Activity designs.  
• Consolidated quarterly and annual reports.  
• Results-oriented monitoring report.  

• Highlights of project board meetings.   
• Technical/financial monitoring reports. 
• Financial reports for the funding analysis required as per the evaluation questions

• Interviews and meetings with key stakeholders (men and women) such as key government counterparts, donor community members, representatives of key civil society organizations, United Nations country team (UNCT) members and implementing partners:  

• Semi-structured interviews, based on questions designed for different stakeholders based on evaluation questions around relevance, coherence, effectiveness, efficiency, and sustainability. 
• Key informant and focus group discussions with men and women, beneficiaries and stakeholders. 

• All interviews with men and women should be undertaken in full confidence and anonymity. The final evaluation report should not assign specific comments to individuals. 

• Surveys and questionnaires including male and female participants in development programmes, UNCT members and/or surveys and questionnaires to other stakeholders at strategic and programmatic levels. 
• Field visits and on-site validation of key tangible outputs and interventions. 
• Other methods such as outcome mapping, observational visits, group discussions, etc. 

• Data review and analysis of monitoring and other data sources and methods. To ensure maximum validity, reliability of data (quality) and promote use, the evaluation team will ensure triangulation of the various data sources. 
• Gender and human rights lens. All evaluation products need to address gender, disability, and human right issues.  

The final methodological approach including interview schedule, field visits and data to be used in the evaluation should be clearly outlined in the inception report and fully discussed and agreed between UNDP, key stakeholders, and the evaluator. 

1. Evaluation products (deliverables)

• Evaluation inception report (10-15 pages). The inception report should be carried out following and based on preliminary discussions with UNDP after the desk review and should be produced before the evaluation starts (before any formal evaluation interviews, survey distribution or field visits) and prior to the country visit in the case of international evaluators. 
• Evaluation debriefings. Immediately following the evaluation, UNDP expects a preliminary debriefing and findings.  

• Draft evaluation report (within an agreed length).2 A length of 40 to 60 pages including executive summary is suggested.   
• Evaluation report audit trail. The programme unit and key stakeholders in the evaluation should review the draft evaluation report and provide an amalgamated set of comments to the evaluator within one week of submission of the draft. Comments and changes by the evaluator in response to the draft report should be retained by the evaluator to show how they have addressed comments. 
• Final evaluation report. 
• Presentations to stakeholders and/or the evaluation reference group (if required). 
• Evaluation brief and other knowledge products agreed in the inception report or participation in knowledge-sharing events, if relevant. 

Standard templates that need to be followed are provided in the Annexes section. It is expected that the evaluator will follow the UNDP evaluation guidelines and UNEG quality check list and ensure all the quality criteria are met in the evaluation report.

In line with UNDP’s financial regulations, when determined by the Country Office and/or the consultant that a deliverable or service cannot be satisfactory completed due to impact of COVID-19 and limitations to the evaluation, that deliverable or service will not be paid. Due to the current COVID-19 situation and its implications, a partial payment may be considered if the consultant invested time towards the deliverable but was unable to complete to circumstances beyond his/her/their control.

1. Evaluation required competencies

The evaluation will be carried out by an international consultant. The consultant shall be responsible for carrying out and performing all the duties and responsibilities as defined in the implementation arrangements section and required by the evaluation.

• Required qualifications:  Advanced degree in political science or relevant field, minimum 10 years’ experience in evaluations, preferably in the field of political science, international affairs, diplomacy and capacity building for strategic planning. Knowledge of Saudi, region or similar context, a plus.  

• Technical competencies: Team leadership skills and experience, technical knowledge in UNDP thematic areas, with specifics depending on the focus of the evaluation, data analysis and report writing etc. 
• Technical knowledge and experience: Gender and disability inclusion competencies are preferable as well as technical knowledge and experience in other cross-cutting areas such equality, disability issues, rights-based approach, and capacity development.   
• Language skills required: Fluent English, knowledge of Arabic is considered an asset. 

Evidence to be presented:  

• resume  
• work samples  
• references  

To support claims of knowledge, skills and experience.   

Explicit statement of evaluators’ independence from any organizations that have been involved in designing, executing, or advising any aspect of the intervention that is the subject of the evaluation should be provided.3    

1. Evaluation ethics

Evaluations in UNDP will be conducted in accordance with the principles outlined in the UNEG ‘Ethical Guidelines for Evaluation’.3  

This evaluation will be conducted in accordance with the principles outlined in the UNEG ‘Ethical Guidelines for Evaluation’. The consultant must safeguard the rights and confidentiality of information providers, interviewees and stakeholders through measures to ensure compliance with legal and other relevant codes governing collection of data and reporting on data. The consultant must also ensure security of collected information before and after the evaluation and protocols to ensure anonymity and confidentiality of sources of information where that is expected. The information knowledge and data gathered in the evaluation process must also be solely used for the evaluation and not for other uses with the express authorization of UNDP and partners. 

1. Implementation arrangements

The section describes the specific roles and responsibilities of all involved in this evaluation:  

1. Evaluation commissioner: The Resident Representative who will approve the inception report and the final evaluation report.

1. Evaluation manager: Lead the evaluation process and participate in all of its stages - evaluability assessment, preparation, implementation, management and use of the evaluation. Ensure quality assurance and manage the ERC portal  

1. Evaluator:   

1. Fulfil the contractual arrangements under the TOR  

1. Develop the evaluation inception report, including an evaluation matrix and a gender responsive methodology, in line with the TOR, UNEG norms and standards and ethical guidelines   

1. Conduct data collection and field visits according to the TOR and inception report   

1. Produce draft reports adhering to UNDP evaluation templates, UNDP Evaluation guidelines including the required quality criteria and brief the evaluation manager, programme/ project managers and stakeholders on the progress and key findings and recommendations   

1. Consider gender equality and women’s empowerment and other cross-cutting issues, check if all and respective evaluation questions are answered, and relevant data, disaggregated by sex, is presented, analysed and interpreted. The evaluator needs to ensure that all the evaluation sections are gender responsive.  

1. Finalize the evaluation report, incorporating comments and questions from the feedback/ audit trail. Record own feedback in the audit trail including those of the members of the team, the evaluation manager, the commissioning programme unit, and key stakeholders.   

1. Project manager:   

1. Provide inputs/ advice to the evaluation manager and evaluation reference group on the detail and scope of the TOR for the evaluation and how the findings will be used  

1. Ensure and safeguard the independence of evaluations  

1. Provide the evaluation manager with all required data (e.g., relevant monitoring data) and documentation (reports, minutes, reviews, studies, etc.), contacts/ stakeholder list etc.  

1. Ensure that data and documentation in general, but in particular related to gender equality and women’s empowerment and other cross-cutting issues, are made available to the evaluation manager  

1. Provide comments and clarification on the TOR, inception report and draft evaluation reports  

1. Respond to evaluation recommendations by providing management responses and key actions to all recommendations addressed to UNDP  

1. Ensure dissemination of the evaluation report to all the stakeholders including the project board  

1. Implement relevant key actions on evaluation recommendations