RMI _ Mid Term Evaluation

Link to Atlas Project

00086017 - Federated States of Micronesia Ridge to Reef

Documents

Terms of Reference
Annex 2 Confirmation of Interest
Conditions of Contract

Overview

Consultancy Title:       Mid Term Evaluation (MTR) Consultancy

Project Name:             RMI National Ridge to Reef Project.

Duty Station:              The consultant will be based in Majuro in order to partake in briefing and debriefings with government and non-government partners in the RMI.

 

Duration of Assignment:   

Duration of Assignment: 30 days within 12 weeks period

Application closure date (for submission of application): 16 March 2020.

Starting date: 26 March 2020

Completion date: 8 June 2020.

Number of Days in Country: 10 days between April 20-May 4

 

Consultancy Proposal (CV & Financial proposal Template) should be uploaded on UNDP Jobshop website(https://jobs.undp.org/cj_view_jobs.cfm?cur_rgn_id_c=RAS) no later than, 18th March 2020 (Fiji Time) clearly stating the title of consultancy applied for. Any proposals received after this date/time will not be accepted. Any request for clarification must be sent in writing, or by standard electronic communication to procurement.fj@undp.org. UNDP will respond in writing or by standard electronic mail and will send written copies of the response, including an explanation of the query without identifying the source of inquiry, to all consultants. Incomplete, late and joint proposals will not be considered and only offers for which there is further interest will be contacted. Failure to submit your application as stated as per the application submission guide (Procurement Notice) on the above link will be considered incomplete and therefore application will not be considered.

NOTE:

Proposals must be sent through UNDP job shop web page. Candidates need to upload their CV and financial proposal -using UNDP template

 

If the selected/successful Candidate is over 65 years of age and required to travel outside his home country; He/She will be required provide a full medical report at their expense prior to issuance to contract. Contract will only be issued when Proposed candidate is deemed medically fit to undertake the assignment.

 

 

 

                                                                                                                                               

Objectives

 

The MTR will assess progress towards the achievement of the project objectives and outcomes as specified in the Project Document and assess early signs of project success or failure with the goal of identifying the necessary changes to be made in order to set the project on-track to achieve its intended results. The MTR will also review the project’s strategy, its risks to sustainability. This is the Terms of Reference (ToR) for the UNDP-GEF Midterm Review (MTR) of the project titled: Looking to the Future: Strengthening natural resources management in atoll communities in the Republic of Marshall Islands Employing Integrated Approaches (RMI R2R). This project is the first GEF national R2R project implemented by UNDP through the direct implementation (DIM) modality, working with the RMI Office of the Environmental Planning and Policy Coordination (OEPPC), who will now become the Department of Climate Change after the recent restructure in the Government of RMI. The Director is the GEF Operational Focal Point.

 

The project started on the November 2017 and is in its third year of implementation. In line with the UNDP-GEF Guidance on MTRs, this MTR process was initiated before the submission of the second Project Implementation Report (PIR). This ToR sets out the expectations for this MTR.  The MTR process must follow the guidance outlined in the document Guidance for Conducting Midterm Reviews of UNDP-Supported, GEF-Financed Projects

(http://web.undp.org/evaluation/documents/guidance/GEF/mid-term/Guidance_Midterm%20Review%20_EN_2014.pdf

 

 

Background Information

As a Small Island Developing State (SIDS), the Republic of Marshall Islands (RMI) has a strong dependence on natural resources and biodiversity not only for food and income. The Marshallese relationship with the islands forms the basis of its culture and way of life which has developed in harmony over thousands of years. In the face of global threats, RMI still has pristine waters and coral reefs that contribute to ecosystem services and livelihoods. In recognition of the importance of its natural assets, RMI together with other SIDS responded to global conservation targets through the Micronesia Challenge and specifically for its part, it prepared Reimaanlok to serve as a clear roadmap of the way forward.

 

This project support operationalizing the Reimaanlok – the National Conservation Area Plan, adopted in 2008 to effectively conserve at least 30% of the nearshore marine resources and 20% of the terrestrial resources across Micronesia by 2020.

The project objective is to sustain atoll biodiversity and livelihoods by building community and ecosystem resilience to threats and degrading influences through integrated management of terrestrial and coastal resources adopting the principles and processes outlined in Reimaanlok. The project will be implemented in 5 islands/atolls within five years (2017-2022) with a $3.9m support through the Global Environment Facility.

 

Project Site Interventions:

The project is piloted on five (5) outer islands of Wotho, Mejit, Likiep, Aur and Ebon. The interventions are designed to strengthen local capacities, enabling local communities to implement the integrated natural resource management plans, and providing scale-able demonstrations of sustainable use of ecosystem goods and services. The lessons from this project will guide replication in other sites.

 

 

Approach and Methodology

The MTR must provide evidence-based information that is credible, reliable and useful. The MTR consultant  will review all relevant sources of information including documents prepared during the preparation phase (i.e. PIF, UNDP Initiation Plan, UNDP Environmental & Social Safeguard Policy, the Project Document, project reports including Annual Project Review/PIRs, project budget revisions, lesson learned reports, national strategic and legal documents, and any other materials that the team considers useful for this evidence-based review). The MTR consultant will review the baseline GEF Core Indicators submitted to the GEF at CEO endorsement, and the midterm GEF core indicators that must be completed before the MTR field mission begins.  

 

The MTR consultant is expected to follow a collaborative and participatory approach[1] ensuring close engagement with the Project Team, government counterparts (the GEF Operational Focal Point), the UNDP Country Office(s), UNDP-GEF Regional Technical Advisers, and other key stakeholders.

 

Engagement of stakeholders is vital to a successful MTR.[2] Stakeholder involvement should include interviews with stakeholders who have project responsibilities, including national government departments, NGO’s/ Civil Society Organizations , resource owning communities, community leaders, key experts and consultants in the subject area, Project Steering Committee, other project stakeholders, academia, etc. Below is a detailed list of the stakeholders involved with the project. The MTR consultant will center most of its work on Majuro, however, travel to the outer island will be discussed and agreed upon between the Consultant, UNDP, GEF OFP (OEPPC), RTA and the PIU Team at the beginning of the consultancy.

 

Types

Name

National Government

Department of Climate Change (former OEPPC)

 

Marshall Islands Marine Resource Authority (MIMRA)

 

Historic Preservation Office (HPO)

 

Department of Lands and Survey (L&S)

 

Public School System (PSS)

 

Ministry of Natural Resource and Commerce (MNRC)

Local Government

Mayors: Five Target Sites

UN Organization

International Organization for Migration (IOM)

NGO/CSO

Marshall Islands Conservation Society (MICS)

 

JoJikum

Academic Institution

College of the Marshall Islands (CMI)

 

University of the South Pacific

 

The final MTR report should describe the full MTR approach taken and the rationale for the approach making explicit the underlying assumptions, challenges, strengths and weaknesses about the methods and approach of the review.

 

The MTR consultant will assess the following four categories of project progress. See the Guidance For Conducting Midterm Reviews of UNDP-Supported, GEF-Financed Projects for extended descriptions.

 

i.    Project Strategy

Project design:

  • Review the problem addressed by the project and the underlying assumptions.  Review the effect of any incorrect assumptions or changes to the context to achieving the project results as outlined in the Project Document.
  • Review the relevance of the project strategy and assess whether it provides the most effective route towards expected/intended results.  Were lessons from other relevant projects properly incorporated into the project design?
  • Review how the project addresses country priorities. Review country ownership. Was the project concept in line with the national sector development priorities and plans of the country (or of participating countries in the case of multi-country projects)?
  • Review decision-making processes: were perspectives of those who would be affected by project decisions, those who could affect the outcomes, and those who could contribute information or other resources to the process, taken into account during project design processes?
  • Review the extent to which relevant gender issues were raised in the project design. See Annex 9 of Guidance For Conducting Midterm Reviews of UNDP-Supported, GEF-Financed Projects for further guidelines.
  • If there are major areas of concern, recommend areas for improvement.

 

Results Framework/Logframe:

  • Undertake a critical analysis of the project’s logframe indicators and targets, assess how “SMART” the midterm and end-of-project targets are (Specific, Measurable, Attainable, Relevant, Time-bound), and suggest specific amendments/revisions to the targets and indicators as necessary.
  • Are the project’s objectives and outcomes or components clear, practical, and feasible within its time frame?
  • Examine if progress so far has led to or could in the future catalyse beneficial development effects (i.e. income generation, gender equality and women’s empowerment, improved governance etc...) that should be included in the project results framework and monitored on an annual basis.
  • Ensure broader development and gender aspects of the project are being monitored effectively.  Develop and recommend SMART ‘development’ indicators, including sex-disaggregated indicators and indicators that capture development benefits.

 

ii.    Progress Towards Results

 

Progress Towards Outcomes Analysis:

  • Review the log-frame indicators against progress made towards the end-of-project targets using the Progress Towards Results Matrix and following the Guidance For Conducting Midterm Reviews of UNDP-Supported, GEF-Financed Projects; colour code progress in a “traffic light system” based on the level of progress achieved; assign a rating on progress for each outcome; make recommendations from the areas marked as “Not on target to be achieved” (red).

 

Table. Progress Towards Results Matrix (Achievement of outcomes against End-of-project Targets)

 

 

 

Project Strategy

Indicator[3]

Baseline Level[4]

Level in 1st PIR (self- reported)

Midterm Target[5]

End-of-project Target

Midterm Level & Assessment[6]

Achievement Rating[7]

Justification for Rating

Objective:

 

Indicator (if applicable):

 

 

 

 

 

 

 

Outcome 1:

Indicator 1:

 

 

 

 

 

 

 

Indicator 2:

 

 

 

 

 

Outcome 2:

Indicator 3:

 

 

 

 

 

 

 

Indicator 4:

 

 

 

 

 

Etc.

 

 

 

 

 

Etc.

 

 

 

 

 

 

 

 

 

Indicator Assessment Key

Green= Achieved

Yellow= On target to be achieved

Red= Not on target to be achieved

 

In addition to the progress towards outcomes analysis:

  • Compare and analyse the GEF Core Indicators at the baseline with the one completed right before the Midterm Review.
  • Identify remaining barriers to achieving the project objective in the remainder of the project.
  • By reviewing the aspects of the project that have already been successful, identify ways in which the project can further expand these benefits.

 

iii.   Project Implementation and Adaptive Management

 

Management Arrangements:

  • Review overall effectiveness of project management as outlined in the Project Document.  Have changes been made and are they effective?  Are responsibilities and reporting lines clear?  Is decision-making transparent and undertaken in a timely manner?  Recommend areas for improvement.
  • Review the quality of execution of the Executing Agency/Implementing Partner(s) and recommend areas for improvement.
  • Review the quality of support provided by the GEF Partner Agency (UNDP) and recommend areas for improvement.

 

Work Planning:

  • Review any delays in project start-up and implementation, identify the causes and examine if they have been resolved.
  • Are work-planning processes results-based?  If not, suggest ways to re-orientate work planning to focus on results?
  • Examine the use of the project’s results framework/ logframe as a management tool and review any changes made to it since project start. 
  • Examine the relevance of indicators and targets as per the results framework/ log frame and wherever necessary recommend appropriate changes

 

Finance and co-finance:

  • Consider the financial management of the project, with specific reference to the cost-effectiveness of interventions.  
  • Review the changes to fund allocations as a result of budget revisions and assess the appropriateness and relevance of such revisions.
  • Does the project have the appropriate financial controls, including reporting and planning, that allow management to make informed decisions regarding the budget and allow for timely flow of funds?
  • Informed by the co-financing monitoring table to be filled out, provide commentary on co-financing: is co-financing being used strategically to help the objectives of the project? Is the Project Team meeting with all co-financing partners regularly in order to align financing priorities and annual work plans?

 

Project-level Monitoring and Evaluation Systems:

  • Review the monitoring tools currently being used:  Do they provide the necessary information? Do they involve key partners? Are they aligned or mainstreamed with national systems?  Do they use existing information? Are they efficient? Are they cost-effective? Are additional tools required? How could they be made more participatory and inclusive?
  • Examine the financial management of the project monitoring and evaluation budget.  Are sufficient resources being allocated to monitoring and evaluation? Are these resources being allocated effectively?

 

Stakeholder Engagement:

  • Project management: Has the project developed and leveraged the necessary and appropriate partnerships with direct and tangential stakeholders?
  • Participation and country-driven processes: Do local and national government stakeholders support the objectives of the project?  Do they continue to have an active role in project decision-making that supports efficient and effective project implementation?
  • Participation and public awareness: To what extent has stakeholder involvement and public awareness contributed to the progress towards achievement of project objectives?

 

Reporting:

  • Assess how adaptive management changes have been reported by the project management and shared with the Project Board.
  • Assess how well the Project Team and partners undertake and fulfil GEF reporting requirements (i.e. how have they addressed poorly rated PIRs, if applicable?)
  • Assess how lessons derived from the adaptive management process have been documented, shared with key partners and internalized by partners.

 

Communications:

  • Review internal project communication with stakeholders: Is communication regular and effective? Are there key stakeholders left out of communication? Are there feedback mechanisms when communication is received? Does this communication with stakeholders contribute to their awareness of project outcomes and activities and investment in the sustainability of project results?
  • Review external project communication: Are proper means of communication established or being established to express the project progress and intended impact to the public (is there a web presence, for example? Or did the project implement appropriate outreach and public awareness campaigns?)
  • For reporting purposes, write one half-page paragraph that summarizes the project’s progress towards results in terms of contribution to sustainable development benefits, as well as global environmental benefits.

 

iv.   Sustainability

  • Validate whether the risks identified in the Project Document, Annual Project Review/PIRs and the ATLAS Risk Management Module are the most important and whether the risk ratings applied are appropriate and up to date. If not, explain why.
  • In addition, assess the following risks to sustainability:

 

Financial risks to sustainability:

  • What is the likelihood of financial and economic resources not being available once the GEF assistance ends (consider potential resources can be from multiple sources, such as the public and private sectors, income generating activities, and other funding that will be adequate financial resources for sustaining project’s outcomes)?

 

Socio-economic risks to sustainability:

  • Are there any social or political risks that may jeopardize sustainability of project outcomes? What is the risk that the level of stakeholder ownership (including ownership by governments and other key stakeholders) will be insufficient to allow for the project outcomes/benefits to be sustained? Do the various key stakeholders see that it is in their interest that the project benefits continue to flow? Is there sufficient public / stakeholder awareness in support of the long-term objectives of the project? Are lessons learned to be documented by the Project Team on a continual basis and shared/ transferred to appropriate parties who could learn from the project and potentially replicate and/or scale it in the future?

 

 

Institutional Framework and Governance risks to sustainability:

  • Do the legal frameworks, policies, governance structures and processes pose risks that may jeopardize sustenance of project benefits? While assessing this parameter, also consider if the required systems/ mechanisms for accountability, transparency, and technical knowledge transfer are in place.

 

Environmental risks to sustainability:

  • Are there any environmental risks that may jeopardize sustenance of project outcomes?

 

Conclusions & Recommendations

 

The MTR consultant will include a section of the report setting out the MTR’s evidence-based conclusions, in light of the findings.[8]

 

Recommendations should be succinct suggestions for critical intervention that are specific, measurable, achievable, and relevant. A recommendation table should be put in the report’s executive summary. See the Guidance For Conducting Midterm Reviews of UNDP-Supported, GEF-Financed Projects for guidance on a recommendation table.

 

The MTR team should make no more than 15 recommendations total.

 

Ratings

 

The MTR consultant will include its ratings of the project’s results and brief descriptions of the associated achievements in a MTR Ratings & Achievement Summary Table in the Executive Summary of the MTR report. See Annex E for ratings scales. No rating on Project Strategy and no overall project rating is required.

 

Table. MTR Ratings & Achievement Summary Table for (RMI Ridge to Reef Project)

Measure

MTR Rating

Achievement Description

Project Strategy

N/A

 

 

 

 

Progress Towards Results

Objective Achievement Rating: (rate 6 pt. scale)

 

Outcome 1 Achievement Rating: (rate 6 pt. scale)

 

Outcome 2 Achievement Rating: (rate 6 pt. scale)

 

Outcome 3 Achievement Rating: (rate 6 pt. scale)

 

Etc.

 

Project Implementation & Adaptive Management

(rate 6 pt. scale)

 

Sustainability

(rate 4 pt. scale)

 

 

 

 

TIMEFRAME

 

The total duration of the MTR will be 30 days within 12 weeks period starting 26 March to 8 June 2020. The tentative MTR timeframe is as follows:

 

TIMEFRAME

ACTIVITY

March 12-16

Advertising Consultant position.

March 17-25

Application closed and Assessment of applications

March 26-April 3 

  • Contracting of consultant
  • Submission of workplan
  • Handing over document for review
  • Submission of inception report

April 20-May 4

MTR mission in country: conducting stakeholder meetings, interviews, field visits to demo sites (to be confirmed)

Mission wrap up meeting and Presentation of initial findings of the MTR

May 18

  • Submission of draft report

May 19-June 1

Government, UNDP and other stakeholders provide feedback on the draft report

June 8

Finalization of MTR incorporating audit trail from feedback on draft report.

 

MIDTERM REVIEW DELIVERABLES

 

#

Deliverable

Description

Timing

Responsibilities

1

MTR Inception Report

MTR team clarifies objectives and methods of Midterm Review

No later than 2 weeks before the MTR mission – by 3 April.

MTR consultant submits to the UNDP, OEPPC (GEF OFP) and project management

2

Presentation

Initial Findings

End of MTR mission –by 4 May

MTR consultant presents to project management, and the OEPPC

3

Draft Final Report

Full report (using guidelines on content outlined in Annex B) with annexes

Within 2 weeks after the MTR mission –by 18 May 

Sent to UNDP, reviewed by RTA, Project Coordinating Unit, GEF OFP

4

Final Report*

Revised report with audit trail detailing how all received comments have (and have not) been addressed in the final MTR report

Within 1 week of receiving UNDP comments on draft -by 8 June

Sent to the UNDP

*The final MTR report must be in English. If applicable, the UNDP/GEF OFP may choose to arrange for a translation of the report into a language more widely shared by national stakeholders. Options for site visits should be provided in the Inception Report

 

MTR ARRANGEMENTS

The principal responsibility for managing this MTR resides with the UNDP Pacific Office, as commissioning unit.

 

The commissioning unit will contract the consultant and ensure the timely provision of per diems and travel arrangements for the MTR consultant. The Project Team will be responsible for liaising with the MTR team to provide all relevant documents, set up stakeholder interviews, and arrange field visits as well as focal points in each state.

 

CONSULTANCY CRITERIA

An independent consultant will conduct the MTR with experience and exposure to projects and evaluations in other regions globally.  The consultant cannot have participated in the project preparation, formulation, and/or implementation (including the writing of the Project Document) and should not have a conflict of interest with project’s related activities. 

 

The selection of consultant will be aimed at maximizing the overall qualities in the following areas

  • Recent experience with result-based management evaluation methodologies;
  • Experience applying SMART indicators and reconstructing or validating baseline scenarios;
  • Competence in adaptive management, as applied to GEF Focal Areas of land degradation, international waters and biodiversity);
  • Previous experience facilitating evaluations of GEF/UNDP and other development agency supported projects/initiatives;
  • Experience working in the Pacific region and/or small island state is advantageous;
  • Work experience in relevant technical areas for at least 10 years;
  • Demonstrated understanding of issues related to gender and biodiversity, land degradation and international waters; experience in gender sensitive evaluation and analysis.
  • Excellent communication skills;
  • Demonstrable analytical skills;
  • A Master’s degree in Environmental Conservation, Sustainable Development, Development studies and /or 10 years of relevant experience in a closely related field is necessary
  • Familiarity and experience with Strategic Environmental Assessment approaches is preferred

 

Criteria

Max. Point

Qualification

  • Minimum Master’s degree in Environmental Conservation, Sustainable Development, Development studies and /or 10 years of relevant experience in a closely related field is necessary

 

 

10%

Experience

  • Previous experience facilitating evaluations of GEF/UNDP and other development agency supported projects/initiatives;
  • Experience applying SMART indicators and reconstructing or validating baseline scenarios;
  • Competence in adaptive management, as applied to GEF Focal Areas of land degradation, international waters and biodiversity);
  • Demonstrated understanding of issues related to gender and biodiversity, land degradation and international waters; experience in gender sensitive evaluation and analysis.
  • Excellent communication skills;
  • Demonstrable analytical skills;
  • Familiarity and experience with Strategic Environmental Assessment approaches is preferred

 

20%

       

10%

 

10%

 

5%

5%

 

10%

 

Total

70%

 

 

 

Criteria for Evaluation of Proposal:  Only those applications which are responsive and compliant will be evaluated.  Offers will be evaluated according to the Combined Scoring method – where the educational background and experience on similar assignments will be weighted at 70% and the price proposal will weigh as 30% of the total scoring.  The applicant receiving the Highest Combined Score that has also accepted UNDP’s General Terms and Conditions will be awarded the contract.

 

PAYMENT MODALITIES AND SPECIFICATIONS

  • 20% of payment upon signing of contract and acceptance of work plan by March 26.
  • 40% upon approval of the draft MTR report by May18.
  • 40% upon approval of final MTR report and submission of supporting document including GCF Core Indicators by June 8

 

 

Supervision/Reporting

 

The Consultant will report and supervised by the Deputy Team Leader Resilience and Sustainable Development Unit, UNDP Pacific Office in Fiji. While working in RMI, will be required to also report to the Project Manager, PIU and Director OEPPC (GEF OFP).

 

The consultant is expected to provide for his/her own laptop. Works station and other support will be provided for by the project.

 

He/ She is expected to coordinate closely with the Office of the Environmental Planning and Policy Coordination (OEPPC), Project Implementation Unit, and UNDP Pacific Office in Fiji.

 

 

 

APPLICATION PROCESS[9]

 

Recommended Presentation of Proposal: 

 

  1. Letter of Confirmation of Interest and Availability using the template[10] provided by UNDP;
  2. CV Brief description of approach to work/technical proposal of why the individual considers him/herself as the most suitable for the assignment, and a proposed methodology on how they will approach and complete the assignment; (max 1 page)
  3. Financial Proposal that indicates the all-inclusive fixed total contract price and all other travel related costs (excluding in country costs of travel), supported by a breakdown of costs, as per template attached to the Letter of Confirmation of Interest template. If an applicant is employed by an organization/company/institution, and he/she expects his/her employer to charge a management fee in the process of releasing him/her to UNDP under Reimbursable Loan Agreement (RLA), the applicant must indicate at this point, and ensure that all such costs are duly incorporated in the financial proposal submitted to UNDP. 

 

The Consultant must send a financial proposal based on a Lump Sum Amount. The total amount quoted shall be all-inclusive and include all costs components required to perform the deliverables identified in the TOR, including professional fee, travel costs, living allowance (if any work is to be done outside the IC´s duty station) and any other applicable cost to be incurred by the IC in completing the assignment. The contract price will be fixed output-based price regardless of extension of the herein specified duration. Payments will be done upon completion of the deliverables/outputs.

 

In general, UNDP shall not accept travel costs exceeding those of an economy class ticket. Should the IC wish to travel on a higher class he/she should do so using their own resources. In the event of unforeseeable travel not anticipated in this TOR, payment of travel costs including tickets, lodging and terminal expenses should be agreed upon, between the respective business unit and the Individual Consultant, prior to travel and will be reimbursed.

The P11 form and Template for confirmation of interest and Submission of Financial Proposal is available under the procurement section of UNDP Fiji website (www.pacific.undp.org)

 

Women candidates are encouraged to apply.