INTRODUCTION In accordance with UNDP and GEF M&E policies and procedures, all full and medium-sized UNDP support GEF financed projects are required to undergo a terminal evaluation upon completion of implementation. These terms of reference (TOR) sets out the expectations for a Terminal Evaluation (TE) of the “Catalysing the Use of Solar Photovoltaic Energy” (PIMS 5137) The essentials of the project to be evaluated are as follows: PROJECT SUMMARY TABLE Project Title: | Catalysing the Use of Solar Photovoltaic Energy | GEF Project ID: | 5063 | | at endorsement (Million US$) | at completion (Million US$) | UNDP Project ID: | 00089774 | GEF financing: | 2,227,273 | 2,227,273 | Country: | Iraq | IA/EA own: | 215,200 | 215,200 | Region: | MENA | Government: | 22,750,000 | 22,750,000 | Focal Area: | Climate Change | Other: | 0 | 0 | FA Objectives, (OP/SP): | Promote Investment in Renewable Energy Technologies | Total co-financing: | 32,965,200 | 32,965,200 | Executing Agency: | UNDP | Total Project Cost: | 35,192,473 | 35,192,473 | Other Partners involved: | -Ministry of Environment -Ministry of Electricity -Ministry of Industry and Minerals -Ministry of Science & Technology - Al Shafei Group | ProDoc Signature (date project began): | 15 Aug 2014 | (Operational) Closing Date: | Proposed: October 1, 2018 | Actual: December 31, 2019 |
OBJECTIVE AND SCOPE: The project was designed to reduce greenhouse gas emissions in Iraq by demonstrating and Catalysing the application of solar power to meet the energy needs of offices, small businesses, residences and town services through small-scale distributed solar PV installations and utility-scale plants, on- and off-grid. The three key expected outcome results are: Outcome 1: Investment in solar photovoltaic power technologies for on-grid and off-gridconnection. Outcome 2:Encouragement of investments in solar power technology in Iraq and consumer uptake of solar appliances through policy reform and financial incentives. Outcome 3: Facilitation of private-sector capacity for technology development innovation and servicing in the solar industry through capacity building and domestic market analysis electricity generation for office, residential, small business and town application.
The Terminal Evaluation (TE) will cover the entire programme. The TE will be conducted according to the guidance, rules and procedures established by UNDP and GEF as reflected in the UNDP Evaluation Guidance for GEF Financed Projects. The objectives of the evaluation are to assess the achievement of project results, and to draw lessons that can both improve the sustainability of benefits from this project, and aid in the overall enhancement of UNDP programming. The TE will be conducted according to the guidance, rules and procedures established by UNDP and GEF as reflected in the UNDP Evaluation Guidance for GEF Financed Projects. The objectives of the evaluation are to assess the achievement of project results, and to draw lessons that can both improve the sustainability of benefits from this project, and aid in the overall enhancement of UNDP programming. |
EVALUATION METHOD AND APPROACH: An overall approach and method [1] for conducting project terminal evaluations of UNDP supported GEF financed projects has developed over time. The evaluator is expected to frame the evaluation effort using the criteria of relevance, effectiveness, efficiency, sustainability, and impact, as defined and explained in the UNDP Guidance for Conducting Terminal Evaluations of UNDP-supported, GEF-financed Projects. A set of questions covering each of these criteria have been drafted and are included with this TOR (fill in Annex C) The evaluator is expected to amend, complete and submit this matrix as part of an evaluation inception report, and shall include it as an annex to the final report. The evaluation must provide evidence-based information that is credible, reliable and useful. The evaluator is expected to follow a participatory and consultative approach ensuring close engagement with government counterparts, in particular the GEF operational focal point, UNDP Country Office, project team, UNDP GEF Technical Adviser based in the region and key stakeholders. The evaluator is expected to conduct a field mission to Iraq, including the following project sites: R&D Station at the Ministry of Science and Technology (MoST), Jadyria, Baghdad, Iraq. Al-Mansour Factory, Baghdad, Iraq. Baytti site, Najaf, Iraq The Prime Minister Advisory Commission (PMAC), Baghdad.
Interviews will be held with the following organizations and individuals at a minimum: The Prime Minister Advisory Commission (PMAC). Minister of Health and Environment (MoHEN). Dr. Jassim Abdul Azez Humadi, Deputy-minister for Environment; GEF Focal Point. Ms. Shatha Kadhum, DG, Directorate of Technical affairs. Ms. Suzan Sami Banna, Climate change Centre; Member of the Project Steering Committee(PSC).
Ministry of Electricity Ministry of Higher Education and Scientific Research (Science and Technology) Dr. Kamal Leteef Hussein, DG, Directorate of Renewable Energy. (Member of PSC). Mr. Ali Abdulaziz, Head of Renewable Energy Directorate. Dr. Falah Al-Atar, Renewable Energy Directorate Mr. Ahmed Abdul Jabbar, Solar PV Panel Lab station staff.
Ministry of Industry and Minerals Mr. Fliah Mizeal Mizher, Deputy-DG, Alzawra State Company (member of PSC). - Mr. Rajed Abdul Wahid, Manager, Al-Mansour Factory?
Mr. Ammar Najim , Production Manager,Al-Mansour Factory Mr. Raad Khalil, Saled Manager,Al-Mansour Factory.
Alshafei Group,Private company (Baytti Site) College of Engineering, Baghdad University - Altreeb Company (private sector engaged in trading and installation of PV solar equipment, Baghdad). Mr. Ammar Abdul Hadi Alhayani
- Regional Technical Advisor (RTA) Office Mr. Saliou Toure, RTA
The Regional Centre for Renewable Energy and energy Efficiency (RCREEE) Project’s Team Mr. Tarik-Ul-Islam, Programme Manager Dr. Abbas Balasem, National Consultant Mr. Mohammed Faez Al-Attar, Solar Engineer
The evaluator will review all relevant sources of information, such as the project document, project reports – including Annual APR/PIR, project budget revisions, midterm review, progress reports, GEF focal area tracking tools, project files, national strategic and legal documents, and any other materials that the evaluator considers useful for this evidence-based assessment. A list of documents that the project team will provide to the evaluator for review is included in Annex B of this Terms of Reference. EVALUATION CRITERIA AND RATINGS An assessment of project performance will be carried out, based against expectations set out in the Project Logical Framework/Results Framework (Annex A), which provides performance and impact indicators for project implementation along with their corresponding means of verification. The evaluation will at a minimum cover the criteria of: relevance, effectiveness, efficiency, sustainability and impact. Ratings must be provided on the following performance criteria. The completed table must be included in the evaluation executive summary. The obligatory rating scales are included in Annex D. Evaluation Ratings: | 1. Monitoring and Evaluation | rating | 2. IA& EA Execution | rating | M&E design at entry | | Quality of UNDP Implementation | | M&E Plan Implementation | | Quality of Execution - Executing Agency | | Overall quality of M&E | | Overall quality of Implementation / Execution | | 3. Assessment of Outcomes | rating | 4. Sustainability | rating | Relevance | | Financial resources: | | Effectiveness | | Socio-political: | | Efficiency | | Institutional framework and governance: | | Overall Project Outcome Rating | | Environmental : | | | | Overall likelihood of sustainability: | |
PROJECT FINANCE/COFINANCE: The Evaluation will assess the key financial aspects of the project, including the extent of co-financing planned and realized. Project cost and funding data will be required, including annual expenditures. Variances between planned and actual expenditures will need to be assessed and explained. Results from recent financial audits, as available, should be taken into consideration. The evaluator(s) will receive assistance from the Country Office (CO) and Project Team to obtain financial data in order to complete the co-financing table below, which will be included in the terminal evaluation report. Co-financing (type/source) | UNDP own financing (mill. US$) | Government (mill. US$) | Private sector (mill. US$) | Total (mill. US$) | Planned | Actual | Planned | Actual | Planned | Actual | Actual | Actual | Grants | | | | | | | | | Loans/Concessions | | | | | | | | | | 215,200 | 215,200 | 22,750,000 | 22,750,000 | 10,000,000 | 10,000,000 | 32,965,200 | 32,965,200 | | | | | | | | | | Totals | 215,200 | 215,200 | 22,750,000 | 22,750,000 | 10,000,000 | 10,000,000 | 32,965,200 | 32,965,200 |
MAINSTREAMING UNDP supported GEF financed projects are key components in UNDP country programming, as well as regional and global programmes. The evaluation will assess the extent to which the project was successfully mainstreamed with other UNDP priorities, including poverty alleviation, improved governance, the prevention and recovery from natural disasters, and gender. IMPACT The evaluators will assess the extent to which the project is achieving impacts or progressing towards the achievement of impacts. Key findings that should be brought out in the evaluations include whether the project has demonstrated: a) verifiable improvements in ecological status, b) verifiable reductions in stress on ecological systems, and/or c) demonstrated progress towards these impact achievements. CONCLUSIONS, RECOMMENDATIONS & LESSONS The evaluation report must include a chapter providing a set of conclusions, recommendations and lessons. IMPLEMENTATION ARRANGEMENTS The principal responsibility for managing this evaluation resides with the UNDP CO in Iraq. The UNDP CO will contract the evaluators and ensure the timely provision of per diems and travel arrangements within the country for the evaluation team. The Project Team will be responsible for liaising with the Evaluators team to set up stakeholder interviews, arrange field visits, coordinate with the Government etc. EVALUATION TIMEFRAME The total duration of the evaluation will be 21 days according to the following plan: Activity | Timing | Completion Date | Preparation | 4 days | 16-19 September 2019 | Evaluation Mission | 5 days | 6-10 October 2019 | Draft Evaluation Report | 10 days | 1-10 November 2019 | Final Report | 2 days | 29-30 November 2019 |
EVALUATION DELIVERABLES The evaluation team is expected to deliver the following: Deliverable | Content | Timing | Responsibilities | Inception Report | Evaluator provides clarifications on timing and method | No later than 2 weeks before the evaluation mission. (by 22 September 2019) | Evaluator submits to UNDP CO | Presentation | Initial Findings | End of evaluation mission (10 October 2019) | To project management, UNDP CO | Draft Final Report | Full report, (per annexed template) with annexes | Within 3 weeks of the evaluation mission (by 31October 2019) | Sent to CO, reviewed by RTA, PCU, GEF OFPs | Final Report* | Revised report | Within 1 week of receiving UNDP comments on draft | Sent to CO for uploading to UNDP ERC. |
*When submitting the final evaluation report, the evaluator is required also to provide an 'audit trail', detailing how all received comments have (and have not) been addressed in the final evaluation report. TEAM COMPOSITION The evaluation team will be composed of one international evaluator. The consultant shall have prior experience in evaluating similar projects. Experience with GEF financed projects is an advantage. The evaluator selected should not have participated in the project preparation and/or implementation and should not have conflict of interest with project related activities. EVALUATOR ETHICS Evaluation consultant will be held to the highest ethical standards and are required to sign a Code of Conduct (Annex E) upon acceptance of the assignment. UNDP evaluations are conducted in accordance with the principles outlined in the UNEG 'Ethical Guidelines for Evaluations' PAYMENT MODALITIES AND SPECIFICATIONS % | Milestone | 10% | At contract signing | 40% | Following submission and approval of the 1ST draft terminal evaluation report | 50% | Following submission and approval (UNDP-CO and UNDP RTA) of the final terminal evaluation report |
[1] For additional information on methods, see the Handbook on Planning, Monitoring and Evaluating for Development Results, Chapter 7, pg. 163 [2] A useful tool for gauging progress to impact is the Review of Outcomes to Impacts (ROtI) method developed by the GEF Evaluation Office: ROTI Handbook 2009 DETAILED DESCRIPTION OF EVALUATION PROCESS IS PROVIDED IN ENCLOSED TERMS OF REFERENCE Documents to be included when submitting the proposals: Interested international individual consultants must submit the following documents/information to demonstrate their qualifications in one single PDF document: - Duly accomplished Confirmation of Interest and Submission of Financial Proposal Template using the template provided by UNDP (Annex II);
- Personal CV or P11, indicating all past experience from similar projects, as well as the contact details (email and telephone number) of the Candidate and at least three (3) professional references.
Technical proposal: - Brief description of why the individual considers him/herself as the most suitable for the assignment;
- A methodology, on how they will approach and complete the assignment
Financial proposal, as per template provided in UNDP jobsite (Annex II); https://www.iq.undp.org/content/iraq/en/home/operations/jobs.html The qualified individuals are requested to make your application through the UNDP Jobs site following the below link: https://jobs.undp.org/cj_view_job.cfm?cur_job_id=87163 Incomplete proposals may not be considered |