Overview : Project Title Using Strategic Monitoring & Evaluation (M&E) to Accelerate the Implementation of the Philippine Development Plan (PDP) 2017-2022 (Strategic M&E Project) Background and rationale On 15 July 2015, the National Economic and Development Authority - Department of Budget and Management issued the Joint Memorandum Circular (JMC) No. 2015 - 01 or the National Evaluation Policy Framework of the Philippines (NEPF). The JMC is widely considered as one of the reform initiatives to engender results-orientation in the Philippines bureaucracy. More specifically, the policy sets the framework for the conduct of evaluation of all government programs and projects in the public sector to (1) support good governance and evidence-based decisions; (2) promote program improvement; and, (3) ensure accountability and transparency. The policy document was a result of engaging and highly participatory approaches including a review of existing evaluation policies of the Philippines and other countries, interviews with different stakeholders, and presentations of outputs in various meetings (e.g., consultation meetings, inter-agency committees, and public fora). Furthermore, the NEPF provides clear guiding principles and evaluation standards that should serve as a guidepost in the conduct of public sector evaluation, namely: setting evaluation criteria, ensuring evaluation competencies, observing ethical standards, planning for evaluation that is aligned with the industry’s best practices, promoting impartiality, and ensuring the dissemination and use of evaluation outputs. The implementing agencies of the NEPF are expected to: formulate and maintain a rolling six-year agenda; create neutral evaluation units at the national level; submit evaluation plans in time with the budget submission; and, ensure management response to evaluations and the use of evaluations. NEDA, DBM, and OP-PMS were identified as the members of the Evaluation Task Force that will provide overall direction and coordination in the public sector evaluation. The Evaluation Task Force Secretariat and Interim Technical Working Groups were also identified as important stakeholders in the NEPF. After six years since the issuance of the policy, the Strategic M&E Project is looking for an individual consultant to conduct a summative evaluation of the NEPF that will identify key accomplishments in the implementation of the NEPF, the challenges encountered in its implementation, and actions needed to fully attain its objectives. Specifically, the summative evaluation shall assess how effective the policy document is in: - improving monitoring and evaluation (M&E) capacities (knowledge, skills, competencies, and practices) across government agencies;
- enhancing national government agencies’ capacities to plan, manage, and conduct public sector evaluations;
- ensuring dissemination, management response and use of evaluation outputs; and
- establishing organizational structure alignment to the policy through the creation of neutral evaluation units at the national level
Institutional Arrangements - The consultant shall be under the overall guidance of the UNDP Institutions and Partnerships Team Leader, and the NEDA Monitoring and Evaluation Staff (MES) Director and reporting directly to the Strategic M&E Project Coordinator, with whom all outputs shall be submitted and through whom all communications shall be coursed or copied.
- The consultant shall report progress, provide updates, or raise issues to the Project Coordinator on a bi-monthly basis, or as the need arises.
- In performing its functions, the consultant is expected to conduct field consultations, and/or coordinate with members of the Project Management Team, relevant implementing agencies, and external stakeholders. The NEDA and UNDP Project Team shall provide the necessary endorsements, including endorsement letters and calls, to the agencies to be covered by the evaluation.
- NEDA and UNDP shall provide comments and provide outputs within ten (10) working days upon receipt of output.
- UNDP Philippines shall be entitled to intellectual property and other proprietary rights over all materials that have direct relation to the project.
- The Individual Consultant is expected to have his/her own equipment and workstation.
Duration of Work The Individual Consultant will be engaged for 110 days from December 1, 2021 to April 30, 2022 unless revised in a mutually agreed upon timetable. Changes in the duration of the contract will be implemented through issuance of a contract amendment. Duty Station The duty station is in Manila but with flexibility of working from home while Alert Levels are in place. The Consultant is not expected to report on a daily basis to the UNDP Office but he/she shall be notified within a reasonable period of time of face-to-face meetings where his/her presence is necessary, following IATF and UN House Manila guidelines. If face-to-face meetings are necessary, they will be held at the UNDP office in Mandaluyong City or NEDA office in Pasig City. Field consultations shall also be held in the offices of relevant implementing agencies and external stakeholders within Metro Manila. Other venues may also be agreed upon. Scope of Price Proposal and Schedule of Payments The Individual Consultant must send a financial proposal based on an all-inclusive lump-sum amount for the delivery of the outputs below. The total amount quoted shall include all cost components required to deliver the services identified above, including professional daily fees X number of person-days and any other applicable costs (e.g., software and online tool/platform subscriptions) to be incurred by the Individual Consultant in completing the assignment. Medical/health insurance must be purchased by the Individual Consultant at his/her own expense, and upon award of contract, the Individual Consultant must be ready to submit proof of insurance valid during contract duration. Payments will be made upon satisfactory completion of the deliverables by target due dates. Outputs will be certified by the Programme Analyst of Institutions and Partnerships prior to payments. Tranches | Deliverable/Outputs | Target Due Date | Percentage of Fee |
---|
Tranche 1 | Upon review and acceptance of Inception Report | December 20, 2021 | 20% | Tranche 2 | Upon review and acceptance of Preliminary Data Gathering Report | March 11, 2022 | 30% | Tranche 3 | Upon review and acceptance of Draft Report | April 8, 2022 | 30% | Tranche 4 | Upon review and acceptance of Final Report | April 29, 2022 | 20% | | TOTAL | 100% |
| Description of Responsibilities : |
---|
Scope of Work Under the overall guidance of the UNDP Institutions and Partnerships Outcome Lead, and the NEDA Monitoring and Evaluation Staff (MES) Director, and reporting directly to the Strategic M&E Project Coordinator, the Evaluation Consultant shall be responsible for the following: Preparatory work, including: - Design an overall analytical framework and methodology for the summative evaluation of the National Evaluation Policy Framework;
- Collate, review, and synthesize relevant documents which shall inform the design of the methodology for the evaluation; and
- Prepare quantitative and qualitative evaluation methods and instruments
Data gathering and analysis, including: - Conduct key informant interviews and focus group discussions; and
- Undertake other data gathering and analysis tools to address the evaluation questions
Reporting of Results: - Draft and revise the Inception Report and Draft Evaluation Report in line with NEDA and UNDP quality assurance standards;
- Prepare and submit a Final Report, subject to a maximum of two (2) revisions, including the raw and processed data used in building the report;
- Present results to and consider feedback from NEDA and UNDP at key stages of the evaluation, and provide feedback on the evaluation process; and
- Communicate and consult with NEDA and UNDP and other stakeholders and incorporate their comments in the evaluation report.
Presentation and Use of Results - Provide recommendations on actions and/or strategies for the improvement of project implementation;
- Present the preliminary or final results of the evaluation in a public forum; and
- Condense the findings in a one-page summary and a five (5)-page executive summary
As a way forward, the evaluation aims to generate lessons learned, good practices, and evidence-based recommendations to further strengthen the implementation of the NEPF. The evaluation can use some of the following key guiding questions based on OECD/DAC evaluation criteria and cross-cutting issues. The Evaluation Consultant is expected to propose, further prioritize, and refine the key guiding questions through a consultative process Relevance | - To what extent do the NEPF outcomes align with the achievement of national priorities?
- To what extent does the NEPF address the urgent needs in the public sector evaluation in the Philippines?
- To what extent has the NEPF complemented evaluation initiatives and standards of development partners?
- To what extent are the objectives of the NEPF still relevant?
| Effectiveness | - To what extent has the NEPF contributed to: (a) improving monitoring and evaluation (M&E) capacities (knowledge, skills, competencies, and practices) across government agencies; (b) enhancing national government agencies’ capacities to plan, manage, and conduct public sector evaluations; (c) ensuring dissemination, management response and use of evaluation outputs; and (d) establishing organizational structure alignment to the policy through the creation of evaluation units at the national level
- To what extent have implementing agencies developed an evaluation agenda due to the NEPF? How about evaluation plans?
- To what extent were the planned evaluations of the implementing agencies budgeted, conducted, and completed?
- To what extent have the implementing agencies disseminated and used their evaluation outputs? Are management responses being facilitated and monitored? Is there a harmonized inventory of evaluation reports/outputs in the public sector?
- To what extent were the M&E Units/Divisions created due to the NEPF? If there are none, are there efforts to create or establish one in the next three years?
- To what extent have implementing agencies developed and implemented a capacity-building plan for M&E? How often are the M&E-related skills and competencies of the M&E staff assessed? Is there a nationally endorsed curriculum to address the M&E capacity gaps?
- What factors facilitated and/or hindered the achievement of the NEPF’s desired outcomes? What agency initiatives are worth replicating?
| Efficiency | - To what extent are the purpose; coverage; key elements such as implementation arrangement, standards; and responsibilities of concerned entities such as agencies, the Evaluation Task Force and Secretariat, were implemented?
- To what extent were the Evaluation Task Force’s structures and processes adequate to support implementing agencies to deliver M&E results?
- To what extent were resources invested in the efficient implementation of the policy?
- At what level of additional investment is needed to achieve improved or desired outcomes?
- What were the challenges and opportunities encountered in implementing the NEPF?
| Sustainability | - To what extent were the implementing agencies and other stakeholders capacitated to sustain the gains of the NEPF?
- To what extent should the Evaluation Task Force provide necessary intervention and resources to complement agency efforts in the implementation of the NEPF?
| Coherence | - To what extent is the NEPF coherent with the existing or other policies on evaluation. To what extent is the policy adding value?
- To what extent is the NEPF consistent with the relevant international norms and standards on evaluation?
| Impact | - To what extent has the NEPF generated significant positive or negative, intended or unintended, higher-level effects?
- To what extent has the NEPF made a significant difference?
|
Expected Output and Deliverables The Individual Consultant is expected to accomplish the following: Deliverables/ Outputs | Estimated Duration to Complete | Target Due Dates | Approvals Required | Designated person to review and accept the output | Inception Report | 10 days | December 20, 2021 | Team Leader, Institutions and Partnerships Programme NEDA MES Director | Strategic M&E Project Coordinator, in consultation with relevant NEDA and UNDP officers | Preliminary Result of Data Gathering Report | 60 days | March 11, 2022 | Draft Report | 20 days | April 8, 2022 | Final Report and Presentation | 20 days | April 29, 2022 | Total | 110 days | | | |
| Competencies : |
---|
- Strong interpersonal and communication skills;
- Strong analytical, reporting and writing abilities skills;
- Openness to change and ability to receive/integrate feedback;
- Ability to plan, organize, implement and report on work;
- Ability to work under pressure and tight deadlines;
- Proficiency in the use of office IT applications and internet in conducting research;
- Outstanding communication, project management and organizational skills;
- Excellent presentation and facilitation skills.
- Demonstrates integrity and ethical standards;
- Positive, constructive attitude to work;
- Displays cultural, gender, religion, race, nationality and age sensitivity and adaptability.
| Qualifications : |
---|
Offers will be evaluated based on the combined scoring method : - Technical qualifications = 70%
- Financial Proposal = 30%
For the evaluation of the Technical Proposal, the selection of the successful consultant must be based on the following qualifications (with the appropriate obtainable points). Qualification | Points Obtainable (70 points) | Education Master’s degree in economics, development studies, evaluation, social science, or other related field. A first-level university degree in combination with seven years of qualifying experience may be accepted in lieu of the advanced university degree. Master’s Degree – 15 points Bachelor’s Degree with 7 years of relevant experience – 15 points Additional 5 points for additional degree, maximum of 20 points | 20 | Professional Experience At least ten (10) years of consultancy or professional work experience in conduct of evaluations Ten years’ experience – 18 points Additional point for each additional year, maximum of 25 points | 25 | Portfolio Portfolio of evaluations, with minimum of (2) summative evaluations of the same scope as stated in this TOR, conducted in the last five years 2 summative evaluations – 18 points additional point for each additional project, maximum of 25 points | 25 | TOTAL | 70 |
Only offerors who will obtain a minimum of 49 out of 70 obtainable points will be shortlisted and considered eligible for evaluation of the financial proposal. Recommended Presentation of Offer Interested applicants must submit the following documents/information at UNDP Jobs - 103419- Evaluation Consultant for the Summative Evaluatio to demonstrate their qualifications. Please group them into one (1) single PDF document as the application only allows to upload of a maximum of one document. - Duly accomplished Letter of Confirmation of Interest and Availability using the template provided by UNDP;
- Personal CV or P11, indicating all past experiences from similar projects, as well as the contact details (email and telephone number) of the Candidate
- Portfolio of evaluation work, with at least (2) summative evaluations of the same scope stated in this TOR, conduction in the last five years. A hyperlink to the public location of the output should ideally be included in the submission.
- Financial Proposal that indicates the all-inclusive fixed total contract price, supported by a breakdown of costs, as per template provided. If an Offeror is employed by an organization/company/institution, and he/she expects his/her employer to charge a management fee in the process of releasing him/her to UNDP under Reimbursable Loan Agreement (RLA), the Offeror must indicate at this point, and ensure that all such costs are duly incorporated in the financial proposal submitted to UNDP. Medical/health insurance must be purchased by the individual at his/her own expense, and upon award of contract, the Individual Consultant must be ready to submit proof of insurance valid during contract duration.
Note: The above documents need to be scanned in one file and uploaded to the online application as one document. Interested applicants to note that personal Medical/health insurance (to be purchased by the individual at his/her own expense) is mandatory for the issuance of contracts. Upon award of the contract, the consultant must be ready to submit proof of insurance valid during the contract duration. The following templates / Annexes and IC General Terms & Conditions can be downloaded from http://gofile.me/6xdJm/bE9TCw8fU: - General Terms and Conditions for Individual Contract
- Letter of Confirmation of Interest and Availability
- P-11 form
In view of the volume of applications, UNDP receives, only shortlisted offerors will be notified. |
|