Purpose of consultancy:
To conduct a midterm review (MTR) of BERANI programme (2018-2020).
Scope of work (Description of services, activities, or outputs):
INTRODUCTION
UNFPA and UNICEF Indonesia are planning to conduct an independent programme midterm review (2018-2020) of the BERANI, Better Sexual and Reproductive Health and Rights for All in Indonesia programme (2018-2022) as agreed in its project document. Programme midterm review serves three main purposes: (i) demonstrate accountability to stakeholders on performance in achieving development results and on invested resources; (ii) support evidence-based decision-making; (iii) contribute important lessons learned to the formulation of the 2021-2022 work plans.
UNFPA Indonesia together with the Government of Canada, the Government of Indonesia (GoI), and UNICEF, have been working since 2018 to improve sexual and reproductive health and rights (SRHR) for women and young people in Indonesia, through a joint programme aimed at increasing the quality of skilled birth attendance (SBA) and thereby decreasing maternal mortality; increasing access to SRHR information and services to young people through comprehensive sexuality education (CSE) and a youth friendly services (UNALA); and decreasing harmful practices such as child marriage and female genital mutilation/cutting (FGM/C) and gender based violence (GBV) through advocacy, evidence-generation, and capacity building.
The programme is implemented through partnerships with strategic partners, such as national counterparts, including BAPPENAS, BKKBN, MOH and MOWECP; and partnerships with parliamentarians, faith-based organizations, the private sector, philanthropists, and youth and women’s networks.
OBJECTIVES AND SCOPE OF THE MIDTERM REVIEW
The MTR aims at assessing the progress of BERANI joint programme towards the achievement of results of the first half of the programme cycle in order to:
- Propose corrective action and strategic recommendations for the remaining one year of the five-year cycle across thematic outputs as well as in cross-cutting issues (management, coordination, strategic partnerships, knowledge management).
- Be the basis for mid-term revisions of the Programme Planning, Monitoring, and Evaluation Matrix.
- To assess the quality of the programme design through assessing the theory of change, bottleneck analysis and critical assumptions of the programme and its sub-programmes including the validity, quality and adequacy of the results and resources frameworks of the respective programmes and capturing all key intended and unintended contributions of the programmes.
Objectives of the MTR:
With the above stated purpose, the objectives of the MTR are:
- To review the programme design (including logic model/results framework), governance, and management measures, identifying the gaps, challenges, and opportunities, in the achievement of programme results/goals as well as in the engagement of national partners.
- To review progress in programme implementation, identifying status of mid-term results achieved in relation to outputs and outcomes.
- To propose corrective action in order to improve performance for the remaining one year of the programme cycle; this may include the revision of the planning framework and the revision of annual targets.
Intended audience:
The main audience and primary users of the midterm review report are the decision makers and programme managers in UNFPA and UNICEF Indonesia (CO), the Government of Canada, as well as counterparts in the Government of Indonesia (GOI), including the civil society, and the United Nations Resident Coordinator Office (UNRCO) in Indonesia.
Outputs:
The MTR team will produce the following deliverables:
- An approved design report including (as a minimum):
- A stakeholder map;
- The MTR matrix (including the final list of evaluation questions and the corresponding judgement criteria and indicators); and
- The overall evaluation design and methodology, with a detailed description of the data collection plan for the data collection phase.
- The division of labor among the MTR team with a work plan indicating timeline for key milestones.
- A debriefing presentation document in the format of PowerPoint synthesizing the main preliminary findings, conclusions and recommendations of the data collection
- A draft MTR report, potentially followed by a second draft
- A power point presentation of the results of the evaluation for the in-country stakeholder workshop;
- An approved final MTR report, with annexes, based on comments expressed during the in-country stakeholder workshop; and
- An evaluation brief, a 2-3 page summary of the key evaluation findings, conclusions and recommendations.
All deliverables will be in English.
SCOPE OF THE CONSULTANCY:
The consultant is expected to undertake the MTR as a leader of the MTR team and make recommendations that are valid and reliable, based on available data and evidence. It is expected that the consultant will conduct a participatory MTR that will involve programme implementers and target beneficiaries. Existing project documents and progress reports will be shared with the consultant to facilitate completion of the tasks.
The Team Leader will be responsible for:
- Providing overall leadership on the independent MTR programme review based on inputs and insights from the other consultants in the MTR team;
- Covering at least one component (Coordination and Management) of the MTR
- Supervising and coordinating the work of MTR team members and responsible for the quality assurance of all MTR deliverables;
- Developing the design report including the MTR matrix and the work plan;
- Collecting information, conducting desk reviews of relevant documents and interviews with key stakeholders;
- Drafting the first comprehensive draft of the MTR report with inputs from team members, addressing the comments from ERG to produce the 2nd draft and final MTR report in line with UNFPA-UNICEF evaluation quality standards; and
- Ensuring that all the MTR team members selected to work under his/her supervision are fully briefed about the whole review process, objectives, methodology framework, evaluation tools, ethical standards, and key milestones/deliverables.
MANAGEMENT OF EVALUATION:
The MTR team will consist of the MTR team leader and the MTR team members. The responsibilities of Team Leader position are: a team leader with overall responsibility for the MTR process including the production of the final report. S/he will lead and coordinate the work of the MTR team and will also be responsible for the quality assurance of all evaluation deliverables. She/he will be responsible for putting together the design report, the draft final and the final MTR reports based on inputs from other MTR team members.
Methodology:
The MTR will utilize a mixed method approach, using qualitative and quantitative methods as necessary. The Logic Model used to design the BERANI joint programme will be reviewed and revised as necessary, based on stakeholder consultations to provide the basis for this MTR.
The MTR will pay special attention to ensure equity, gender and human rights based approaches are embedded into the data collection and analysis. It will be also guided by the United Nations Evaluation Group (UNEG) ethical guidelines for evaluation, as well as UNEG Norms and Standards.[1][2] The MTR will be transparent, inclusive and participatory as well as gender and human rights responsive. It will seek and utilize data disaggregated by age, gender, vulnerable groups, etc. to ensure findings are gender reflective and targeted.
Duration and working schedule:
The MTR Team Leader will be 30 working days in length for the consultancy as part of the MTR team, and may take place from August to November 2021.
The midterm review will unfold in five phases:
1. Preparation phase
This phase will include:
- Drafting the MTR Terms of Reference;
- Approval of the ToR;
- Recruitment of a team of evaluators;
- Set up the Evaluation Reference Group; and
- Orientation of key national government counterparts to the MTR process.
2. Design phase – (output: design report)
This phase will include:
- Desk review by the MTR team of all relevant documents available;
- Develop a stakeholder map ;
- Reconstruct the programme Logic Model/Results Framework;
- Develop the evaluation matrix;
- Develop a data collection and analysis strategy as well as a concrete work plan for the data collection and analysis, including division of labor;
- Specify limitations and challenges expected to conduct the MTR and any mitigation efforts to be taken to overcome these;
- Share with the Evaluation Reference Group (ERG) ERG for review, discussion and finalization
- Clearance of the design report by the GAC and UNFPA-UNICEF CO
- Approval of the design report.
3. Data Collection phase – (output: debriefing presentation on the preliminary results of the MTR and testing conclusions)
The MTR team will collect data involving a series of individual and group interviews, focus group discussions and online surveys to answer the evaluation questions identified in the design phase.
4. Reporting phase – (output: first draft final report)
The MTR team will prepare a first draft of the MTR report. This first draft report will be submitted to the Evaluation Reference Group (ERG) (in writing). The MTR Team will submit a second draft of the report addressing the comments made by the reference group.
This second draft report will form the basis for an in-country dissemination workshop. The final report will be drafted taking into account comments received from the participants of the workshop.
The Report will be cleared by the UNFPA-UNICEF and submitted with an Evaluation Quality Assessment (EQ) to the GAC for approval.
5. Facilitation of use and dissemination phase
This phase will include:
- Publishing and dissemination of the final MTR report to key stakeholders
- Preparation of the management response to the recommendations;
- Periodic follow-up of the recommendations of the evaluation.
Place where services are to be delivered:
Home based.
Delivery dates and how work will be delivered:
All deliverables will be in English in an electronic file.
Deadline and terms of Payment will be based on the delivery outputs, as follows:
No |
Items |
Number of working days |
Deadline and Terms of Payment |
1 |
Upon completion of the data collection phase |
12 |
End of September 2021 40% of total payment |
2 |
Upon receipt of the approved final MTR report and MTR brief |
13 |
End of November 2021 60% of total payment |
|
TOTAL |
25 |
|
Monitoring and progress control, including reporting requirements, periodicity format and deadline:
Breakdown of MTR phases (please see annex 1)
Supervisory arrangements:
The MTR Team Leader will work under the overall guidance of the UNFPA Representative and day to day direct supervision by the Monitoring and Evaluation Analyst (a CO evaluation manager). UNFPA & UNICEF CO evaluation managers (Monitoring and Evaluation Analyst) will be assigned to interact on a day-to-day basis with the MTR team, and will ensure that all the necessary aspects of MTR programme review are well taken into account by the MTR team.
Expected travel:
Travel from home-based to Jakarta and other project locations (if it is deemed necessary in the agreed design report by the Evaluation Reference Group (ERG)).
Required expertise, qualifications and competencies, including language requirements:
The MTR Team Leader will be an international expert in evaluation of development programmes with:
- Advanced degree in evaluation, development studies, public health, population and gender studies or any other social science studies;
- At least 15 years’ proven experience in conducting evaluations in the field of development for UN organizations or other international organizations;
- Experience in leading complex programme and/or country level evaluations;
- Experience in the South East Asia region and preferably in Indonesia;
- Strong technical and analytical capacities and demonstrated knowledge of evaluation methods and techniques for data collection and analysis;
- Familiarity with the humanitarian-development nexus is desirable;
- Excellent leadership, communication ability and excellent writing skills in English; and
- Ability to lead a diverse team.
Inputs / services to be provided by UNFPA or implementing partner:
The background documents (including the detailed concept note) for the BERANI MTR will be the following:
The below documents can be derived at the following link:
https://drive.google.com/drive/folders/1M1jAsYEkdZH3DC78cUmTSjsGtb2bcxwu?usp=sharing.
# |
Title |
1 |
BERANI MTR Concept Note |
2 |
BERANI Programme Documents |
3 |
BERANI Annual Reports 2018, 2019 and 2020 |
4 |
BERANI programme Knowledge Products database 2018-2020 |
5 |
Stakeholder Mapping Matrix |
6 |
UNFPA Evaluation Policy |
ANNEXES
Annex |
Title |
1 |
Breakdown of MTR phases |
2 |
Programme Logic Model / Results Framework |
3 |
Template for the Design Report |
4 |
Template for Final MTR Report |
5 |
Template for Abstract of the Final MTR Report |
6 |
A template for the MTR matrix |
7 |
Management Response |
8 |
Evaluation Quality Assessment Grid (EQA) |
9 |
Ethical Code of Conduct for UNEG/ UNFPA Evaluation |
How to apply:
Interested applicants should send a letter of motivation and a detailed Curriculum Vitae/resume by email to indonesia.office@unfpa.org by 12 July 2021, with “UNFPA/IDN/21/02” in the subject.
Disclaimer:
UNFPA does not charge any application, processing, training, interviewing, testing or other fee in connection with the application or recruitment process. Fraudulent notices, letters or offers may be submitted to the UNFPA fraud hotline http://www.unfpa.org/help/hotline.cfm
UNFPA provides a work environment that reflects the values of gender equality, teamwork, Embracing diversity in all its forms, integrity and a healthy balance of work and life. We are committed to maintaining our balanced gender distribution and therefore encourage women to apply. UNFPA promotes equal opportunities for all including persons with disabilities.
We are no longer accepting applications for this position.