Duties and Responsibilities
The overall objective of the consultancy is to produce a meta-evaluation and (discrete) meta-analysis of evaluations produced by UN Trust Fund grantees from 2017 through 2019 and prepare a database of coded material to enable future analysis. The specific outputs will be:
- Before 15 May 2019: An inception report describing the approach to the project, including the software/tools to be utilized, and establishing the code dictionary for qualitative data analysis;
- By 30 June 2019 a draft (partial) report on initial findings (based on a qualitative analysis tool with coded evaluations) and by 31 July 2019 a final report to include:
- An assessment of the quality of evaluations produced by UN Trust Fund grantees against UN Women/GERAAS and UNEG quality standards including a summary of trends in quality and credibility of evaluations (e.g. by variations in quality by theme, region or evaluation design). The report should also include recommendations for the UN Trust Fund to improve evaluation practice and identify a selection of satisfactory quality evaluations which can be used for UNTF’s next objective;
- An analysis of a sub-set of evaluations (those of satisfactory or above quality) to identify those assessed as effective and sustainable projects to inform further synthesize of evaluative knowledge;
- Handover of database of coded material to the UN Trust Fund. This would be aligned with the code dictionary generated during the inception phase. Any changes or additions to the dictionary should be explained in narrative form.
Activities (exact order to be agreed in the inception phase)
- Record and map the evaluations produced by UN Trust Fund grantees by theme, country, region and evaluation design – in a selected qualitative software tool that can be handed over to the UNTF;
- Identify what exclusion criteria to apply to the evaluation universe;
- Develop a code dictionary for the UNTF to utilize for future analysis of evaluation reports;
- Assessment of the quality of individual reports and scoring:
- This comprises an assessment of the quality of individual evaluation reports against (at minimum) eight UN Women adapted UNEG Parameters (Object and Context of Evaluation; Evaluation Purpose, Objectives and Scope; Evaluation Methodology; Findings; Conclusions and Lessons Learned; Recommendations; Gender and Human Rights Considerations; and the report structure);
- Sub-code within each parameter – and further parameters as agreed with the UN Trust Fund team - utilizing the code dictionary developed during the inception stage.
- Draft a report on the findings from the meta-evaluation and recommendations for the UN Trust Fund to: (1) improve evaluation practice; and (2) provide targeted support to grantees on evaluation management;
- Identify a sub-set of the satisfactory (or above) quality evaluations to conduct a discrete meta-analysis of the evidence produced (for example 50 evaluations overall), on which projects were assessed as effective and sustainable.
Inputs and Timing
Contribution from the beneficiary (UNTF Secretariat): the UNTF will provide the consultant with access to all the documentation required, guidance, direction and the agreed daily rate upon delivery of the work delivered as above.
Consultants input: over a period of three months (15 May to end July 2019) to deliver the following products:
- Inception report - 15 May 2019;
- First draft report (and database/tool) - 30 June 2019;
- Final report (and database/tool to be handed over to the UN Trust Fund) - 31 July 2019.
The consultant is expected to cover the costs of the home-based activities, the initial database/tool cost and any assistance needed within the fee rate.
The consultant will report to the UNTF’s Monitoring, Evaluation and Knowledge Manager, Gemma Wood. The draft report should be shared with the UNTF Secretariat by 30 June 2019 for consultation and the final report to be completed by 31 July 2019.
- Respect for Diversity;
- Awareness and Sensitivity Regarding Gender Issues;
- Creative Problem Solving;
- Effective Communication;
- Inclusive Collaboration;
- Stakeholder Engagement;
- Leading by Example.
Required Skills and Experience
- Master’s degree or equivalent in social sciences, human rights, gender/women's studies, international development, or a related field is required.
- A minimum of 5 years relevant experience undertaking evaluations is required including proven practical professional experience in designing and conducting major evaluations;
- Substantive experience in evaluating similar development projects related to local development and political and economic empowerment of women;
- Substantive experience in evaluating projects and programmes with a strong focus on ending violence against women and girls and/or women’s empowerment and gender equality is preferred;
- Excellent and proven knowledge of evaluation methodologies and approaches;
- Experience with qualitative software;
- Experience with meta-evaluation and meta-analysis of evaluation reports, preferably with UN agencies, is an asset;
- Familiarity with UNEG evaluation standards, is an asset;
- Proven experience in producing coherent, clear analytic reports and knowledge pieces is a requirement.
- Full proficiency in English (written and spoken) required;
- Working language of at least one of the following languages is also required: Spanish a/o French.
Please be sure to indicate that you saw this position on Globaljobs.org