IDH and WSAF Publication of ToolKit
Tashi Dendup Blog
David Wand - Podcast Reviewing Somalia SRH GBV project Performance Measurement Framework
Public Health Journal - December, 2024
Please get in touch with Steven Ariss (s.ariss@sheffield.ac.uk) if you’re keen to learn more or would like more FAIRSTEPS related resources.
ORACLE NEWS DAILY - Article by George S. Tengbeh
IEG & World Bank Publication - October, 2024
Getaneh Gobezie - Two Blogs
EVALSDGs Insight Dialogue - October 23rd 2024
Quick tips to assess the risks of AI applications in Monitoring and Evaluation
recording here, and the Evaluation Insight here.
Value for Women Publication 2024
March 4, 2025 at 6pm to March 6, 2025 at 7pm – Europe
0 Comments 0 LikesThe purpose of the consultations (18th Jan-18th Feb 2016)
Following the approval of the 17 Sustainable Development Goals (SDGs) by the UN General Assembly and by the international development community in 2015, EvalPartners (including EvalGender+) and United Nations Evaluation Group (UNEG)’s members have begun to form working groups to strengthen monitoring and evaluation systems to assess these different goals. The purpose of the present consultations, organized by EvalGender+, UNEG and the Independent Evaluation Office (IEO) of UN Women, is to provide guidance to strengthen M&E systems to assess all SDGs with an equity-focused and gender-responsive lens, in addition to Goal 5 (Achieve gender equality and empower all women and girls) and Goal 10 (Reduce inequality within and among countries). The above mentioned agencies and network, in collaboration with other strategic stakeholders, are planning to prepare a guidance note that will assist both actors directly involved in social equity and gender equality, as well as all actors involved with the evaluation of the SDGs, in ensuring that social equity and gender equality are adequately addressed in all of the SDG evaluations. It is intended to produce a first version of this Guidance note by June 2016. The SDG strategy is to work through, and to help strengthen existing M&E systems at the national and local levels and consequently the focus of the present consultations is on indicators and approaches that can be implemented through existing M&E structures – many of which may have limited experience and resources to address social equity and gender equality issues.
In addition to their importance as stand-alone sustainable development goals, both of these are cross-cutting themes that must be integrated into the assessment of all of the other goals. For example, the achievement of Goal 2 (end hunger), Goal 3 (ensure healthy lives and promote well-being for all at all ages), Goal 7 (ensure access to affordable, reliable, sustainable modern energy) and Goal 13 (take urgent action to combat climate change) – to mention only four, all have important gender dimensions that affect the achievement of these goals. Similarly, there are social equity dimensions to all goals. To read more on SDGs visit the link "Transforming our world: The 2030 agenda for sustainable development.https://sustainabledevelopment.un.org/post2015/transformingourworld
The consultations identify four important themes that must be addressed in the M&E systems to assess SDGs with an equity-focused and gender-equality lens, in addition to goals 5 and 10:
Each of these themes has different implications in different countries, regions, sectors and according to the type of organization. Consequently we invite you to share your experiences and perspectives to assist the EvalGender+, UNEG, UN Women IEO teams in ensuring that the Guidance Note will reflect the diversity of experiences and perspectives in different countries, regions and types of organization.
Theme 1: The relevance of “new metrics” (measurement tools and indicators) for the evaluation of SDGs from an equity-focused and gender-responsive perspective.
In recent years a number of “new metrics” have evolved which can potentially widen the range of indicators and measures available for the monitoring and evaluation of development results from equity and gender responsive perspectives. These include:
Participants are invited to share their thoughts and experiences on the following questions (as well as others they propose)as they relate to equity-focused and gender responsive evaluation.
Theme 2: Evaluation and complexity – Dealing with the increasing complexity of development and interconnectedness of SDGs to ensure “no one is left behind”
As SDGs are interconnected, national policies and programme to implement them will be complex. As programs grow in size and scope, the number of partners and stakeholders and in terms of the kinds of social and behavioral changes they seek to produce, they become more complex – both in terms of how they are designed and implemented, but also in terms of how they must be evaluated. Complexity is defined in terms of: (a) the nature of the programme, (b) the number of partners and stakeholders and the patterns of interaction among them (including the level of consensus or disagreement among them on the goals of the programs), (c) the number of external (contextual) factors that influence how the programme is implemented and its outcomes and (d) the complexity of the causal chains through which outcomes are to be achieved. A number of additional factors are particularly important for the evaluation of social equity and gender equality, including: (i) social and cultural constraints and pressures, (ii) the power relationships and social definition of gender relations and social equity, (iii) multiple influences on processes of behavioral change, (iv) the role of social media, and (v) the long, non-linear causal chains through which changes are produced.
Participants are invited to share their thoughts and experiences on the following questions (as well as others they propose) as they relate to equity-focused and gender responsive evaluation.
Theme 3: Towards equity-focused and gender-responsive national evaluation systems – Multi-stakeholder partnerships to strengthen national evaluation capacities
The SDGs pose challenges for national evaluation systems as the SDGs require the involvement of a broader range of stakeholders, a broadening of the range of indicators to be measured and the methodological and organizational problems required to assess sustainability which requires collecting data over a much longer period of time. Many programmes are intended to produce benefits that continue over five or even ten years and the evaluation must (ideally) continue over all of this period. So instead of conventional evaluations that often only cover the 3-5 years of project implementation, the SDG evaluations may be required to continue for twice as long. The application of a social equity and gender equality lens will often present additional challenges for national evaluation systems, including the fact that the evaluation of gender outcomes and impacts is often the weakest part of many national evaluation systemsand the methodologies for evaluating social equity are also not well developed in many countries (or in the evaluation literature in general). Given resource constraints of many evaluation agencies, it will often not be possible to consider specialized evaluations that focus exclusively on equity and gender, and it will be necessary to adapt standard M&E methodologies to address these issues. It will be important to consider the extent to which some of the multi-shareholder partnerships can bring in agencies with expertise in these areas and with additional resources that may permit the selective application of gender and equity focused data collection and analysis methodologies
Participants are invited to share their thoughts and experiences on the following questions (as well as others they propose) as they relate to equity focused and gender-responsive evaluation.
Theme 4: Demand for and use of evidence from equity-focused and gender responsive evaluation to inform equitable development
Experience from all regions and sectors shows that one of the biggest challenges facing evaluation systems is the very low rate of utilization of evaluations. In many cases evaluation findings do not reach many of the key organizations and groups (including community and women’s organizations), in other cases they are not presented in a form which is easily accessible to some groups, particularly the most vulnerable. Even when evaluations are reviewed, action is often not taken on many of the recommendations. These challenges are likely to be even more serious for social equity and gender equality as these themes are less familiar to many organizations and the mechanisms to review and action are often less developed.
Participants are invited to share their thoughts and experiences on the following questions (as well as others they propose) as they relate to equity focused and gender-responsive evaluation.
Tags:
When it comes to our health systems data collection and M&E systems are mostly implemented in donor funded health projects. I am yet to see a project that has no funding ties calling for a baseline or midterm surveys or even asking for support to strengthen M&E system. Therefore the culture of M&E has not been completely sustained.
The challenge that I have faced when conducting Evaluations is the limited understanding for the need of carrying out and Evaluation. This is mostly by the team members in projects. There is a feeling that this is almost like auditing of accounts and the attitude expressed is that the Evaluator has been brought in to “check if work has been done”. There is therefore a need to aggressively build capacity in M&E to all members and empower one another on the need to collect quality data and use it for various decisions.
What you have said is very true that has been my experience also Evaluations are feared as like auditing of accounts. In both ways there is so much tension all round that the data collected might not reflect the true position of the situation.
In the capacity building I believe there is need to emphasis on the approach. To major on the strengths and bring out the weakness as a way of corrections
Theme 1:
Some systems do not have data about gender, making it difficult to do analysis about equity.
the most difficult issues to measure are those that are related to the "why" - why are/are not measures of equity changing - and context - whether changes in those measures have a meaningful impact on the lives of women and/or other marginalized groups.
Here is an example: income equality. We may see gains in income equality in the years ahead. But why - is it because women are working more hours, so their aggregate incomes are higher than men's, even if men are working less? If a woman's income goes up, is her quality of life also improving, or it getting worse/staying the same because of issues like long hours and/or control over family finances?
Luisa Belli, FAO, Rome
Thank you Rituu for this wonderful initiative you launched, and I understand is being finalized in these last few hours.
Theme 1
I would like to address the issue of metrics in field work and usefulness of evaluations.
I wish to highlight that when we decide to ask questions and to liaise with an informant, we are becoming part of the entire picture, of that analysis. We will necessarily affect the results that will emerge from that consultation and interview.
As evaluators we are surely very aware of the importance of neutrality and independence, however we are never neutral, never fully independent. The eyes that are looking an object, the mind and the heart, our eyes, heart and mind are not neutral, since we are human beings.
We could honestly assume thoughts can lead the discussion in one direction or the other and that prejudgments are reducing opportunities for getting the “reality” of what we are observing.
Our thoughts, our intentions, can these affect the results of the discussion? The hypothesis, which seems plausible, is that our presence and our intention determine the results of our investigations.
Thinking to be able to collect information without affecting the results is pure illusions. Now, it would be better to ask ourselves, what type of results do I really want to collect? And what type of change would I like to affect, since in any case I’m affecting the reality with my presence, with my questions.
This is particularly evident when we are consulting people to ask about their lives, about changes in their lives, about problems and solutions and about facts, in other words what we actually do when we conduct consultations through interviews, focus group discussions etc. etc.
Are we really open to listen to what is coming from the informants?
What kind of mind, heart should we have in order to listen and understand?
Is it plausible to think that an open mind, can determine an open discussion and no agenda, neither from the evaluator nor from the informants. That an open mind can lead to discussions that are closer to solutions or that are themselves solutions.
We need a lot of courage, as human beings to accept that changes are happening in the present moment. It doesn’t make any sense to reduce that
moment to an “information gathering” process.
This strongly links the methodology and the evaluation process to the usefulness of the evaluation itself.
Such a process has a direct usefulness. After a similar process, all participants (even the evaluators) are enriched, empowered.
The privilege of being evaluators and conducting filed level analysis in my view should be systematically used to empower people, simply by listening to them with an open mind and an open heart and no judgement. This I think cannot be forgotten when we talk about tools, when we talk about professionalization of the evaluation function (since we need to develop different skills!) and about usefulness of the evaluations.
Infant to 14 years and Missing in the SDGs Goals and Indicators
1. No indicators on children from infant to 14 years in Goal 5 or any other Goal
2. Missing Goal for children only.
Example Goal 5
Target: 5.2 eliminate all forms of violence against all women and
girls in public and private spheres, including trafficking and sexual
and other types of exploitation.
Proposed Indicators:
38. Prevalence of girls and women 15-49 who have experienced physical
or sexual violence [by an intimate partner] in the last 12 months.
It is evidence that in all most every country infant to 14 too faced
similar ? How do you measure this ? Still troubles me .
Best regards
isha
Dear all,
At the NILERD ECOI ISST consultation and workshop held on 9th of March 2016, our group (Beryl Leach, Rajib Nandi, Sunita Palita and I) discussed Theme 4 of the query i.e. Demand for and use of evidence from equity-focused and gender responsive evaluation to inform equitable development.
We took a holistic approach to discussing the factors affecting the demand for and use of evaluations, factors for demand and utilization of social equity and gender equality evaluations, and the types of evaluation presentations that can be proposed to make evaluation more accessible to stakeholders. We felt that within the government a number of factors affect demand for evaluation including lack of incentives, complacency, high staff turnover (leading to change in focus and lack of incentive), and above all a lack of understanding about the intention and technique of evaluation. These concerns can be addressed by providing performance and career incentives, providing understanding on values of evaluation, on improving performance of the project (such that learnings/ best practices of a project can be replicated).
At the level of the implementing agency, conception of the program should take into account a credible and capable agency which would be gender responsive. At the level of the evaluators/researchers, demand and use depend on how theory based, mixed method, multi-disciplinary have been used in the evaluations, subject to availability of time and budget.
Overall, there is demand for evaluations if there is a suitable political economy and culture in the country; subject of course to the availability of time and budget. The evaluation is used if there is ownership of and participation in the study. (This is true for all stakeholders – including the community).
The evaluator or the evaluating agency should be engaged from the very conception of the project, so that
a) it has clarity on the objectives of the project resulting to ownership of the project and evaluation is not reduced to a routine activity or as an activity on the check list, or even a fault finding exercise.
b) the implementing agency has communication from the very beginning on the need for evaluations.
There is need to recognize the importance of mid-term evaluation – as a space for participation with scope for learning.
Theme one
If we are looking at power relations, let us not forget those with other sexual identities.
Systemic participatory Action research, Participatory statistics India and Nepal
Funded by the Freedom Fund, IDS has been directing a systemic participatory action research process which involves working across 18 NGOs of Geneva Global across UP and Bihar states in India. The process so far has involved a participatory story analysis with 8 NGOs.
To overcome challenges of estimating changes in the magnitude of various forms of slavery introduced participatory statistics has been facilitated across 60 villages. The aim was to combining participatory approaches with statistical principles to generate robust data for assessing impact of slavery eradication. The work is currently being extended to Nepal.
Read Navigating Complexity in International Development: Facilitating sustainable change at scale
Danny Burns and Stuart Worsley - 2015
© 2024 Created by Rituu B Nanda. Powered by