What is feminist about outcome harvesting?

[Barbara Klugman]

Rituu suggested I reflect on my practice and also share with you the set of blogs a few outcome harvesting practitioners wrote for AEA365 (attachment) to give a sense of the method and in so doing pay tribute to the method’s originator, Ricardo Wilson-Grau – see attached. So, this note reflects on outcome harvesting as feminist. It is arguably feminist in its because of both its steps and principles (See in the attachment, blog 1 which outlines the steps, and Quinn Patton’s comments on the principles in blog 2; as well as Ricardo Wilson-Grau’s image of the tree which lists the steps and principles.)

Fundamental to a feminist approach is participation – that those affected by an intervention need to be involved throughout the cycle of planning, implementing, evaluating and improving it. Outcome harvesting requires that an evaluation be useful, and that those most involved in an intervention get involved in the shaping of the evaluation and the interpretation of findings.  This is not only a utilisation-focused approach, but one that recognizes that in the design itself, those who could be using findings for learning, need to be inputting on the purpose and shape of the evaluation and doing the sense-making along the way with the evaluators.

 The approach also relies on those engaged in the intervention to generate outcomes or to engage deeply in the framing of outcomes descriptions and descriptions of the contribution of the organisation being evaluated and its allies, a process which involves a high level of recognition of the knowledge of those involved even while it includes coaching or capacity building.  This is relevant to a feminist approach because ‘M&E’ is frequently disempowering of those running or benefiting from an initiative, whereas OH’s coaching style builds their sense of power and agency. It also supports or coaches them to make meaning of the relationship between their outcomes and their strategies and to use this to strengthen their strategic thinking and planning going forward.

 

This photo illustrates outcomes generated by leadership of the Treatment Action Campaign (TAC) in one of South Africa’s most rural and impoverished provinces, the Eastern Cape.  Using post-its, they put outcomes in one colour, TAC’s contribution in another. This formed the basis for collective discussion about where TAC had been and where it is going. When I was asked by one of TAC’s core funders to draw lessons from the experience of TAC, I asked its leadership if this would be useful to them. They argued that multiple papers had been written about how TAC won a legal victory that brought the right to treatment to millions of South Africans. But little had been written about their organizing and mobilizing strategies on the ground. They sent me to the Eastern Cape. In my consultations with their leadership, they were keen on the exercise because they felt their own history was untold. What they most wanted was a pamphlet about their own work. So, this is the trajectory we followed. In addition to their pamphlet, the product for the funder, which was about lessons from TAC as a whole, used the Eastern Cape experience to bring alive the TAC story. See Membership based organizations in constitutional democracies  Lessons from the Treatment Action Campaign.

 OH recognizes the need to identify and name collaboration which is an aspiration of feminism. Like other methods steeped in a recognition that social change in complex contexts happens in neither a linear nor predictable way, OH focuses on the contribution of the initiative, looking for a plausible or reasonable explanation of its direct or indirect influence on outcomes rather than seeking to attribute changes in their entirety to the initiative being evaluated.  Outcome harvesting draws on systems theory, in particular recognizing the multiple factors may have influenced change. It is not interested in proving that a single intervention caused a change, but rather in tracing back from actual changes that can be observed, to see what the contribution of a particular intervention was, whether directly or indirectly.  In addition, it makes it possible to systematically name the role of others in the contribution.  Indeed, in the framing of outcome statements, in addition to drafting the outcome and the contribution descriptions, one can draft the ‘contribution of others’ and analyse that to understand if, when and how collaborations have been critical in influencing outcomes.

The following quote illustrates one of the findings of an evaluation that used outcome harvesting among other methods, to get to grips with the influence of collaborations among workers’ organisations, researchers and others involved in building ‘inclusive cities’: “Everyone has their roles, but combining together these capacities and experiences we were able to meet larger objectives, larger than the sum of its parts or number of people involved. For example, there are people trained in handling media who collaborated with us, people skilled in the lobbying, politics and the ways in which these events take place. There are other people with very strong skills in rallies, protests, organisation, or logistics. The different capacities together made our achievements a reality.” –Silvio Ruis Grisales, RED Lacre, Latin America Regional Network of Recyclers (From Klugman, B., ‘Global advocacy networks: lessons from the ‘Inclusive Cities’ project and WIEGO, AEA Conference, Denver, 17 Oct 2014)

 Oh recognises the importance of process. Feminism gives attention to process, to the values embodied in the way individuals and institutions behave, and to recognising small steps that are signs of increased empowerment or agency.  By enabling one to identify any outcomes, and to choose how to categorise them, OH can give weight to values and objectives that may not be the end-goals of initiatives. For example, if the end goal is a change in policy, OH can nevertheless harvest and name increased participation of marginalised groups in decision-making spaces, invitations to such individuals or groups that recognise that their voice matters. Naming these shifts is important in recognising the role of organising and voice in efforts to ensure that any policy changes reflect the perspectives of those most affected, a core value of feminism. As another example, in an initiative to strengthen capacities of farmers, OH can give weight to increased leadership by women farmers, or to decisions by farmers’ organisations to recognize long-standing practices of women farmers in seed management. Of course, any method can do this, but because OH asks, ‘what changed’ rather than looking for predefined changes in a logical framework, it renders those involved open to understanding the dynamics of change and what changes are considered meaningful by those involved.

 Having said that, OH is about outcomes; it is not the best method for evaluating the quality of relationships which is why I frequently use it alongside other methods. A feminist evaluation approach is likely to encourage evaluation designers and users to ask questions about power in an initiative and about if and how well it challenges power relations. While OH can pick up outcomes in this regard, interviews, focus groups, workshop conversations or even surveys may be needed as a supplement to get to grips with relationship dynamics.

 In my view, feminist practice can be brought to most evaluation approaches; and any evaluation can ask questions of concern to feminism. I am not arguing that OH is better or unique, but for those not familiar with the method, I hope these thoughts encourage you to explore it further.

 Barbara Klugman(PhD) provides strategy and evaluation support to social justice networks, organisations and funders. She has a long history in activism and policy advocacy, development of training materials, and grantmaking for gender equity and sexual and reproductive justice.

[e-mail]

Johannesburg, South Africa

[Prakash Kumar]

Dear Barbara, 

This is in the context of outcome method (OM) which lays down changes in behavior of intervention’s direct partner. Here changes are defined as changes in behavior, action and relationship. The method provides a broader sense of understanding in every layer of intervention who is involved as boundary partners and also gradually defined changes markers in three dimensions as expect to see, like to see and love to see. To look forwards in the outcome harvesting (OH) method as evaluation focuses on contribution, engagement, participation to see the immediate result of certain intervention in particular period of time.  

The question will be raised here how the OH is different from OM, Is it same or provides some additional mechanism to examine/ investigate in immediate changes in terms of attitude, action and behavior? Will it be a different level of findings while using these two different methods?

[Fabiola Amariles]

Dear Barbara, congratulations on this excellent tribute to Ricardo Wilson-Grau! I am sure he would have enjoyed the way you highlight the important contributions of OH to feminist evaluation.

I like the way you connect the feminist perspective with the main characteristics of OH; we feminist evaluators need to preserve, promote and apply those links in order to apply the view you express in the blog, with which I agree completely: that “feminist practice can be brought to most evaluation approaches”; and that “any evaluation can ask questions of concern to feminism”.

Thank you for bringing these concepts forward!

Abrazos (hugs), Fabiola

[Lyn Messner]

Thank you Barbara for this blog. We use outcome mapping quite a bit at EnCompass and are eager to do more in outcome harvesting, and I appreciate how you've outlined the key components of this process while highlighting how and why it's feminist while acknowledging limitations. 

[Mary Nderitu]

Nice post Barbara, i got a little confused at the beginning but am sorted now by all the explanation in this blog post.

[Ivan Tasic]

Hi Barbara, thanks for the post and the attachment. Really useful. Cheers!

[Ranjani K.Murthy]

Thanks for this clarification barbs- is outcome harvesting one way of contribution analysis? Will read up more. I am glad you are working on gender mainstreaming in these- as often we feminists do our own thing, and these approaches continue with theirs

My dad is unwell, at 87. Mustafa and Armaan are fine.  Thanks for your annual updates 

[Barbara Klugman]

Hi Ranjani !! Fully agree with your posts. Also want to note that it is Outcome Mapping, rather than Outcome Harvesting that engages the various activities you mention - outcome maps, boundary partners etc. Outcome Harvesting is used to see what actual outcomes occurred and then explore the contribution of the groups concerned, going backwards in time from the actual outcomes. Although OH drew some of its inspiration from Outcome Mapping, it is not a planning tool, but rather focuses on actual changes.  Hope all's well with you and yours, Barbara

[Ranjani K.Murthy]

Dear Barbara

Thanks 

I think both process and outcomes need to reflect a feminist perspective

The process of arrive at outcome maps, definition of boundary partners, and what one would expect to see, like to see and love to see have to reflect a gender-transformative lens . 

Not all outcome mapping exercises are feminist, and not all feminist evaluations clearly focus on outcomes and impact 

Best

Ranjani