Monthly Corner

Astha Ramaiya Articles

Girls' Education Challenge - Working Paper, 2024

SIAS Publications, 2024

Ellen Hagerman and Ai-Ju Huang - Blog, December 2024

IEG & World Bank Group Publication - 2024

This evaluation assesses World Bank Group support to address gender inequalities between fiscal years 2012 and 2023.

IEG & World Bank - Blog

A new evaluation of a decade’s worth of World Bank Group support for gender equality offers insights and lessons to inform the implementation of the institution’s ambitious, new gender strategy.

Utthan & Edel Give Foundation Publication - 2024

This zine, commissioned by Utthan and supported by EdelGive Foundation, captures the essence of a qualitative evaluation,Transformative Narratives: Storytelling for Evaluation and Organizational Learning through a Gender Justice Lens, of a multi-themed project implemented by Utthan over 2021-2024.  Piloting Storytelling as a means of Learning & Evaluation has been of immense value to us as a team and the communities we serve.

Query: Creative ways of collaborative qualitative data analysis

Dear All,

I am reaching out for your insights. The group has set the objectives of the review. they will design the process, collect data, analyse and disseminate. I plan to facilitate online participatory data analysis with a group of about 15-20 staff members from different organisations. The study is qualitative. I have facilitated group data analysis a few times, but would like to go a bit deeper. 

Any creative ideas/experiences on collaborative data analysis would be very welcome! 

Thanks and regards,

Rituu

Photo courtesy https://www.canstockphoto.com/teamwork-entrepreneurs-engaged-in-811...

Views: 519

Reply to This

Replies to This Discussion

If you are using a common data set and conducting a thematic analysis, you might assign various anticipated themes - based on the evaluation structure, questions and data content - to pairs or trios of participants, ask them to comb through the data prior to the call and be ready to report on highlights of findings relevant to their assigned themes.

You might also provide participants with a summary template so that everyone's work is completed in a similar format and easy to merge or blend if that is a useful step.

Thanks a lot Dr Deborah. What if the group arrived at the themes on their own as well? 

Better still if participants arrive at the themes on their own without being prompted.  More realistic.

I think generating themes is a really good idea.  You might start out with soliciting actual stories, and then maybe have the participants draft "ideal-type" stories that demonstrate processes and outcomes? I'm thinking of user scenarios/stories from the design world. Usually you do them in the beginning, but it might be interesting to ask for them at the end, once the participants have seen how the thing you're evaluating really works! 

If you're interested in soliciting narratives about why things worked or didn't, you could try doing a Five Whys style exercise. Or you could tweak this Unintended Consequences exercise to have participants investigate what were the consequences that weren't anticipated/part of the TOC, and try to get a causal narrative there. Ooh, I Like, I Wish, I Wonder might be a good structure for a go-around? (I really like HyperIsland Toolbox, as you can tell, even though everything needs to be flipped from being about business/design to be being about evaluation/community building...)

You could invite participants to comb through specific (assigned) evaluation questions to look for themes within the findings related to those specific questions as a way to divide the work.

Amazing suggestions, many thanks Dr Deborah!

This is a super interesting question! I'm assuming the data already exists and the group will be analyzing it, not generating the data...

If what you want at the end is coded texts, I have used the free software Taguette to have many people coding the same transcripts - it can get a little funny if two people are in the document at the same time but otherwise works well.  

You could also divide the analysis - ten questions for 20 people, each person gets a question, everybody looks at the material, and then you think-pair-share their analysis (each person thinks alone, they pair up with the other person/people doing their question and discuss, they present their analysis to the group and the whole group dialogues about it). 

To what extent will you be determining what is being evaluated as you work together, or will everyone come to the conversation with an agreed-upon idea of what is being evaluated in the data?

Amazing Emily! Am grateful. They will be generating the data. I would like the group to take on the role of decision making at each step.

Hi

You could ask them to think about how cultural and organizational context influences (positively and challenging) their work -- Get them to tell "stories" -- that is conduct qualitative inquiry to obtain meaning and context to their responses.  These "stories" are qualitative data and if you have the context you can compare across the organizations, staff lines, topical areas etc.  Its callled "thick description" in anthropological inquiry.

Mary Ann Castle

Thanks Mary Ann. Please would you give me a bit more on the - how cultural and organizational context influences (positively and challenging) their work.

I will love to use it. Am so grateful to you!

also -possibly-the most important aspect would be to know who the participants are .. this will give you much information about how to analyze and understand their responses

RSS

© 2025   Created by Rituu B Nanda.   Powered by

Badges  |  Report an Issue  |  Terms of Service