In 2009 I was at a networking meeting with some of our program donors. One of them posed a question on how the networking partners monitor and evaluate their program activities. I was representing Vijana Amani Pamoja (VAP), an organization that uses soccer to empower youth in Nairobi Kenya. Part of my answer was that it is challenging to evaluate and show impact on positive behavior change, even though I strongly believed in the impact of our programs. Since then however, thanks to VAP’s combined use of score cards and story centered learning, we are much better equipped to measure and report on the impact of our work.
Use of Score Cards
To help us monitor and evaluate our programs, Grassroots Soccer, one of our oldest partners trained us on how to use score cards to capture behavior change and knowledge gained among participants from our programs. We used the score cards to ask questions related to gender relations, and knowledge about and attitude towards HIV. The score cards were a great first step towards helping us compare the results of our post surveys to our baseline surveys to measure a change in attitudes, perceptions and behavior.
Introduction to Story Centered Learning
In 2010 Global Giving shared with us a powerful qualitative tool for evaluation, story centered learning. Story centered learning perfectly complemented our score card tool because it enabled participants to go beyond the questions asked and fully express their experience regarding the program.
Story centered learning is a structured way of recording the experiences of your program participants. Participants narrate their story and answer questions related to it via forms administered by trained “scribes”. In addition to allowing the participants to openly express themselves, the story collection process allows program implementers to become more aware of the needs of the target group. This is very important since it is vital to involve the participants as you evaluate and begin to design new program activities.
Learning through Stories from the Field
In 2010 we used this approach to collect stories for our Mrembo program which seeks to empower young mothers and adolescents girls through soccer activities, life skills sessions and vocational training. The participants were to share stories of any significant change in their lives as a result of our program activities, as well as general stories on the challenges and problems facing their communities. Through these stories, we learned that rape was a big issue in the communities where our programs were running. We had not realized the magnitude till we read and analyzed the stories.
As a result of this analysis, we began to place a special emphasis on creating a safe space for girls to talk about Gender Based Violence (GBV) in our program sessions. We also created a Miss Mrembo tournament where girls would play soccer but also discuss GBV and self-esteem. In addition, we approached various referral centers for medical and counseling assistance for GBV survivors, and legal centers to provide support to girls regarding the GBV legal process.
Advice to other Organizations
I would highly recommend for other organizations to incorporate story centered learning. It is one of the best ways to involve program staff as they evaluate and design program activities, as they directly hear about beneficiaries experiences and needs.
If you are interested in using story centered learning, one of the first step is to read up on why it’s important. It’s also important for the staff and volunteers to be well trained on the story collection process. Then, develop a tool on evaluation or partner with an organization that can assist you with the analysis process.
I would also like to add that reading stories from youth regarding the impact of your work can be a great motivator. Running community projects call for a lot of motivation. Work can be overwhelming and staff will feel that their efforts are not enough to do what needs to be done. Stories that show positive behavior change then, help provide inspiration to staff and volunteers working hard to bring about positive change in the world.
Recommended Reading
Global Giving Story Telling Project Maps
Lessons from Four Years of Story-based Monitoring
Nancy Njeri Waweru is a program director at Vijana Amani Pamoja. She has worked for VAP since 2006. She has a degree in Bachelor of Arts (Sociology and Kiswahili).
You must be logged in in order to leave a comment