Attending Evaluation 2019? Check out our guide to this year’s conference!
DME for Peace
ADVANCED, BEGINNER, INTERMEDIATE
Are you attending this week’s American Evaluation Association’s Annual Conference: Path to the Future of Evaluation? Check out DME for Peace’s recommendations for what’s not to be missed in Minneapolis, Minnesota! For a list of all the events, check out the Evaluation 2019 website.
Wednesday, November 13th
Developmental Evaluation: Getting over the Price Tag Problem
When: 4:30 PM – 5:30 PM
Where: CC – L100F
Identifying solutions to socially and technically complicated development challenges requires intentional innovation. Developmental Evaluation (DE) is a relatively new and untested evaluation approach designed to support the process of innovation within organizations by fostering continuous learning and adaptive management in unpredictable environments. However, DE can seem expensive. There is a real cost to embedding a full-time evaluator in projects or organizations and potential opportunity costs if a DE is selected but not appropriate for the situation. This panel will present learning on when DE is and is not worth the cost, and how to develop, promote, and communicate value.
Presentations given by Social Impact, Inc., Search or Common Ground, and US Global Development Lab/US Agency for International Development.
Journey Mapping: Inspiring Dynamic Participation Through Visual Storytelling
When: 4:30 PM – 5:30 PM
Where: Hilton Marquette IX
Have you ever wondered how to use individual journeys to build a shared visual narrative of a program or evaluation? A journey map is a visualization of the process that a person or group goes through in order to accomplish a goal. In the evaluation context, journey mapping can be used to explore multiple realities simultaneously, and help groups understand the complete, multi-layered, and evolving story of their impact. Journey mapping combines skills that many evaluators use: storytelling, visualization, and facilitation. In this session, you’ll learn how to use journey mapping as an evaluation tool; you’ll learn how to meaningfully facilitate journey mapping sessions, how to analyze individual journeys, and how to co-create a visual journey map that can be used for group learning, team-building, and decision-making. Journey mapping is a powerful tool for evaluators looking to strengthen the use and application of their evaluation work through visual storytelling.
Evaluating interventions aimed at the most vulnerable populations: findings and lessons learned
When: 6:30 PM – 8:30 PM
Where: Poster 82
BBC Media Action evaluates media and communication interventions that are aimed at supporting some of the most vulnerable populations in the world. The substantial research team – in London and in country offices in Africa and Asia carries out research to evaluate the impact of media on development outcomes using a range of methods. Recent work includes a 5 year evaluation of a program aimed at supporting girls education; an evaluation of a UNICEF funded polio magazine program Ghamai in Taliban controlled areas in Afghanistan and an evaluation of a project run with Internews and Translators without Borders aimed at improving access to information for Rohingya communities by supporting humanitarian and media agencies in their communication in the camps. This paper will outline how these evaluations were carried out, the key findings and lessons learned from implementation that researchers and practitioners can apply to work going forward.
Presentation given by BBC Media Action.
Thursday, November 14th
Institutionalizing Doing no Harm in Monitoring and Evaluation
When: 8:00 AM – 9:00 AM
Where: CC M100 H
Leaving no one behind, a frame emanating from the Sustainable Development Goals, is an important path to follow for the future of evaluation practice. Leaving no one behind requires us to adapt evaluation to understand both changes that people value and also change that is harmful.
Evaluation has guidance on advancement, but little on how people are pushed back or held behind from doings and beings they have reason to value. Institutionally evaluation practices still struggle to fully get to grips with the reality of harm, in the pressure to report results. This panel demonstrates that although we often do not focus on harm, we already have theory and practice to draw upon that supports harm prevention in the form of knowledge on: complex ecologies, feminist evaluation, responsible data practice and harm identification and mitigation in evaluation practices.
Planning for Success from Start to Exit: Lessons Learned from USAID Stopping as Success
When: 5:00 PM – 5:45 PM
Where: CC M100 H
International aid actors increasingly strive to foster locally-led development through their activities and programs, but what are the key factors at play when ending a development program? How do we ensure we leave no one behind?
This session is presented by the Stopping as Success (SAS) consortium (Peace Direct, Search for Common Ground and CDA Collaborative Learning). SAS is a three-year USAID-funded collaborative learning project examining responsible exits and transitions of INGOs from a variety of different international development and peacebuilding contexts. The SAS team will discuss implications for practice from cases in which INGOs have successfully exited or transitioned to a locally-led organization or initiative, sharing insights and lessons learned around exits and transitions from twenty case studies conducted in thirteen countries, as well as two regional workshops engaging key stakeholders and local aid actors in Washington, DC and Bangkok, Thailand.
Friday, November 15th
Found in Translation: Fostering communication between local MEL staff and the donor community
When: 10:15 AM – 11:00 AM
Where: CC M100 I
USAID works to empower local actors to take the lead in identifying and addressing development challenges with more resilient solutions. In order to meet the expectations of their donors and effectively communicate their successes, local partners must learn to “speak Donor”, sometimes for multiple different donors. Local actors must learn to navigate the unique lexicons used within the global development community, and the MEL community, with the additional languages of its academic roots, is no exception. Donors have a responsibility to understand and minimize the burden this imposes on local partners. Donors can set the stage for local partner and program success when they facilitate shared understanding of program objectives and assist local partners in navigating policies and guidelines for Monitoring, Evaluation and Learning. Our three panelists will share examples of success in working effectively with local partners and the conditions that enabled them to do so.
Roundtable discussion led by USAID.
Where Does Community Led Development Work and Why: What the Perfectly Imperfect Evidence tells us
When: 2:15 PM – 3:15 PM
Where: CC 200 H
What is Community Led Development (CLD)? Where does it work? In what context? What is its impact at the individual, system, and population levels?
Over the last decade, CLD—under many names and forms—has emerged as the preferred strategy for governments and aid agencies, with the World Bank alone funding 190 community-driven projects in 78 countries. Yet, it has been the defining value for many NGOs for much longer. To address the needs of peer organizations running CLD programs in highly complex environments, a collaborative effort to distill, analyze and gather evidence on CLD was launched in 2019.
This roundtable presents the work of 60 global non-profit organizations who constitute the CLD Movement. It discusses methodological gaps that make it difficult to measure the intended and unintended consequences of CLD and presents a framing, co-created by evaluation and learning specialists across many organizations.
Improving Systems-Oriented Adaptive Management to Ensure Collective Impact
When: 4:30 PM – 5:30 PM
Where: CC 101 A
Systems-level collective impact requires systems-oriented adaptive management. Political economy analysis (PEA) provides critical information on power dynamics and incentives in a system that ultimately affect whether a project will succeed or fail. Used effectively, it can improve project design and decision-making, and result in projects that address the underlying system rather than mere symptoms. However, too often PEA findings are forgotten or sidelined. Three organizations –Pact, Chemonics, and IREX – have led parallel efforts to integrate learning from PEA into adaptive management processes. Panel participants will discuss the critical role that PEA plays in systems-oriented problem and contextual analysis, how PEA results can inform decision-making throughout a project life-cycle, how each organization has implemented a utilization-focused and adaptive management approach, and to-date lessons learned that will be of immediate use to audience participants. Lastly, panelists will share practical tools they have developed to enable effective operationalization of PEA findings.
Saturday, November 3rd
Evaluating Transitions to Locally-Led Development: What Are Metrics for Success?
When: 10:15 AM – 11:00 AM
Where: CC M100 H
As members of the international development community increasingly strive to foster locally-led development through activities and programs, how is the evaluation community assessing this shift to locally-led development? And what metrics are being used to determine whether such efforts are successful?
“Stopping As Success” is a three-year USAID-funded collaborative learning project implemented by Peace Direct, Search for Common Ground and CDA. The consortium documented 20 cases of INGO exits or transitions to local entities in 13 countries and has identified factors that enable successful transitions. Drawing on learning from these case studies, the consortium is developing a set of tools that can be used by a range of stakeholders in transitions to locally-led development. This think tank will capture the ways in which the evaluation community is understanding transitions to locally-led development and will help the consortium design tools that meet the needs of evaluators assessing transitions to locally-led development.
Think Tank discussion by Search for Common Ground.