Blog Layout

Four limiting beliefs about program evaluation

Dr. Robin LaBarbera • August 3, 2023

Many leaders resistant to program evaluation hold one of these four limiting beliefs. Do you?


Evaluation...what is it?

Evaluation is a process that critically examines a program to collect and analyze information about a program’s activities, characteristics, and outcomes.


We know, however, that evaluation can be somewhat intimidating and confusing for those unfamiliar with its usefulness. Because of the negative stigma sometimes attached to evaluation, we feel it imperative to debunk some common myths associated with program evaluation.


Why should you conduct an evaluation?

  1. Evaluations can help an organization identify areas for improvement and help you realize your goals more efficiently.
  2. The information you collect in an evaluation can allow your organization to communicate your program’s impact to others, which is critical for public relations, staff morale, and for attracting and retaining support from current and potential funders.
  3. The report from an evaluation is useful for marketing and creating program awareness. 


Evaluation findings can  showcase the effectiveness of a program to funders and the community. An evaluation can demonstrate that a program is worthwhile. Sharing findings with the community can serve as marketing and outreach tools for attracting collaborative partners, recruiting participants and program facilitators, and building trust with stakeholders.


Also, funders often require that a program evaluation be conducted when they agree to fund a program, and some funders will not fund or continue to fund a program until an evaluation has been conducted and outcomes have been demonstrated.


Program evaluation is a valuable tool, critical for securing funding sources and boosting organizational growth. In this article, we address four common concerns program managers and organizational leaders might have regarding an evaluation. 


Myth #1 – “Evaluation generates lots of boring data with useless conclusions.

Fact: Quantitative data can be difficult to analyze—statistical analyses are left to the “academics” who understand such data, and they sometimes fail to communicate results in ways that are meaningful and understandable to stakeholders.


Good evaluators, however, draw out implications from the findings from tables of numbers, and they can make substantial use of graphs and other visual aids to share results. An expert evaluator can use the data to develop recommendations that make sense for the program.


Ideally, an evaluation will have provided new insights to program managers who can then make program improvements or capitalize on existing program strengths. 


Myth #2 – “Evaluation is all about showing the failure of a program.”

Fact: When you use data to understand what’s not working as intended, you gain the power to change it. This kind of organizational self-awareness and sophistication makes you stand out to funders and accrediting bodies even more.


If you find that some parts of your program are not working, you have a responsibility to your clients and donors to do something about it, and an evaluation will give you the power to do just that. An effective evaluation will permit the program’s staff to decide whether to offer the program again because it is successful, to alter the program in order to make it more useful to participants, or to drop the program because it fails to meet a need.


Staff would not want to devote resources to a program that does not meet the needs of participants; in such a case, something more helpful should be offered instead. If the program is good, you want the evaluation to detect its strengths; where it needs improvement, you want to detect its limitation. 


Myth #3 – “Evaluation is too expensive.”

Fact: It is true that organizations can pay a bunch of money for fancy software to collect data, that at the end of the day tells them nothing about how to improve their programming. And while it is also true that evaluation will take some of your program resources up front, what a program can learn from an evaluation can help streamline its resources to focus on “what works” for program participants and improve outcomes.


An independent evaluator or consultant can help develop an evaluation design that is most appropriate for a program’s service delivery, the evaluation questions the program wishes to address, and the program’s resources for conducting an evaluation.


Many evaluators negotiate their fees to accommodate organizational resources. A program evaluation is well worth the initial investment to find out what works and what does not work. 


Myth #4: "Evaluation is too complicated, and no one here knows how to do it."

Fact: Many sources of help are available for designing an evaluation. If your organization does not have employees with the necessary skills, find help at a nearby university or from someone related to your program (e.g., a board member, a volunteer, or someone from a partner organization), or look for an independent evaluator.


If you are considering working with an independent evaluator, look for one who has experience with programs in your particular content area. In such situations, the evaluator has a passion for this particular social impact cause and would love working with your team.



RELATED: Download our free Guide to Program Evaluation


Final thoughts.

While conducting an evaluation may seem complicated, expensive, or somewhat overwhelming, it is important to remember that program evaluations serve as tools to improve programs and demonstrate effectiveness to stakeholders. Simply put, program evaluations are conducted to make programs better.


Although evaluation is not without challenges, the information obtained from a program evaluation can help to streamline and target program resources in the most cost-efficient way by focusing time and money on delivering services that benefit program participants. Data on program outcomes can also help secure future funding. Ultimately, an evaluation enables you to demonstrate your program’s impact to others.


Need help finding a reputable program evaluator? LaBarbera Learning Solutions offers a full suite of program evaluation and research expertise to nonprofits, community-based organizations, educational institutions, philanthropies, corporations, and state and federal agencies. Visit us at https://labarberalearning.com to learn more.



Scaling impact through program evaluation (credit: Shutterstock)
By Robin LaBarbera August 26, 2024
You can drive greater impact with data – work with a program evaluator who has a history of publishing research in academic journals to ensure that more people set eyes on your accomplishments. We helped a client get their program expanded into 53 new locations because we published evaluation data in over 25 blogs and in three academic journals.
returning home from incarceration: improving outcomes (credit: Shutterstock)
By Robin LaBarbera July 15, 2024
Based on the first round of data collection and analysis, it appears that HOM is achieving its desired outcomes. Specifically, program participants rated themselves highly in terms of their perceptions of HOM’s programs and services, ability to think adaptively under stress, psychological strength and approach to problem-solving, perceived social support, employment and educational trajectories, and positive use of leisure time.
Cognitive distortions (credit: Shutterstock)
By Dr. Robin LaBarbera June 9, 2024
Cognitive distortions - irrational thoughts that can distort the way a person sees themselves, their life, their specific day-to-day situations, their relationships, and other people - can contribute to mental health conditions such as depression and anxiety. Learn how to identify and address them in our peer2peer mental health support training.
Higher education in prison (credit: Shutterstock)
By Robin LaBarbera June 9, 2024
The evidence is clear: TUMI is responsible for the drastic change I observed in people like David McMillan. So, yes, we should provide educational opportunities to those who are incarcerated!
Peer-directed CBT (credit: Shutterstock)
By Dr. Robin LaBarbera May 26, 2024
In a recent post, I explained the “why” behind the development of my peer support training program, where we expand CBT beyond the traditional therapy office to individuals who have traditionally been unable to access evidence-based mental health care. We train peer support specialists on how to recognize and address negative thought processes and behaviors and help their clients thrive. Right away, I received one very important question from a colleague on LinkedIn: Can trained peer counselors provide Cognitive Behavioral Therapy? That question deserves a thoughtful response, and I did so in this article.
CBT in peer support (Shutterstock)
By Dr. Robin LaBarbera May 24, 2024
Some people want help with their own mental health and well-being but hesitate to see a licensed psychologist. Another group of people have the skills and want to help others achieve greater mental health and well-being, but they hesitate to undergo the lengthy schooling process necessary to become a licensed psychologist. Cognitive behavioral therapy (CBT) works in a variety of situations (especially reentry), but few peer support training programs explicitly include CBT principles in their curriculum. We created a tool to train people with lived experience to implement CBT to educate clients on healthy coping strategies.
Cognitive Distortions for Peer Counselors (Shutterstock)
By Robin LaBarbera May 20, 2024
As peer counselors, we play a vital role in supporting individuals through their emotional struggles and challenges. One common hurdle we encounter with clients is cognitive distortions—patterns of thinking that skew perceptions of reality and often lead to negative emotions and behaviors. Identifying and addressing these distortions is a crucial step in promoting mental well-being. In this article, we'll explore strategies and techniques to help clients recognize and overcome cognitive distortions effectively.
Peer Support and Self-Awareness (Shutterstock)
By Robin LaBarbera March 12, 2024
Self-awareness is becoming aware of our thoughts and feelings. By understanding ourselves, we are better positioned to understand others and help them in their healing journey. As peer supporters, self-awareness is essential to preparing to encounter those we support, their families, and the system and support our peers in reentry.
writing successful grant proposals (Credit: Shutterstock)
By Robin LaBarbera January 8, 2024
Grant proposals describe your organization’s mission, how you plan to use grant funds, your program's goals and objectives, a timeline for completion of the project, and an expected outcome. However, a grant proposal must be written in such a way as to convince potential funders of the value and impact of your project. At LaBarbera Learning Solutions, we’ve helped our clients write several successful grant proposals. In this guide, we’ll share with you 8 tips we’ve learned about what it takes to create a winning proposal.
belongingness behind bars (Shutterstock)
By Robin LaBarbera November 17, 2023
The intricate link between belongingness and criminal behavior suggests that addressing the fundamental human need for connection can be a key element in the rehabilitation of those who are incarcerated.
More Posts
Share by: