Blog Layout

Is your program working? How do you know?

Robin LaBarbera • March 3, 2022

How do you know that your program is effective in meeting the needs of the community you serve? This is perhaps the most important question a nonprofit can answer for themselves, for the people their program serves, and for the donors who support their work.


The best way to answer this question is to understand, measure, and communicate the value of your program with an evaluation.


Before you begin your evaluation, it is essential to create an evaluation plan. A clear understanding of what you are looking at is vital to evaluating and interpreting your findings, so we start by mapping out a plan for what you do and how you will measure its impact on the community.


What is an evaluation plan?

An evaluation plan provides a clear articulation of what your program is trying to change, what your program is doing to change it, and how to track progress and/or measure outcomes to show the program’s effectiveness.


In a program evaluation, you will systematically collect information about program activities and objectives, monitor progress, and report/communicate results to partners, stakeholders, and the community. 


Why should you have an evaluation plan?

You’ve started a program or initiative with intention of addressing the problem you see in the world. Your initiative has finally gotten off the ground. Congratulations!


If your program is working perfectly in every way, you deserve the satisfaction of knowing that. If adjustments need to be made to guarantee success, you want to know about them so you can jump in and keep your hard work of organizing and initiating the program from going to waste. And, in the worst-case scenario, you’ll want to know if the program is an utter failure so you can re-direct your precious resources more effectively. For these reasons, evaluation is extremely important.


Stakeholders want to know how many people were served by your program, and whether the program had the community-level impact it intended to have. 


Developing your evaluation plan.

Take time to think about what you want to know about your program. Your evaluation plan should address simple questions that are important to the community, your staff, and your funding partners. The best way to ensure that you have the most productive evaluation possible is to develop an evaluation plan.


We recommend that you clearly define the following items before getting started with an evaluation plan:


Program Mission: What change do you want to see in the world?

What are the goals and objectives of your program? What is the program intended to accomplish? What outcomes do you intend to achieve with this program?

           Example: Improved health of community members with diabetes.

 

Program Activities: What does your program do to achieve the changes you want to see?

These are the actions and processes put into place to execute objectives. Ideally, program activities will align with the outcomes described above. 

           Example: Providing a low-cost health care program and offering free educational seminars in the community you wish to impact. 

 

Data Collection: How can you systematically measure what your program achieves?

Select key outcomes and specific ways to measure them. Don’t waste time measuring things that do not show how you’re achieving the goals and objectives. 


If improved health of community members with diabetes was the intended outcome, it’s not important to measure how many snacks were served and at what cost at the community outreach event. Measure instead, for example, improved lab results over the 6 months of participation in the program.


Plan how you will gather the data. Qualitative information includes data that can be counted. Qualitative data, such as that gathered through focus groups, interviews, or observation can be used to highlight opportunities for improvement, lessons learned, best practices, and strengths.


Some data-gathering options related to the community diabetes clinic, for example, could be pre-test/post-test results of diabetes awareness educational events, or focus groups about participant satisfaction with program services, or electronic health records (lab results). 


The results of your data collection efforts will provide a means of demonstrating program progress and impact to its members and the community.


If you are a nonprofit leader faced with evaluating your program’s effectiveness, we hope this brief article has provided you with the foundational knowledge you need to get started. If you’d like help with the process of planning and implementing a full-scale impact evaluation, consider the experts at LaBarbera Learning Solutions. We’re an experienced team of researchers, evaluators, and educators with the expertise needed to demonstrate your program’s impact to stakeholders. See our cost-effective solutions at www.labarberalearning.com


Scaling impact through program evaluation (credit: Shutterstock)
By Robin LaBarbera August 26, 2024
You can drive greater impact with data – work with a program evaluator who has a history of publishing research in academic journals to ensure that more people set eyes on your accomplishments. We helped a client get their program expanded into 53 new locations because we published evaluation data in over 25 blogs and in three academic journals.
returning home from incarceration: improving outcomes (credit: Shutterstock)
By Robin LaBarbera July 15, 2024
Based on the first round of data collection and analysis, it appears that HOM is achieving its desired outcomes. Specifically, program participants rated themselves highly in terms of their perceptions of HOM’s programs and services, ability to think adaptively under stress, psychological strength and approach to problem-solving, perceived social support, employment and educational trajectories, and positive use of leisure time.
Cognitive distortions (credit: Shutterstock)
By Dr. Robin LaBarbera June 9, 2024
Cognitive distortions - irrational thoughts that can distort the way a person sees themselves, their life, their specific day-to-day situations, their relationships, and other people - can contribute to mental health conditions such as depression and anxiety. Learn how to identify and address them in our peer2peer mental health support training.
Higher education in prison (credit: Shutterstock)
By Robin LaBarbera June 9, 2024
The evidence is clear: TUMI is responsible for the drastic change I observed in people like David McMillan. So, yes, we should provide educational opportunities to those who are incarcerated!
Peer-directed CBT (credit: Shutterstock)
By Dr. Robin LaBarbera May 26, 2024
In a recent post, I explained the “why” behind the development of my peer support training program, where we expand CBT beyond the traditional therapy office to individuals who have traditionally been unable to access evidence-based mental health care. We train peer support specialists on how to recognize and address negative thought processes and behaviors and help their clients thrive. Right away, I received one very important question from a colleague on LinkedIn: Can trained peer counselors provide Cognitive Behavioral Therapy? That question deserves a thoughtful response, and I did so in this article.
CBT in peer support (Shutterstock)
By Dr. Robin LaBarbera May 24, 2024
Some people want help with their own mental health and well-being but hesitate to see a licensed psychologist. Another group of people have the skills and want to help others achieve greater mental health and well-being, but they hesitate to undergo the lengthy schooling process necessary to become a licensed psychologist. Cognitive behavioral therapy (CBT) works in a variety of situations (especially reentry), but few peer support training programs explicitly include CBT principles in their curriculum. We created a tool to train people with lived experience to implement CBT to educate clients on healthy coping strategies.
Cognitive Distortions for Peer Counselors (Shutterstock)
By Robin LaBarbera May 20, 2024
As peer counselors, we play a vital role in supporting individuals through their emotional struggles and challenges. One common hurdle we encounter with clients is cognitive distortions—patterns of thinking that skew perceptions of reality and often lead to negative emotions and behaviors. Identifying and addressing these distortions is a crucial step in promoting mental well-being. In this article, we'll explore strategies and techniques to help clients recognize and overcome cognitive distortions effectively.
Peer Support and Self-Awareness (Shutterstock)
By Robin LaBarbera March 12, 2024
Self-awareness is becoming aware of our thoughts and feelings. By understanding ourselves, we are better positioned to understand others and help them in their healing journey. As peer supporters, self-awareness is essential to preparing to encounter those we support, their families, and the system and support our peers in reentry.
writing successful grant proposals (Credit: Shutterstock)
By Robin LaBarbera January 8, 2024
Grant proposals describe your organization’s mission, how you plan to use grant funds, your program's goals and objectives, a timeline for completion of the project, and an expected outcome. However, a grant proposal must be written in such a way as to convince potential funders of the value and impact of your project. At LaBarbera Learning Solutions, we’ve helped our clients write several successful grant proposals. In this guide, we’ll share with you 8 tips we’ve learned about what it takes to create a winning proposal.
belongingness behind bars (Shutterstock)
By Robin LaBarbera November 17, 2023
The intricate link between belongingness and criminal behavior suggests that addressing the fundamental human need for connection can be a key element in the rehabilitation of those who are incarcerated.
More Posts
Share by: