Our Role in Shifting the Evaluation Paradigm: Evaluation through an Equity Lens

By Tiffany Smith

Evaluation has been known as a systematic method for collecting, analyzing, and using data to examine the effectiveness and efficiency of programs and to contribute to continuous program improvement. Traditional evaluation has not historically centered equity and has operated with their beliefs that evaluative practices are neutral and objective, which is now known not to be possible. Equity in evaluation means equity is not a step in the process or a set of questions to include in a data collection tool; it is the way evaluation is designed and carried out from design, implementation, analysis, and reporting.  Applying an equity approach to evaluation includes learning and practicing ways you can include equity at different points throughout the evaluation process. Table 1 lists characteristics of evaluations centering equity and their difference from historically preferred evaluation approaches. 

Cities & People prioritizes and values equity and participatory practices in our evaluation approach. We acknowledge the history of systemic and structural oppression and as an agency we center equity by holding the following values in our evaluative work:

1. Acknowledging the complexity of the diverse cultural identities of partner organizations and their team members and communities.
2. Recognizing power dynamic between groups (e.g. program evaluators and program participants, program funders and program staff).
3. Co-creating evaluation design plans and data collection tools with program advisory councils. We engage with advisory boards as equals and build trust as a first step.
4. Working collaboratively with program staff and the advisory council to disseminate products that center utilization and transparency.
5. Supporting community partners’ ownership of the project and all data collected.  

Additionally, Cities & People understands and embraces the evolution of social consciousness and language and consistently self-educates to maintain current knowledge of trends and frameworks in equitable evaluation. As we continue in our journey, we both use and recommend resources such as the Equitable Evaluation Framework, Shifting the Paradigm , and Centering Equity in Evaluation. These resources assist us in learning best practices in equitable evaluation and considering what data can be collected and how they can be collected, analyzed, and shared to reduce existing disparities. 

There is no “one size fits all” approach to equitable evaluation. Through our work, we have grown to understand that when a community feels ownership over the evaluation, then they are more likely to engage with the process and implement recommendations from the evaluation. The process requires self-reflection, a growth mentality, adaptability, transparency, and accountability. It is best to start where you are and be amenable to feedback, growth, and revision! 

Reach out to us if you’d like to learn more about equitable evaluation.