The “dirty little secrets” of program evaluation

Dirty little secret #1—When you say “We do program evaluation,” typical reactions include polite but confused nods and rolling or glazed-over eyes. Unfortunately, the real value of evaluation is often crowded out by rhetoric about investing only in “evidence-based” programs on the one hand and pressures of grant compliance on the other.

CGR’s clients operate in the real world, where program evaluation isn’t quite as pristine as it is in academia. Some of CGR’s evaluations have formal designs with control groups, sophisticated statistical analysis, and measurable “hard” outcomes. But the vast majority of evaluations are not as “pure”—and this is where the fun begins. Real programs serve real people who are affected by many things besides the program in question. They have real limited budgets, real funders funding different outcomes, real challenges getting data, and operate in real dynamic contexts. Evaluation often gets a bum rap—either it’s watered down to the point of PR or it’s done just for compliance. So what’s the point? Read more »