Between efficiency and effectiveness
Evaluation in for-profit education organizations

Article Highlights

  • How do we encourage transparency in the evaluation of for-profits while allowing them to do what they do best—innovate?

    Tweet This

  • For-profits use evaluation to identify how they can get better results and/or how they can get the same results w/ fewer resources

    Tweet This

  • Policymakers can help promote for-profit evaluations that retain a focus on both efficiency and effectiveness

    Tweet This

Between efficiency and effectiveness: evaluation in for-profit education organizations

Download PDF
As the education policy landscape shifts toward a system of outcomes-based accountability, evaluation and research have grown increasingly vital. This is especially true for for-profit education firms, which must overcome skepticism, scrutiny, or even outright hostility in a field that has long been suspicious of the profit motive and where the bottom line is directly influenced by public perceptions of effectiveness.

This paper describes how these for-profit organizations view evaluation work, what they choose to focus on and why, the assets and capabilities they bring to the work, and the challenges they face. It also explores the question of how to encourage transparency and rigor in the evaluation practice of private enterprises while allowing them to do what they do best—innovate and attract investment.

How the Profit Motive Shapes Evaluation Practice. Though for-profits and nonprofits approach evaluation similarly, they differ in two important ways. First, whereas many nonprofits and public agencies operate on a fixed revenue model, for-profits do not. Second and related is that for-profits either earn more than they spend or go out of business. For-profits, then, face a unique set of challenges with evaluation. Questions of implementation and fidelity can cause these firms to hesitate to commit to independent evaluation; additionally, many customers of for-profit education services do not rely on third-party research when making purchasing decisions, leaving these firms with little incentive to commission independent evaluations of their effectiveness.

For-Profits, Nonprofits, and the Accountability Landscape. Changes in the education policy environment are raising the profile of evaluation work focused on the private sector. But when it comes to private-sector engagement in education, significant differences exist between types of companies. Supplemental service providers compete with one another and are decidedly not trying to put school districts out of business. By contrast, enterprises that actually seek to operate schools (whether in K–12 or higher education) directly compete with public school districts or state colleges and universities. These providers recognize that, appropriately or not, the public sector does not regard them as benign, and they see increased (and, in some cases, special) scrutiny at least in part as a response to this perception.

Using Evaluation to Promote Efficiency and Effectiveness. While for-profits’ approach to evaluation depends on which sector of the education market they occupy, most companies have two common characteristics. First, for-profits focus on the customer experience and satisfaction, resulting in an evaluation approach that emphasizes ongoing user or customer feedback to drive product improvements or management decisions. Second, they emphasize measures that capture academic performance in relation to operational efficiency; they use evaluation to identify how they can get better results for their students but also consider whether they could get the same results with fewer resources. In an era when schools, districts, state universities, and community colleges face relentless pressure to cut budgets and public disaffection with schools is high, we can learn something from these two areas of emphasis. On the other hand, the lack of rigorous, third-party evaluation of many for-profit operators raises concerns about how prospective consumers should make informed decisions about whether to purchase their products or services.

Policymakers can do four things to help promote evaluation that retains a focus on both efficiency and effectiveness: (1) grant increased flexibility to schools and systems for managing resources; (2) establish policies that more closely align incentives for educational and financial performance; (3) at the K–12 level, reward schools more for performance than enrollment; and (4) develop policies to encourage states and school districts to weigh rigorous evidence more heavily in decisions about resource allocation and contracting. Together, policies such as these would increase the quality and use of evaluation data both inside and outside education’s private sector.

Matthew Riggan ([email protected]) is a senior researcher at University of Pennsylvania's Consortium for Policy Research in Education.

Also Visit
AEIdeas Blog The American Magazine

What's new on AEI

Love people, not pleasure
image Oval Office lacks resolve on Ukraine
image Middle East Morass: A public opinion rundown of Iraq, Iran, and more
image Verizon's Inspire Her Mind ad and the facts they didn't tell you
AEI on Facebook
Events Calendar
  • 21
  • 22
  • 23
  • 24
  • 25
Monday, July 21, 2014 | 9:15 a.m. – 11:30 a.m.
Closing the gaps in health outcomes: Alternative paths forward

Please join us for a broader exploration of targeted interventions that provide real promise for reducing health disparities, limiting or delaying the onset of chronic health conditions, and improving the performance of the US health care system.

Monday, July 21, 2014 | 4:00 p.m. – 5:30 p.m.
Comprehending comprehensive universities

Join us for a panel discussion that seeks to comprehend the comprehensives and to determine the role these schools play in the nation’s college completion agenda.

Tuesday, July 22, 2014 | 8:50 a.m. – 12:00 p.m.
Who governs the Internet? A conversation on securing the multistakeholder process

Please join AEI’s Center for Internet, Communications, and Technology Policy for a conference to address key steps we can take, as members of the global community, to maintain a free Internet.

Event Registration is Closed
Thursday, July 24, 2014 | 9:00 a.m. – 10:00 a.m.
Expanding opportunity in America: A conversation with House Budget Committee Chairman Paul Ryan

Please join us as House Budget Committee Chairman Paul Ryan (R-WI) unveils a new set of policy reforms aimed at reducing poverty and increasing upward mobility throughout America.

Thursday, July 24, 2014 | 6:00 p.m. – 7:15 p.m.
Is it time to end the Export-Import Bank?

We welcome you to join us at AEI as POLITICO’s Ben White moderates a lively debate between Tim Carney, one of the bank’s fiercest critics, and Tony Fratto, one of the agency’s staunchest defenders.

No events scheduled this day.
No events scheduled today.
No events scheduled this day.
No events scheduled this day.
No events scheduled this day.