Most people realize that the U.S. News and World Reports rankings of America's best colleges are a bit silly. What they tend not to realize is that since a change in rankings has real impact on a college administrator's career, real things happen in higher education in an effort to move up the rankings, and this has real -- and very bad -- consequences. Kevin Carey has one example here, noting that a large proportion of the U.S. News score is based on pure input measures (spending per student, etc.) rather than anything related to educational outcomes:
That tranlsates into incentives that virtually guarantee inefficiency and constantly rising costs. If a university were able to figure out how to reduce its costs by, say, 10 percent, while holding quality constant, and it chose to pass those savings along to its customers in the form of a tuition decrease, its U.S. News rankings would go down. If, on the other hand, it became 10 percent less efficient and passed the cost onto customers in the form a tuition increase (not a hard thing to do if you're a selective college), its ranking would go up.
But nothing's good for magazine sales like a much-discussed list, and so the madness continues.


If a college became 10% less "efficient," that could come to be reflected in the other measures of quality, more people could be dissuaded by the higher cost, alumni could get angry, students could drop out, the Prisoner's Dilemma peer assesment may even be affected. If the college retains efficiency but cuts costs, then more students may be attracted by the lower cost.
No it is not a perfect measure by any standard, but I do not believe that having a standard definition of what a college does and then giving entrance exams and exit exams to students based on that definition to see how much the college contributes is really a viable alternative.
It is always useful to be able to categorize things, even something as silly as college rankings.
Another thing, it is one thing for colleges not to publicize their rankings, but it is ridiculous, relativist, self-righteous hooey for colleges to refuse to participate. If the education a school provides is special and valuable and is not reflected in these rankings, then the college should still be able to articulate its merits without the rankings, especially considering that people who make their decisions based on U.S. News are not likely to be open to the special value of the school. (Yes, I know it may be the parents making the decision, but still!)
Posted by Moral Panicker | October 23, 2007 9:09 AM