New players, new approaches to ranking colleges

Sep 12, 2012, 1:05 PM

AP Education Writer

(AP) – U.S. News & World Report may still be the 800-pound gorilla of college rankings. But with a formula that rarely changes, the latest edition _ out Wednesday _ looks pretty much the same as a decade ago, with very few exceptions.

More interesting are a pair of newer players to the rankings game. Both have shortcomings, but both produce a top-colleges list that looks somewhat different from the magazine’s (where Princeton and Harvard share the top spot, just like last year). And neither relies on information provided by the colleges themselves; more and more schools have been caught fudging the numbers they give to U.S. News.

More broadly, the new players offer data intriguing even to those who don’t buy the idea that colleges can be ranked like their football teams.

The first, now in its second year, comes from a company called, whose main business is serving as electronic middleman between students at 7,500 high schools and the colleges where they send transcripts. But through a college search function, the site has collected valuable and otherwise hard-to-come-by data: It knows the names of the colleges where 200,000 students nationwide applied, got accepted, and chose to attend.

Ranking automobile companies is fairly straightforward; each basically makes as many cars as it can sell and the results are clear enough. But college is often a two-way selection. The most prestigious ones have limited slots and regularly turn down business. So Parchment looks at what the customers with options choose.

The “Student Choice” rankings _ based on a model developed by economist Caroline Hoxby about a decade ago _ make no effort to measure a college’s “inputs” such as average freshman SAT scores. They do nothing to measure “outputs” like learning outcomes or alumni salaries.

Instead, they reveal only the collected wisdom of students choosing among multiple colleges. If, for example, 75 out of 100 students accepted to both Yale and the University of Virginia choose Yale, then Yale moves up relative to Virginia in the model. The choices of every student are played out in a kind of gigantic computerized tournament, and eventually the results settle into ranking similar to how chess players are ranked.

The list that emerges contains many of the familiar names, with Harvard, Stanford and Yale on top (few students accepted to those schools choose others instead). But distinctive colleges with a particular mission fare well, like the Air Force Academy, which comes in No. 10.

The system has weaknesses. The pool of students is large but somewhat weighted regionally. But it does some things others can’t. To the extent students reward value, the rankings do, too (tuition-free Cooper Union in New York City scores an impressive 43rd). And it allows schools of all sizes to be ranked on the same list, unlike U.S. News, which separates national universities and liberal arts colleges. That’s helpful because in practice, students are often choosing between a big and a small school, said general manager Brent Pirruccello, who helped create the rankings. Amherst College, No. 2 on the U.S. News liberal arts list, is the top liberal arts school in the Student Choice rankings, at No. 9 overall.

The second new system, which debuted Monday, focuses on the other end of college _ alumni satisfaction. Until now, individual colleges have surveyed their alumni, but surveying enough people across colleges to compare the results has been too complex.

A new company called The Alumni Factor is trying, claiming it’s surveyed and interviewed 42,000 alumni of 450 colleges over the last four years, and is now publishing the results on 177 well-known schools where it says it has enough data to be statistically reliable (at least around 200 alumni per school). The surveys try to pin down objective results on 15 attributes. Among them: intellectual and social development, friendships made and even overall happiness of graduates. Other attributes are purely financial, such as percentage of graduates earning over $150,000.

A generic ranking blending the survey results in those 15 category equally also produces some interesting results: Well-respected but not widely famous Washington & Lee University in Virginia finishes No. 1, followed by Yale, Princeton, Rice and _another surprise _ the College of The Holy Cross in Massachusetts. Some well-known names do less well. Harvard, for instance, scores spectacularly in the financial success categories, but relatively poorly on indicators like overall happiness and whether alumni would recommend the college to others. Overall it’s 37th, between Carleton College in Minnesota and Vanderbilt.

Alumni Factor (a subscription site that will charge either $3.95 or $5.95 per month depending on access level) then adds a feature even rankings critics will probably like: It will let users generate their own rankings, using sliding scales on its website to give various factors more or less weight. Students who care mostly about money can tilt the formula’s emphasis toward the financial outcomes and Harvard moves up from 37. But tweak the dials to indicate you care more about happiness and less about money, and it falls to No. 82 (some of the sorting options aren’t yet available on the website).

Still, Alumni Factor has at least one big problem. Despite a promise of transparency, it says little about how it finds the people it surveys and how it questions them, other than to offer assurances the methods are vetted by a Georgia Tech statistician.

Executive editor and CEO Monica McGurk did offer a few details in a telephone interview, such as the minimum of about 200 alumni surveyed per school. Also, she said the questions cover so many issues that respondents don’t realize they’re being surveyed about their college experience, so they won’t cheerlead for their alma mater.

But McGurk said she couldn’t provide more details without compromising the method’s objectivity. Without knowing how the company finds the alumni, there’s no way for outsiders to judge if they’re really tapping a representative group, or one that’s, say, more financially inclined and successful than the average graduate (the company hopes to sell some of the information back to colleges themselves).

All of which is to say, the rankings game may not be getting much more credible, but it is getting more interesting. Students who (wisely) take the horse-race aspect with a grain of salt nonetheless have some interesting new data to explore in their college search.




Follow Justin Pope at

(Copyright 2012 The Associated Press. All rights reserved. This material may not be published, broadcast, rewritten or redistributed.)

United States News

South Carolina's Victaria Saxton, at left, and Maryland's Diamond Miller, at left, jump the ball to...
Associated Press

Congressional hearing targets ‘NIL chaos’ in college sports

A congressional hearing Wednesday targeting “NIL chaos” in college sports drifted into the ramifications of athletes being deemed employees of their schools and mostly highlighted those who support congressional intervention to protect the collegiate model. A subcommittee of the House Committee on Energy and Commerce held the first hearing related to college sports on Capitol […]
13 hours ago
This photo provided by the Arapahoe County, Colo., Sheriff's Office shows Reginald Maclaren, an 81-...
Associated Press

Colorado man cites fear of homelessness in ax killings case

DENVER (AP) — An 81-year-old Colorado man accused of killing his wife and daughter with an ax told police he lost his job and was afraid they would end up homeless. Reginald Maclaren told police he didn’t regret killing them because he “knows they are in a better place,” according to court documents. Maclaren was […]
13 hours ago
Emergency responders and heavy equipment are seen at the site of a deadly explosion at a chocolate ...
Associated Press

Investigators examine pipeline in chocolate factory blast

WEST READING, Pa. (AP) — Federal safety investigators are examining a natural gas pipeline for fractures and other damage as they gather evidence on the cause of last week’s deadly explosion at a Pennsylvania chocolate factory, a spokesperson said Wednesday. The National Transportation Safety Board opened a probe into Friday’s blast at R.M. Palmer Co. […]
13 hours ago
Associated Press

Mel King, who helped ease Boston’s racial strife, dies at 94

BOSTON (AP) — Longtime Boston civil rights activist Mel King, whose 1983 campaign for mayor helped the city begin to repair some of the racial divisions sparked during the school busing crisis, has died. He was 94. King served in the state Legislature for nearly a decade before becoming the first Black man to reach […]
13 hours ago
FILE - Judge Clifton Newman stands during a break in the Alex Murdaugh's double murder trial at the...
Associated Press

Murdaugh judge Newman not surprised by jury’s quick verdict

CLEVELAND (AP) — The judge who presided over Alex Murdaugh’s murder trial in South Carolina told his law school he wasn’t surprised the jury came back with a guilty verdict in three hours. Judge Clifton Newman returned to Cleveland State University where he earned his law degree in 1976 to discuss his career and the […]
13 hours ago
Associated Press

Vermont deputy charged with attempted murder in NY gunfight

ALBANY, N.Y. (AP) — A Vermont deputy sheriff who was involved in a gunfight in upstate New York that left three injured last year was indicted on charges including attempted murder and a felony for possessing a gun in a sensitive location. Vito Caselnova pleaded not guilty at his arraignment in Saratoga County Court on […]
13 hours ago

Sponsored Articles

(Photo: OCD & Anxiety Treatment Center)...

Here’s what you need to know about OCD and where to find help

It's fair to say that most people know what obsessive-compulsive spectrum disorders generally are, but there's a lot more information than meets the eye about a mental health diagnosis that affects about one in every 100 adults in the United States.
(Desert Institute for Spine Care in Arizona Photo)...
Desert Institute for Spine Care in Arizona

5 common causes for chronic neck pain

Neck pain can debilitate one’s daily routine, yet 80% of people experience it in their lives and 20%-50% deal with it annually.
(Pexels Photo)...

Sports gambling can be fun for adults, but it’s a dangerous game for children

While adults may find that sports gambling is a way to enhance the experience with more than just fandom on the line, it can be a dangerous proposition if children get involved in the activity.
New players, new approaches to ranking colleges