College selection: getting reliable information about colleges

Key points

• Information about a college is often unreliable.
• It is easier to get reliable information about hard-to-fudge metrics than about subjective experiences.
• The best source of reliable information about subjective experiences and for getting the inside scoop on easy-to-fudge metrics, as of now, appears to be College Confidential.

Reasons why information about colleges is unreliable

• College incentives: College admissions and outreach officers have incentives to portray themselves favorably to prospective students to maximize the number of student applications.
• Lack of transparency makes it easy for colleges to fudge numbers: Much of the data that colleges release cannot be independently verified by third parties, and colleges can therefore tweak the numbers in suitable ways. Outside agencies that rank and rate colleges often rely on this data and this corrupts their ratings. Some of these outside agencies rely on colleges to provide them information, and therefore need to maintain good relationships with the colleges.
• Bias among other information sources: Current and former students and others who give feedback about the college experience may be biased. Biases include selection bias (not everybody gives feedback, and those who do are atypical), endowment effect bias (current and former students are loyal to their alma maters because they want to feel they made the right decision), and sour grapes (people who were rejected from a college may want to believe the college was not good anyways).
• Arbitrary weights: Outside agencies that rank and rate colleges often use arbitrary "weights" when deciding how to combine different aspects of a college experience. Even if the individual measurements were correct, the weighted rating is not meaningful.

KEEP IN MIND: In general, information is usually not designed to be as accurate as possible. Think critically about the reliability of a given source.

Typical sources of information about colleges

College visits

Further information: College visit

These include:

1. Informal visit to a friend or sibling studying in the college where you might tag along with the friend to sit in classes and go to the other places the friend is going.
2. Formal visits that colleges organize for admitted students, typically by having current undergraduates host them and by having them sit in classes based on a formal selection process.
3. Brief visits where you are shown around the campus by an official tour guide, but don't sit in classes.

(1) is the most informative, (2) is less informative (because the college plays a role in scripting the experience more carefully in order to portray itself positively), and (3) provides very little information -- tour guides generally focus on describing the physical location and its historical significance rather than provide accurate information about the current student experience.

Independent forums for current and prospective students to interact with one another

The best such source as of now appears to be College Confidential.