Comment: Metrics (Score 5, Insightful) 107
This is what happens when you have metrics. You create a metric like "impact factor", and before long people will figure out ways to maximize "impact factor" that have nothing to do what the metric was originally supposed to measure. Hyperfocusing on metrics like that ends up undermining the things you really value in favor of increasing your scores.
This happens all over the place. Games in every game find ways to increase their score in ways that the game designers wouldn't really consider valid. Universities do things simply to make their "US News" ratings go up, not because they will make themselves better. Students figure out ways to raise their grades that have nothing to do with mastering the material of the course. Heck, the entire US (and world?) economy suffers from this; the most reliably rich people are the ones who manipulate money transactions, and do absolutely nothing with the underlying reality that money is supposed to be an abstract representation of.
People strive to improve the things that they are rewarded for and that they are evaluated on. When you focus too much on the wrong thing, people will do the wrong things in response.