Comment We need a good central repository (Score 1) 505
If a proposal like this is to succeed -- and I hope so hard that it does -- we need a central repository to store code and meaningfully link it to the papers that use it.
This repository should have the same amount of peer review and, therefore, authority that scientific journals have now. Maybe that can happen by existing journals adding the ability to link code to a paper (and enforce that any code used to generate results is included), maybe a new organization has to rise up to the challenge (I would love to see a code.arxiv.org).
Already I can hear the outcry of scientists claiming that their code is "sloppy" and "not ready to be released," but those concerns are simply irrelevant: all that matters is that the code produces the output cited in the paper given the input cited in the paper. That's it. If another researcher finds your result interesting, then let it be up to them to parse out your code -- it's probably still way better than trying to reproduce your result based on the prose that describes your algorithm.