URU in the Myst sequel of games has been open sourced by Cyan Worlds. See openuru.org.
Aside from the fact that it is a linear problem to solve (simple polynomial if you add lens correction), you also need a good feature extractor to create a 3D model from a set of 2D pictures. There are some excellent packages for doing 3D reconstruction, but they also come with a high price tag. There are some free implementations as well, but they are not very good.
Is seems to be an interesting solver, but you have to add a lot more for building an application for 3D reconstruction. I wonder if Google is going to release the software behind PhotoTour as well. And preferable for Windows.
"Don't drop acid, take it pass-fail!" -- Bryan Michael Wendt