I can relate to the grand-parent poster... the issue isn't about how much it's swapping when it can choose whether to swap or not, it's about what happens when you do run out of ram.
This happened to me when I tried to convert an svg of a microchip design to a png using inkscape (generated from a cadence export with millions of rectangles). When linux really runs out of memory and begins running things off of a gig of swap on a rotational disk, you have serious problems. It took 30 minutes for me to open a terminal and kill it.
Amusingly enough, the execution slows down so much that it can take hours for the runaway process to finally exhaust all of swap as well, and finally trigger the OOM, and until then the entire computer is useless. This is what motivates people to get rid of their swap partition, so the OOM will kill a runaway process when it happens, instead of after your computer has been frozen for a couple of hours.
I've heard that havings some swap makes the vm happier under normal circumstances, so I use a 256 MB swap partition.