There are other bottlenecks to consider, is your CPU fast enough, do you have enough RAM, could the hard drive your software and OS is on use an upgrade, etc.
If your swapfile is stored on a SSD, how much does it still matter that you ran out of RAM? And if you're not asking your CPU to do as many I/O waits, maybe you can squeeze more useful cycles and therefore performance out of it. A SSD should be a sure way to improve system performance... a reasonable way to spend $300.
It seems to me that black holes could explain this away. If there are enough black holes out there, they could be intercepting and sucking in enough stray light / radiation to prevent the sky from lighting up. Light could wrap around the universe a few times until it hit a black hole, then that would be the last you saw of it.
The optimum committee has no members. -- Norman Augustine