I've used many web hosts, and they all do _something_ that annoys you eventually. As a result, I have finally found what has been the best host I've ever used: esecuredata.com. You get a dedicated machine for as little as $59/mo. (I use a G5Jr for $79/mo). The rest is up to you. They'll install whatever free os you want (using default install), provide you the root password, and the rest you do yourself. The G5 Jr server I use has 2 core Intel CPU, 2 GB RAM, 400GB hard disk, and bandwidth isn't limited (I use 1 TB - 2 TB/mo). I run more than 12 domains from it, as well as a small MySQL instance and a decent size PostgreSQL instance without any issues.
I've been with the for about 4 years now, and there has been 2 unplanned outages - both beyond their control, but they implemented work arounds so neither can happen again - and 1 planned downtime when they moved into a newly built data center (the move happened without any issues, something I can't say for 2 of the other hosts I've used).
I literally can't say enough good about them. Well, I do have 1 complaint: Why didn't they exist 10 or 12 years ago...