Agreed. I have a relatively inexpensive Instek scope that I use at home (GDS-820C), and it's a great tool. I use Tektronic scopes at work which are certainly nicer because of the much higher sampling rates, but the cheap scope handles 95% of what I need.
One word of caution; Instek (and I'm sure this is true of other cheap scope manufacturers) make some wild claims about handling very high frequency signals with these inexpensive scopes. For example, my scope claims to have 150MHz bandwidth and "25Gsa/s Sampling Rate for Repetitive Waveforms" on the product page. This is just marketing hype, don't believe it!
When comparing scopes, look at the actual sampling rate of the signals. My scope samples at 100 MHz, the Tektronic I use at work samples 10 times that fast. It makes a big difference when working with fast waveforms.
I'm not putting down the cheap scopes, you can pick up the model that I'm using new for around $1000. Just be aware that these inexpensive scopes are not great for looking at very fast signals. If you need speed, you will need to spend significantly more.