Amen, brother. I have 7 screens of apps on my iPhone, many of which I seldom use. There're also, maybe, 5-7 apps I have removed from iPhone, most of which I paid for (within $4 each, I think). There are a few apps I still keep on the phone simply because I think I **might** need them (e.g. PCalc, HearPlanet, iTalk, Sketches). There're also those that I use, but rarely -- since they serve a certain purpose like: show-off (PocketGuitar, MiniPiano), getting stuff on and off the phone (Air Sharing), sharing photos (Darkslide), killing time (lots of games), etc.
There's nothing wrong with such pattern. Think in terms of a number of shareware or demo apps one downloads to give it a try. Except iPhone makes it far easier and cheaper.