You're mostly right, but only because the technology is young. LEDs have been around for nearly 50 years, but it's only been recently that we've been ramping up the power to general lighting requirements.
That said, here are the potential advantages over CFL:
1) Higher efficiency. Yes, CFLs and LEDs are roughly equivalent right now, but the potential for LEDs is much greater. As added incentive, heat is a limiting factor for LEDs, so there's more than one motivation to improve efficiency.
2) Longer life. This is related to the efficiency, as too much heat decreases life. Expect life to increase dramatically as time goes on.
3) Dimming control. Still in its infancy, but some LED bulbs can be dimmed in the same way as incandescents. I can't use CFLs in touch lamps for the same reason.
4) Color control. Currently sucks, but the technology allows for better control than CFLs, especially when it comes to dimming.
5) Manufacturing capability. This is a big unknown, but many are predicting that the price will drop dramatically, just like we've seen with other semiconductor products. Personally, I think this might take a while since we don't really know what it will take to make bright, color-corrected LED bulbs.
6) Form factor. LEDs can conform better to the incandescent form factor. This advantage is also slightly debatable because of heat controls: liquid cooling and heat sinks are being put on LED bulbs right now ... if that's continues to be the case then the shape of the bulb might be quite odd for some time. The nature of using a collection of individual lights also places strange limitations on the form factor, which is why flood lighting is one of the early form factors that works well.
7) Public image. CFLs have (mostly wrongfully) gotten a bad reputation for bad color quality, flickering, warm-up, and mercury. It remains to be seen how the public views LEDs, but many of these (except for color, for now) don't apply.
8) Rugged. I've saved this one for last. Incandescent and CFL light bulbs are much more fragile than LED bulbs, which makes shipping them from overseas (where manufacturing costs are lower) much more effective. It also increases the applications that can use LEDs.
Notice that most of these are still only theoretical. Stick with CFLs for now, or expect to pay a lot more for something with few advantages.
Maybe by the time your CFLs burn out the LED technology will have caught up.