Which is why, when you do use tantalums, you use ones that are specced at twice the voltage you expect over them.
We've used tantalums in some telecom equipment we make, and except for about 5 spectacular failures (explosions, fireballs) on some early prototypes (because of wrong part numbers and such), we've never seen a failure in almost 7 years.
We could not have used electrolytic caps as they would not have survived as long.
BTW: reverse voltage an electrolyte, and witness the explosion (and foul smell) also.... Used to do that to scare people in electronics class.....
Of course, if we redesigned now, I'd probably change out some of the tantalums with ceramic caps.