1. You don't lose your money.
Depends entirely on the jurisdiction of the bank. Yes in the US we are FDIC ensured, which protects most people from bank collapse and funds that are stolen.
This isn't true for commercial banks or trading funds though. Reference, MF Global. What a mess. Its also entirely based on the fact that the government can simply reallocate other people's money in order to cover losses, i.e taxes, and money printing.
2. Hacker has a hell of a time using the money.
Seems like credit card fraud, ach fraud, and wire fraud are working great all over the world, I think if it was so difficult to abscond with the money we wouldn't be seeing these crimes occur every single day. Most of the systems to prevent this are after the fact and significantly increase operating costs in the form of insurance and other fees.
3. The hacker may get arrested. Whereas when people do bad things on the Internet they are never arrested? I think we both know this isn't true, we arrest people who run spam servers, bot nets, and child porn rings all of the time. Many with little off line presence.
You are right in one thing though, there is a huge difference between state currencies and Bitcoin, and that is unfettered control, and institutionalized devaluation in the form of printing money and buying it back. A properly secured bitcoin balance is more secure than any other system of money storage currently in existence.