>Most people would just suggest to store it in "the cloud", but I'm naturally averse to doing so because that means someone else is responsible for my data and I could loose (sic) it to hackers, the entity going out of business, etc.
Simply strongly encrypt your data before backing it up to the cloud, you will be at no risk of hackers or anyone else gaining access that way. If you can't find a cloud storage service that you trust/trust won't go out of business, you can make your own cloud using Amazon's AWS system. The levels of security at the facilities and redundancy mean your data will survive anything short of nuclear Armageddon. Personally I'd just go with the local encryption option.