Pretty much all providers with KVM technically support this, whether they intend it or not.
Can you expand on this?
The provider still can trivially make a snapshot of your running VM, including live keys in memory
Cleartext SSH keys (or, say, EncFS passwords) in memory would be news to me. Can you confirm?