"Sure, that never causes a problem. Why, every time it's been tried in history it has ended well. Wait, sorry, it always ends the other way, but hey, maybe this time will be different!"
All decisions can be made well or poorly in all things, not simply governance or social organization. The error you make is believing that there is some kind of perfect system, when the reality is humans are imperfect, irrational creatures. Money is like religion and mass propaganda. It is a high level abstraction that organizes society. In all cases, such organization can be beneficial or detrimental, what matters is not the system, but the people making the decisions.
The reality is there are relatively few examples of the hyperinflation bogeyman in civilized countries. In fact, the evidence is overwhelming that unrestrained creation of money by banks is far more dangerous than a sovereign running fiscal deficits, as every single major depression was predicated upon reckless creation of money my banks that severely misallocated capital, and resulted in massive defaults and impoverishment.
Regardless, the fact remains that this is our financial system. You have either banks creating money with loans, or you have the sovereign authority running fiscal deficits. The former method requires more money to be created to pay interest, the latter does not.
You are free to propose a new economic order, but it is cruel and irresponsible to suggest a currency issuing sovereign can or should run budget surpluses or have a "balanced budget". This, again, shows a total lack of understanding of how banking works, and has ever worked.