The Government can issue as much (sovereign) money as it likes without causing inflation provided it is in exchange for new wealth so the wealth per dollar ratio is maintained. The limit is the capacity of the economy and ecosystem to produce wealth.
Exceeding this will cause inflation. Borrowing is entirely optional.
The causes of hyperinflation are a little more involved than the popular narrative you relate. See Michael Hudson's definition here: H is for...
A more detailed examination of Weimar and Zimbabwe here:
A fuller explanation of the whole borrowing/spending thing here: Warren Mosler