You fail to make a distinction between the government forcing person A to give money to person B through taxation (force) versus letting person A give money to person B on their own accord which lets person A decide how much money and when to give the money, neither of which is possible when the money is forcefully taken through taxes.
If you are arguing that a government can run without any taxation, then you should buy enough drugs for everyone and share them around. But you don't seem to be saying that, later on, you say "I ... have no trouble paying for taxes that are used to pay for infrastructure, etc." making some arbitrary distinction between "infrastructure" and whatever it is you feel the government shouldn't be spending "your" money on.
So here's a clue, as soon as the government taxes anything for any reason it's redistributing wealth. It really doesn't matter if it's doing this by building roads, allowing companies/people to deduct bad investments from profits on good investments, or paying for someone's education/medical-care. All of those could be good usage of government money, and probably all three could be bad (although the later one much less so, IMNSHO).