First of all, you're not talking about HFT really, but about arbitrage: making use of inefficiencies in the dissemination of information in a market. Arbitrage is as old as trading itself and now that trading happens with fast computers, the same goes for arbitrage. If some knowledge becomes available in some place, it will quickly spread over the entire market. In this process, the arbitrageur plays an important role: the parties that profit from trading are the parties that actually spread the information: if you buy/sell an instrument because it's under/over priced, you actually help to in/decrease its price. The fact that arbitrage rakes up big profits only means that the trading system is efficient. You should thus work to make it more efficient instead of killing the arbitrageur.
The solutions you propose are exactly symptom killers:
1. Adding a delay means you're withholding information from the markets. With less information, market participants make decisions that are less informed and thus poorer.
2. Adding a tax has actually the same result: if you raise a tax, you're actually putting a threshold on the level of information that can be disseminated with a profit. This will in effect mean that new information will only be sent once it reaches a certain level of impact and the tax thus functions as a delay for this information.
Why don't you propose a more open economy, where information is easier to get by and cheaper. This will automatically result in better prices (one of the important functions of financial markets: knowing what something is comparatively worth) and it will reduce the profits of the arbitrageurs.