Market manipulation by millisecond trading

cfa22 writes: Nice NYT piece today on ultrafast trading on the NYSE and other markets. The "algos" that make autonomous trading decisions have to be fast, but I wonder: Is network speed ever a bottleneck? Can anyone with inside experience with millisecond trading provide some details for the curious among us regarding hardware architectures and networking used for such trading systems?