Accurate Methods For Benchmarking Hardware? 5
General Breetai asks: "This is yet another benchmark showing DDR is faster than RDRAM. I'm not posting this as another DDR vs. RDRAM debate, but rather to question the benchmark methods. When looking through the results, it's clear that the OS and test SW has a huge impact on the results. How can we trust SW benchmarks to test a particular subsystem when it's clear that the SW relies on the entire system? In the case of new memory systems, I propose that the only reliable method is to compare published timing data in a theoretical setting. SW is just too dependent on too many things to be reliable, especially if it is running on top of a complex OS." Are there ways to benchmark hardware components using some measure that isn't explicitly tied to the OS on which said benchmarks run?