Comment Re:Expert AND non-expert testing. (Score 2) 292
Actually, I would suggest no tuning done for the non-expert class testing. Just straight out of the box with all defaults. Install any patches the distro and Windows may have and leave it at that. That is probably a more accurate test on the non-expert.
If you start to include the learning curve of the individuals, you add too many variables to the testing and muddy the results.
Also, you might want to limit the tuning time for the experts. A single 8 hour period from start of install to completion of task. You can spend all the prep time you want planning how to tune it. Just limit the amount of time on the box. Most places I've been at say they want the server running within a certain period of time. I don't have as long as I would like to tune the box once the hardware has arrived.
