Next | Making Programs Faster | 33 |
Heisenberg said that it's impossible to measure something without altering the measurement
That is certainly true of benchmarking
Every benchmark introduces some bias into the thing it purports to measure
You can try to minimize this in at least two ways
One way is to make the benchmark apparatus as simple and as lightweight as possible
Then the effects will be small
Or, if not, it will be clear what the biases might be
Next | Copyright © 2003 M. J. Dominus |