Fix pull/push benchmarks
In ASV setup is run for each repeat but benchmark function is run `number` of time within the same repetition (calling it a "sample"). So for push / pull benchmarks, number should be set to 1 (call setup before each call of the benchmark method), also setup isn't called during "warmup" time, so disable it. Set repeat to 20 (instead of the default 10) this should be enough to have stable results while keeping benchmark time reasonable. Also move benchmark params (number, timer) to class variable.
Loading
Please register or sign in to comment