Skip to content

Added bench mark groups and some more python 3 benchmarks

Created originally on Bitbucket by rjnienaber (Richard Nienaber)

Python 3 Benchmarks

The following benchmarks were copied from CPython or ported:

  • CPython: chaos, django, fannkuch, float, go, hexiom2, json, meteor-contest, nobody, pidigits, raytrace, richards, spectral-norm, telco, ai (now nqueens)
  • Ported: htm5lib, crypto_pyaes, pyflate, sympy, scimark, mako, chameleon

Not ported (Python 3 not supported or not released)

  • spambayes
  • twisted
  • eparse (twisted code)
  • rietveld (requires app_engine as well)
  • sphinx (http://bugs.python.org/issue10224)
  • trans2 (rpython specific test which will require lots of work)
  • genshi
  • spitfire

Benchmark groups

The benchmark group logic from unladen swallow has been reused to separate python3 benchmarks from the original benchmarks.

The following are examples for running benchmark code:

  • pypy runner.py --fast -c pypy --baseline=pypy19 (all default/original)
  • pypy runner.py --fast -c pypy --baseline=pypy19 -b default (all default/original)
  • pypy runner.py --fast -c pypy --baseline=pypy19 -b math (math group)
  • pypy runner.py --fast -c pypy --baseline=pypy19 -b 2n3 (benchmarks valid in python 2 and python 3)
  • pypy runner.py --fast -c pypy3 --baseline=pypy3 --baseline=pypy19 -b python3 (python3 only benchmarks)
  • pypy runner.py --fast -c pypy --baseline=pypy19 -b spitfire (individual test)
  • pypy runner.py --fast -c pypy --baseline=pypy19 -b regex,ai (group and individual test)
  • pypy runner.py --fast -c pypy --baseline=pypy19 -b scimark,-scimark_fft (scimark group except scimark_fft)

Note: regex tests have been enabled in the default group

Edited by Matti Picus

Merge request reports