Skip to content
Snippets Groups Projects
Commit d4a682de authored by Pierre-Yves David's avatar Pierre-Yves David :octopus:
Browse files

py3: add Python 3.7 test environment

We have to update the existing smoke test. We also add a new one dedicated
python. It runs a revision that supports python 3.
parent efba44f9
No related branches found
No related tags found
No related merge requests found
......@@ -35,7 +35,7 @@
// The Pythons you'd like to test against. If not provided, defaults
// to the current version of Python used to run `asv`.
// "pythons": ["2.7", "3.3"],
"pythons": ["2.7", "3.7"],
// The matrix of dependencies to test. Each key is the name of a
// package (in PyPI) and the values are version numbers. An empty
......
= ============================
Make sure basic ASV run works
=============================
#require slow
initialize reference
$ export HGRCPATH=
$ export PATH=$TESTDIR/../repo-scripts/:${PATH}
$ mkdir references
$ hg init test-repo
$ hg -R test-repo debugbuilddag --new-file .+2000
$ cd references
Define partial set
$ cat << EOF >> p-config.yaml
> partial-sets:
> same:
> roles:
> pull:
> noop:
> same:
> source: "reference"
> target: "same"
> EOF
$ make-reference ../test-repo smoke-test-A p-config.yaml
hg cloning repository from: ../test-repo
building a reference tarball
result available at: smoke-test-A-f62f46ce-reference.tar
$ make-partial-repos *.benchrepo
Cloning smoke-test-A (smoke-test-A-f62f46ce-reference stripped of None) into ./smoke-test-A-f62f46ce-partial-same (for exchange benchmarks)
$ cd ..
setup a copy of the asv repo
$ rsync --exclude 'repos' --exclude 'mercurial' --exclude 'results' -ra $TESTDIR/.. test-asv
$ cd test-asv
$ cat << EOF > local.repos
> smoke-test-A-f62f46ce
> # (second copy of the same repo, for testing)
> EOF
setup appropriate virtual env
$ mkdir -p /tmp/.scm-perf-test/pip-cache
$ export XDG_CACHE_HOME=/tmp/.scm-perf-test/pip-cache
$ virtualenv $TESTTMP/venv 1>/dev/null 2>&1
$ export PATH=$TESTTMP/venv/bin:${PATH}
$ PYTHONWARNINGS="ignore:DEPRECATION" pip --disable-pip-version-check install --requirement requirements.txt --quiet
Switched to a new branch 'octobuspatches' (?)
Branch '?octobuspatches'? set up to track remote branch '?octobuspatches'? from '?origin'?\. (re) (?)
run
$ mkdir -p /tmp/.scm-perf-test/repo-pool
$ cat << EOF >> test.hgrc
> [ui]
> quiet = yes
>
> [extensions]
> share=
>
> [share]
> pool = /tmp/.scm-perf-test/repo-pool
> poolnaming = remote
> EOF
$ export HGRCPATH="${TESTTMP}"/test-asv/test.hgrc
$ $PYTHON ./script/setup-repos $TESTTMP/test-asv/local.repos repos "file://$TESTTMP/references/"
1 repositories to setup in $TESTTMP/test-asv/repos
Setting up reference repository: smoke-test-A-f62f46ce
main reference
downloading repo
updating repo
partial reference: same
downloading repo
$ ASV_SKIP_SYSTEM_CHECK=1 $PYTHON ./launch.py -q 8fda98a68427 -b "track_commit" --no-pull
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
* (glob)
check that system is ready for benchmark
(use ASV_SKIP_SYSTEM_CHECK=1 to skip it)
requesting all changes (?)
adding changesets (?)
adding manifests (?)
adding file changes (?)
added * (glob) (?)
updating to bookmark @* (glob) (?)
new changesets * (glob) (?)
* files updated, 0 files merged, 0 files removed, 0 files unresolved (glob) (?)
Ensuring we have a mercurial clone handy
no Mercurial clone found, making a fresh clone
preparing cache warming
Setting up all target repositories (from ./local.repos)
1 repositories to setup in $TESTTMP/test-asv/repos
Setting up reference repository: smoke-test-A-f62f46ce
main reference
already up to date
partial reference: same
already up to date
Creating the skip file
Warming caches for all repos
(use SCMPERF_WARMCACHE=skip to skip it)
checking caches for: repos/smoke-test-A-f62f46ce-reference
checking caches for: repos/partial-references/smoke-test-A-f62f46ce-partial-same
warming cache took \d+ seconds (re)
- Creating environments
- Discovering benchmarks
-- Uninstalling from virtualenv-py2.7-pyyaml-HGMODULEPOLICYrust+c-HGWITHRUSTEXTcpython (?)
-- Building 8fda98a6 for virtualenv-py2.7-pyyaml-HGMODULEPOLICYrust+c-HGWITHRUSTEXTcpython (?)
-- Installing 8fda98a6 into virtualenv-py2.7-pyyaml-HGMODULEPOLICYrust+c-HGWITHRUSTEXTcpython (?)
- Running 4 total benchmarks (1 commits * 4 environments * 1 benchmarks)
[ 0.00%] - For mercurial commit 8fda98a6:
[ 0.00%] -- Benchmarking virtualenv-py2.7-pyyaml-HGMODULEPOLICYrust+c-HGWITHRUSTEXTcpython
[ 25.00%] --- Setting up utils:*ok (glob)
[ 25.00%] --- simple_command.write.track_commit ok
\[ 25.00%\] --- ============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =+ (re)
repo repo-format-compression repo-format-compression-level repo-format-copies-sdc repo-format-dotencode repo-format-fncache repo-format-generaldelta repo-format-plain-cl-delta repo-format-sidedata repo-format-sparserevlog mode + (re)
-------------- ------------------------- ------------------------------- ------------------------ ----------------------- --------------------- -------------------------- ---------------------------- ---------------------- -------------------------- -------- -+ (re)
smoke-test-A zlib default False True True True True False True create +\d+\.\d+ * (re)
smoke-test-A zlib default False True True True True False True update +\d+\.\d+ * (re)
============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =+ (re)
[ 25.00%] -- Benchmarking virtualenv-py2.7-pyyaml-HGMODULEPOLICYc-HGWITHRUSTEXTcpython
[ 50.00%] --- Setting up utils:* ok (glob)
[ 50.00%] --- simple_command.write.track_commit ok
\[ 50.00%\] --- ============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =+ (re)
repo repo-format-compression repo-format-compression-level repo-format-copies-sdc repo-format-dotencode repo-format-fncache repo-format-generaldelta repo-format-plain-cl-delta repo-format-sidedata repo-format-sparserevlog mode + (re)
-------------- ------------------------- ------------------------------- ------------------------ ----------------------- --------------------- -------------------------- ---------------------------- ---------------------- -------------------------- -------- -+ (re)
smoke-test-A zlib default False True True True True False True create +\d+\.\d+ * (re)
smoke-test-A zlib default False True True True True False True update +\d+\.\d+ * (re)
============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =+ (re)
[ 50.00%] -- Building for virtualenv-py3.7-pyyaml-HGMODULEPOLICYrust+c-HGWITHRUSTEXTcpython (?)
[ 50.00%] -- Benchmarking virtualenv-py3.7-pyyaml-HGMODULEPOLICYrust+c-HGWITHRUSTEXTcpython
[ 75.00%] --- Setting up utils:* ok (glob)
[ 75.00%] --- simple_command.write.track_commit ok
\[ 75.00%\] --- ============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =+ (re)
repo repo-format-compression repo-format-compression-level repo-format-copies-sdc repo-format-dotencode repo-format-fncache repo-format-generaldelta repo-format-plain-cl-delta repo-format-sidedata repo-format-sparserevlog mode + (re)
-------------- ------------------------- ------------------------------- ------------------------ ----------------------- --------------------- -------------------------- ---------------------------- ---------------------- -------------------------- -------- -+ (re)
smoke-test-A zlib default False True True True True False True create +\d+\.\d+ * (re)
smoke-test-A zlib default False True True True True False True update +\d+\.\d+ * (re)
============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =+ (re)
[ 75.00%] -- Benchmarking virtualenv-py3.7-pyyaml-HGMODULEPOLICYc-HGWITHRUSTEXTcpython
[100.00%] --- Setting up utils:* ok (glob)
[100.00%] --- simple_command.write.track_commit ok
\[100.00%\] --- ============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =+ (re)
repo repo-format-compression repo-format-compression-level repo-format-copies-sdc repo-format-dotencode repo-format-fncache repo-format-generaldelta repo-format-plain-cl-delta repo-format-sidedata repo-format-sparserevlog mode + (re)
-------------- ------------------------- ------------------------------- ------------------------ ----------------------- --------------------- -------------------------- ---------------------------- ---------------------- -------------------------- -------- -+ (re)
smoke-test-A zlib default False True True True True False True create +\d+\.\d+ * (re)
smoke-test-A zlib default False True True True True False True update +\d+\.\d+ * (re)
============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =+ (re)
+ ['./lib/before-check.sh']
+ ['asv', 'run', '--launch-method', 'spawn', '--skip-existing-successful', '8fda98a68427', '-b', 'track_commit', '--no-pull']
check the repos directory afterwards
$ ls repos/
partial-references
skip.json
smoke-test-A-f62f46ce-reference
smoke-test-A-f62f46ce.benchrepo
$ ls repos/partial-references/
smoke-test-A-f62f46ce-partial-same
......@@ -193,6 +193,6 @@
-- Uninstalling from virtualenv-py2.7-pyyaml-HGMODULEPOLICYrust+c (?)
-- Building fe3ca1e6 for virtualenv-py2.7-pyyaml-HGMODULEPOLICYrust+c (?)
-- Installing fe3ca1e6 into virtualenv-py2.7-pyyaml-HGMODULEPOLICYrust+c (?)
- Running 2 total benchmarks (1 commits * 2 environments * 1 benchmarks)
- Running 4 total benchmarks (1 commits * 4 environments * 1 benchmarks)
[ 0.00%] - For mercurial commit fe3ca1e6:
[ 0.00%] -- Benchmarking virtualenv-py2.7-pyyaml-HGMODULEPOLICYrust+c
......@@ -197,8 +197,8 @@
[ 0.00%] - For mercurial commit fe3ca1e6:
[ 0.00%] -- Benchmarking virtualenv-py2.7-pyyaml-HGMODULEPOLICYrust+c
[ 50.00%] --- Setting up utils:* ok (glob)
[ 50.00%] --- simple_command.write.track_commit ok
[ 50.00%] --- ============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =====
[ 25.00%] --- Setting up utils:* ok (glob)
[ 25.00%] --- simple_command.write.track_commit ok
[ 25.00%] --- ============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =====
repo repo-format-compression repo-format-compression-level repo-format-copies-sdc repo-format-dotencode repo-format-fncache repo-format-generaldelta repo-format-plain-cl-delta repo-format-sidedata repo-format-sparserevlog mode
-------------- ------------------------- ------------------------------- ------------------------ ----------------------- --------------------- -------------------------- ---------------------------- ---------------------- -------------------------- -------- -----
smoke-test-A zlib default False True True True True False True create n/a
......@@ -207,13 +207,13 @@
smoke-test-B zlib default False True True True True False True update n/a
============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =====
[ 50.00%] -- Benchmarking virtualenv-py2.7-pyyaml-HGMODULEPOLICYc-HGWITHRUSTEXTcpython
[100.00%] --- Setting up utils:* ok (glob)
[100.00%] --- simple_command.write.track_commit ok
[100.00%] --- ============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =====================
repo repo-format-compression repo-format-compression-level repo-format-copies-sdc repo-format-dotencode repo-format-fncache repo-format-generaldelta repo-format-plain-cl-delta repo-format-sidedata repo-format-sparserevlog mode
-------------- ------------------------- ------------------------------- ------------------------ ----------------------- --------------------- -------------------------- ---------------------------- ---------------------- -------------------------- -------- ---------------------
[ 25.00%] -- Benchmarking virtualenv-py2.7-pyyaml-HGMODULEPOLICYc-HGWITHRUSTEXTcpython
[ 50.00%] --- Setting up utils:* ok (glob)
[ 50.00%] --- simple_command.write.track_commit ok
\[ 50.00%\] --- ============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =+ (re)
repo repo-format-compression repo-format-compression-level repo-format-copies-sdc repo-format-dotencode repo-format-fncache repo-format-generaldelta repo-format-plain-cl-delta repo-format-sidedata repo-format-sparserevlog mode + (re)
-------------- ------------------------- ------------------------------- ------------------------ ----------------------- --------------------- -------------------------- ---------------------------- ---------------------- -------------------------- -------- -+ (re)
smoke-test-A zlib default False True True True True False True create +\d+\.\d+ * (re)
smoke-test-A zlib default False True True True True False True update +\d+\.\d+ * (re)
smoke-test-B zlib default False True True True True False True create +\d+\.\d+ * (re)
smoke-test-B zlib default False True True True True False True update +\d+\.\d+ * (re)
......@@ -216,8 +216,33 @@
smoke-test-A zlib default False True True True True False True create +\d+\.\d+ * (re)
smoke-test-A zlib default False True True True True False True update +\d+\.\d+ * (re)
smoke-test-B zlib default False True True True True False True create +\d+\.\d+ * (re)
smoke-test-B zlib default False True True True True False True update +\d+\.\d+ * (re)
============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =====================
============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =+ (re)
[ 50.00%] -- Building for virtualenv-py3.7-pyyaml-HGMODULEPOLICYrust+c-HGWITHRUSTEXTcpython
[ 50.00%] -- Benchmarking virtualenv-py3.7-pyyaml-HGMODULEPOLICYrust+c-HGWITHRUSTEXTcpython
[ 75.00%] --- Setting up utils:* ok (glob)
[ 75.00%] --- simple_command.write.track_commit ok
[ 75.00%] --- ============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =====
repo repo-format-compression repo-format-compression-level repo-format-copies-sdc repo-format-dotencode repo-format-fncache repo-format-generaldelta repo-format-plain-cl-delta repo-format-sidedata repo-format-sparserevlog mode
-------------- ------------------------- ------------------------------- ------------------------ ----------------------- --------------------- -------------------------- ---------------------------- ---------------------- -------------------------- -------- -----
smoke-test-A zlib default False True True True True False True create n/a
smoke-test-A zlib default False True True True True False True update n/a
smoke-test-B zlib default False True True True True False True create n/a
smoke-test-B zlib default False True True True True False True update n/a
============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =====
[ 75.00%] -- Benchmarking virtualenv-py3.7-pyyaml-HGMODULEPOLICYc-HGWITHRUSTEXTcpython
[100.00%] --- Setting up utils:* ok (glob)
[100.00%] --- simple_command.write.track_commit ok
[100.00%] --- ============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =====
repo repo-format-compression repo-format-compression-level repo-format-copies-sdc repo-format-dotencode repo-format-fncache repo-format-generaldelta repo-format-plain-cl-delta repo-format-sidedata repo-format-sparserevlog mode
-------------- ------------------------- ------------------------------- ------------------------ ----------------------- --------------------- -------------------------- ---------------------------- ---------------------- -------------------------- -------- -----
smoke-test-A zlib default False True True True True False True create n/a
smoke-test-A zlib default False True True True True False True update n/a
smoke-test-B zlib default False True True True True False True create n/a
smoke-test-B zlib default False True True True True False True update n/a
============== ========================= =============================== ======================== ======================= ===================== ========================== ============================ ====================== ========================== ======== =====
+ ['./lib/before-check.sh']
+ ['asv', 'run', '--launch-method', 'spawn', '--skip-existing-successful', 'fe3ca1e6', '-b', 'track_commit', '--no-pull']
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment