Read about our upcoming Code of Conduct on this issue

metadata: filter the `removed` set to only contains relevant data

The `files` entry can be bogus and contains too many entries. This can badly
combines with the computation of `removed` inflating the set size. The can lead
to the changesets centric rename computation to process much more data than
needed, slowing it down (and increasing space taken by data storage).

In practice newer commits already that reduced set, this applies this "fix" to
older changeset.

Differential Revision: https://phab.mercurial-scm.org/D8589
10 jobs for topic/default/metadata-computation in 31 minutes and 10 seconds (queued for 28 minutes and 10 seconds)
Status Name Job ID Coverage
  Test
failed checks-py2 #78625

00:03:07

failed checks-py3 #78626

00:02:49

passed rust-cargo-test-py2 #78627

00:02:02

passed rust-cargo-test-py3 #78628

00:02:04

failed test-py2 #78629

00:19:53

failed test-py2-pure #78631

00:17:19

failed test-py2-rust #78633

00:16:25

failed test-py3 #78630

00:12:20

failed test-py3-pure #78632

00:15:15

failed test-py3-rust #78634

00:11:45

 
Name Stage Failure
failed
test-py2 Test
Skipped test-sparse-revlog.t: missing artifact, run "/tmp/mercurial-ci/tests/artifacts/scripts/generate-churning-bundle.py"
Skipped test-sqlitestore.t: missing feature: sqlite3 module is available
Skipped test-verify-repo-operations.py: missing feature: allow slow tests (use --allow-slow-tests)
Skipped test-wireproto-exchangev2-shallow.t: missing feature: sqlite3 module is available
Failed test-check-pyflakes.t: output changed
Failed test-mailmap.t: timed out
# Ran 868 tests, 54 skipped, 2 failed.
python hash seed: 1102168197
ERROR: Job failed: exit code 1
failed
test-py2-rust Test
Skipped test-sparse-fsmonitor.t: skipped
Skipped test-sparse-revlog.t: missing artifact, run "/tmp/mercurial-ci/tests/artifacts/scripts/generate-churning-bundle.py"
Skipped test-sqlitestore.t: missing feature: sqlite3 module is available
Skipped test-verify-repo-operations.py: missing feature: allow slow tests (use --allow-slow-tests)
Skipped test-wireproto-exchangev2-shallow.t: missing feature: sqlite3 module is available
Failed test-check-pyflakes.t: output changed
# Ran 868 tests, 54 skipped, 1 failed.
python hash seed: 3833601643
ERROR: Job failed: exit code 1
failed
test-py3-rust Test
Skipped test-sparse-fsmonitor.t: skipped
Skipped test-sparse-revlog.t: missing artifact, run "/tmp/mercurial-ci/tests/artifacts/scripts/generate-churning-bundle.py"
Skipped test-sqlitestore.t: missing feature: sqlite3 module is available
Skipped test-verify-repo-operations.py: missing feature: allow slow tests (use --allow-slow-tests)
Skipped test-wireproto-exchangev2-shallow.t: missing feature: sqlite3 module is available
Failed test-check-pyflakes.t: output changed
# Ran 862 tests, 60 skipped, 1 failed.
python hash seed: 4163759658
ERROR: Job failed: exit code 1
failed
test-py3-pure Test
Skipped test-sparse-fsmonitor.t: skipped
Skipped test-sparse-revlog.t: missing artifact, run "/tmp/mercurial-ci/tests/artifacts/scripts/generate-churning-bundle.py"
Skipped test-sqlitestore.t: missing feature: sqlite3 module is available
Skipped test-verify-repo-operations.py: missing feature: allow slow tests (use --allow-slow-tests)
Skipped test-wireproto-exchangev2-shallow.t: missing feature: sqlite3 module is available
Failed test-check-pyflakes.t: output changed
# Ran 859 tests, 63 skipped, 1 failed.
python hash seed: 1700795116
ERROR: Job failed: exit code 1
failed
test-py2-pure Test
Skipped test-sparse-fsmonitor.t: skipped
Skipped test-sparse-revlog.t: missing artifact, run "/tmp/mercurial-ci/tests/artifacts/scripts/generate-churning-bundle.py"
Skipped test-sqlitestore.t: missing feature: sqlite3 module is available
Skipped test-verify-repo-operations.py: missing feature: allow slow tests (use --allow-slow-tests)
Skipped test-wireproto-exchangev2-shallow.t: missing feature: sqlite3 module is available
Failed test-check-pyflakes.t: output changed
# Ran 865 tests, 57 skipped, 1 failed.
python hash seed: 818836646
ERROR: Job failed: exit code 1
failed
test-py3 Test
Skipped test-sparse-fsmonitor.t: skipped
Skipped test-sparse-revlog.t: missing artifact, run "/tmp/mercurial-ci/tests/artifacts/scripts/generate-churning-bundle.py"
Skipped test-sqlitestore.t: missing feature: sqlite3 module is available
Skipped test-verify-repo-operations.py: missing feature: allow slow tests (use --allow-slow-tests)
Skipped test-wireproto-exchangev2-shallow.t: missing feature: sqlite3 module is available
Failed test-check-pyflakes.t: output changed
# Ran 862 tests, 60 skipped, 1 failed.
python hash seed: 544313539
ERROR: Job failed: exit code 1
failed
checks-py3 Test
  0.000   8.251  20.310   3.120   8.251   test-check-py3-compat.t
0.010 20.224 32.070 4.430 20.214 test-check-help.t
0.003 21.944 48.170 4.650 21.942 test-check-config.t
0.029 22.704 264.010 15.350 22.675 test-check-format.t
0.010 25.116 280.610 15.670 25.107 test-check-module-imports.t
0.012 44.111 317.890 16.090 44.099 test-check-pyflakes.t
0.000 48.070 356.790 16.570 48.070 test-check-code.t
0.019 72.064 421.620 17.710 72.045 test-check-pylint.t
ERROR: Job failed: exit code 1
failed
checks-py2 Test
  0.031  21.675  21.390  16.110  21.644   test-check-jshint.t
0.000 37.988 29.880 16.990 37.987 test-check-py3-compat.t
0.001 39.271 50.430 17.670 39.270 test-check-config.t
0.035 40.641 268.240 28.730 40.607 test-check-format.t
0.006 41.462 289.210 29.610 41.455 test-check-module-imports.t
0.011 52.557 322.600 30.670 52.546 test-check-pyflakes.t
0.000 61.187 363.780 31.640 61.187 test-check-code.t
0.024 83.466 424.390 33.100 83.442 test-check-pylint.t
ERROR: Job failed: exit code 1