Re: Slow tests

Michael Sokolov <[email protected]> Wed, 8 Oct 2025 07:20:08 -0400
Newsgroups gmane.comp.jakarta.lucene.devel
Message-ID <CAGUSZHA+egAHb_1c+Tj1QXXkntTRuFDDRh+64bB0Yr5x2V6m5g@mail.gmail.com>
Thanks for bumping this up Dawid! I pushed a fix for TestBPReorderingMergePolicy

On Wed, Oct 8, 2025 at 5:03 AM Dawid Weiss <[email protected]> wrote:
>
>
> Hello everyone!
>
> In short: the tests have become slow. This happens, gradually - nothing new. But we should do a shakedown of the most terrible offenders because github mac runners occasinoally can't finish in 30 minutes (!).
>
> Mike filed an issue already -
>
> https://github.com/apache/lucene/issues/15212
>
> So:
>
> 1) try to run the tests in the module you're most familiar with, for example:
>
> ,/gradlew -p lucene/sandbox/ test -Ptests.jvms=1 -Ptests.seed=deadbeef
>
> this will report (for this seed) the slowest tests and suites. You can also take a peek at past build results on github, for example:
>
> The slowest tests during this run:
>   13.88s TestRescoreTopNQuery.testRescoreField (:lucene:core)
>   11.80s TestBPReorderingMergePolicy.testReorderOnAddIndexes (:lucene:misc)
>   10.74s TestIndexOrDocValuesQuery.testUseIndexForSelectiveMultiValueQueries (:lucene:core)
> ...
> The slowest suites during this run:
>   31.05s TestSimpleTextDocValuesFormat (:lucene:codecs)
>   21.26s TestBPReorderingMergePolicy (:lucene:misc)
>   20.85s TestAssertingDocValuesFormat (:lucene:test-framework)
> ...
>
> 2) review if the test depends heavily on randomization, try to tone it down.
>
> 3) apply your changes to branch 15212-speed-up-slow-tests.
>
> The more eyes, the better but speeding up the tests will be a relief for everyone.
>
> Thank you!
> Dawid