Skip to content

Conversation

@sim642
Copy link
Member

@sim642 sim642 commented Nov 28, 2025

While testing the Marshal-related parts of #1880 (-m and -i), I was annoyed that the tests run so slow. And that's not because they're inherently so slow (just double the Goblint runs), but because update_suite falls back to sequential run for any of these modes with multiple Goblint runs.

The reason parallel runs were forbidden is to avoid mixing up the intermediate files between the two runs when everything is happening in parallel: run/ for -m, incremental_data/ for -i and witness.yml for -w.
We have options to configure each of those names, so this PR makes update_suite use unique per-test names to avoid conflicts and thus allow parallel runs.
This was already done for .goblint/ where preprocessing output goes anyway.

@sim642 sim642 added this to the v2.8.0 milestone Nov 28, 2025
@sim642 sim642 added testing performance Analysis time, memory usage labels Nov 28, 2025
This is just for consistency. Other CI jobs allow parallel runs still.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

performance Analysis time, memory usage testing

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants