[Tests] Cache issues when installing additional linux packages

[mszulik]

Tests somehow start failing when the cached is used. This phenomenon started appearing in the Transmorpher repository, check action logs for more information.