Revise Linux GPU unittests CI workflow and remove ffmpeg CI workflow. (#4103)

* Remove ffmpeg use in github workflows (#4083)
* Revise linux gpu tests file
* Let deterministic settings use less cuda memory

---------

Co-authored-by: Pearu Peterson <[email protected]>

Author: samanklesaria