Add unload method to preprocess; restart on crashes#80

Open

eugen-ajechiloae-clearml wants to merge 14 commits intoclearml:mainfrom eugen-ajechiloae-clearml:main

Commits on Aug 14, 2024

initial commit for oom issues - allow for model unload and restart serving on crash
eugen-ajechiloae-clearml
committed
not tested - exit on cuda oom
Eugen Ajechiloae
committed
add degug print
Eugen Ajechiloae
committed
more debug prints
Eugen Ajechiloae
committed
change dbg print
Eugen Ajechiloae
committed
more dbg prints
Eugen Ajechiloae
committed
add debugging comment
Eugen Ajechiloae
committed

Commits on Aug 15, 2024

let gc handle unload
Eugen Ajechiloae
committed
force exit using os._exit
Eugen Ajechiloae
committed
set status in exit
Eugen Ajechiloae
committed
call gc on remove as well
Eugen Ajechiloae
committed
dont call gc collect on remove
Eugen Ajechiloae
committed
remove dbg prints
Eugen Ajechiloae
committed
remove dbg print
Eugen Ajechiloae
committed