Feature Request: Model Eval Mode

[lapp0]

Requesting "Model Eval Mode".

The goal is to verify that sampled videos are using the highest possible quality, so we can distinguish between inference issues and model issues.

The idea is a checkbox in settings for "Model Eval Mode". If enabled it should

• disable quantization
• puts "Model Eval Mode" text in top right corner, along with the model URI
• force world_engine backend

[philpax]

Should we force the performance metrics on (which would show the model name, as well as performance), and then show "Model Eval Mode" in that panel, or would you want something separate?

As a side question, should this live in Biome, or can it be a modification of Overworldai/world_engine#44, which has fewer moving pieces and thus will be more reflective of the raw engine?

[lapp0]

Resolved with https://github.com/Overworldai/rashomon