bug: Migration Takes a really long time

[githilman]

Describe the bug

Migration takes a long time after upgrade version to 1.461.0 from 1.456.0

To reproduce

using helm chart upgrade version to chart windmill-2.0.365 with app version 1.461.0

Expected behavior

Migration and upgrade run successfully

Screenshots

Browser information

No response

Application version

No response

Additional Context

UPDATE: I tried to rollback but the deployment is blocked because of the migration is still in progress

[githilman]

I successfully rollback the app version but the migration query from the update is still stuck in progress

[rubenfiszel]

It's expected, we're migrating all the jobs to a new v2 format. It doesn't require downtime, it will only block new containers to be ready until the migration is complete. You do a rollout deployment and have the old node stay until the new ones are ready.
The only way to make the migration faster is to delete rows in completed_job because that's what is taking time to migrate.