[FEATURE] Make it possible to see what settings are applied to segments

[Shituation]

I don't know how difficult is to implement this and how resource costly it is

But it would be a great addition, to be able to correct frames in a video recording individually with each frame having its custom settings saved (per frame settings). The principle would be the same that we now use for using different settings for different faces.

Why?
Because right now we only can "check for issues" but that only lets us discard parts of the video where the algorithms can't find faces. Even if we have no issues, the only thing we can do is fire and forget, hoping the face will be more or less stable through the whole clip; which as you may know, is almost impossible (mostly because of eyes). Bytetracking helped a lot with flickering but we still get weird malformation on some videos where the face turns a little to a side (the Achilles heel of face-swappers) but in most cases, regulating the "keypoints scale" saves the day with those pesky face angles. So we if could make use of it in a per frame base on a video without affecting the whole video, it would save the otherwise bad quality output video.

-Please see below!! this is not the issue anymore-

[Elricfae]

I'm not sure i understand what you really mean... but i think the markers are able to do this, you adjust the settings on the 'problem' frame using a marker, add a second marker on next frame and re-adjust your settings ?

[Shituation]

I have no idea how the markers work to be honest. I always thought the markers were only to tell the app "record from here until there" and just that.

Do they preserve face settings on each individualy? I mean, I put a mark on a problematic face (frame) of a video, adjust settings on it, then the rest of the video is left untouched meaning each marker has its own settings for the current marked frame?

I say this because if put a marker it wants me to put an end marker too. Meaning I cannot do the complete video.

To be more specific: I want to grab a clip, see which faces fail (I can do this manually, no problem) then tell the app "for this frame, use these settings, the rest of the video as it was", then let it record the complete clip.

[Elricfae]

So, there are two types of marker, the Start / End markers to record parts of the video you select and the 'normal' markers that allows changing settings for the selected detected face. This is the marker you want. When the recording passes this specific marker it will change the settings accordingly so you'll have to add a second one on the next frame (or more) to rechange the settings back.

[Shituation]

I see now!

One more question: when I add the second marker after editing the face, will it go back to initial settings? or will it keep the "modified frame" settings for the rest of the video so I need to switch all my settings back to "normal" for the rest of the video?

Nevermind, I tested it now and it works so I'm closing this issue. Thanks!

[Shituation]

uhmm... hello?
Are there any plans to make this mechanic less confusing? right now I don't know where the settings end or start, the visual of the marks are there, but I cannot understand what settings are being applied where, for instance I am now trying to fix a rather complex scene, but I don't know where the settings end so when I play the video, I get the incorrect settings applied.

I understand that this works like parentheses which apply the settings inside the segments between them, but if you use more than one of those, it becomes a mess. I am having a hard time with 4 markers 😩, when jumping inside one of the "parentheses" (middle of two markers) the settings are not changing in real time, only when I play the video the settings change in the panel.

Sorry If I am insisting with this, I didn't know how to use the markers but now I am getting confused by them.

My humble petition would be to make the settings update the parameters saved into the segments, as right now if I click on a part of a video I don't see what settings I am using confusing me.

Since explaining this is rather difficult, here is an example:

9rrDJO25g3_1.mp4

I also changed the name of this issue since it would be misleading. I do not have rights to reopen the issue. Suddenly I do have the permission to reopen the issue.

[Elricfae]

I was just editing a video myself and i think something is broken with the markers. They don't work as they should and don"t update the ui like before.
I'll have to take a look at that. No wonder it appears confusing for you, it's not working right at the moment !

[Elricfae]

To see how the ui is between the markers you have to activate the option in settings tab ' Track Markers on Video Seek"
But like i said, something seems wrong at the moment with how they react.
I'll have to fix this first.

[Shituation]

Hi Elricfae! I saw a new commit on this issue, it seems to do the same for me; do I wait for you to tell me to try it when you think its working or do I keep telling you if it works or not on each change? I don't want to be annoying. Thank you for your time