Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RoMa in Mismatched Paper #2

Open
scott-vsi opened this issue Nov 15, 2024 · 1 comment
Open

RoMa in Mismatched Paper #2

scott-vsi opened this issue Nov 15, 2024 · 1 comment

Comments

@scott-vsi
Copy link

scott-vsi commented Nov 15, 2024

Sorry if this is the wrong place to ask this, but I was looking at your paper, Mismatched: Evaluating the Limits of Image
Matching Approaches and Benchmarks link. In Figure 1, you put RoMa at 0% on the Niantic benchmark, but looking at Table 1 it looks like RoMa should be around 20% wrt GIM (0.104/0.560=0.18). Am I reading that right?

Also, do you have any thoughts on why RoMa did so poorly in that benchmark considering it did so well in the OoD benchmark? Is the thought that RoMa may do better if something like colmap instead of mickey were use to estimate the camera?

@scott-vsi
Copy link
Author

I see. RoMa is at 0% because it is normalized between min/max not just max. Still, RoMa's poor performance on Niantic is surprising.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant