Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DINOv2 Evaluation Results Different From Paper #13

Open
gyyj28 opened this issue Nov 21, 2024 · 0 comments
Open

DINOv2 Evaluation Results Different From Paper #13

gyyj28 opened this issue Nov 21, 2024 · 0 comments

Comments

@gyyj28
Copy link

gyyj28 commented Nov 21, 2024

Hello, thank you very much for this excellent work!
I am trying to reproduce the paper results on Surface Normal Estimation using NAVI and DINOv2 B14, I using gradient accumulation (steps=4) on a single GPU, and the detailed information as well as the results are as follows.

python train_snorm.py backbone=dinov2_b14 +backbone.return_multilayer=True +output_dir="outputs/dinov2_b14/navi" +dataset=navi

This is my log and result:
1
2
but this is different from the corresponding result in Table 3 of the paper:
3

Additionally, when I set step=1 on a single GPU, I obtained results similar to those with step=4, and both differ from what is reported in the paper. Below is the results I got setting step=1 on a single GPU.
4

Is there something I have set up improperly?
Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant