Hello, thank you for doing a very good job! May I ask if the training steps are to first run scripts/pretrain.sh and then run fintune_ *.sh or lora_ *.sh files? Is the tune_mm_mlp_adapter in pretrain.sh for pretraining projection MLP showed in Figure2 in your paper? Is the pretrain_mm_mlp_adapter in the remaining files the projector weights after runing pretrain.sh?
Could you please describe the training process? Thank you very much!
Hello, thank you for doing a very good job! May I ask if the training steps are to first run
scripts/pretrain.shand then runfintune_ *.shorlora_ *.shfiles? Is thetune_mm_mlp_adapterinpretrain.shfor pretraining projection MLP showed in Figure2 in your paper? Is thepretrain_mm_mlp_adapterin the remaining files the projector weights after runing pretrain.sh?Could you please describe the training process? Thank you very much!