You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi @marcoyang1998 , another question, when finetuning adapter or lora, is there any difference between optimizer with whole model parameters and optimizer with only adapter/lora module paramters ?
They should be equivalent as only the parameters in lora or adapter will have gradients, but the latter could be more efficient (not tested though) as it won't traverse all model parameters.
All adapters are only used in
forward()
, but not instreaming_forward
, please fix it.icefall/egs/librispeech/ASR/zipformer_adapter/zipformer.py
Line 933 in 2dfd5db
The text was updated successfully, but these errors were encountered: