Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

运行脚本get_predict_qlora.sh的时候,如何传入模型地址 #71

Open
Matter-Charles opened this issue Sep 5, 2023 · 1 comment

Comments

@Matter-Charles
Copy link

Matter-Charles commented Sep 5, 2023

Traceback (most recent call last):
File "/root/xx/DB-GPT-Hub/predict_qlora.py", line 233, in
dataset_name, result = predict()
File "/root/xx/DB-GPT-Hub/predict_qlora.py", line 109, in predict
) = parser.parse_args_into_dataclasses()
File "/root/anaconda3/envs/dbgpt_hub/lib/python3.10/site-packages/transformers/hf_argparser.py", line 347, in parse_args_into_dataclasses
raise ValueError(f"Some specified arguments are not used by the HfArgumentParser: {remaining_args}")
ValueError: Some specified arguments are not used by the HfArgumentParser: ['--peft_ckpt_path', 'adapterqlora']

@Matter-Charles Matter-Charles reopened this Sep 6, 2023
@Matter-Charles Matter-Charles changed the title Can't find 'adapter_config.json' at './adapter/adapter_model' 运行脚本get_predict_qlora.sh的时候,如何传入模型地址 Sep 6, 2023
@wangzaistone
Copy link
Member

i

Traceback (most recent call last): File "/root/xx/DB-GPT-Hub/predict_qlora.py", line 233, in dataset_name, result = predict() File "/root/xx/DB-GPT-Hub/predict_qlora.py", line 109, in predict ) = parser.parse_args_into_dataclasses() File "/root/anaconda3/envs/dbgpt_hub/lib/python3.10/site-packages/transformers/hf_argparser.py", line 347, in parse_args_into_dataclasses raise ValueError(f"Some specified arguments are not used by the HfArgumentParser: {remaining_args}") ValueError: Some specified arguments are not used by the HfArgumentParser: ['--peft_ckpt_path', 'adapterqlora']

if not works , you can difine the model path in the predict_qlora.py , the function :
"
def get_args():
parser = argparse.ArgumentParser()
parser.add_argument(
"--base_model_name_or_path",
type=str,
default="/home/model_files/Llama-2-13b-chat-hf",
)
parser.add_argument(
"--peft_ckpt_path",
type=str,
default="/home/LLM/DB-GPT-Hub/llama_adapter/qlora_32_lr_2e4_drop1e1/checkpoint-500",
.....
"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants