I may be misunderstanding the code, but I see phi4:latest set as default values to functions and classes throughout the codebase. I don't have phi4 and can't download it (18GB) at my coffee shop here. But I do have GLM-4-32B installed locally. When using npm install of cloi, it tried to download all of phi4.
So I used find/replace:
s/phi4:latest/GLM-4-32B-0414-Q4_K_M:latest/g
s/phi4/GLM-4-32B-0414-Q4_K_M:latest/g
I'm still testing if this worked, but wanted to provide some feedback since I think this is a really cool project & want it to work in more cases.
Maybe the defaults should not be set all over the place, but centralized in one place? Or perhaps the model should be chosen/set after installation?
I may be misunderstanding the code, but I see
phi4:latestset as default values to functions and classes throughout the codebase. I don't have phi4 and can't download it (18GB) at my coffee shop here. But I do have GLM-4-32B installed locally. When usingnpm installof cloi, it tried to download all ofphi4.So I used find/replace:
s/phi4:latest/GLM-4-32B-0414-Q4_K_M:latest/gs/phi4/GLM-4-32B-0414-Q4_K_M:latest/gI'm still testing if this worked, but wanted to provide some feedback since I think this is a really cool project & want it to work in more cases.
Maybe the defaults should not be set all over the place, but centralized in one place? Or perhaps the model should be chosen/set after installation?