fix(init): include server,seekdb extras and improve LLM auto-detection#1016
Merged
Merged
Conversation
4077ba1 to
a6a33c9
Compare
- Default POWERMEM_INIT_PACKAGE to powermem[server,seekdb] so pyseekdb is installed on fresh plugin init (fixes ModuleNotFoundError at startup) - Detect LLM provider from available API key rather than model name prefix, preventing provider/key mismatch when settings.json model field uses a different provider prefix (e.g. qwen/...) than the available key - Add validate_llm_config step after .env creation: makes a test API call and fails early with a clear error if the model is incompatible, instead of silently starting a broken server - Fix SETUP.md non-CN model preload: add pip install huggingface_hub before snapshot_download call - Fix SETUP.md dashboard ask ordering: move background build prompt to immediately after model download is started, so it runs in parallel
a6a33c9 to
10a96eb
Compare
Member
|
LGTM |
5 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
init.sh: DefaultPOWERMEM_INIT_PACKAGEtopowermem[server,seekdb]sopyseekdbis installed on fresh plugin init, fixingModuleNotFoundError: No module named 'pyseekdb'at server startupinit.sh: Detect LLM provider from available API key rather than model name prefix — prevents provider/key mismatch whensettings.jsonhas e.g.model: "qwen/..."but the only available key isANTHROPIC_API_KEY; key priority order:ANTHROPIC_AUTH_TOKEN→ANTHROPIC_API_KEY→OPENAI_API_KEY→DEEPSEEK_API_KEY→DASHSCOPE_API_KEYinit.sh: Addvalidate_llm_configstep after.envcreation — makes a minimal test API call and fails early with a clear error if provider/model/key are incompatible, instead of silently starting a broken serverSETUP.md: Fix non-CN model preload — addpip install huggingface_hubbeforesnapshot_downloadcall (mirrors the CN path which installsmodelscopefirst)SETUP.md: Fix dashboard build ordering — move the background build prompt to immediately after model download is started in background, so dashboard build runs in parallel with model download and server startup