-
Notifications
You must be signed in to change notification settings - Fork 1.2k
feat: Add langchain llamastack Integration example notebook #3314
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
} | ||
], | ||
"source": [ | ||
"!pip install fastapi uvicorn \"langchain>=0.2\" langchain-openai \\\n", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
use uv pip install
?
"source": [ | ||
"# Insert chunks into FAISS vector store\n", | ||
"\n", | ||
"response = client.vector_io.insert(vector_db_id=\"acme_docs\", chunks=chunks)" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yea let's use the new vector_stores APIs instead
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ways to make this simpler -
!pip install
everything in one step- use
pkill -f llama_stack.core.server.server -e
- use
uv run --with llama-stack llama stack build ... --run
for one step install & startup - avoid
!pip install
andsubprocess(... "pip"...)
- the vector_store api will do this chunking for you
- pass
base_url
andapi_key
toChatOpenAI
instead of seting env vars
questions -
- why do you need to adjust
UV_SYSTEM_PYTHON
? - why are so many models listed?
0019616
to
7ae7d6a
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
For this, I have added a comment above, just in case user has this set
Removed the long list and made it short just of the provider used in the tutorials @mattf thanks for the helpful comments! I have made it simpler with the suggestions above. |
@mattf Will be landing this, if no other comments to address? |
ok landing for now, feel free to raise a task if anything pending still |
…ck#3314) # What does this PR do? The notebook was reverted(llamastack#3259) as it had some local paths, I missed correcting. Trying with corrections now ## Test Plan Ran the Jupyter notebook
What does this PR do?
The notebook was reverted(#3259) as it had some local paths, I missed correcting. Trying with corrections now
Test Plan
Ran the Jupyter notebook