Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

First draft glean example #272

Merged
merged 4 commits into from
Feb 19, 2025
Merged

First draft glean example #272

merged 4 commits into from
Feb 19, 2025

Conversation

slopp
Copy link
Contributor

@slopp slopp commented Jan 31, 2025

Example chat app that uses NVIDIA NIMs and Glean Search API

@slopp slopp requested a review from dglogo February 3, 2025 20:54
@dglogo
Copy link
Collaborator

dglogo commented Feb 8, 2025

@slopp see my comments

@slopp slopp requested a review from dglogo February 18, 2025 18:21
This tool demonstrates how to utilize a user-friendly interface to interact with NVIDIA NIMs, including those available in the API catalog, self-deployed NIM endpoints, and NIMs hosted on Hugging Face. It also provides settings to integrate RAG pipelines with either local and temporary vector stores or self-hosted search engines. Developers can use this tool to design system prompts, few-shot prompts, and configure LLM settings.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

NIMs -> NIM microservices

- Chroma DB for a lightweight vector DB
- An internal knowledge base stored in Glean and available over the Glean Search API

This example uses NVIDIA NIMs which can be hosted completely on-premise, which combined with the Glean on-premise offering, allows organizations to use LLMs for internal knowledge search, chat, and retrieval without any data leaving their environment.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

NIMs

@dglogo dglogo merged commit 0392821 into NVIDIA:main Feb 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants