Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Ollama and vLLM as Options for Local Apps in Hugginface #688

Closed
EliMCosta opened this issue May 20, 2024 · 6 comments
Closed

Add Ollama and vLLM as Options for Local Apps in Hugginface #688

EliMCosta opened this issue May 20, 2024 · 6 comments

Comments

@EliMCosta
Copy link
Contributor

I suggest Ollama and vLLM as options for local apps in Hugginface's model repo because they are two big apps used for dev and prod environments, respectivelly.
image

@EliMCosta
Copy link
Contributor Author

I've already made some changes to the code, but I don't think they're enough. For example, I couldn't find how to link to each app's icon, which should appear on the Hugginface. Need a feedback/help before a PR:
main...EliMCosta:huggingface.js:patch-1

@EliMCosta
Copy link
Contributor Author

I've already made some changes to the code, but I don't think they're enough. For example, I couldn't find how to link to each app's icon, which should appear on the Hugginface. Need a feedback/help before a PR: main...EliMCosta:huggingface.js:patch-1

Or someone can do the entire PR to solve this issue..

@julien-c
Copy link
Member

hey, thanks for opening this! indeed, the icons are in our internal codebase – we can take care of those.

Can you split the PR into two and make one just for vLLM?

@EliMCosta
Copy link
Contributor Author

hey, thanks for opening this! indeed, the icons are in our internal codebase – we can take care of those.

Can you split the PR into two and make one just for vLLM?

Opened this PR for vLLM: #693

@julien-c
Copy link
Member

closing in favor of #693

@julien-c julien-c closed this as not planned Won't fix, can't repro, duplicate, stale May 22, 2024
@Vaibhavs10
Copy link
Member

re:ollama @EliMCosta - We're thinking about it more closely, we might have some updates soon: #687 (review)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants