aschaeffer / ollama-poc Public

Notifications You must be signed in to change notification settings
Fork 0
Star 1

POC: Run tinyllama in 15 minutes with Rust

1 star 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 7 Commits
src		src
.gitignore		.gitignore
.rustfmt.toml		.rustfmt.toml
Cargo.toml		Cargo.toml
LICENSE.md		LICENSE.md
README.md		README.md
clippy.toml		clippy.toml

Repository files navigation

ollama-poc

Install ollama

curl -fsSL https://ollama.com/install.sh | sh

Install and run tinyllama model

ollama run tinyllama

Run

cargo run

Use a custom prompt and/or custom model

cargo run --release -- --model tinyllama --prompt "What is ollama?"

About

POC: Run tinyllama in 15 minutes with Rust

rust-lang ollama tinyllama

Report repository

Languages

Rust 100.0%