Add Intel i3-7100 1-bit benchamark results - #135
Open
argorain wants to merge 1 commit into
Open
Conversation
Contributor
There was a problem hiding this comment.
Pull request overview
Adds CPU benchmark results for Bonsai 1-bit models on an Intel Core i3-7100 Proxmox VM.
Changes:
- Adds throughput results for 27B, 8B, 4B, and 1.7B models.
- Records VM hardware and operating-system details.
Comments suppressed due to low confidence (3)
community-benchmarks/bonsai/cpu-i3-7100-linux-proxmox.md:53
- This block also retains the template's Metal/GPU invocation while the table reports a four-thread CPU run. Document the exact 8B command that was executed instead of leaving the applicable Linux CPU command commented out.
# GPU (Metal / CUDA / Vulkan / ROCm) — adjust BENCH path:
BENCH=bin/mac/llama-bench
$BENCH -m models/gguf/8B/*.gguf -ngl 99 -fa 1
community-benchmarks/bonsai/cpu-i3-7100-linux-proxmox.md:68
- This command inherits the earlier
bin/macassignment and still uses the template's GPU offload flag, so it cannot serve as the exact Linux CPU command for the 4B result. Replace it with the command actually run.
$BENCH -m models/gguf/4B/*.gguf -ngl 99 -fa 1
community-benchmarks/bonsai/cpu-i3-7100-linux-proxmox.md:78
- This command likewise inherits the macOS binary path and keeps the template's GPU settings despite the CPU result. Record the exact 1.7B invocation used for the measurement.
$BENCH -m models/gguf/1.7B/*.gguf -ngl 99 -fa 1
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Contributor
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 1 out of 1 changed files in this pull request and generated no new comments.
Comments suppressed due to low confidence (2)
community-benchmarks/bonsai/cpu-i3-7100-linux-proxmox.md:37
- This benchmark uses the CPU binary and reports the CPU backend, so the copied GPU instruction is misleading. Label this as a CPU-only command instead.
# GPU (Metal / CUDA / Vulkan / ROCm) — adjust BENCH path (bin/mac, bin/cuda, bin/rocm, bin/vulkan, bin/cpu):
community-benchmarks/bonsai/cpu-i3-7100-linux-proxmox.md:52
- This is also a CPU benchmark, but the snippet still describes a GPU run and leaves separate CPU commands commented out. Label the command actually used as CPU-only so readers can reproduce the reported result without ambiguity.
# GPU (Metal / CUDA / Vulkan / ROCm) — adjust BENCH path:
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.