Skip to content

Add Intel i3-7100 1-bit benchamark results - #135

Open
argorain wants to merge 1 commit into
PrismML-Eng:mainfrom
argorain:main
Open

Add Intel i3-7100 1-bit benchamark results#135
argorain wants to merge 1 commit into
PrismML-Eng:mainfrom
argorain:main

Conversation

@argorain

Copy link
Copy Markdown

No description provided.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds CPU benchmark results for Bonsai 1-bit models on an Intel Core i3-7100 Proxmox VM.

Changes:

  • Adds throughput results for 27B, 8B, 4B, and 1.7B models.
  • Records VM hardware and operating-system details.
Comments suppressed due to low confidence (3)

community-benchmarks/bonsai/cpu-i3-7100-linux-proxmox.md:53

  • This block also retains the template's Metal/GPU invocation while the table reports a four-thread CPU run. Document the exact 8B command that was executed instead of leaving the applicable Linux CPU command commented out.
# GPU (Metal / CUDA / Vulkan / ROCm) — adjust BENCH path:
BENCH=bin/mac/llama-bench
$BENCH -m models/gguf/8B/*.gguf -ngl 99 -fa 1

community-benchmarks/bonsai/cpu-i3-7100-linux-proxmox.md:68

  • This command inherits the earlier bin/mac assignment and still uses the template's GPU offload flag, so it cannot serve as the exact Linux CPU command for the 4B result. Replace it with the command actually run.
$BENCH -m models/gguf/4B/*.gguf -ngl 99 -fa 1

community-benchmarks/bonsai/cpu-i3-7100-linux-proxmox.md:78

  • This command likewise inherits the macOS binary path and keeps the template's GPU settings despite the CPU result. Record the exact 1.7B invocation used for the measurement.
$BENCH -m models/gguf/1.7B/*.gguf -ngl 99 -fa 1

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread community-benchmarks/bonsai/cpu-i3-7100-linux-proxmox.md Outdated
Comment thread community-benchmarks/bonsai/cpu-i3-7100-linux-proxmox.md Outdated
Comment thread community-benchmarks/bonsai/cpu-i3-7100-linux-proxmox.md
Comment thread community-benchmarks/bonsai/cpu-i3-7100-linux-proxmox.md

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 1 changed files in this pull request and generated no new comments.

Comments suppressed due to low confidence (2)

community-benchmarks/bonsai/cpu-i3-7100-linux-proxmox.md:37

  • This benchmark uses the CPU binary and reports the CPU backend, so the copied GPU instruction is misleading. Label this as a CPU-only command instead.
# GPU (Metal / CUDA / Vulkan / ROCm) — adjust BENCH path (bin/mac, bin/cuda, bin/rocm, bin/vulkan, bin/cpu):

community-benchmarks/bonsai/cpu-i3-7100-linux-proxmox.md:52

  • This is also a CPU benchmark, but the snippet still describes a GPU run and leaves separate CPU commands commented out. Label the command actually used as CPU-only so readers can reproduce the reported result without ambiguity.
# GPU (Metal / CUDA / Vulkan / ROCm) — adjust BENCH path:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants