Skip to content

feat(cli): label VRAM vs system RAM in ls and up tables#482

Open
itzlambda wants to merge 5 commits into
mainfrom
feat/cli-vram-column
Open

feat(cli): label VRAM vs system RAM in ls and up tables#482
itzlambda wants to merge 5 commits into
mainfrom
feat/cli-vram-column

Conversation

@itzlambda
Copy link
Copy Markdown
Contributor

@itzlambda itzlambda commented May 18, 2026

basilica ls previously labelled a single RAM column on the detailed Citadel (GPU) table, but the value was system memory — while --memory-min filters on GPU VRAM. Offerings could pass the filter and still display a smaller RAM number, e.g. a shadeform kansascity 1× A100 row showing RAM 64GB when the A100 carries 80GB of VRAM.

This PR:

  • adds a VRAM column (total GPU memory: mem_per_gpu × gpu_count) to the detailed Citadel (GPU) table; system RAM stays
  • suffixes the basilica up unified picker memory column with VRAM or RAM per row, and widens that column so the suffix doesn't squash the price

Summary by CodeRabbit

Release Notes

  • New Features

    • Added dedicated VRAM column to detailed GPU offerings table for enhanced visibility of GPU memory information.
  • Style

    • Updated memory labels in GPU offerings display from "GB" to "GB VRAM" for improved clarity.

Review Change Stack

Add a VRAM column to the detailed Citadel (GPU) listing so total GPU
memory is visible alongside system RAM, and suffix the unified picker's
memory column with VRAM/RAM so mixed GPU and CPU offerings can't be
misread.
@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented May 18, 2026

Warning

Rate limit exceeded

@itzlambda has exceeded the limit for the number of commits that can be reviewed per hour. Please wait 12 seconds before requesting another review.

You’ve run out of usage credits. Purchase more in the billing tab.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 2999ddac-b487-4b0f-b5de-b6e3275be8df

📥 Commits

Reviewing files that changed from the base of the PR and between b95632a and c40cacc.

📒 Files selected for processing (8)
  • crates/basilica-cli/CHANGELOG.md
  • crates/basilica-cli/src/cli/handlers/deploy/templates/sglang.rs
  • crates/basilica-cli/src/cli/handlers/deploy/templates/vllm.rs
  • crates/basilica-cli/src/cli/handlers/deploy/validation.rs
  • crates/basilica-cli/src/cli/handlers/gpu_rental.rs
  • crates/basilica-cli/src/cli/handlers/gpu_rental_helpers.rs
  • crates/basilica-cli/src/cli/handlers/volumes.rs
  • crates/basilica-cli/src/output/table_output.rs

Walkthrough

The PR updates GPU memory display labeling and rendering across two CLI output surfaces: the interactive offering selection table gains a "GB VRAM" suffix, with corresponding layout adjustments, and the detailed offerings table gains a new VRAM column that computes and displays total GPU VRAM per offering.

Changes

GPU Memory Display Enhancement

Layer / File(s) Summary
GPU Memory Label Standardization
crates/basilica-cli/src/cli/handlers/gpu_rental_helpers.rs
Memory values in both secure-cloud and community-cloud offering displays are relabeled from "GB" to "GB VRAM" within resolve_offering_unified.
Interactive Selection Table Layout Adjustment
crates/basilica-cli/src/cli/handlers/gpu_rental_helpers.rs
The interactive "Select offering" table's Memory column width is expanded and header spacing is updated to match the new "GB VRAM" label format.
Detailed Offerings Table VRAM Column
crates/basilica-cli/src/output/table_output.rs
A new vram field is added to OfferingRow and populated by multiplying per-GPU memory by GPU count, formatted as "GB" or "-" when unavailable.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~8 minutes

Possibly related PRs

  • one-covenant/basilica#266: Modifies the same secure-cloud offerings table rendering path in table_output.rs, providing foundational unification for this PR's VRAM column addition.
  • one-covenant/basilica#234: Introduced the unified GPU offering selection UI in gpu_rental_helpers.rs that this PR extends with improved memory labeling.
  • one-covenant/basilica#374: Also modifies the resolve_offering_unified path in gpu_rental_helpers.rs to adjust GPU memory computation and display in the interactive table.

Poem

🐰 A table grew with VRAM so clear,
Displaying memory, year by year,
"GB VRAM" now gleams so bright,
Each column spaced just right—delight!
hops

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Docstring Coverage ⚠️ Warning Docstring coverage is 50.00% which is insufficient. The required threshold is 80.00%. Write docstrings for the functions missing them to satisfy the coverage threshold.
✅ Passed checks (4 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly summarizes the main change: adding VRAM labeling to distinguish GPU VRAM from system RAM in CLI tables.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch feat/cli-vram-column

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@itzlambda itzlambda marked this pull request as ready for review May 18, 2026 19:19
Copy link
Copy Markdown
Contributor

@coderabbitai coderabbitai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🧹 Nitpick comments (1)
crates/basilica-cli/src/cli/handlers/gpu_rental_helpers.rs (1)

887-887: 💤 Low value

Header spacing doesn't match format column width.

The Memory column uses {:<12} (12 characters) in the format string, but the header has "Memory" + 7 spaces = 13 characters before the separator.

📏 Proposed fix for alignment
         style(
-            "  Type      │ GPU/CPU                   │ Provider        │ Loc  │ Memory       │ Price"
+            "  Type      │ GPU/CPU                   │ Provider        │ Loc  │ Memory      │ Price"
         )

Also applies to: 902-902

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@crates/basilica-cli/src/cli/handlers/gpu_rental_helpers.rs` at line 887, The
header text spacing is misaligned with the format string "{} │ {:<25} │ {:<15} │
{:<4} │ {:<12} │ {}" — the "Memory" header currently has 7 trailing spaces (13
chars) but the format uses a 12-char column; update the header string(s) (the
header row(s) printed near the format string in gpu_rental_helpers.rs) to give
"Memory" a total width of 12 (i.e., "Memory" + 6 spaces) so it lines up with the
"{:<12}" column; apply the same adjustment to the other header occurrence noted
around line 902.
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@crates/basilica-cli/src/cli/handlers/gpu_rental_helpers.rs`:
- Line 828: The display uses per‑GPU VRAM for the community cloud (memory_str
computed from min_memory_gb) but secure cloud shows total VRAM; fix by computing
total VRAM and using that in memory_str: multiply min_memory_gb by the GPU count
variable (e.g., gpu_count or num_gpus) to produce total_vram_gb and format
memory_str from total_vram_gb instead of min_memory_gb; update the memory_str
assignment (symbol: memory_str) and ensure any other place that formats per‑GPU
vs total VRAM (symbols: min_memory_gb, gpu_count/num_gpus) is made consistent.

---

Nitpick comments:
In `@crates/basilica-cli/src/cli/handlers/gpu_rental_helpers.rs`:
- Line 887: The header text spacing is misaligned with the format string "{} │
{:<25} │ {:<15} │ {:<4} │ {:<12} │ {}" — the "Memory" header currently has 7
trailing spaces (13 chars) but the format uses a 12-char column; update the
header string(s) (the header row(s) printed near the format string in
gpu_rental_helpers.rs) to give "Memory" a total width of 12 (i.e., "Memory" + 6
spaces) so it lines up with the "{:<12}" column; apply the same adjustment to
the other header occurrence noted around line 902.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 5a6efbf2-fcd3-4cd0-a1e8-282e389cadc0

📥 Commits

Reviewing files that changed from the base of the PR and between 6dff16f and b95632a.

📒 Files selected for processing (2)
  • crates/basilica-cli/src/cli/handlers/gpu_rental_helpers.rs
  • crates/basilica-cli/src/output/table_output.rs

Comment thread crates/basilica-cli/src/cli/handlers/gpu_rental_helpers.rs Outdated
itzlambda added 4 commits May 19, 2026 00:56
Add dedicated VRAM column to `basilica ls` secure-cloud table, label
the `up` selector Memory column as `<N> GB (VRAM)` / `<N> GB (RAM)`,
and put a space between number and unit (`16 GB` vs `16GB`) across
VRAM, RAM, storage, and volume size columns to match SI/NIST style.
Community cloud was displaying per-GPU VRAM while secure cloud showed
total VRAM, making multi-GPU offerings appear smaller than they are.
The validation error message was normalized to include a space between
the number and unit ("24 GB") in b5993ad, but the corresponding test
assertion still expected "24GB".
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant