Skip to content

Commit 83ed463

Browse files
committed
f
1 parent 51aa5a8 commit 83ed463

1 file changed

Lines changed: 3 additions & 5 deletions

File tree

ggml/src/ggml-cuda/ggml-cuda-roofline.cpp

Lines changed: 3 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -89,11 +89,9 @@ struct dispatch {
8989
// the node itself); in_storage_ids are the storages it reads from outside the span. The consumer
9090
// links each in_storage_id to the most recent prior launch whose out_storage_id matches (last
9191
// writer wins, which also resolves in-place ops whose output aliases an input).
92-
// Per external source, aligned 1:1 with in_storage_ids, so the consumer can label and classify
93-
// each operand without re-deriving it from the shared (head-only, for a fused row) geometry record:
94-
// the tensor name makes weight-vs-input unambiguous (a model weight is named e.g.
95-
// "blk.0.ffn_gate.weight"; a dynamic input is "inp_pos" / "cache_k_l0" / ...), and the type/shape
96-
// are the operand's own -- which for a fused span's non-head operands the geometry record omits.
92+
// One entry per external source (aligned 1:1 with in_storage_ids). Holds each operand's own
93+
// name/type/shape so the consumer can label and classify it (weight vs dynamic input, by name) --
94+
// which a fused row's head-only geometry record can't supply.
9795
struct src_operand {
9896
std::string name;
9997
std::string type; // ggml_type_name

0 commit comments

Comments
 (0)