Search results

gguf: use an unordered_map for faster duplicate tensor name lookups

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 14818

#14818 In ggml-org/llama.cpp;

· struct opened on Jul 22, 2025

sycl: refactor quantization to q8_1

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

Status: Open (in progress).

ggml-org/llama.cppnumber 14815

#14815 In ggml-org/llama.cpp;

· Alcpz opened on Jul 22, 2025

sycl: unified semantics of block offset calculation

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

Status: Open (in progress).

ggml-org/llama.cppnumber 14814

#14814 In ggml-org/llama.cpp;

· Alcpz opened on Jul 22, 2025

opencl: tiled mul_mat with local memory for f16 and f32

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

OpenCLIssues specific to the OpenCL backendIssues specific to the OpenCL backend

Status: Draft (not ready).

ggml-org/llama.cppnumber 14809

#14809 In ggml-org/llama.cpp;

· lhez opened on Jul 22, 2025

CUDA: add fused rms norm

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

testingEverything test relatedEverything test related

Status: Open (in progress).

ggml-org/llama.cppnumber 14800

#14800 In ggml-org/llama.cpp;

· am17an opened on Jul 21, 2025

[ROCm] Fix HIP version check for HIPBLAS V2 API compatibility

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Open (in progress).

ggml-org/llama.cppnumber 14744

#14744 In ggml-org/llama.cpp;

· danielholanda opened on Jul 17, 2025

metal: SSM_SCAN performance

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 14743

#14743 In ggml-org/llama.cpp;

· gabe-l-hart opened on Jul 17, 2025

CUDA: skip masked out KQ slices in mma FA kernel

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

pythonpython script changespython script changes

Status: Open (in progress).

ggml-org/llama.cppnumber 14735

#14735 In ggml-org/llama.cpp;

· JohannesGaessler opened on Jul 17, 2025

Fix KleidiAI compilation errors with -DGGML_NATIVE=OFF (issue #14464)

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 14700

#14700 In ggml-org/llama.cpp;

· baonudesifeizhai opened on Jul 15, 2025

Add Pad Reflect 1D CUDA support

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Open (in progress).

ggml-org/llama.cppnumber 14659

#14659 In ggml-org/llama.cpp;

· YavorGIvanov opened on Jul 13, 2025

Add CUDA non-contiguous Unary Ops support

buildCompilation issuesCompilation issues

documentationImprovements or additions to documentationImprovements or additions to documentation

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

testingEverything test relatedEverything test related

Status: Open (in progress).

ggml-org/llama.cppnumber 14639

#14639 In ggml-org/llama.cpp;

· YavorGIvanov opened on Jul 11, 2025

OpenCL: add <code>mul_mat_f16_f32_image</code> kernel

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

OpenCLIssues specific to the OpenCL backendIssues specific to the OpenCL backend

Status: Open (in progress).

ggml-org/llama.cppnumber 14635

#14635 In ggml-org/llama.cpp;

· rmatif opened on Jul 11, 2025