Code

Tinygrad Quantization Support [WIP]#630

Code

Draft

KhanerX wants to merge 4 commits intoexo-explore:mainexo-explore/exo:mainfrom KhanerX:tinyquantKhanerX/exo:tinyquantCopy head branch name to clipboard

Commits

Commits on Jan 25, 2025

• test llama-3.2-1b-8bit

  KhanerX

  committed
  ca43d0c

  Copy full SHA for ca43d0c

• weights dtype is uint

  KhanerX

  committed
  11e7aac

  Copy full SHA for 11e7aac

Commits on Feb 5, 2025

• support loading 4-bit quantized weights

  KhanerX

  committed
  25a5523

  Copy full SHA for 25a5523

• Merge branch 'exo-explore:main' into tinyquant

  KhanerX

  authored
  8ff2b74

  Copy full SHA for 8ff2b74