Code

Shortfin LLM Direct-to-batcher tests#987

Code

Open

renxida wants to merge 10 commits intonod-ai:mainnod-ai/shark-ai:mainfrom renxida:llm-micro-serverrenxida/shark-ai:llm-micro-serverCopy head branch name to clipboard

+209-11

Commits

Commits on Feb 20, 2025

• separate arg parsing into its own function

  renxida

  committed
  381e4ed

  Copy full SHA for 381e4ed

Commits on Feb 21, 2025

• add initial test script

  renxida

  committed
  b8c862e

  Copy full SHA for b8c862e

• test is working

  renxida

  committed
  cdffe8e

  Copy full SHA for cdffe8e

• move to batcher

  renxida

  committed
  f551ff0

  Copy full SHA for f551ff0

• docstring to explain why we need to impl a process

  renxida

  committed
  2ff6fba

  Copy full SHA for 2ff6fba

• change test params

  renxida

  committed
  d38644f

  Copy full SHA for d38644f

• add todo

  renxida

  committed
  bf04bcf

  Copy full SHA for bf04bcf

• move test file location

  renxida

  committed
  889140f

  Copy full SHA for 889140f

• final touches and enable ci

  renxida

  committed
  5cb7094

  Copy full SHA for 5cb7094

Commits on Feb 22, 2025

• Merge branch 'main' into llm-micro-server

  renxida

  authored
  292e55d

  Copy full SHA for 292e55d