Skip to content

fix: update LFM2 audio plugin for llama.cpp b8967#163

Merged
TimPietruskyRunPod merged 4 commits into
mainfrom
t3code/e5a74185
Apr 29, 2026
Merged

fix: update LFM2 audio plugin for llama.cpp b8967#163
TimPietruskyRunPod merged 4 commits into
mainfrom
t3code/e5a74185

Conversation

@TimPietruskyRunPod

Copy link
Copy Markdown
Collaborator

Summary

  • llama-liquid-audio-server was removed in llama.cpp b8967 — audio support is now built into llama-server via the mtmd library
  • Updated audio_lfm2.py plugin to use llama-server with the same CLI args (--mmproj, -mv, --tts-speaker-file)
  • Added --jinja flag for chat template support
  • All references to the old binary updated

Test plan

  • Verified llama-server --help on b8967 confirms -mv, --tts-speaker-file, --mmproj flags exist
  • E2E audio test on RunPod pod (will test after merge + build)

Remove `--reasoning-format none` from all 13 GGUF model configs (Qwen 3.5,
GLM 4.7, GPT-OSS) so llama.cpp's default auto mode handles reasoning +
tool calling correctly — fixes OpenClaw agentic tool calling which was
broken by raw `<think>` tags and XML tool calls leaking into content.

Also:
- Add `oc_sync_openclaw_runtime` to entrypoint-common.sh — writes the
  resolved model provider, context window, and gateway config into
  openclaw.json so OpenClaw picks up the local llama-server automatically
- Run the sync twice in entrypoint-unified.sh (before and after
  `openclaw doctor --fix`) to survive doctor's rewrite
- Fix LD_LIBRARY_PATH to append existing paths instead of replacing them
- Add controlUi (allowedOrigins + dangerouslyDisableDeviceAuth) to Go
  config, TypeScript config, and validation schema
Hermes rejects short or common placeholder API keys (e.g. "test123",
"changeme") when binding to 0.0.0.0. The entrypoint now detects weak
tokens and auto-generates a 32-byte hex key via openssl, displaying it
in the ready banner so users can still authenticate.
…binary

llama-liquid-audio-server was removed in llama.cpp b8967 — audio support
is now built into llama-server via the mtmd library. The plugin just needs
to point at llama-server with the same CLI args (--mmproj, -mv, --tts-speaker-file).
@vercel

vercel Bot commented Apr 29, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
a2go Ready Ready Preview, Comment Apr 29, 2026 4:37pm

Request Review

@TimPietruskyRunPod TimPietruskyRunPod merged commit 5857d32 into main Apr 29, 2026
3 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant