Skip to content

feat(wiki-research): add optional pluggable CLI retrieval backends - #109

Open
Ar9av wants to merge 1 commit into
mainfrom
agenttower/issue-106
Open

feat(wiki-research): add optional pluggable CLI retrieval backends#109
Ar9av wants to merge 1 commit into
mainfrom
agenttower/issue-106

Conversation

@Ar9av

@Ar9av Ar9av commented Jun 16, 2026

Copy link
Copy Markdown
Owner

Summary

  • Adds an optional vault file references/research-backends.md that registers extra CLI retrieval backends (name, binary, invoke template, when-to-use, cost tier, env key)
  • In Rounds 1–2, the skill checks active backends against each angle/URL and folds their output into the same claims/concepts/entities/contradictions extraction
  • Ships a starter YAML registry template (defuddle, yt-dlp, perplexity-sonar) inline in the skill

Key guarantees

  • Zero regression: no research-backends.md → behaviour identical to today
  • Graceful fallback: missing binary / unset env key / non-zero exit → backend skipped with a note; research continues via WebSearch/WebFetch. A backend never aborts a run.
  • Free-first ordering: free backends evaluated before paid ones per angle
  • CLI hooks, not MCP: same pattern as existing defuddle hook; no server wiring, no hard dependency

Net change

+78 lines in .skills/wiki-research/SKILL.md, fully additive and optional.

Test plan

  • Vault with no research-backends.md → skill runs identically to before
  • Vault with research-backends.md containing an unavailable binary → backend noted as skipped, research completes normally
  • Vault with a paid backend whose env_key is unset → backend skipped, noted in summary
  • Vault with a working free backend (e.g., defuddle) → invoked for matching URLs, output folded into extraction
  • Backend that exits non-zero → skipped for that angle, run continues

Closes #106

Introduces an optional vault file `references/research-backends.md`
that registers extra CLI retrieval backends — name, binary, invoke
template, when-to-use, cost tier, and env key. In Rounds 1–2 the
skill checks active backends against each angle/URL and folds their
output into the same claims/concepts/entities/contradictions extraction.

Key guarantees:
- No `research-backends.md` → zero change in behaviour
- Missing binary / unset env key / non-zero exit → backend skipped,
  noted in run summary, research continues via WebSearch/WebFetch
- Free-first ordering: free backends evaluated before paid ones per angle
- A backend failure never aborts a run

Ships a starter YAML registry template (defuddle, yt-dlp, perplexity-sonar)
inline in the skill for users to copy into their vault.

Closes #106

@Aspyder1 Aspyder1 left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed: scoped, additive-only (opt-in via references/research-backends.md, zero regression when absent), graceful fallback on missing binaries/env keys, CI green (install-leaves-tree-clean passing), closes #106. Looks ready to merge.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Proposal: optional pluggable retrieval backends for wiki-research (defuddle-style CLI hooks)

2 participants