Skip to content

Spike: verify Foundry Local embedding-model support for RAG #496

Description

@jongalloway

Summary

The workshop is a RAG app needing both a chat model and an embedding model (semantic search). Foundry Local is focused on generative/chat SLMs; embedding-model coverage needs verification before we document it as a complete fallback.

Tasks

  • Determine whether Foundry Local can serve an embedding model usable by IEmbeddingGenerator
  • If yes: document the model + wiring, and Foundry Local becomes a full-RAG offline path
  • If no: document Foundry Local as chat-only, and keep Ollama (e.g., all-minilm) as the full-RAG offline path
  • Record the finding in the alternative-providers issue/section

Acceptance criteria

  • A definitive answer on Foundry Local embeddings, with the offline-provider docs updated accordingly.

Metadata

Metadata

Assignees

No one assigned

    Labels

    github-models-retirementUpdates to accommodate GitHub Models retirement (July 30, 2026)

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions