Provide the V1 tokenizer inventory activation bridge - #1168
Conversation
|
Important Review skippedDraft detected. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Organization UI Review profile: CHILL Plan: Pro Plus Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
This pull request is currently a draft. Reviews will not take place until the PR is marked as ready for review. |
18aeb33 to
5303997
Compare
04efbfa to
05b4afe
Compare
Purpose
Provide the V1 native-serving-plugin activation contract for tokenizer-aware serving plugins.
Design
ActivationContextcarries a borrowedTokenizerInventoryViewwith native token IDs, byte pieces, and control-token identities.activatereturns.mesh_native_serving_plugin_v1.Use
A tokenizer-aware plugin can build an immutable native-token table during activation. Vocabulary discovery and table construction therefore complete before the proposal/decode path.
Dependency
This draft is based on #1149, which provides the native serving-plugin host and generation lifecycle.
Validation
just with-lld cargo test -p model-artifact -p mesh-native-serving-plugin-host -p skippy-serverjust with-lld cargo clippy -p model-artifact -p mesh-native-serving-plugin-host -p skippy-server -- -D warnings