llguidance support

[yujonglee]

• https://github.com/guidance-ai/llguidance has C api
• can replace existing tool calling logic, and allow user to provide grammar

[HenryNdubuaku]

@yujonglee thanks for this, did you fix from your end or we should?

[yujonglee]

I haven’t worked on it yet - just suggestion & feature request

[yujonglee]

maybe this is easier once we're done with the Kernel→C++, Graph/Engine→Rust transition.

[DuFanYin]

@HenryNdubuaku @yujonglee hi if this is still a TO-DO item, im happy to work on it!

[asuzukosi]

I think someone is currently working on CFG with xgrammer