Skip to content

0.9.1 - NVIDIA NIM Chat and Embeddings API Integration
Compare
Choose a tag to compare
@Cyb3rWard0g Cyb3rWard0g released this 12 Jan 06:54
· 97 commits to main since this release
0.9.1
391dc33
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

This release introduces integration with NVIDIA NIM (Inference Microservice), enabling Floki to leverage NVIDIA's Chat and Embeddings APIs. NIM microservices offer standardized APIs, enabling effortless integration into AI-driven applications and workflows.

What's Changed

  • Integration of NVIDIA LLM Client with Enhanced Structured Response Support by @Cyb3rWard0g in #18
  • Integration of NVIDIA Embedding Client and Embedder by @Cyb3rWard0g in #19
  • Fix Structured Output Parsing for Chat Completion Responses and Prepare for v0.9.1 Release by @Cyb3rWard0g in #20

Full Changelog: 0.8.1...0.9.1

Contributors

Cyb3rWard0g
Assets 2
Loading