Skip to content

gpt_server v0.3.5

Choose a tag to compare

@shell-nlp shell-nlp released this 20 Dec 08:17
· 232 commits to main since this release

gpt_server v0.3.5

What's Changed

  1. 兼容v1/rerank 接口 #25 #6
  2. 修复glm4的推理问题 #21
  3. 更新infinity==0.0.73 vllm==0.6.5
  4. 支持了 Phi-4
  5. 优化了 Function Calling
  6. 将pip 项目管理修改为了 uv