Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

通过xinference部署的FLUX.1-dev量化版本Q4_k_s 在dify内调用失败 #2832

Closed
1 of 3 tasks
XiaoCC opened this issue Feb 10, 2025 · 6 comments · Fixed by #2897
Closed
1 of 3 tasks

通过xinference部署的FLUX.1-dev量化版本Q4_k_s 在dify内调用失败 #2832

XiaoCC opened this issue Feb 10, 2025 · 6 comments · Fixed by #2897
Labels
Milestone

Comments

@XiaoCC
Copy link

XiaoCC commented Feb 10, 2025

System Info / 系統信息

docker部署的dify0.15.3和xinference1.2.2 cuda版本12.4

Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?

  • docker / docker
  • pip install / 通过 pip install 安装
  • installation from source / 从源码安装

Version info / 版本信息

docker部署的dify0.15.3和xinference1.2.2

The command used to start Xinference / 用以启动 xinference 的命令

通过docker启动

Reproduction / 复现过程

通过xinference部署好了量化版本的flux 在xinference的webui能正常出图,接入dify的xinference的stablediffusion插件后无法生图报错信息如下图

langgenius/dify#8385 这个插件

image
image
image
xinference里面部署的是Q4_k_s量化版本的flux dev

image
xinference这边能正常出图 帮忙看看是不是这个插件问题,谢谢

Expected behavior / 期待表现

希望能在dify里面正常调用xinference的flux模型出图

@XiaoCC
Copy link
Author

XiaoCC commented Feb 10, 2025

@qinxuye 找到问题 是xinference这边 只要选了任意一个Sampling method webui也报错 只有保持原本的default才能正常出图,而dify的xinference插件的Sampling method默认值是sampler_name": "DPM++ 2M“ 并且前端无法修改,导致异常报错,麻烦修复一下

Image

@XiaoCC XiaoCC closed this as completed Feb 10, 2025
@XiaoCC XiaoCC reopened this Feb 10, 2025
@qinxuye
Copy link
Contributor

qinxuye commented Feb 10, 2025

明白了,Flux 确实是无法选择这些 scheduler 的,对于 flux 只能 ignore 这个参数了。

@XiaoCC
Copy link
Author

XiaoCC commented Feb 10, 2025

明白了,Flux 确实是无法选择这些 scheduler 的,对于 flux 只能 ignore 这个参数了。

那是需要修改dify那边的xinference插件么

@qinxuye
Copy link
Contributor

qinxuye commented Feb 10, 2025

明白了,Flux 确实是无法选择这些 scheduler 的,对于 flux 只能 ignore 这个参数了。

那是需要修改dify那边的xinference插件么

xinf 这边修改吧。

@XiaoCC
Copy link
Author

XiaoCC commented Mar 17, 2025

这个工具插件在dify1.0.1应用市场里面没有???

@qinxuye
Copy link
Contributor

qinxuye commented Mar 17, 2025

Xinference 的 sd 工具?这我还真不清楚 dify,能问下吗?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
3 participants