Usage

[zhouyizhuo]

@xiaren-qincai Hi, how to use this model?

[xiaren-qincai]

just run inference with ms-swift vllm infer

https://swift.readthedocs.io/zh-cn/latest/Instruction/%E6%8E%A8%E7%90%86%E5%92%8C%E9%83%A8%E7%BD%B2.html

[zhouyizhuo]

just run inference with ms-swift vllm infer

https://swift.readthedocs.io/zh-cn/latest/Instruction/%E6%8E%A8%E7%90%86%E5%92%8C%E9%83%A8%E7%BD%B2.html

@xiaren-qincai Hi, can i use it like the original qwenvl-2.5?
https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct

[xiaren-qincai]

just run inference with ms-swift vllm infer
https://swift.readthedocs.io/zh-cn/latest/Instruction/%E6%8E%A8%E7%90%86%E5%92%8C%E9%83%A8%E7%BD%B2.html

@xiaren-qincai Hi, can i use it like the original qwenvl-2.5? https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct

Yep
use it just like the original model, and we recommend using vLLM for faster inference.