Hugging Face's logo

Qwen
/
Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text
Transformers
Safetensors
English
qwen2_5_vl
multimodal
conversational
text-generation-inference
4-bit precision
awq
Model card Files
xet
Community
8

AWQ quantization script to Qwen-VL-2.5 7B model

#8
by Berkesule - opened
Discussion
Berkesule

Hi, great work on Qwen-VL-2.5! I was wondering if there is a script or official code available to apply AWQ quantization to the original Qwen-VL-2.5 7B model?

Sign up or log in to comment