ggml-org
/

Qwen2.5-VL-3B-Instruct-GGUF

Model card Files Files and versions

Qwen2.5-VL-3B-Instruct

Original model: https://huggingface.co/Qwen/Qwen2.5-VL-3B-Instruct

Downloads last month: 5,105

GGUF

Model size

3.09B params

Architecture

qwen2vl

Hardware compatibility

Log In to view the estimation

4-bit

8-bit

16-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/Qwen2.5-VL-3B-Instruct-GGUF

Base model

Qwen/Qwen2.5-VL-3B-Instruct

Quantized

(32)

this model

Collection including ggml-org/Qwen2.5-VL-3B-Instruct-GGUF

Qwen 2 VL and Qwen 2.5 VL

4 items • Updated 24 days ago