RedHatAI
/

Qwen2.5-VL-3B-Instruct-quantized.w8a8

Image-Text-to-Text

text-generation-inference

8-bit precision

compressed-tensors

Model card Files Files and versions

Qwen2.5-VL-3B-Instruct-quantized.w8a8

Ctrl+K

Ctrl+K

3 contributors

History: 14 commits

shubhrapandit's picture

Update files to match base model keeping quant_config intact

fcd4bf9 about 1 month ago

.gitattributes

1.57 kB

Upload model files 4 months ago
README.md

15.2 kB

Update README.md 2 months ago
chat_template.json

1.05 kB

Update files to match base model keeping quant_config intact about 1 month ago
config.json

8.5 kB

Update files to match base model keeping quant_config intact about 1 month ago
generation_config.json

216 Bytes

Update files to match base model keeping quant_config intact about 1 month ago
merges.txt

1.67 MB

Update files to match base model keeping quant_config intact about 1 month ago
model-00001-of-00002.safetensors

4.74 GB
xet

Upload model files 4 months ago
model-00002-of-00002.safetensors

622 MB
xet

Upload model files 4 months ago
model.safetensors.index.json

87.5 kB

Upload model files 4 months ago
preprocessor_config.json

350 Bytes

Update files to match base model keeping quant_config intact about 1 month ago
recipe.yaml

185 Bytes

Upload model files 4 months ago
tokenizer.json

7.03 MB
xet

Update files to match base model keeping quant_config intact about 1 month ago
tokenizer_config.json

5.7 kB

Update files to match base model keeping quant_config intact about 1 month ago
vocab.json

2.78 MB

Upload model files 4 months ago