mahihossain666
/

llama-2-70b-hf-quantized-3bits-GPTQ

Text Generation

text-generation-inference

Model card Files Files and versions Community

Quantized to 3bit precision using AutoGPTQ.

Downloads last month: 16

Safetensors

Model size

7.54B params

Tensor type

I32

·

FP16

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train mahihossain666/llama-2-70b-hf-quantized-3bits-GPTQ