solidrust
/

dolphin-2.8-mistral-7b-v02-AWQ

Text Generation

Generated from Trainer

4-bit precision

text-generation-inference

Model card Files Files and versions

Resources

View closed (0)

Performed my own Quantization, now encounter an error while running inference with vllm.

#1 opened 1 day ago by

ryan-rozanitis-bd