Experimental merge of multiple Llama 3.2 3B models, guided by MoonRide-Index-v7. Created with mergekit.
Original model: MoonRide/Llama-3.2-3B-Khelavaster.
GGUFs made with llama.cpp (b4855). Calibration file used for creating imatrix: calibration_datav3.txt.
For best quality use Q8_0 or Q6_K quant.
- Downloads last month
- 22
Hardware compatibility
Log In
to view the estimation
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for MoonRide/Llama-3.2-3B-Khelavaster-GGUF
Base model
MoonRide/Llama-3.2-3B-Khelavaster