--- license: llama3.3 --- SmartQuant v1 of Llama-3.3-70B-Instruct in just 2.39 bpw. With just 19.60GB it compares to those two: * Llama-3.3-70B-Instruct-IQ2_XS.gguf IQ2_XS 21.14GB false Low quality, uses SOTA techniques to be usable. * Llama-3.3-70B-Instruct-IQ2_XXS.gguf IQ2_XXS 19.10GB false Very low quality, uses SOTA techniques to be usable. I'll do some qualification and perplexity runs next.