Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

34,779

Full-text search

Active filters: 4-bit

unsloth/Meta-Llama-3.1-8B-Instruct-unsloth-bnb-4bit

Text Generation • Updated Feb 15 • 72.4k • 3

FINGU-AI/Chocolatine-Fusion-14B

Text Generation • Updated Feb 2 • 397 • 6

ahaduzzamanasif/CADLlama

Text Generation • Updated Feb 3 • 132 • 1

lkg67/minicpm4

Image-Text-to-Text • Updated Feb 13 • 6 • 1

nguyen599/deepseek-qwen-14b-aime-awq

Updated Feb 17 • 1 • 1

Qwen/QwQ-32B-AWQ

Text Generation • Updated Mar 11 • 19.5k • 125

LGAI-EXAONE/EXAONE-Deep-7.8B-AWQ

Text Generation • Updated Mar 19 • 359 • 14

unsloth/gemma-3-12b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated 25 days ago • 42.8k • 13

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • Updated Apr 6 • 6.69k • 11

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • Updated Apr 6 • 6.42k • 21

MaziyarPanahi/ReasonFlux-F1-14B-GGUF

Text Generation • Updated Mar 24 • 38 • 1

RichardErkhov/thrishala_-_mental_health_chatbot-4bits

Updated Mar 24 • 1 • 1

AIDC-AI/Ovis2-4B-GPTQ-Int4

Image-Text-to-Text • Updated Mar 25 • 677 • 3

hjc4869/Llama-3.3-70B-Instruct-w4g32-auto-gptq

Updated Mar 28 • 21 • 1

gaunernst/gemma-3-4b-it-qat-autoawq

Image-Text-to-Text • Updated Apr 6 • 702 • 1

gaunernst/gemma-3-27b-it-qat-autoawq

Image-Text-to-Text • Updated Apr 20 • 1.32k • 7

kishizaki-sci/Llama-4-Scout-17B-16E-Instruct-AWQ

Updated May 4 • 11.1k • 3

GusPuffy/Synthia-S1-27b-bnb-4bit

Image-Text-to-Text • Updated Apr 18 • 10 • 1

wolfofbackstreet/DeepCoder-14B-Preview-int4-qptq-v1

Text Generation • Updated Apr 23 • 94 • 1

Sumo10/Phi-4-mini-instruct-AWQ-4bit

Updated Apr 25 • 27 • 1

unsloth/Qwen3-4B-unsloth-bnb-4bit

Text Generation • Updated 24 days ago • 93.2k • 6

unsloth/Qwen3-30B-A3B-bnb-4bit

Updated 24 days ago • 30.6k • 12

unsloth/Qwen3-8B-unsloth-bnb-4bit

Updated 24 days ago • 81.1k • 3

unsloth/Qwen3-8B-bnb-4bit

Updated 24 days ago • 12.2k • 1

lmstudio-community/Qwen3-32B-MLX-4bit

Text Generation • Updated Apr 28 • 45.7k • 3

mlx-community/Qwen3-30B-A3B-4bit

Text Generation • Updated Apr 29 • 1.71k • 10

abhishekchohan/Qwen3-32B-AWQ

Updated Apr 30 • 801 • 1

Qwen/Qwen3-14B-AWQ

Text Generation • Updated 16 days ago • 48.3k • 23

kaitchup/Qwen3-14B-autoround-4bit-gptq

Updated May 2 • 485 • 1

lmstudio-community/Phi-4-mini-reasoning-MLX-4bit

Text Generation • Updated May 1 • 77k • 2