Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

34,798

Full-text search

Active filters: 4-bit

kaitchup/Qwen3-14B-autoround-4bit-gptq

Updated May 2 • 485 • 1

lmstudio-community/Phi-4-mini-reasoning-MLX-4bit

Text Generation • Updated May 1 • 77k • 2

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • Updated 17 days ago • 66.4k • 14

Jh0mpis/gemma-3-4b-physics-instruct-alpaca-model

Updated May 6 • 6 • 1

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated 17 days ago • 7.32k • 14

mlx-community/gemma-3-12b-it-4bit-DWQ

Text Generation • Updated 19 days ago • 759 • 2

mlx-community/gemma-3-27b-it-4bit-DWQ

Text Generation • Updated 23 days ago • 710 • 2

lmstudio-community/Devstral-Small-2505-MLX-4bit

Text Generation • Updated 18 days ago • 198k • 4

unsloth/medgemma-4b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated 17 days ago • 6.97k • 1

unsloth/Devstral-Small-2505-unsloth-bnb-4bit

Text2Text Generation • Updated 13 days ago • 2.14k • 4

unsloth/Devstral-Small-2505-bnb-4bit

Text2Text Generation • Updated 13 days ago • 2.07k • 3

mlx-community/Devstral-Small-2505-4bit-DWQ

Text Generation • Updated 16 days ago • 758 • 4

OrionCAF/TurkishEducation

Updated 15 days ago • 4 • 3

Jimmi42/sarvam-m-4bit-mlx

Text Generation • Updated 12 days ago • 25 • 1

mlx-community/DeepSeek-R1-0528-4bit

Text Generation • Updated 9 days ago • 2.22k • 9

lmstudio-community/DeepSeek-R1-0528-Qwen3-8B-MLX-4bit

Text Generation • Updated 9 days ago • 311k • 1

unsloth/DeepSeek-R1-0528-Qwen3-8B-bnb-4bit

Text Generation • Updated about 18 hours ago • 1.55k • 3

yxccai/text-style-converter

Text Generation • Updated 4 days ago • 73 • 1

sid22669/Llama-3.2-1b-instruct-bnb-4bit

Text Generation • Updated 7 days ago • 78 • 1

VortexHunter23/LeoPARD-Coder-0.1

Text Generation • Updated 7 days ago • 18 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Lite

Text Generation • Updated 3 days ago • 49 • 1

Intel/DeepSeek-R1-0528-Qwen3-8B-int4-AutoRound-awq-inc

Updated 6 days ago • 781 • 1

MetaphoricalCode/Synthia-S1-27b-exl3-4bpw-hb6

Image-Text-to-Text • Updated 6 days ago • 15 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Compact

Text Generation • Updated 3 days ago • 302 • 1

ziyingchen1106/Llama-3.2-3B-Instruct-fp16-lora-gptqmodel-4bit

Text Generation • Updated 6 days ago • 23 • 1

mlx-community/Qwen3-4B-4bit-DWQ-053125

Text Generation • Updated 6 days ago • 212 • 1

mlx-community/Qwen3-8B-4bit-DWQ-053125

Text Generation • Updated 5 days ago • 178 • 1

mlx-community/Qwen3-14B-4bit-DWQ-053125

Text Generation • Updated 5 days ago • 174 • 1

xwzagan/Qwen3-14b-windmaster-4bit

Updated 4 days ago • 28 • 1

c1uc/Llama-3.2-3B-Instruct-lora-4bit-g128

Updated 4 days ago • 361 • 1