Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

2,287

Full-text search

Active filters: quantized

RedHatAI/DeepSeek-R1-0528-quantized.w4a16

Text Generation • Updated 3 days ago • 316 • 5

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • Updated 6 days ago • 9.45k • 20

Tonic/GemmaX2-28-2B-4bit

Translation • Updated Feb 26 • 91 • 3

ABDALLALSWAITI/FLUX.1-dev-ControlNet-Union-Pro-2.0-fp8

Text-to-Image • Updated Apr 19 • 5.27k • 28

jedisct1/MiMo-7B-RL-GGUF

Updated Apr 30 • 8k • 21

Gapeleon/bytedance_BAGEL-7B-MoT-INT8

Any-to-Any • Updated 10 days ago • 381 • 23

meimeilook/BAGEL-7B-MoT-FP8

Any-to-Any • Updated 6 days ago • 12

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • Updated 7 days ago • 39.1k • 2

legraphista/Nxcode-CQ-7B-orpo-IMat-GGUF

Text Generation • Updated Jun 2, 2024 • 561 • 1

qualcomm/Posenet-Mobilenet-Quantized

Keypoint Detection • Updated Apr 9 • 136 • 5

MaziyarPanahi/ruadapt_qwen2.5_3B_ext_u48_instruct_v4-GGUF

Text Generation • Updated Oct 30, 2024 • 43 • 1

RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic

Text Generation • Updated 6 days ago • 6.81k • 6

MaziyarPanahi/ReasonFlux-F1-14B-GGUF

Text Generation • Updated Mar 24 • 37 • 1

boltuix/NeuroBERT-Tiny

Text Classification • Updated 13 days ago • 230 • 10

nvidia/Llama-4-Maverick-17B-128E-Instruct-FP8

Updated 7 days ago • 242 • 3

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text • Updated 6 days ago • 1.43k • 4

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8

Image-Text-to-Text • Updated 6 days ago • 9.48k • 5

RedHatAI/Qwen3-14B-FP8-dynamic

Text Generation • Updated 23 days ago • 159 • 1

patf82/Absolute_Zero_Reasoner-Coder-14b-5.0bpw-exl3

Updated 22 days ago • 8 • 4

HagalazAI/CyberDolphin-2.9.3-mistral-nemo-12b-GGUF

Text Generation • Updated 13 days ago • 663 • 2

Jimmi42/sarvam-m-4bit-mlx

Text Generation • Updated 10 days ago • 18 • 1

roylin1003/royal-zhTW-ID-f16.gguf

Text Generation • Updated 2 days ago • 9 • 1

roylin1003/royal-ZhTW-ID-q4_k_m

Text Generation • Updated 2 days ago • 13 • 1

Lewdiculous/InfinityRP-v1-7B-GGUF-IQ-Imatrix

Updated May 4, 2024 • 458 • 45

ravenscroftj/CodeGen-350M-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 2

ravenscroftj/CodeGen-2B-multi-ggml-quant

Text Generation • Updated Aug 5, 2023 • 2

ravenscroftj/CodeGen-6B-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 9

ethzanalytics/dolly-v2-12b-sharded-8bit

Text Generation • Updated Apr 29, 2023 • 15 • 4

ethzanalytics/dolly-v2-7b-sharded-8bit

Text Generation • Updated Jun 28, 2023 • 13 • 1

pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit

Summarization • Updated Jan 21 • 28