Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,014

Full-text search

Active filters: 8-bit

microsoft/bitnet-b1.58-2B-4T

Text Generation • Updated May 1 • 21.2k • 1.05k

lmstudio-community/DeepSeek-R1-0528-Qwen3-8B-MLX-8bit

Text Generation • Updated 8 days ago • 304k • 4

OrionCAF/qwen2_5_turkish_vlm

Updated 4 days ago • 125 • 3

HF1BitLLM/Llama3-8B-1.58-100B-tokens

Text Generation • Updated Sep 19, 2024 • 2.44k • 186

Qwen/Qwen1.5-4B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 29 • 6

MaziyarPanahi/ChatMusician-GGUF

Text Generation • Updated Mar 2, 2024 • 299 • 13

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 1.56k • 128

atcsecure/dolphin-2.9-llama3-70b-8.0bpw-h8-exl2

Text Generation • Updated May 2, 2024 • 20 • 2

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 2.19k • 25

brunopio/Llama3-8B-1.58-100B-tokens-GGUF

Text Generation • Updated Sep 19, 2024 • 2.25k • 16

MaziyarPanahi/ruadapt_qwen2.5_3B_ext_u48_instruct_v4-GGUF

Text Generation • Updated Oct 30, 2024 • 48 • 1

PrunaAI/PJMixers-Dev-Qwen2.5-RomboTiesTest-7B-bnb-8bit-smashed

Updated Dec 21, 2024 • 22 • 1

LucidityAI/pico-mini-v1-.5b

Text Generation • Updated Dec 27, 2024 • 16 • 1

RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8

Image-Text-to-Text • Updated Apr 3 • 1.27k • 5

Emilio407/nllb-200-distilled-600M-8bit

Translation • Updated Feb 22 • 168 • 1

MaziyarPanahi/ReasonFlux-F1-14B-GGUF

Text Generation • Updated Mar 24 • 38 • 1

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8

Image-Text-to-Text • Updated 7 days ago • 9.43k • 5

tiiuae/Falcon-E-3B-Instruct

Text Generation • Updated 21 days ago • 1.31k • 29

mlx-community/Qwen3-30B-A3B-8bit

Text Generation • Updated Apr 28 • 1.41k • 6

premkumarkora/qwen3-shakespeare-final

Text Generation • Updated 20 days ago • 7 • 1

mlx-community/Devstral-Small-2505-8bit

Text Generation • Updated 16 days ago • 951 • 1

bullerwins/DeepSeek-R1-0528-Qwen3-8B-exl3-8.0bpw

Text Generation • Updated 8 days ago • 42 • 1

Disya/DeepSeek-R1-0528-Qwen3-8B-exl2-8bpw-h8

Text Generation • Updated 6 days ago • 13 • 1

Cosmobillian/qwen2_5-turkish-vlm

Updated 5 days ago • 67 • 1

mlx-community/Nemotron-Research-Reasoning-Qwen-1.5B-8bit

Updated 4 days ago • 96 • 1

speakleash/Bielik-11B-v2.6-Instruct-MLX-8bit

Text Generation • Updated about 4 hours ago • 1

nm-testing/gemma-3-27b-it-quantized.w8a8

Image-Text-to-Text • Updated 18 minutes ago • 1

mlx-community/plamo-2-translate-8bit

Text Generation • Updated 1 day ago • 14 • 1

echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic

Text Classification • Updated Jun 13, 2023 • 1.9k • 1

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 15 • 1