Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

text-generation-inference

4-bit precision

Inference Endpoints

Mixture of Experts

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Models

570

Full-text search

Active filters: AWQ

solidrust/gemma-2-9b-it-SimPO-AWQ

Text Generation • Updated Sep 20, 2024 • 621 • 1

solidrust/Gemma-2-Ataraxy-9B-AWQ

Text Generation • Updated Sep 20, 2024 • 8 • 1

solidrust/gemma-2-9b-it-abliterated-AWQ

Text Generation • Updated Sep 20, 2024 • 14

solidrust/Llama-3SOME-8B-v2-AWQ

Text Generation • Updated Sep 20, 2024 • 9

solidrust/Magic_v2_8B-AWQ

Text Generation • Updated Sep 23, 2024 • 9

solidrust/L3-Luna-8B-AWQ

Text Generation • Updated Sep 23, 2024 • 9

solidrust/Chili_Dog_8B-AWQ

Text Generation • Updated Sep 23, 2024 • 13

solidrust/L3-Umbral-Mind-RP-v0.3-8B-AWQ

Text Generation • Updated Sep 23, 2024 • 11

solidrust/L3-Super-Nova-RP-8B-AWQ

Text Generation • Updated Sep 23, 2024 • 653

solidrust/Fatgirl_v2_8B-AWQ

Text Generation • Updated Sep 23, 2024 • 10

solidrust/Llama-3.1-8B-TitanFusion-v3-AWQ

Text Generation • Updated Sep 23, 2024 • 10

solidrust/Llama-3.1-8B-TitanFusion-Mix-AWQ

Text Generation • Updated Sep 23, 2024 • 10

solidrust/Llama-3-8B-Stroganoff-4.0-AWQ

Text Generation • Updated Sep 27, 2024 • 8

Esperanto/llama-3.2-3B-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024 • 7

Esperanto/llama-3.2-1B-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024

Esperanto/llama3.1-8b-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024 • 8

Esperanto/mistral-7b-kvc-AWQ-int4-onnx

Updated Dec 18, 2024 • 3

pomelk1n/RuadaptQwen2.5-32B-instruct-4-bit-AWQ-Marlin

Text Generation • Updated Nov 20, 2024 • 14

pomelk1n/RuadaptQwen2.5-32B-instruct-4-bit-AWQ-GEMM

Text Generation • Updated Nov 20, 2024 • 36 • 1

pomelk1n/RuadaptQwen2.5-32B-instruct-4-bit-AWQ-GGUF

Text Generation • Updated Nov 20, 2024 • 22 • 2

nisten/qwen2.5-coder-7b-abliterated-128k-AWQ

Text Generation • Updated Jan 7 • 14

gghfez/jukofyork_creative-writer-32b-preview-AWQ

Text Generation • Updated Dec 29, 2024 • 14

ctranslate2-4you/Phi-4-ct2-AWQ

Updated Jan 14 • 7

vital-ai/watt-tool-70B-awq

Updated Jan 24 • 12.4k • 4

noxneural/Hermes-3-Llama-3.2-3B-awq-4-bit

Text Generation • Updated Feb 8 • 53

hiauiarau/RuadaptQwen2.5-32B-Pro-Beta-AWQ

Text Generation • Updated Feb 9 • 59 • 1

JohnConnor123/RuadaptQwen2.5-14B-Instruct-1M-AWQ-64G-INT4-vGEMM

Text Generation • Updated Feb 26 • 9

dangvansam/gemma-2-9b-it-fix-system-role-awq

Text Generation • Updated Mar 8 • 457

Sumo10/Llama-3.2-3B-Instruct-AWQ-4bit

Updated Apr 25 • 8

Goraint/QwQ-32b-MLX-AWQ-4bit

Text Generation • Updated 22 days ago • 69