Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

20,339

Full-text search

Active filters: llama-cpp

Triangle104/Theta-Crucis-0.6B-Turbo1-Q8_0-GGUF

Text Generation • Updated 5 days ago • 6 • 1

Triangle104/OpenCodeReasoning-Nemotron-7B-Q8_0-GGUF

Text Generation • Updated 5 days ago • 15 • 1

tetsajin/Josiefied-Qwen3-14B-abliterated-v3-Q6_K-GGUF

Text Generation • Updated 4 days ago • 51 • 1

NikolayKozloff/Nemotron-Research-Reasoning-Qwen-1.5B-Q8_0-GGUF

Updated 3 days ago • 35 • 1

sizzlebop/Holo1-7B-Q8_0-GGUF

Image-Text-to-Text • Updated 3 days ago • 42 • 1

NikolayKozloff/Homunculus-Q5_K_M-GGUF

Updated 3 days ago • 1

NikolayKozloff/Homunculus-Q6_K-GGUF

Updated 3 days ago • 1

BlackBeenie/DeepSeek-R1-0528-Qwen3-8B-Q4_K_M-GGUF

Updated 2 days ago • 43 • 1

JohnRoger/AReaL-boba-2-14B-Q8_0-GGUF

Text Generation • Updated 1 day ago • 5 • 1

JohnRoger/VisCoder-7B-Q8_0-GGUF

Updated about 18 hours ago • 3 • 1

openfree/Gemma-3-R1984-27B-Q8_0-GGUF

Image-Text-to-Text • Updated Mar 30 • 880 • 14

openfree/Gemma-3-R1984-27B-Q6_K-GGUF

Image-Text-to-Text • Updated Mar 30 • 110 • 10

openfree/Gemma-3-R1984-12B-Q8_0-GGUF

Image-Text-to-Text • Updated Mar 30 • 308 • 15

openfree/Gemma-3-R1984-12B-Q6_K-GGUF

Image-Text-to-Text • Updated Mar 30 • 345 • 14

openfree/QwQ-R1984-32B-Q8_0-GGUF

Updated Mar 31 • 197 • 11

DavidAU/Buttocks-7B-v1.0-Q6_K-GGUF

Updated Apr 10, 2024 • 210 • 10

DavidAU/llama-2-16b-nastychat-Q6_K-GGUF

Updated Apr 9, 2024 • 216 • 9

DavidAU/DarkForest-20B-v2.0-Q6_K-GGUF

Updated Apr 10, 2024 • 95 • 3

Novaciano/QwQ-0.5B-Distilled_and_Uncensored-GGUF

Updated Dec 28, 2024 • 34 • 2

cs2764/Qwen2.5-QwQ-37B-Eureka-Triple-Cubed-abliterated-uncensored-h-novel-Q4_K_M-GGUF

Updated Apr 24 • 68 • 1

Triangle104/L3.1-Dark-Reasoning-Jamet-8B-MK.I-Hermes-R1-Uncensored-8B-Q6_K-GGUF

Text Generation • Updated 5 days ago • 231 • 1

arkii/chatglm2-6b-ggml

Updated Jul 26, 2023 • 6

BUT-FIT/csmpt7b

Text Generation • Updated 16 days ago • 1.93k • 14

pcuenq/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated Mar 29, 2024 • 18

reach-vb/phi-2-Q2_K-GGUF

Text Generation • Updated Mar 27, 2024 • 29

reach-vb/TinyLlama-1.1B-Chat-v1.0-Q2_K-GGUF

Updated Jun 19, 2024 • 109

reach-vb/TinyLlama-1.1B-Chat-v1.0-Q8_0-GGUF

Updated Mar 27, 2024 • 5

osanseviero/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated Mar 27, 2024 • 1

LeroyDyer/Language_VisionModel_GGUF

Image-Text-to-Text • Updated Aug 26, 2024 • 48 • 2

reach-vb/TinyLlama-1.1B-Chat-v1.0-Q6_K-GGUF

Updated Mar 28, 2024 • 10