Edit Models filters

Inference Providers

Misc

GGUF

Inference Endpoints

4-bit precision

8-bit precision

Merge

text-generation-inference

text-embeddings-inference

Models

6,302

Full-text search

Active filters: GGUF

kalle07/embedder_collection

MaziyarPanahi/ReasonFlux-F1-14B-GGUF

Text Generation • Updated Mar 24 • 37 • 1

DavidAU/Gemma-3-Nine-Rings-of-Power-Fiction-Horror-4b-it-GGUF

Text Generation • Updated Mar 25 • 6.42k • 1

DavidAU/Fallen-Gemma-3-Nine-Rings-of-Power-4b-it-GGUF

Text Generation • Updated Mar 25 • 329 • 3

kroonen/OpenOrca-Platypus2-13B-GGUF

Updated Aug 30, 2023 • 2 • 2

Mozilla/llava-v1.5-7b-llamafile

Updated Apr 1 • 6.82k • 183

Trelis/openchat_3.5-function-calling-v3

Text Generation • Updated Mar 6, 2024 • 20

TIGER-Lab/TIGERScore-7B-GGUF

Text2Text Generation • Updated Dec 5, 2023 • 21 • 2

TIGER-Lab/TIGERScore-13B-GGUF

Text2Text Generation • Updated Dec 5, 2023 • 10 • 1

cosimoiaia/Loquace-7B-Mistral-GGUF

Updated Dec 16, 2023 • 9 • 3

tsunemoto/Magicoder-S-CL-7B-GGUF

Updated Dec 13, 2023 • 54 • 4

tsunemoto/SOLAR-10.7B-Instruct-v1.0-GGUF

Updated Dec 13, 2023 • 38

tsunemoto/bagel-dpo-7b-v0.1-GGUF

Updated Dec 13, 2023 • 30

tsunemoto/openchat-3.5-1210-GGUF

Updated Dec 14, 2023 • 57 • 1

tsunemoto/ToxicHermes-2.5-Mistral-7B-GGUF

Updated Dec 17, 2023 • 25 • 1

tsunemoto/dopeyshearedplats-1.3b-v1-GGUF

Updated Dec 17, 2023 • 19

tsunemoto/dolphin-2.5-mixtral-8x7b-GGUF

Updated Dec 17, 2023 • 55 • 1

tsunemoto/Mistral-7B-Instruct-v0.2-GGUF

Updated Feb 18, 2024 • 78

tsunemoto/MiniChat-1.5-3B-GGUF

Updated Dec 18, 2023 • 17 • 2