Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

130

Full-text search

Active filters: 8b

Triangle104/Llama3.1-8B-ShiningValiant2-Q5_K_M-GGUF

Text Generation • Updated Nov 24, 2024 • 12 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q6_K-GGUF

Text Generation • Updated Nov 24, 2024 • 7 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q8_0-GGUF

Text Generation • Updated Nov 24, 2024 • 10 • 1

itlwas/Kosmos-8B-v1-Q4_K_M-GGUF

Updated Dec 18, 2024 • 1

itlwas/CursedMatrix-8B-v9-Q4_K_M-GGUF

Updated Dec 18, 2024 • 1 • 1

QuantFactory/Multilingual-SaigaSuzume-8B-GGUF

Updated Dec 21, 2024 • 80 • 2

Triangle104/Llama3.1-8B-PlumMath-Q4_K_S-GGUF

Text Generation • Updated Dec 26, 2024 • 2

Triangle104/Llama3.1-8B-PlumMath-Q4_K_M-GGUF

Text Generation • Updated Dec 26, 2024 • 4

Triangle104/Llama3.1-8B-PlumMath-Q5_K_S-GGUF

Text Generation • Updated Dec 26, 2024 • 10

Triangle104/Llama3.1-8B-PlumMath-Q6_K-GGUF

Text Generation • Updated Dec 26, 2024 • 6

Triangle104/Llama3.1-8B-PlumMath-Q5_K_M-GGUF

Text Generation • Updated Dec 26, 2024 • 3

Triangle104/Llama3.1-8B-PlumMath-Q8_0-GGUF

Text Generation • Updated Dec 26, 2024 • 9

matrixportal/Kosmos-8B-v1-Q4_K_S-GGUF

Updated Jan 3 • 5 • 2

matrixportal/Multilingual-SaigaSuzume-8B-Q4_K_S-GGUF

Updated Jan 3 • 1

matrixportal/Kosmos-8B-v1-Q4_K_M-GGUF

Updated Jan 9 • 2 • 2

matrixportal/Kosmos-8B-v1-GGUF

Updated Jan 13 • 3 • 1

matrixportal/CursedMatrix-8B-v9-GGUF

Updated Jan 14 • 6 • 1

Triangle104/Llama3.1-8B-PlumCode-Q4_K_S-GGUF

Updated Jan 18 • 4

Triangle104/Llama3.1-8B-PlumCode-Q4_K_M-GGUF

Updated Jan 18 • 8

Triangle104/Llama3.1-8B-PlumCode-Q5_K_S-GGUF

Updated Jan 18 • 5

Triangle104/Llama3.1-8B-PlumCode-Q5_K_M-GGUF

Updated Jan 18 • 8

Triangle104/Llama3.1-8B-PlumCode-Q6_K-GGUF

Updated Jan 18 • 2

Triangle104/Llama3.1-8B-PlumCode-Q8_0-GGUF

Updated Jan 18 • 8

roleplaiapp/internlm3-8b-instruct-Q2_K-GGUF

Text Generation • Updated Jan 19 • 19

roleplaiapp/internlm3-8b-instruct-Q3_K_S-GGUF

Text Generation • Updated Jan 19 • 8

roleplaiapp/internlm3-8b-instruct-Q3_K_M-GGUF

Text Generation • Updated Jan 19 • 2

roleplaiapp/internlm3-8b-instruct-Q3_K_L-GGUF

Text Generation • Updated Jan 19 • 4

roleplaiapp/internlm3-8b-instruct-Q4_0-GGUF

Text Generation • Updated Jan 19 • 10

roleplaiapp/internlm3-8b-instruct-Q4_K_S-GGUF

Text Generation • Updated Jan 19 • 2

roleplaiapp/internlm3-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Jan 19 • 7