Edit Models filters

Model Tree

meta-llama/Llama-3.1-8B

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

255

Full-text search

Active filters: meta-llama/Llama-3.1-8B

reach-vb/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • Updated Aug 1, 2024 • 11

reach-vb/Meta-Llama-3.1-8B-Q2_K-GGUF

Text Generation • Updated Aug 1, 2024 • 12 • 2

kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-c3o12

Text Generation • Updated Aug 1, 2024

kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-c3o14

Text Generation • Updated Aug 1, 2024 • 5

sgerhart/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 2, 2024 • 4 • 2

kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-4lc

Text Generation • Updated Aug 3, 2024 • 8

polyverse/Meta-Llama-3.1-8B-Q5_K_M-GGUF

Text Generation • Updated Aug 3, 2024 • 2

5fp/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 4, 2024 • 2

5fp/Meta-Llama-3.1-8B-Q4_0-GGUF

Text Generation • Updated Aug 4, 2024 • 3

fedric95/Meta-Llama-3.1-8B-GGUF

Text Generation • Updated Oct 21, 2024 • 176 • 2

FriendliAI/Meta-Llama-3.1-8B-Instruct-fp8

Text Generation • Updated Nov 3, 2024 • 23

NousResearch/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 23, 2024 • 8.63k • 120

QuantFactory/dolphin-2.9.4-llama3.1-8b-GGUF

Updated Aug 6, 2024 • 69 • 2

cognitivecomputations/dolphin-2.9.4-llama3.1-8b-gguf

Updated Aug 8, 2024 • 1.35k • 70

mlc-ai/Llama-3.1-8B-q4f32_1-MLC

Updated Sep 19, 2024 • 30

mlc-ai/Llama-3.1-8B-q4f16_1-MLC

Updated Sep 19, 2024 • 1

mlc-ai/Llama-3.1-8B-q0f16-MLC

Updated Sep 19, 2024 • 1

jdumanski/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 8, 2024 • 2

TheWonderfulTartiflette/Meta-Llama-3.1-8B-Q6_K-GGUF

Text Generation • Updated Aug 8, 2024

Thanyatad/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 9, 2024 • 1

MeikoWu/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 9, 2024 • 1

FuturisticVibes/dolphin-2.9.4-llama3.1-8b-8.0bpw-h8-exl2

Updated Aug 23, 2024 • 3

DaveLeongSG/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 13, 2024 • 3

Alex156/Meta-Llama-3.1-8B-Q2_K-GGUF

Text Generation • Updated Aug 13, 2024

winvoker/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • Updated Aug 14, 2024 • 3 • 1

lmutimb/Meta-Llama-3.1-8B-Q5_0-GGUF

Text Generation • Updated Aug 15, 2024

LoneStriker/Hermes-3-Llama-3.1-8B-3.0bpw-h6-exl2

Updated Aug 15, 2024 • 4 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-4.0bpw-h6-exl2

Updated Aug 15, 2024 • 2 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-5.0bpw-h6-exl2

Updated Aug 15, 2024 • 6 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-6.0bpw-h6-exl2

Updated Aug 15, 2024 • 3 • 2