Models

OPEA/Meta-Llama-3.1-70B-Instruct-int4-asym-inc

11B • Updated Apr 30 • 3 • 1

OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc

11B • Updated Apr 24 • 3 • 1

bartowski/Llama-3.3-70B-Instruct-exl2

Text Generation • Updated Dec 20, 2024 • 3 • 3

etemiz/Llama-3.1-70B-Instruct-GGUF

71B • Updated Dec 19, 2024 • 13

RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic

Text Generation • 71B • Updated May 30 • 17.9k • 9

RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16

Text Generation • 11B • Updated May 30 • 7.46k • 2

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16

Text Generation • 11B • Updated Jan 3 • 8

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w8a8

Text Generation • 71B • Updated Jan 3 • 5

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q2_K-GGUF

Text Generation • 71B • Updated Jan 19 • 5

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S-GGUF

Text Generation • 71B • Updated Jan 19 • 4

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M-GGUF

Text Generation • 71B • Updated Jan 19 • 8

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L-GGUF

Text Generation • 71B • Updated Jan 19 • 5

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_0-GGUF

Text Generation • 71B • Updated Jan 19 • 12

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S-GGUF

Text Generation • 71B • Updated Jan 19 • 3

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M-GGUF

Text Generation • 71B • Updated Jan 19 • 35 • 1

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_0-GGUF

Text Generation • 71B • Updated Jan 19 • 2

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S-GGUF

Text Generation • 71B • Updated Jan 19 • 1

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M-GGUF

Text Generation • 71B • Updated Jan 19 • 9

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K-GGUF

Text Generation • 71B • Updated Jan 19 • 1

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q8_0-GGUF

Text Generation • 71B • Updated Jan 19 • 1

tensorblock/Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated about 1 month ago • 48

context-labs/neuralmagic-llama-3.1-70b-instruct-FP8

Text Generation • 71B • Updated Feb 24 • 5

necva/replicate-IEPile-Llama3.1-70B

37B • Updated Mar 10 • 2

necva/replica-IEPile-Llama3.1-70B

37B • Updated Mar 10 • 3

Mungert/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation • 71B • Updated Jun 15 • 193 • 5

jusjinuk/Llama-3.1-70B-Instruct-2bit-GuidedQuant-QTIP

11B • Updated Jun 19 • 7

jusjinuk/Llama-3.1-70B-Instruct-3bit-GuidedQuant-QTIP

15B • Updated Jun 19 • 6

jusjinuk/Llama-3.1-70B-Instruct-4bit-GuidedQuant-QTIP

19B • Updated Jun 19 • 6

RedHatAI/Llama-3.1-70B-Instruct-NVFP4

Text Generation • 41B • Updated Jun 30 • 113

RedHatAI/Llama-3.1-70B-Instruct-NVFP4A16

Text Generation • 41B • Updated Jun 30 • 47