Edit Models filters

Model Tree

nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

46

Full-text search

Active filters: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_8.0bpw

Text Generation • Updated Dec 2, 2024 • 13

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 2, 2024 • 11

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_6.0bpw

Text Generation • Updated Dec 2, 2024 • 13

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_5.0bpw

Text Generation • Updated Dec 2, 2024 • 12

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_4.5bpw

Text Generation • Updated Dec 2, 2024 • 14

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_4.0bpw

Text Generation • Updated Dec 2, 2024 • 12

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_3.5bpw

Text Generation • Updated Dec 2, 2024 • 11

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_3.0bpw

Text Generation • Updated Dec 2, 2024 • 11

OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc

Updated Apr 24 • 2

sandbox-ai/Llama-3.1-Tango-70b-bnb_4b

Text Generation • Updated Jan 3 • 302

cnfusion/Llama-3.1-Nemotron-70B-Instruct-HF-Q2-mlx

Text Generation • Updated Dec 16, 2024 • 28

backyardai/Llama-3.1-Nemotron-70B-Instruct-GGUF

Text Generation • Updated Dec 22, 2024 • 112

matatonic/Llama-3.1-Nemotron-70B-Instruct-HF-abliterated-6.5bpw-h8-exl2

Text Generation • Updated Jan 6 • 14

EliasOenal/Llama-3.1-Nemotron-70B-Instruct-W8A8-dynamic

Text Generation • Updated Feb 12 • 10

medmekk/Llama-3.1-Nemotron-70B-Instruct-HF-bnb-4bit

Text Generation • Updated Mar 19 • 6

featherless-ai-quants/nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation • Updated 3 days ago • 132