Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

34,779

Full-text search

Active filters: 4-bit

TheBloke/Open_Gpt4_8x7B-AWQ

Text Generation • Updated Jan 5, 2024 • 12 • 2

TheBloke/Open_Gpt4_8x7B-GPTQ

Text Generation • Updated Jan 6, 2024 • 11 • 9

nicesen/sen-llama

Text Generation • Updated Jan 6, 2024 • 11

Anarchist/llama-bad-roleplay

Text Generation • Updated Jan 6, 2024 • 25 • 2

AlignmentLab-AI/teensyorca

Text Generation • Updated Jan 13, 2024 • 22

TheBloke/zephyr-quiklang-3b-GPTQ

Text Generation • Updated Jan 6, 2024 • 20 • 1

TheBloke/LLaMA-Pro-8B-AWQ

Text Generation • Updated Jan 6, 2024 • 16 • 3

TheBloke/LLaMA-Pro-8B-GPTQ

Text Generation • Updated Jan 6, 2024 • 72 • 2

isaiahbjork/tinyllama-function-calling-v0.1-merge

Text Generation • Updated Jan 18, 2024 • 12

Danielbrdz/Barcenas-Mixtral-8x7b-4bit

Text Generation • Updated Jan 6, 2024 • 14

TheBloke/Pallas-0.5-frankenmerge-GPTQ

Text Generation • Updated Jan 6, 2024 • 17 • 1

TheBloke/Pallas-0.5-frankenmerge-AWQ

Text Generation • Updated Jan 6, 2024 • 20 • 1

TheBloke/bagel-8x7b-v0.2-GPTQ

Text Generation • Updated Jan 6, 2024 • 21 • 3

TheBloke/bagel-8x7b-v0.2-AWQ

Text Generation • Updated Jan 6, 2024 • 11 • 1

TheBloke/zephyr-quiklang-3b-4K-GPTQ

Text Generation • Updated Jan 6, 2024 • 26 • 2

TheBloke/Sensualize-Solar-10.7B-GPTQ

Text Generation • Updated Jan 6, 2024 • 24 • 8

TheBloke/Sensualize-Solar-10.7B-AWQ

Text Generation • Updated Jan 6, 2024 • 21 • 2

TheBloke/sonya-medium-x8-MoE-GPTQ

Text Generation • Updated Jan 7, 2024 • 17 • 3

danielhanchen/test2

Text Generation • Updated Jan 7, 2024 • 15

danielhanchen/test3

Text Generation • Updated Jan 7, 2024 • 10

Delosint/firsttestmodel

Updated Jan 7, 2024

TheBloke/LLaMA-Pro-8B-Instruct-GPTQ

Text Generation • Updated Jan 7, 2024 • 416 • 5

TheBloke/LLaMA-Pro-8B-Instruct-AWQ

Text Generation • Updated Jan 7, 2024 • 390 • 1

TheBloke/Noromaid-13B-v0.3-AWQ

Text Generation • Updated Jan 7, 2024 • 20 • 2

TheBloke/Noromaid-13B-v0.3-GPTQ

Text Generation • Updated Jan 7, 2024 • 18 • 9

Muhammadreza/Nucleus-1B-GPTQ

Text Generation • Updated Jan 7, 2024 • 12 • 1

KnutJaegersberg/MoMo-72B-4bit

Text Generation • Updated Jan 13, 2024 • 13

danielhanchen/test4

Text Generation • Updated Jan 7, 2024 • 10

Anarchist/myLora

Text Generation • Updated Jan 7, 2024 • 9

janphilippfranken/Mistral-7B-v0.1-awq

Text Generation • Updated Jan 8, 2024 • 14