Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

6,134

Full-text search

Active filters: gptq

Xu-Ouyang/pythia-1.4b-deduped-int4-step115000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 11

Xu-Ouyang/pythia-1.4b-deduped-int4-step129000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 10

Xu-Ouyang/pythia-6.9b-deduped-int4-step43000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 13

Xu-Ouyang/pythia-6.9b-deduped-int4-step57000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 11

Xu-Ouyang/pythia-12b-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • Updated Jul 20, 2024 • 11

Xu-Ouyang/pythia-6.9b-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 11

Xu-Ouyang/pythia-6.9b-deduped-int4-step100000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 13

Ksgk-fy/Llama-3-8B-Instruct-abliterated_gptq_prompt

Text Generation • Updated Jul 19, 2024 • 14

ModelCloud/DeepSeek-V2-Chat-0628-gptq-4bit

Text Generation • Updated Jul 20, 2024 • 22 • 3

Xu-Ouyang/pythia-6.9b-deduped-int4-step115000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 10

navubolecou/semikong-8b-GGUF

Text Generation • Updated Jul 19, 2024 • 10

acl-srw-2024/llama-3-8b-instruct-cs-gptq-2bit

Text Generation • Updated Jul 19, 2024 • 13

acl-srw-2024/llama-3-8b-instruct-scb-gptq-2bit

Text Generation • Updated Jul 19, 2024 • 14

acl-srw-2024/llama-3-8b-instruct-scb-gptq-3bit

Text Generation • Updated Jul 19, 2024 • 14

acl-srw-2024/llama-3-8b-instruct-cs-gptq-3bit

Text Generation • Updated Jul 19, 2024 • 16

Xu-Ouyang/pythia-2.8b-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 11

Xu-Ouyang/pythia-2.8b-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 11

acl-srw-2024/llama-3-8b-instruct-scb-gptq-4bit

Text Generation • Updated Jul 19, 2024 • 14

Xu-Ouyang/pythia-2.8b-deduped-int4-step43000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 11

acl-srw-2024/llama-3-8b-instruct-cs-gptq-4bit

Text Generation • Updated Jul 19, 2024 • 15

Xu-Ouyang/pythia-6.9b-deduped-int4-step129000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 8

Xu-Ouyang/pythia-2.8b-deduped-int4-step115000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 13

shuyuej/Command-R-Plus-GPTQ

Text Generation • Updated Jul 25, 2024 • 24 • 1

Xu-Ouyang/pythia-410m-deduped-int3-step14000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 24

Xu-Ouyang/pythia-410m-deduped-int3-step29000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 22

acl-srw-2024/llama-3-8b-instruct-scb-gptq-8bit

Text Generation • Updated Jul 20, 2024 • 18

Xu-Ouyang/pythia-410m-deduped-int3-step43000-GPTQ-wikitext2

Text Generation • Updated Jul 20, 2024 • 22

acl-srw-2024/llama-3-8b-instruct-cs-gptq-8bit

Text Generation • Updated Jul 20, 2024 • 14

Xu-Ouyang/pythia-2.8b-deduped-int4-step57000-GPTQ-wikitext2

Text Generation • Updated Jul 20, 2024 • 10

Xu-Ouyang/pythia-410m-deduped-int3-step57000-GPTQ-wikitext2

Text Generation • Updated Jul 20, 2024 • 22