-
-
-
-
-
-
Inference Providers
Active filters:
4bit
ModelCloud/Mistral-Nemo-Instruct-2407-gptq-4bit
Text Generation
•
3B
•
Updated
•
57
•
5
TheCluster/gemma-3-27b-it-uncensored-mlx-4bit
Image-Text-to-Text
•
Updated
•
1.22k
•
4
Chun121/Qwen3-4B-RPG-Roleplay-V2
Text Generation
•
4B
•
Updated
•
2.35k
•
4
tahamajs/Qwen3-4b-gsm8k-Qlora-SFT
Text Generation
•
Updated
•
1
tahamajs/Qwen3-4b-gsm8k-Qlora-GRPO
Text Generation
•
Updated
•
1
sweatSmile/Gemma-3-270m-Buddha-QA
Question Answering
•
Updated
•
1
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
30
•
40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
20
•
120
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
16
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
15
•
2
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
16
•
5
Ancestral/PPO_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
17
Ancestral/Dolly_Malion-6b-4bit-128g
Text Generation
•
Updated
•
17
4bit/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
15
•
3
mlabonne/gpt2-GPTQ-4bit
Text Generation
•
Updated
•
30
•
1
seonglae/opt-125m-4bit-gptq
Text Generation
•
Updated
•
13
seonglae/wizardlm-7b-uncensored-gptq
Text Generation
•
Updated
•
18
seonglae/llama-2-7b-chat-hf-gptq
Text Generation
•
Updated
•
16
seonglae/llama-2-13b-chat-hf-gptq
Text Generation
•
Updated
•
13
CalderaAI/13B-Ouroboros-GPTQ4bit-128g-CUDA
Text Generation
•
Updated
•
16
SebastianSchramm/UniNER-7B-all-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
9
•
8
SebastianSchramm/UniNER-7B-type-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
8
•
1
SebastianSchramm/UniNER-7B-definition-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
7
•
1
SebastianSchramm/UniNER-7B-type-sup-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
20
Sanrove/gpt2-GPTQ-4b
Text Generation
•
Updated
•
6
kingabzpro/zephyr-7b-beta-Agent-Instruct
Text Generation
•
Updated
•
1
SebastianSchramm/LlamaGuard-7b-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
6
•
2
A2H0H0R1/Qwen-7B-Chat-Int4-Qlora-biology
Text Generation
•
Updated
•
1
kingabzpro/phi-2-role-play
Text Generation
•
Updated
•
5
ecastera/eva-mistral-7b-spanish-GGUF
7B
•
Updated
•
56
•
8