LLMs in EXL3 format that fit into 32GB VRAM
DeusImperator
DeusImperator
AI & ML interests
None yet
Recent Activity
updated
a collection
about 21 hours ago
EXL3 models for 32GB VRAM
updated
a collection
about 21 hours ago
EXL3 models for 32GB VRAM
updated
a model
6 days ago
DeusImperator/L3.3-MS-Nevoria-70b_exl3_3.0bpw_H6
Organizations
None yet
Collections
5
70B LLMs that fit in 24GB VRAM with over 16k context (with exl2 Q4 cache)
-
DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw_rpcal
Text Generation • Updated • 23 • 1 -
DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw_rpcal_mk2
Text Generation • Updated • 17 -
DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw
Text Generation • Updated • 18 -
DeusImperator/Dark-Miqu-70B_exl2_2.4bpw
Text Generation • Updated • 10
models
53
DeusImperator/L3.3-MS-Nevoria-70b_exl3_3.0bpw_H6
Text Generation
•
Updated
•
5
DeusImperator/Legion-V2.1-LLaMa-70B_exl3_3.0bpw_H6
Text Generation
•
Updated
•
8
DeusImperator/Qwen2.5-32B-Instruct_exl2_4.7bpw_rpcal_mk2
Text Generation
•
Updated
•
20
DeusImperator/Forgotten-Abomination-24B-v1.2_exl2_6.5bpw_L
Updated
•
3
•
1
DeusImperator/Forgotten-Safeword-24B_exl2_6.5bpw_L
Updated
•
2
•
1
DeusImperator/Mistral-Small-24B-Instruct-2501_exl2_6.5bpw_L
Updated
•
3
•
6
DeusImperator/Dumpling-Qwen2.5-32B_exl2_4.5bpw_L
Text Generation
•
Updated
•
11
DeusImperator/EVA-Rombos1-Qwen2.5-32B_exl2_4.5bpw_L
Text Generation
•
Updated
•
10
DeusImperator/DeepSeek-R1-Distill-Qwen-32B_exl2_4.5bpw_L
Text Generation
•
Updated
•
12
•
1
DeusImperator/EVA-Instruct-32B-v2_exl2_4.6bpw
Text Generation
•
Updated
•
17
datasets
0
None public yet