Update README.md
Browse files
README.md
CHANGED
@@ -36,6 +36,8 @@ license: apache-2.0
|
|
36 |
|
37 |
## Llamacpp imatrix Quantizations of Devstral-Small-2505 by mistralai
|
38 |
|
|
|
|
|
39 |
Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b5432">b5432</a> for quantization.
|
40 |
|
41 |
Original model: https://huggingface.co/mistralai/Devstral-Small-2505
|
@@ -46,6 +48,12 @@ Run them in [LM Studio](https://lmstudio.ai/)
|
|
46 |
|
47 |
Run them directly with [llama.cpp](https://github.com/ggerganov/llama.cpp), or any other llama.cpp based project
|
48 |
|
|
|
|
|
|
|
|
|
|
|
|
|
49 |
## Prompt format
|
50 |
|
51 |
```
|
|
|
36 |
|
37 |
## Llamacpp imatrix Quantizations of Devstral-Small-2505 by mistralai
|
38 |
|
39 |
+
### Created using Unsloth's conversion (huge thanks for uploading it) from here: https://huggingface.co/unsloth/Devstral-Small-2505
|
40 |
+
|
41 |
Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b5432">b5432</a> for quantization.
|
42 |
|
43 |
Original model: https://huggingface.co/mistralai/Devstral-Small-2505
|
|
|
48 |
|
49 |
Run them directly with [llama.cpp](https://github.com/ggerganov/llama.cpp), or any other llama.cpp based project
|
50 |
|
51 |
+
## Vision support thanks to ngxson
|
52 |
+
|
53 |
+
ngxson has shown that the original mmproj from Mistral Small 3.1 works seamlessly with Devstral Small, so the mmproj file is here for vision use!
|
54 |
+
|
55 |
+
Note this is not official, and may not work perfectly, but in practice seems functional!
|
56 |
+
|
57 |
## Prompt format
|
58 |
|
59 |
```
|