bartowski commited on
Commit
b953234
·
verified ·
1 Parent(s): aca3580

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -36,6 +36,8 @@ license: apache-2.0
36
 
37
  ## Llamacpp imatrix Quantizations of Devstral-Small-2505 by mistralai
38
 
 
 
39
  Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b5432">b5432</a> for quantization.
40
 
41
  Original model: https://huggingface.co/mistralai/Devstral-Small-2505
@@ -46,6 +48,12 @@ Run them in [LM Studio](https://lmstudio.ai/)
46
 
47
  Run them directly with [llama.cpp](https://github.com/ggerganov/llama.cpp), or any other llama.cpp based project
48
 
 
 
 
 
 
 
49
  ## Prompt format
50
 
51
  ```
 
36
 
37
  ## Llamacpp imatrix Quantizations of Devstral-Small-2505 by mistralai
38
 
39
+ ### Created using Unsloth's conversion (huge thanks for uploading it) from here: https://huggingface.co/unsloth/Devstral-Small-2505
40
+
41
  Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b5432">b5432</a> for quantization.
42
 
43
  Original model: https://huggingface.co/mistralai/Devstral-Small-2505
 
48
 
49
  Run them directly with [llama.cpp](https://github.com/ggerganov/llama.cpp), or any other llama.cpp based project
50
 
51
+ ## Vision support thanks to ngxson
52
+
53
+ ngxson has shown that the original mmproj from Mistral Small 3.1 works seamlessly with Devstral Small, so the mmproj file is here for vision use!
54
+
55
+ Note this is not official, and may not work perfectly, but in practice seems functional!
56
+
57
  ## Prompt format
58
 
59
  ```