qt-spyro-hf commited on
Commit
e7a21ee
·
verified ·
1 Parent(s): 693e5fa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -23,6 +23,8 @@ CodeLlama-13B-QML is a medium-sized Language Model that requires significant com
23
 
24
  Large Language Models, including CodeLlama-13B-QML, are not designed to be deployed in isolation but instead should be deployed as part of an overall AI system with additional safety guardrails as required. Developers are expected to deploy system safeguards when building AI systems.
25
 
 
 
26
  ## How to run CodeLlama-13B-QML in cloud deployment:
27
 
28
  The configuration depends on the chosen cloud technology.
 
23
 
24
  Large Language Models, including CodeLlama-13B-QML, are not designed to be deployed in isolation but instead should be deployed as part of an overall AI system with additional safety guardrails as required. Developers are expected to deploy system safeguards when building AI systems.
25
 
26
+ The repository contains multiple files with adapters. Please notice that .gguf file, that is used by Ollama, is quantised (q_4 quant type).
27
+
28
  ## How to run CodeLlama-13B-QML in cloud deployment:
29
 
30
  The configuration depends on the chosen cloud technology.