PeterSchneider commited on
Commit
83da44a
·
verified ·
1 Parent(s): 0e13c7f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -11,7 +11,7 @@ tags:
11
  ## Description:
12
  CodeLlama-13B-QML is a large language model customized by the Qt Company for Fill-In-The-Middle code completion tasks in the QML programming language, especially for Qt Quick Controls compliant with Qt 6 releases. The CodeLlama-13B-QML model is designed for companies and individuals that want to self-host their LLM for HMI (Human Machine Interface) software development instead of relying on third-party hosted LLMs.
13
 
14
- This model reaches a score of 54% on the QML100 Benchmark for prompt-based inference with GPT4o scoring 43% and Claude 3.5 Sonnet scoring 66%. This model was fine-tuned with over 4000 human-created QML code snippets using the LoRa fine-tuning method. Llama-3.3-70B-QML is not optimised for the creation of Qt5-release compliant, C++, or Python code. Llama-3.3-70B-QML is great for human-language prompts in English but not suitable, like its base model, for Fill-In-Middle code completion tasks.
15
 
16
  ## Terms of use
17
  By accessing this model, you are agreeing to the Llama 3.2 terms and conditions of the [license](https://github.com/meta-llama/llama-models/blob/main/models/llama3_3/LICENSE), [acceptable use policy](https://github.com/meta-llama/llama-models/blob/main/models/llama3_1/USE_POLICY.md) and [Meta’s privacy policy](https://www.facebook.com/privacy/policy/). By using this model, you are furthermore agreeing to [Qt AI Model terms & conditions](https://www.qt.io/terms-conditions).
 
11
  ## Description:
12
  CodeLlama-13B-QML is a large language model customized by the Qt Company for Fill-In-The-Middle code completion tasks in the QML programming language, especially for Qt Quick Controls compliant with Qt 6 releases. The CodeLlama-13B-QML model is designed for companies and individuals that want to self-host their LLM for HMI (Human Machine Interface) software development instead of relying on third-party hosted LLMs.
13
 
14
+ This model reaches a score of 79% on the QML100 Fill-In-The-Middle code completion benchmark for Qt6-compliant code. In comparison, GPT4o scored 62%, Claude 3.5 Sonnet scored 68%, and the un-tuned CodeLlama-13B-hf 66%. This model was fine-tuned based on raw data from 4000 human-created QML code snippets using the LoRa fine-tuning method. CodeLlama-13B-QML is not optimised for the creation of Qt5-release compliant, C++, or Python code.
15
 
16
  ## Terms of use
17
  By accessing this model, you are agreeing to the Llama 3.2 terms and conditions of the [license](https://github.com/meta-llama/llama-models/blob/main/models/llama3_3/LICENSE), [acceptable use policy](https://github.com/meta-llama/llama-models/blob/main/models/llama3_1/USE_POLICY.md) and [Meta’s privacy policy](https://www.facebook.com/privacy/policy/). By using this model, you are furthermore agreeing to [Qt AI Model terms & conditions](https://www.qt.io/terms-conditions).