romitraj-ds commited on
Commit
bfb7327
·
verified ·
1 Parent(s): 4519f36

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -3
README.md CHANGED
@@ -18,11 +18,20 @@ pipeline_tag: summarization
18
  ---
19
 
20
  # Uploaded model
21
-
22
  - **Developed by:** romitraj-ds
23
  - **License:** apache-2.0
24
  - **Finetuned from model :** unsloth/llama-3-8b-bnb-4bit
 
 
 
 
 
 
 
 
 
 
 
 
25
 
26
- This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
27
 
28
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
18
  ---
19
 
20
  # Uploaded model
 
21
  - **Developed by:** romitraj-ds
22
  - **License:** apache-2.0
23
  - **Finetuned from model :** unsloth/llama-3-8b-bnb-4bit
24
+ - **Fine-tuning Method:** LoRA (Low-Rank Adaptation) using Unsloth
25
+
26
+ # Evaluation
27
+ The model was evaluated using the ROUGE metric on a subset of the `neil-code/dialogsum-test` dataset.
28
+
29
+ # Results
30
+ | Metric | Original Model | Fine-tuned Model | Improvement |
31
+ |-----------|----------------|------------------|-------------|
32
+ | rouge1 | 0.317 | 0.427 | +10.99% |
33
+ | rouge2 | 0.100 | 0.169 | +6.85% |
34
+ | rougeL | 0.262 | 0.347 | +8.54% |
35
+ | rougeLsum | 0.248 | 0.348 | +10.03% |
36
 
 
37