Update README.md
Browse files
README.md
CHANGED
@@ -18,11 +18,20 @@ pipeline_tag: summarization
|
|
18 |
---
|
19 |
|
20 |
# Uploaded model
|
21 |
-
|
22 |
- **Developed by:** romitraj-ds
|
23 |
- **License:** apache-2.0
|
24 |
- **Finetuned from model :** unsloth/llama-3-8b-bnb-4bit
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
25 |
|
26 |
-
This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
27 |
|
28 |
-
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
|
|
18 |
---
|
19 |
|
20 |
# Uploaded model
|
|
|
21 |
- **Developed by:** romitraj-ds
|
22 |
- **License:** apache-2.0
|
23 |
- **Finetuned from model :** unsloth/llama-3-8b-bnb-4bit
|
24 |
+
- **Fine-tuning Method:** LoRA (Low-Rank Adaptation) using Unsloth
|
25 |
+
|
26 |
+
# Evaluation
|
27 |
+
The model was evaluated using the ROUGE metric on a subset of the `neil-code/dialogsum-test` dataset.
|
28 |
+
|
29 |
+
# Results
|
30 |
+
| Metric | Original Model | Fine-tuned Model | Improvement |
|
31 |
+
|-----------|----------------|------------------|-------------|
|
32 |
+
| rouge1 | 0.317 | 0.427 | +10.99% |
|
33 |
+
| rouge2 | 0.100 | 0.169 | +6.85% |
|
34 |
+
| rougeL | 0.262 | 0.347 | +8.54% |
|
35 |
+
| rougeLsum | 0.248 | 0.348 | +10.03% |
|
36 |
|
|
|
37 |
|
|