Hugging Face's logo

jondurbin
/
airoboros-180b-2.2.1-checkpoints

Model card Files Community
jondurbin commited on
Commit
b961926
·
1 Parent(s): e1c3f6a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -2,4 +2,10 @@
2
  license: other
3
  license_name: falcon-180b
4
  license_link: LICENSE
 
 
5
  ---
 
 
 
 
 
2
  license: other
3
  license_name: falcon-180b
4
  license_link: LICENSE
5
+ datasets:
6
+ - jondurbin/airoboros-2.2.1
7
  ---
8
+
9
+ QLoRA peft adapters at various checkpoints, fine-tuning on the airoboros-2.2.1 dataset with rope_scaling to 4k context.
10
+
11
+ https://wandb.ai/jondurbin/airoboros-180b-2.2.1/runs/ns3deq73?workspace=user-jondurbin