Any chance of creating these with RoPE/Yarn for a context size larger than 32k?
5
#2 opened 29 days ago
by
smcleod
SOTA score
🔥
2
#1 opened about 1 month ago
by
oobabooga