Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling
Paper
•
2401.16380
•
Published
•
50
synthetic-data
-
-
Best Practices and Lessons Learned on Synthetic Data for Language Models
Paper • 2404.07503 • Published • 32 -
WizardLM: Empowering Large Language Models to Follow Complex Instructions
Paper • 2304.12244 • Published • 14 -
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Paper • 2402.13064 • Published • 49 -
Textbooks Are All You Need
Paper • 2306.11644 • Published • 145 -
Orca 2: Teaching Small Language Models How to Reason
Paper • 2311.11045 • Published • 75 -
Orca: Progressive Learning from Complex Explanation Traces of GPT-4
Paper • 2306.02707 • Published • 46 -
WizardCoder: Empowering Code Large Language Models with Evol-Instruct
Paper • 2306.08568 • Published • 29 -
Ensemble-Instruct: Generating Instruction-Tuning Data with a Heterogeneous Mixture of LMs
Paper • 2310.13961 • Published • 5