Attention Heads of Large Language Models: A Survey
Paper
•
2409.03752
•
Published
•
90
LLM
-
-
Transformer Explainer: Interactive Learning of Text-Generative Models
Paper • 2408.04619 • Published • 162 -
Addition is All You Need for Energy-efficient Language Models
Paper • 2410.00907 • Published • 151 -
DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining
Paper • 2305.10429 • Published • 3 -
Phi-4 Technical Report
Paper • 2412.08905 • Published • 119 -
Qwen2.5 Technical Report
Paper • 2412.15115 • Published • 368 -
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
Paper • 2501.12948 • Published • 400 -
Qwen2.5-1M Technical Report
Paper • 2501.15383 • Published • 71