HGRN2 - a OpenNLPLab123 Collection

OpenNLPLab123 's Collections

HGRN

HGRN2

HGRN2

updated Jun 25, 2024

HGRN2: Gated Linear RNNs with State Expansion

HGRN2: Gated Linear RNNs with State Expansion

Paper • 2404.07904 • Published Apr 11, 2024 • 21
Scaling Laws for Linear Complexity Language Models

Paper • 2406.16690 • Published Jun 24, 2024 • 23