Value Residual Learning For Alleviating Attention Concentration In Transformers
Paper
•
2410.17897
•
Published
•
9
•
2
Zhanchao Zhou
Zcchill
·
AI & ML interests
None yet
Recent Activity
authored
a paper
8 days ago
QUBE: Enhancing Automatic Heuristic Design via Quality-Uncertainty
Balanced Evolution
authored
a paper
8 days ago
Grove MoE: Towards Efficient and Superior MoE LLMs with Adjugate Experts
upvoted
a
paper
8 days ago
MoBE: Mixture-of-Basis-Experts for Compressing MoE-based LLMs
Organizations
None yet
commented
a
paper
10 months ago