11 15 5

Furu Wei

thegenerality

AI & ML interests

None yet

Recent Activity

upvoted a paper 1 day ago

Rectified Sparse Attention

authored a paper 2 days ago

Rectified Sparse Attention

upvoted a paper 8 days ago

On-Policy RL with Optimal Reward Baseline

View all activity

Organizations

None yet

thegenerality's activity

upvoted a paper 1 day ago

Rectified Sparse Attention

Paper • 2506.04108 • Published 3 days ago • 9

upvoted a paper 8 days ago

On-Policy RL with Optimal Reward Baseline

Paper • 2505.23585 • Published 9 days ago • 14

upvoted an article 23 days ago

Article

Falcon-Edge: A series of powerful, universal, fine-tunable 1.58bit language models.

and 9 others •

23 days ago

• 33

upvoted a paper about 2 months ago

BitNet b1.58 2B4T Technical Report

Paper • 2504.12285 • Published Apr 16 • 73

upvoted a collection about 2 months ago

BitNet

Collection

🔥BitNet family of large language models (1-bit LLMs). • 7 items • Updated May 1 • 42

upvoted a paper 4 months ago

Chain-of-Retrieval Augmented Generation

Paper • 2501.14342 • Published Jan 24 • 58

upvoted 2 papers 6 months ago

Multimodal Latent Language Modeling with Next-Token Diffusion

Paper • 2412.08635 • Published Dec 11, 2024 • 46

MH-MoE:Multi-Head Mixture-of-Experts

Paper • 2411.16205 • Published Nov 25, 2024 • 29

upvoted a paper 7 months ago

BitNet a4.8: 4-bit Activations for 1-bit LLMs

Paper • 2411.04965 • Published Nov 7, 2024 • 69

upvoted a paper 8 months ago

Differential Transformer

Paper • 2410.05258 • Published Oct 7, 2024 • 179

upvoted 2 papers 11 months ago

Q-Sparse: All Large Language Models can be Fully Sparsely-Activated

Paper • 2407.10969 • Published Jul 15, 2024 • 23

Direct Preference Knowledge Distillation for Large Language Models

Paper • 2406.19774 • Published Jun 28, 2024 • 22

upvoted 2 papers over 1 year ago

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models

Paper • 2402.13064 • Published Feb 20, 2024 • 49

BitNet: Scaling 1-bit Transformers for Large Language Models

Paper • 2310.11453 • Published Oct 17, 2023 • 103

upvoted a paper almost 2 years ago

Retentive Network: A Successor to Transformer for Large Language Models

Paper • 2307.08621 • Published Jul 17, 2023 • 171