BabyLM Sequence Length

community

AI & ML interests

BabyLM 2025 paper submission

Recent Activity

rdiehlmartinez updated a model about 7 hours ago

babylm-seqlen/mamba-4096

rdiehlmartinez updated a model about 10 hours ago

babylm-seqlen/opt-8192

rdiehlmartinez published a model about 10 hours ago

babylm-seqlen/mamba-4096

View all activity

Collections 2

models 34

babylm-seqlen/mamba-4096

Updated about 7 hours ago

babylm-seqlen/opt-8192

Updated about 10 hours ago

babylm-seqlen/opt-4096

Updated about 10 hours ago

babylm-seqlen/mamba-8192

Updated 3 days ago • 14

babylm-seqlen/mamba-8192-warmup

Updated 3 days ago • 18

babylm-seqlen/mamba-4096-warmup

Updated 3 days ago • 11

babylm-seqlen/mamba-2048-warmup

Updated 3 days ago • 4

babylm-seqlen/mamba-512-warmup

Updated 3 days ago • 6

babylm-seqlen/mamba-1024-warmup

Updated 3 days ago • 5

babylm-seqlen/mamba-64-warmup

Updated 3 days ago • 1

datasets 18

babylm-seqlen/train_100M_64

Viewer • Updated Apr 8 • 2.56M • 12

babylm-seqlen/train_100M_512_single_shuffle

Viewer • Updated Apr 8 • 319k • 18

babylm-seqlen/train_100M_8192_single_shuffle

Viewer • Updated Apr 8 • 19.8k • 16

babylm-seqlen/train_100M_2048_single_shuffle

Viewer • Updated Apr 8 • 79.8k • 16

babylm-seqlen/train_100M_16384_single_shuffle

Viewer • Updated Apr 8 • 9.86k • 18

babylm-seqlen/train_100M_4096_single_shuffle

Viewer • Updated Apr 8 • 39.8k • 15

babylm-seqlen/train_100M_256_single_shuffle

Viewer • Updated Apr 8 • 639k • 19

babylm-seqlen/train_100M_1024_single_shuffle

Viewer • Updated Apr 8 • 160k • 22

babylm-seqlen/train_100M_128_single_shuffle

Viewer • Updated Apr 8 • 1.28M • 24

babylm-seqlen/train_100M_64_single_shuffle

Viewer • Updated Apr 8 • 2.56M • 23