Finally, a Replacement for BERT: Introducing ModernBERT
•
670
AI & ML interests
None defined yet.
Recent Activity
View all activity
Articles
Bringing BERT into modernity via both architecture changes and scaling
-
answerdotai/ModernBERT-base
Fill-Mask • 0.1B • Updated • 1.14M • • 901 -
answerdotai/ModernBERT-large
Fill-Mask • 0.4B • Updated • 135k • • 413 -
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference
Paper • 2412.13663 • Published • 152
Bringing BERT into modernity via both architecture changes and scaling
-
answerdotai/ModernBERT-base
Fill-Mask • 0.1B • Updated • 1.14M • • 901 -
answerdotai/ModernBERT-large
Fill-Mask • 0.4B • Updated • 135k • • 413 -
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference
Paper • 2412.13663 • Published • 152
models
28
answerdotai/ReadBench
Updated
•
3
answerdotai/ModernBERT-large-training-checkpoints
Updated
•
1
answerdotai/ModernBERT-base-training-checkpoints
Updated
•
2
answerdotai/ModernBERT-Large-Instruct
Fill-Mask
•
0.4B
•
Updated
•
1.09k
•
28
answerdotai/ModernBERT-base
Fill-Mask
•
0.1B
•
Updated
•
1.14M
•
•
901
answerdotai/ModernBERT-large
Fill-Mask
•
0.4B
•
Updated
•
135k
•
•
413
answerdotai/answerai-colbert-small-v1
0.0B
•
Updated
•
4.38M
•
153
answerdotai/qwen_large_mix_dataset_v0_dedup_1024
Updated
answerdotai/Llama-3.1-70B-Instruct-4-2-Bit-BI-20pct
Updated
•
4
answerdotai/JaColBERTv2.4
Sentence Similarity
•
0.1B
•
Updated
•
11
•
3
datasets
15
answerdotai/ReadBench
Preview
•
Updated
•
35
answerdotai/triviaqa_entailment
Viewer
•
Updated
•
29.8k
•
23
•
1
answerdotai/tiny_programs
Viewer
•
Updated
•
100
•
28
•
2
answerdotai/fasthtml-instruct
Viewer
•
Updated
•
304
•
20
•
2
answerdotai/MMARCO-japanese-32-scored-triplets
Viewer
•
Updated
•
8.64M
•
121
•
6
answerdotai/MLMMLU
Viewer
•
Updated
•
46.2k
•
76
•
2
answerdotai/MLMMLU-Rookie
Viewer
•
Updated
•
23.3k
•
19
answerdotai/hqq_plus_plus_mix_40k
Viewer
•
Updated
•
39.8k
•
21
answerdotai/MLMMLU-Amateur
Viewer
•
Updated
•
8.43k
•
34
answerdotai/MLMMLU-Semipro
Viewer
•
Updated
•
12k
•
30