Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference Providers
Select all
Together AI
SambaNova
Replicate
Nebius AI Studio
fal
Novita
Cerebras
Hyperbolic
Nscale
Cohere
Fireworks
HF Inference API
Misc
Reset Misc
tokenizer
Inference Endpoints
text-generation-inference
Misc with no match
Eval Results
Merge
4-bit precision
custom_code
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
65
Full-text search
Edit filters
Sort: Trending
Active filters:
tokenizer
Clear all
novateur/WavTokenizer
Text-to-Speech
•
Updated
Dec 2, 2024
•
52
pszemraj/sail-slimpajama-6B-32768-BPE-tokenizer
Updated
Oct 6, 2024
gpwr/bark-it-tokenizer
Updated
Nov 9, 2024
charanhu/kannada-tokenizer
Text Generation
•
Updated
Nov 12, 2024
•
2
GlowCheese/minBERT
Text Classification
•
Updated
Dec 4, 2024
•
1
AhmetSemih/tr_tokenizer
Updated
Dec 26, 2024
aliarda/turkish_tokenizer
Updated
Dec 3, 2024
•
1
aliarda/turkish_tokenizer_256k
Updated
Dec 4, 2024
•
1
tejagowda/t5-hebrew-translation
Text Classification
•
Updated
Dec 7, 2024
•
35
aloobun/IN-Llama-3-Tokenizer
Updated
Mar 7
clearloop/tokenizer
Updated
Jan 7
aayushraina/hindi-bpe-tokenizer
Text2Text Generation
•
Updated
Jan 11
aayushraina/bpe-hindi
Text2Text Generation
•
Updated
Jan 11
InterwebAlchemy/PGNTokenizer
Updated
Feb 11
sachin6624/sachin-gpt2-tokenizer
Updated
Feb 3
•
1
Ornaments/72k-Bilingual-BBPE-TK-SPM-Identity
Updated
Feb 18
Ornaments/72k-TK-BBPE-HF
Updated
Feb 18
savath/laonlp-enhanced
Updated
Feb 21
suffolk-design/uniformat-longformer-v1
Text Classification
•
Updated
Feb 21
•
8
mishmish66/throwing_fast
Robotics
•
Updated
Feb 28
Adiii143/code-search-net-tokenizer
Updated
Mar 12
maverickweyunga/Sarufi
Updated
Apr 5
mishmish66/trying-fast
Robotics
•
Updated
Apr 22
deshanksuman/romanized-sinhala-tokenizer
Updated
Apr 22
Namuun123/mn_sentencepiece_tokenizer
Updated
Apr 25
luispintoc/MoleBERT-Tokenizer-NbTMC_scratch_150k_20ep
Updated
28 days ago
•
1
luispintoc/MoleBERT-Tokenizer-NbTMC_scratch_400k_30ep
Updated
28 days ago
•
121
ArabovMK/tajik-tokenizers-v1
Updated
27 days ago
nsslq/segmo
Updated
22 days ago
Hailay/geez-tokenizer
Token Classification
•
Updated
20 days ago
Previous
1
2
3
Next