fhswf
/

tiny-stack-tokenizer

Model card Files Files and versions

tiny-stack-tokenizer / merges.txt

Commit History

Using BPE Tokenizer

1227d41

Paul Weber commited on 15 days ago

Upload 5 files

52b5bec
verified

pweb002 commited on Jul 15

Added code, error_message and description special token

986b051

Paul Weber commited on Mar 17

Changed config

c36d23a

Paul Weber commited on Feb 18

Trained tokenizer for Tiny-Stack dataset

18151ff

Paul Weber commited on Feb 17