nerdstash-tokenizer-v1 / tokenizer.model
finetune's picture
Add tokenizer
c23941d
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
578fa0ed4d6dbee435f21d7f7a741506d09cdd93cce241008abf725407cbdb41
Pointer size:
132 Bytes
·
Size of remote file:
1.03 MB
·
Xet backed hash:
51ec869bd30f4ed1cd6b337bd1bdedda2aaced61d4d2fb3c17b71fbbcefe77e3

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.