3.42 GB
64,989 files
Updated 17 minutes ago
Name
Size
__init__.py310 Bytes
xet
base_tokenizer.py15.8 kB
xet
bert_wordpiece.py5.52 kB
xet
byte_level_bpe.py4.27 kB
xet
char_level_bpe.py5.45 kB
xet
sentencepiece_bpe.py3.72 kB
xet
sentencepiece_unigram.py7.63 kB
xet
Total size
3.42 GB
Files
64,989
Last updated
Nov 20
Pre-warmed CDN
US EU US EU

Contributors