Hugging Face's logo

fhswf
/
tiny-stack-tokenizer

gpt2
Model card Files
xet
 Community
1
tiny-stack-tokenizer / vocab.json

Commit History

  1. Using BPE Tokenizer

    Paul Weber
    1227d41

  1. Upload 5 files

    pweb002
    Verified signature
    52b5bec

  1. Fixed special token

    Paul Weber
    be70724

  1. Added code, error_message and description special token

    Paul Weber
    986b051

  1. Changed config

    Paul Weber
    c36d23a

  1. Trained tokenizer for Tiny-Stack dataset

    Paul Weber
    18151ff