deliberate-v2 / tokenizer

Commit History

  1. Add tokenizer/vocab.json

    Verified signature
    a5e9c31
  2. Add tokenizer/tokenizer_config.json

    Verified signature
    0b09e3d
  3. Add tokenizer/special_tokens_map.json

    Verified signature
    f1ba437
  4. Add tokenizer/merges.txt

    Verified signature
    3e3c934