compactlm-5m / tokenizer.json

Commit History

  1. Add gollem_eval byte-level BPE tokenizer (12,288 vocab)

    Verified signature
    1b61941