Quark3Tokenizer / tokenizer_config.json

Commit History

  1. BPE 16k tokenizer, Italian-first bilingual with ChatML

    Verified signature
    a101152