Update tokenizer_config.json

by kyoui-dev - opened 15 days ago

base: refs/heads/main

←

from: refs/pr/2

Discussion Files changed

-1

kyoui-dev

15 days ago

•

edited 11 days ago

Update tokenizer class for Transformers v4 compatibility

Update tokenizer class for Transformers v4 compatibilitye4f8896b

echarlaix changed pull request status to merged 15 days ago

kyoui-dev changed pull request title from Update tokenizer class for Transformers v4 compatibility to Update tokenizer_config.json 11 days ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment