How to use ytgui/Search-R3.0-Small with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, HFQwen2LM tokenizer = AutoTokenizer.from_pretrained("ytgui/Search-R3.0-Small") model = HFQwen2LM.from_pretrained("ytgui/Search-R3.0-Small", device_map="auto")
