Instructions to use chengpingan/ExpandR_LLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use chengpingan/ExpandR_LLM with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Models/llama3-8b-instruct") model = PeftModel.from_pretrained(base_model, "chengpingan/ExpandR_LLM") - Notebooks
- Google Colab
- Kaggle
ExpandR query expansion model
How can a language model learn which query expansions help a dense retriever rank a relevant document higher? ExpandR samples candidate expansions and uses retrieval feedback and a self-consistency signal to build preference pairs. Direct preference optimization (DPO) trains the generator on those pairs. The method section describes how the preferences are constructed.
This repository contains the LoRA adapter for the query expansion generator. The training script uses Meta-Llama-3-8B-Instruct. The original release lists PEFT 0.15.2. Use it to generate expansion text, then use the ExpandR retriever to rank documents.
Training data · Training and evaluation code
Citation
The first preprint appeared as LLM-QE: Improving Query Expansion by Aligning Large Language Models with Ranking Preferences. The archival citation is Sijia Yao, Pengcheng Huang, Zhenghao Liu, Yu Gu, Yukun Yan, Shi Yu, and Ge Yu (EMNLP 2025), ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidance. BibTeX
- Downloads last month
- 34
Model tree for chengpingan/ExpandR_LLM
Base model
meta-llama/Meta-Llama-3-8B-Instruct