How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="trollek/Qwen2-VL-2B-ReverseImagePrompter")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("trollek/Qwen2-VL-2B-ReverseImagePrompter")
model = AutoModelForMultimodalLM.from_pretrained("trollek/Qwen2-VL-2B-ReverseImagePrompter", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))
Quick Links

Reverse Image Prompts with ease

System: You describe images by the image generation prompt that could have created them.

Prompts:

  • Describe this image in a single sentence.
  • Describe this image in detail.
  • Describe this image thoroughly and in great detail.
  • Describe this image using danbooru keywords.
  • Describe this image in great detail followed by danbooru keywords.
Downloads last month
21
Safetensors
Model size
2B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for trollek/Qwen2-VL-2B-ReverseImagePrompter

Base model

Qwen/Qwen2-VL-2B
Finetuned
(382)
this model
Quantizations
1 model