Sizhe-Chen/Qwen3.6-27B-Instruct-SecPO
Image-Text-to-Text • 27B • Updated • 359 • 4
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
287
Active filters: preference-optimization
madebywest/maple-pro
20B • Updated • 424 • 6
pratikjalan/selfpo-qwen25vl-7b-chip-random
Updated • 26 • 1
pratikjalan/selfpo-qwen25vl-3b-chip-random
Updated • 15 • 1
tokutsu/japanese-answer-13b-8bit
Updated • 37
HaiZhiYan/CheX-Phi35V
Visual Question Answering • Updated • 2
tahamajs/llama-3.2-3b-orpo-lora64-4bit-instruct
Updated • 3
Likhith003/dpo-pairrm-lora-adapter
Text Generation • 1B • Updated • 11
Likhith003/dpo-llmjudge-lora-adapter
Text Generation • 1B • Updated • 9
jasperyeoh2/mistral-dpo-peft
Updated • 2
loganlin777/mistral-7b-dpo-adapter
Updated
gandhiraketla277/finance-llama-3.1-8b-dpo-trained
Text Generation • Updated • 3
ecoxial2007/CheX-Phi4MM-GRPO
Image-Text-to-Text • 6B • Updated • 16 • 1
vidavox/Qwen3-SKK-32B-DPO
Text Generation • Updated
Nishef/MiniCPM-1B-sft-bf16-Full_KTO_20251225_185339
Text Generation • Updated
Nishef/Qwen3-0.6B-Full_DPO_20251225_130318
Text Generation • Updated
Nishef/Qwen3-0.6B-Full_ENHANCED_KTO_20251225_162818
Text Generation • Updated
Nishef/Qwen3-0.6B-Full_KTO_20251225_102050
Text Generation • Updated
Nishef/Qwen3-0.6B-Full_ORPO_20251225_145426
Text Generation • Updated
Nishef/SmolLM2-360M-Full_DPO_20251225_043457
Text Generation • Updated
Nishef/SmolLM2-360M-Full_ENHANCED_KTO_20251225_074953
Text Generation • Updated
Nishef/SmolLM2-360M-Full_KTO_20251225_020028
Text Generation • Updated
Nishef/SmolLM2-360M-Full_ORPO_20251225_062447
Text Generation • Updated
Nishef/SmolLM2-360M-Full_ENHANCED_KTO_20251225_074953-merged
Text Generation • 0.4B • Updated • 22
Nishef/Qwen3-0.6B-Full_ENHANCED_KTO_20251225_162818-merged
Text Generation • 0.6B • Updated • 23 • 1
Nishef/SmolLM2-360M-Full_KTO_20251225_020028-merged
Text Generation • 0.4B • Updated • 28
Nishef/SmolLM2-360M-Full_DPO_20251225_043457-merged
Text Generation • 0.4B • Updated • 10
Nishef/SmolLM2-360M-Full_ORPO_20251225_062447-merged
Text Generation • 0.4B • Updated • 28
Nishef/Qwen3-0.6B-Full_KTO_20251225_102050-merged
Text Generation • 0.6B • Updated • 24
Nishef/Qwen3-0.6B-Full_DPO_20251225_130318-merged
Text Generation • 0.6B • Updated • 15