🧙♂️ LLightPro
Small model. Massive logic.
This is a high-fidelity fine-tune of the experimental p-e-w/Qwen3-4B-Instruct-2507-heretic base model, sharpened for complex reasoning, coding, and logic puzzles using the elite GrandMaster2 dataset.
Unlike standard LoRA fine-tunes, this model uses DoRA (Weight-Decomposed Low-Rank Adaptation), allowing it to learn subtle nuances in reasoning without catastrophic forgetting. The training was performed in pure bfloat16 (no quantization during training) on an NVIDIA RTX 4090 to ensure maximum precision.
🚀 Key Features
🧠 Advanced Architecture: Built upon the experimental "Heretic" Qwen3 build.
⚡ DoRA Technology: Uses Weight-Decomposed LoRA (r=64, alpha=128) for superior learning capacity compared to standard LoRA.
💎 Uncompromised Quality: Trai…
