| --- |
| license: other |
| license_name: server-side-public-license |
| license_link: https://www.mongodb.com/legal/licensing/server-side-public-license |
| tags: |
| - diffusion |
| - virtual try-on |
| - virtual try-off |
| - virtual-try-off |
| - image generation |
| - fashion |
| - e-commerce |
| base_model: |
| - CompVis/stable-diffusion-v1-4 |
| --- |
| |
| ## TryOffDiff <small>[[Project Page]][project_page]</small> |
| |
| These models are based on the research papers: |
| 1. _"TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models"_ [[paper]][paper_arxiv] |
| 2. _"MGT: Extending Virtual Try-Off to Multi-Garment Scenarios"_ [[paper]][paper2_arxiv] |
| |
| Available models: |
| - `tryoffdiff.pth`: Generates upper-body garments. Fine-tuned on `VITON-HD-train`. |
| - `tryoffdiffv2_upper.pth`: Generates upper-body garments. Fine-tuned on a subset of `Dress Code-train`. |
| - `tryoffdiffv2_lower.pth`: Generates lower-body garments. Fine-tuned on a subset of `Dress Code-train`. |
| - `tryoffdiffv2_dress.pth`: Generates dresses. Fine-tuned on a subset of `Dress Code-train`. |
| - `tryoffdiffv2_multi.pth` (*MGT*): Generates all three garment types (upper-body, lower-body, dresses). Fine-tuned on the entire `Dress Code-train`. |
|
|
| ## Usage |
|
|
| > For a complete running example, see the demo code on [HuggingFace Spaces][hf_spaces]. |
|
|
| > For more information on training, inference, and evaluation, refer to the [GitHub repository][github]. |
|
|
| ## License |
| TL;DR: Not available for commercial use, unless the FULL source code is shared! \ |
| This project is intended solely for academic research. No commercial benefits are derived from it. |
| Models are licensed under [Server Side Public License (SSPL)][license] |
|
|
| ## Citation |
| If you use this work, please give a star ⭐ and a citation: |
| ``` |
| @inproceedings{velioglu2025tryoffdiff, |
| title = {TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models}, |
| author = {Velioglu, Riza and Bevandic, Petra and Chan, Robin and Hammer, Barbara}, |
| booktitle = {BMVC}, |
| year = {2025}, |
| note = {\url{https://doi.org/nt3n}} |
| } |
| @inproceedings{velioglu2025mgt, |
| title = {MGT: Extending Virtual Try-Off to Multi-Garment Scenarios}, |
| author = {Velioglu, Riza and Bevandic, Petra and Chan, Robin and Hammer, Barbara}, |
| booktitle = {ICCVW}, |
| year = {2025}, |
| note = {\url{https://doi.org/pn67}} |
| } |
| ``` |
|
|
| [hf_spaces]: https://huggingface.co/spaces/rizavelioglu/tryoffdiff/blob/main/app.py |
| [project_page]: https://rizavelioglu.github.io/tryoffdiff/ |
| [paper_arxiv]: https://arxiv.org/abs/2411.18350 |
| [paper2_arxiv]: https://arxiv.org/abs/2504.13078 |
| [github]: https://github.com/rizavelioglu/tryoffdiff |
| [license]: https://www.mongodb.com/legal/licensing/server-side-public-license |
