File size: 2,308 Bytes
4310611
 
 
 
f03bf14
 
 
 
 
 
 
 
 
 
 
4310611
f03bf14
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
---

license: other
license_name: server-side-public-license
license_link: https://www.mongodb.com/legal/licensing/server-side-public-license
tags:
- diffusion
- virtual try-on
- virtual try-off
- image generation
- fashion
- e-commerce
base_model:
- CompVis/stable-diffusion-v1-4
pipeline_tag: image-to-image
library_name: diffusers
---


## TryOffDiff

The models proposed in the paper _"TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction\\using Diffusion Models"_
[[paper]](https://arxiv.org/abs/2404.08582) [[project page]][project_page]:

- `tryoffdiff.pth`: The pre-trained StableDiffusion-v1.4 fine-tuned on `VITON-HD-train` dataset.

- `.pth`: A U-Net trained from scratch on `VITON-HD-train` dataset.

- `.pth`: 





## Usage



```python

from torchvision.io import read_image
from torchvision.models.detection import MaskRCNN_ResNet50_FPN_Weights

from huggingface_hub import hf_hub_download

path_onnx = hf_hub_download(

    repo_id="rizavelioglu/tryoffdiff",
    filename="tryoffdiff.pth",  # or one of ["ldm-1", "ldm-2", "ldm-3", ...]

)


```



> Check out the demo code on [HuggingFace Spaces][hf_spaces] for visualizing the output.



> Also, check out [GitHub repository][project_page] to get more information on

> training, inference, and evaluation.



### License

TL;DR: Not available for commercial use, unless the FULL source code is shared! \

This project is intended solely for academic research. No commercial benefits are derived from it.

Models are licensed under [Server Side Public License (SSPL)][license]



### Citation

If you find this repository useful in your research, please consider giving a star ⭐ and a citation:

```
@article{velioglu2024tryoffdiff,
  title     = {TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models},
  author    = {Velioglu, Riza and Bevandic, Petra and Chan, Robin and Hammer, Barbara},
  journal   = {arXiv},
  year      = {2024},
  note      = {\url{https://doi.org/....}}
}
```



[hf_spaces]: https://huggingface.co./spaces/rizavelioglu/tryoffdiff

[project_page]: https://rizavelioglu.github.io/tryoffdiff/

[github]: https://github.com/rizavelioglu/tryoffdiff

[license]: https://www.mongodb.com/legal/licensing/server-side-public-license