ClothFit: Cloth-Human-Attribute Guided Virtual Try-On Network Using 3D Simulated Dataset

Abstract

Online clothing shopping has become increasingly popular, but the high rate of returns due to size and fit issues has remained a major challenge. To address this problem, virtual try-on systems have been developed to provide customers with a more realistic and personalized way to try on clothing. In this paper, we propose a novel virtual try-on method called ClothFit, which can predict the draping shape of a garment on a target body based on the actual size of the garment and human attributes. Unlike existing try-on models, ClothFit considers the actual body proportions of the person and available cloth sizes for clothing virtualization, making it more appropriate for current online apparel outlets. The proposed method utilizes a U-Net-based network architecture that incorporates cloth and human attributes to guide the realistic virtual try-on synthesis. Specifically, we extract features from a cloth image using an auto-encoder and combine them with features from the users height, weight, and cloth size. The features are concatenated with the features from the U-Net encoder, and the U-Net decoder synthesizes the final virtual try-on image. Our experimental results demonstrate that ClothFit can significantly improve the existing state-of-the-art methods in terms of photo-realistic virtual try-on results.

Publication
IEEE International Conference on Image Processing 2023 (ICIP 2023)
Dr. Sungho Suh
Dr. Sungho Suh
Senior Researcher

Human Activity Recognition, Safe and Trusted Human Centric Artificial Intelligence in Future Manufacturing Lines

Prof. Dr. rer. nat. Paul (Pawel) Lukowicz
Prof. Dr. rer. nat. Paul (Pawel) Lukowicz
Professor (W3) “Embedded Intelligence”

Paul Lukowicz is Full Professor of AI at the Technical University of Kaiserslautern in Germany where he is heading the Embedded Intelligence group at DFKI. From 2006 till 2011 he has been full Professor (W3) of Computer Science at the University of Passau. He has also been a senior researcher (“Oberassistent”) at the Electronics Laboratory at the Department of Information Technology and Electrical Engineering of ETH Zurich Paul Lukowicz has MSc. (Dipl. Inf.) and a Ph.D. (Dr. rer nat.) in Computer Science a MSc. in Physics (Dipl. Phys.). His research focus are context aware ubiquitous and wearable systems including sensing, pattern recognition, system architectures, models of large scale self-organized systems, and applications. Paul Lukowicz coordinates the FP7-FET SOCIONICAL projects, is Associate Editor in Chief of IEEE Pervasive Computing Magazine, and has been serving as TPC Chair of a number of international events in the area