Mirror Mirror

Magic mirrors superimpose virtual clothing over viewers’ mirror image to let them evaluate fashion items without actually wearing them. We contribute the mirror Mirror system that supports not only mixing and matching existing fashion items, but also lets users design new items in front of the mirror and export designs to fabrication devices. Mirror Mirror makes use of spatial augmented reality and a mirror Virtual garments are visible both on the body for precise manipulation as well as in the reflection to obtain a third person perspective. While much previous work deals with re-texturing and registering virtual garments to live user data, we focus on collaborative design and show various ways of designing using real bodies as mannequins.

We implemented a few ways of designing with graphics. By using mid-air gestures, users can manipulate graphics and edit properties of patterns, color, density and layering. The body also doubles as a canvas for drawing with a tracked brush and thanks to the in-place visualization, and unlike DressUp, users can be their own mannequins. Tracking hand position while drawing on the body proved to be unstable. Hence, we employ an IR reflective marker on a brush. Finally, an additional background image is projected behind the user to support evaluating designs in simulated environments such as office, forest or beach.

This novel, but seemingly complicated optical setup that combines a projector and mirror-TV results in a system that is easy to use and versatile due to the multiple “display” layers: on the body, on the mirror surface that shows the UI, on the reflected body and on the background behind the user. Thereby, allowing users to experience and evaluate designs in context.

Mirror Mirror reacts on the contemporary fast fashion trend of disposable clothing and anticipates the rise of personal fabrication technologies and possible futures of flexible color changing e-ink garments and sharing designs over the Internet.


Daniel Saakes, Hui-Shyong Yeo, Seung-Tak Noh, Gyeol Han and Woontack Woo. Mirror Mirror: An On-Body T-Shirt Design System</a> CHI ‘16 Papers and Notes [pdf]

Gyeol Han, Seung-Tak Noh, Hui-Shyong Yeo, Daniel Saakes and Woontack Woo 공간 증강 현실 기반 패션 디자인 시스템을 위한 사용자 경험 연구 / User Research for Experience of Fashion Design System Based on Spatial Augmented Reality In HCI KOREA 2016. Accepted.
Daniel Saakes, Hui-Shyong Yeo, Seung-Tak Noh, Gyeol Han, Woontack Woo. Mirror Mirror: An On-Body Clothing Design System SIGGRAPH ‘15: Studio Installation Accepted.
Daniel Saakes, Hui-Shyong Yeo, Seung-Tak Noh, Gyeol Han, Woontack Woo. Mirror Mirror: An On-Body Clothing Design System SIGGRAPH ‘15: Talks Accepted.

Maker Festival (Creative Korea Expo 2015), 26 Nov 2015 - 29 Nov 2015. Seoul, South Korea.
SIGGRAPH 2015 Studio, 9 Aug 2015 - 13 Aug 2015. Los Angeles, California, USA.
Dongdaemun Exhibition, 18 July 2015 - 25 July 2015. Seoul, South Korea.
CHI 2015 KAIST Visit, 24 Apr 2015. Daejeon, South Korea.