We have many opportunities to experience narratives in our everyday life. Our very human ability to connect cause and effect allows us to consider the stories behind events and experiences. As storytelling elements, animating daily objects can create compelling moments into daily scenarios. The Hanged Man brings to life clothing displayed in apparel shop windows – an interstitial space considered as a layer a retail brand’s story and the daily life of a shopper.
As a robotic user interface to animate retail clothing through interaction with people, The Hanged Man aims to attract people by moving and mimicking the observers. Employing the form of a clothes hanger into a computational interface to animate clothing, each brand can use the interface to animate and tell its own story.
Context and Existing Research
It is often seen that people animate physical materials to describe stories in daily communication. The main interest of this project is how to design a new communication tool by applying animated common products for everyday life.
Robots, especially humanoids, sometimes have "the Uncanny Valley" issue that people feel strangeness on their design. Meanwhile, there are some research and artworks to employ inhuman-like forms, such as animals, daily objects and abstract motion, into designing the alternative robotic user interface [1, 2].
Inhuman-like characters and motion have also been depicted in animation over decades. In order to convey stories deeply, the animation industry has developed principles how to draw expressive motion with both human-like and inhuman-like characters . Therefore, this project attempts to apply the methods of animation and storytelling into designing a new robotic user interface.
According to Storr, people's brains radically simplify the world with narrative in order to comprehend chaotic information in everyday life  and this means daily situation is surrounded by many elements of storytelling. From this perspective, I considered robotic user interface with animated daily items could make new communicational experience driven by the elements of narrative.
In order for the implementation, my project picks up the specific place of store window, specifically apparel store’s display, because it can be considered as one of the intermediate between daily place and brand's storytelling world. Additionally, a prior research suggests that clothing retailers focusing on displaying whole of the product fit and store image successfully draw customers more than others focusing on just promotion . This fact supports my project in the practical aspect of advertisement.
Analysis and Ideation
The principles of animation tend to focus on the relationship between motion and materials' softness, such as squashing and stretching characters' form and follow through and overlapping motion with the moment of inertia [6, 7]. For this reason, this project decides to employ clothes as a part of the user interface and animates this daily soft material as a computational user interface.
At the same time, in oder to design the system, I also examined the existing skeletons for clothes by defining two axises: abstract vs. human-like form and interactive vs. static. I considered that the abstract form, like clothes hanger, is suitable for the medium working with narrative because it should not disturb the storytelling.
After the analysis, I started to design a prototype named Naked. It is a robotic user interface formed like a clothes hanger.
The first prototype had simple actions and it has no interaction with people. Although it does not interact technically, the observer associates this machine with kinds of character and narrative.
The second prototype has a function to mimic the observer's behaviour.
I designed the third prototype called 'The Hanged Man' afterwards. It is designed by applying a structure of the six axis robotic arm in order to move precisely more than previous prototypes. It is also coded to mimic the user’s motion but also the action has faint arrangement in order for exaggeration.
I had several opportunities to demonstrate and test the prototypes in art events and public places, including Samsung's concept store and one of the largest retail markets in London. I got various reaction and feedback from the visitors. The following is the representative comments.
- Exhibited the second prototype at UCL, Here East, Jun 2019.
- Exhibited the second prototype at Samsung KX, Aug 2019.
- Demonstrated the third prototype at Camden Market, Dec 2019.
- Exhibited the third prototype at Bartlett main campus, Dec 2019.
Conclusion and Next Step
The prototypes and user feedback show that the interactive system animating daily objects contains a lot of potential for different usages, such as daily communication, commerce and art, which is driven by elements of storytelling. Creators can apply this fact in order to design communication tools which focuses on interactivity and narratives.
For the next step, I would like to improve the system to have collective user interfaces interacting each other in order to create more immersive experience.
Another consideration is to develop a system in which the interface's motion is automatically arranged based on the context.
- Award (Jury Selection) - 24th JAPAN MEDIA ARTS FESTIVAL
- Nomination - Generation Award category of INNO-vation progmram organised by the Ministry of Internal Affairs and Communications.
- Adopted Project (a development plan from this project) - Disruptive Challenge Selection of INNO-vation progmram as well.
- Semi-final Project (a development plan from this project) - Tokyo Startup Gateway Contest 2020 organisied by Tokyo Metropolitan Government.
- Sugiura, Y. et al. (2012) ‘PINOKY: A ring that animates your plush toys’, in Conference on Human Factors in Computing Systems - Proceedings. doi: 10.1145/2207676.2207780.
- Watanabe, K. et al. (2013) ‘SyncPresenter : Turntable Presentation System that Synchronizes Motion and Sound’, Information Processing Society of Japan Interaction 2013, pp. 488–489.
- Thomas, F. and Ollie, J. (1997) 'The Illusion of Life: Disney Animation'.
- Storr, W. (2019) ‘The Science of Storytelling’.
- Sena, S., Block, L. G., Chandran, S. (2002) 'Window displays and consumer shopping decisions', in Journal of Retailing and Consumer Services, 9, pp.277–290
- Lodigiani, V. (2014) 'The Illusion of Life'. Available at: https://centolodigiani.com/the-illusion-of-life
- 'Aladdin' (2019) [Film]. Directed by Guy Ritchie.