GHOST · Generic and Highly Organic, Shape-changing inTerfaces

Current user interfaces for computers and mobile devices often separate input and output, are typically static in their physical appearance, and rarely tap humans' ability to reason about and manipulate physical objects. We propose a new paradigm of interfaces that address these limitations. The paradigm is called Generic and Highly Organic, Shape-changing inTerfaces (GHOSTs). GHOSTs are display surfaces made of malleable materials that can change into and retain arbitrary shapes so as to display output from the system or afford new actions. At the same time, GHOSTs allow users to deform, touch, or otherwise manipulate the shape of their display surface to provide input to the system. We argue that such interfaces provide many benefits over current user interfaces by leveraging humans' ability to perceive, express, and communicate through touch and manipulation of physical objects.The present project will design, develop, and evaluate GHOST prototypes. We combine disciplines focusing on (a) the hardware and software for shape change, using combinations of shape actuators and smart materials; (b) the industrial and interaction design for such interfaces, in particular how to make them physically appealing, useful, and usable; and (c) the user experience of interacting with GHOSTs, quantifying and modeling users' performance with and affect towards the interface. These disciplines are brought together in four iterations of prototypes, continuously testing and refining the prototypes' resolution, the shape-change response, users' performance, and the experience of interaction. In addition to the proof-of-concept prototypes, we establish the technical and scientific basis for useful and usable shape-changing interfaces.