Exploring the Design of Audio-Kinetic Graphics for Education

A user gripping the mechanical arm of a pen plotter to experience kinetic content

Creating tactile representations of visual information, especially moving images, is difficult due to a lack of available tactile computing technology and a lack of tools for authoring tactile information. In this project, we developed a software framework that enables educators and other subject experts to create tactile representations that combine audio descriptions with kinetic motion. These audio-kinetic graphics can be played back using off-the-shelf computer hardware, such as a pen plotter.

Ìý

Associated Researchers

Publications

Annika Muehlbradt, Madhur Atreya, Darren Guinness, and Shaun K. Kane. 2018. Exploring the Design of Audio-Kinetic Graphics for Education. In Proceedings of the 20th ACM International Conference on Multimodal Interaction (ICMI '18). ACM, New York, NY, USA, 455-463. DOI: (Boulder, Colorado – October 16 - 20, 2018).