The research project “Tangible Signals” investigates the physical representation and haptic feedback control of computer sound data.
From GUI to TUI
The creation and manipulation of sounds
The physical representation and modification of digital sound data including haptic feedback is the core of this research work Tangible Signals. The audience is at first visually impaired musicians who are limited in their work with GUIs, but also sighted musicians who want to integrate a physical level into their creative process. In addition, this research may also be of interest to other disciplines that benefit from physical representation and modification of data.
- How can the physical representation of sound and haptic feedback control contribute to the process of sound generation, sound processing
doesthe physical representation of sound and its haptic control feedback open up new inspiration and creativity in artistic-musical expression?
- How does the interaction with the physical representation of sound and its haptic control feedback compare to GUI-based workflows?
Three tangible user interface prototypes were developed, that use sensor technology in combination with mechanical actuators to provide an interactive physical display of sound and music data for people with visual impairments. The prototypes can be used either separately or combined as input and output devices utilizing pin-based, string-based and wheel-based interaction elements.
ACCESSIBLE SOFTWARE “WELLE”
For creating computer-based music with children and adults with VI, the simplified web-based live code environment WELLE was developed. WELLE will also serve as a tool and interface platform for connecting the various tangible signal prototypes to computer generated sounds and sequences.
– – – – – –
* This PhD project is funded with the DOC fellowship by the Austrian Academy of Sciences, starting June 2019.
* In collaboration with the Federal Institute of the Blind, Vienna.