Voiceye: A Multimodal Inclusive Development Environment

Paudyal, Bharat and Creed, Chris and Frutos-Pascual, Maite and Williams, Ian (2020) Voiceye: A Multimodal Inclusive Development Environment. In: DIS2020 More than Human Centred Design, 6th -20th July 2020, Eindhoven, Netherland.

DIS2020 - Voiceye.pdf - Accepted Version

Download (1MB)


People with physical impairments who are unable to use traditional input devices (i.e. mouse and keyboard) are often excluded from technical professions (e.g. web development). Alternative input methods such as eye gaze tracking and speech recognition have become more readily available in recent years with both being explored independently to support people with physical impairments in coding activities. This paper describes a novel multimodal application (“Voiceye”) that combines voice input, gaze interaction, and mechanical switches as an alternative approach for writing code. The system was evaluated with non-disabled participants who have coding experience (N=29) to assess the feasibility of the application in writing HTML and CSS code. Results found that Voiceye was perceived positively and enabled successful completion of coding tasks. A follow-up study with disabled participants (N=5) demonstrated that this method of multimodal interaction can support people with physical impairments in writing and editing code.

Item Type: Conference or Workshop Item (Paper)
Identification Number: https://doi.org/10.1145/3357236.3395553
Date: 6 July 2020
Subjects: CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science
Divisions: Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology > Digital Media Technology
Depositing User: Chris Creed
Date Deposited: 02 Jul 2020 09:56
Last Modified: 10 Sep 2021 14:24
URI: http://bcu-test.eprints-hosting.org/id/eprint/9404

Actions (login required)

View Item View Item


In this section...