Virtual Piano Dynamics Enhancement with Electromyography

Fen, Cherlynn Chew Hui and Lim, Woan Ning * (2021) Virtual Piano Dynamics Enhancement with Electromyography. In: 2021 Innovations in Intelligent Systems and Applications Conference (ASYU), 6-8 October 2021, Elazig, Turkey.

Full text not available from this repository. (Request a copy)
Official URL:


Pianos are musical instruments that are not easily accessible and portable, which can cause limitations in learning the instrument. Although various technologies have shown promising results in resolving this issue, an optimal solution that can overcome the physical limitation yet provide reality and immersive playing experience has yet to be achieved. This research proposed a lightweight and portable virtual piano solution for beginner-level piano playing, enhanced with biofeedback and tactile sensation to overcome the limitation of lacking in dynamics in most of the virtual piano application. The player’s hands are detected and tracked for playing movements as they interact with the 3D graphical interface by using the Leap Motion Controller (LMC). The MyoWare muscle sensors are used to detect the electromyography (EMG) readings to enable the dynamic variation while playing. User testing was carried out on two groups of participants: experienced and novice players respectively. Quantitative and qualitative data have been collected for accuracy, usability, workload, and realism analysis. Results of the study show that this approach has the potential to be used as a beginner’s instrument for simple pieces or warm-up practices. The results also indicate that with the addition of tactile sensation by using an acrylic panel and incorporating dynamics with the EMG signals into the solution has led to a better immersive user experience. This study provides an alternative option and worthwhile insight for future development of virtual piano applications.

Item Type: Conference or Workshop Item (Paper)
Uncontrolled Keywords: virtual piano; human computer interaction; electromyography; haptics
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
T Technology > TJ Mechanical engineering and machinery
Divisions: Sunway University > School of Engineering and Technology [formerly School of Science and Technology until 2020] > Dept. Computing and Information Systems
Depositing User: Ms Yong Yee Chan
Related URLs:
Date Deposited: 20 Mar 2023 02:55
Last Modified: 20 Mar 2023 05:50

Actions (login required)

View Item View Item