The task of learning the piano has been a centuries-old challenge for novices, experts and technologists. Several innovations have been introduced to support proper posture, movement, and motivation, while sight-reading and improvisation remain the least-explored areas. In this PhD, we address this gap by redesigning the piano augmentation as an interactive and adaptive space. Specifically, we will explore how to support learners with adaptive visualisations through a two-pronged approach: (1) by designing adaptive visualisations based on the proficiency of the learner to support regular piano playing and (2) by assisting them with expert annotations projected on the piano to encourage improvisation. To this end, we will build a model to understand the complexities of learners' spatiotemporal data and use these to support learning. We will then evaluate our approach through user studies enabling practice and improvisation. Our work contributes to how adaptive visualisations can push music instrument learning and support multi-target selection tasks in immersive spaces.
翻译:学会钢琴的任务对新手、专家和技术人员来说是一个数百年来的挑战。已经引入了几项创新,以支持适当的姿态、运动和动力,同时视觉阅读和即兴表演仍然是探索最少的领域。在本博士学位中,我们通过重新设计钢琴扩增作为互动和适应性空间来弥补这一差距。具体地说,我们将探索如何通过双管齐下的方法支持学生的适应性视觉化:(1)根据学习者熟练程度设计适应性视觉化,以支持正常钢琴演奏;(2)协助他们制作钢琴专家说明,鼓励即兴表演。为此,我们将建立一个模型,以了解学习者群体数据的复杂性,并利用这些数据支持学习。然后我们将通过用户研究来评估我们的方法,促进实践和即兴表演。我们的工作有助于适应性视觉化如何推动音乐仪器的学习,并支持在隐蔽空间开展多目标选择任务。