Posted on December 12, 2024 by Jean M O'Sullivan

2023-2024 CSUN Research Fellow for HHD, Jacob Hinkel-Lipsker, Presents at Provost’s Colloquium

2023-2024 CSUN Research Fellow for HHD, Jacob Hinkel-Lipsker (Kinesiology) presented at the 16th Annual Research Fellows Colloquium hosted by the Provost in November. Hinkel-Lipsker’s project focuses on the feasibility of virtual reality for rehabilitation motor skills to generate new knowledge of how humans and virtual reality systems interact. This research is filling a knowledge gap in human-virtual reality interaction research by demonstrating the potential of virtual reality to improve learning and rehabilitation.

When humans put on a virtual reality headset, they are transported into an immersive digital world that can be anything or anywhere. Recent advancements of virtual reality systems make it so that these digital worlds closely mimic the real-world — opening up many possibilities to train rehabilitative skills. However, in order for this potential to be fully realized, a better understanding of the components of immersive virtual environments that translate to real-world motor skill development is needed.

Correspondingly, the project explores the fundamental research of human movements and experiences linked to learning in virtual reality environments which will best fit their particular learning needs.

Findings from the current study will benefit the U.S. economy and society as many schools and workplaces are using virtual reality systems to provide people with scalable training of complex motor skills. To properly examine the complexities of motor learning in virtual worlds, this project involves researchers from several disciplines including mechanical engineering, kinesiology, psychology, and vision science. Moreover, the multi-disciplinary approach of this project helps broaden participation of people from underrepresented groups, along with aids to bridge gaps between engineering and social science research fields.

The multidisciplinary research team in this project is developing two dynamic human-virtual reality interaction systems. One involves walking through a virtual world while avoiding obstacles, and the other utilizes a prosthetic arm and hand with a foot controller. Each system includes a virtual reality headset with strategically designed adaptive environments that scale to the skill level of the user.

Other subsystems record vital user data such as gait, eye gaze behaviors, and toe tapping events (while controlling the prosthesis). The developed systems rely on various sensors, such as eye trackers, 3D motion capture systems, and foot controller insoles that can fully capture the biomechanics of the users, as well as their strategies in performing assigned tasks.

Data analysis is leading to a clearer understanding of the bi-directional relationships between humans and virtual reality systems during motor learning or rehabilitation tasks. And, as humans enhance their skills, the VR systems adapt to their needs.

F2024
Jacob Hinkel-Lipsker