Skip to main content

Sequential motor learning transfers from real to virtual environment

Abstract

Background

Skill acquisition of motor learning between virtual environments (VEs) and real environments (REs) may be related. Although studies have previously examined the transfer of motor learning in VEs and REs through the same tasks, only a small number of studies have focused on studying the transfer of motor learning in VEs and REs by using different tasks. Thus, detailed effects of the transfer of motor skills between VEs and REs remain controversial. Here, we investigated the transfer of sequential motor learning between VEs and REs conditions.

Methods

Twenty-seven healthy volunteers performed two types of sequential motor learning tasks; a visually cued button-press task in RE (RE task) and a virtual reaching task in VE (VE task). Participants were randomly assigned to two groups in the task order; the first group was RE task followed by VE task and the second group was VE task followed by RE task. Subsequently, the response time in RE task and VE task was compared between the two groups respectively.

Results

The results showed that the sequential reaching task in VEs was facilitated after the sequential finger task in REs.

Conclusions

These findings suggested that the sequential reaching task in VEs can be facilitated by a motor learning task comprising the same sequential finger task in REs, even when a different task is applied.

Background

Motor learning refers to an improvement in the performance of sensory-guided motor behavior via practice [1]. The acquisition of new skills through motor practice is essential to interact with the environment and adjust the integration of multiple elements of movement. The two components of the learning process [2, 3] include implicit motor learning that improves the performance of a sequence without the knowledge of the sequence [4] and explicit motor learning that involves conscious recollection with the knowledge of the sequence. The memory system employed differs between implicit and explicit learning [5]. Explicit motor learning is associated with the activity of the dorsal premotor cortex, dorsolateral prefrontal cortex, and supplementary motor area [6]. By contrast, implicit learning is primarily related to the activity of the contralateral sensory and primary motor cortices [7]. Previous studies focusing on implicit motor learning have reported the activations of the right ventral striatum [8,9,10], right thalamus [9], and subcortical regions [11] during a serial reaction time task (SRTT). This implicit sequential task has been widely used to quantitatively evaluate the acquisition of a new skill [12,13,14].

Virtual environments (VEs) have attracted attention with the recent advances in technology. VEs can modulate perception and cognition by providing coherent sensory feedback that corresponds to the actions taken place within the VE and grants users the psychological sense of being present there [15]. To illustrate, previous studies have reported that both the agency and ownership of the virtual hand are induced concurrently if the visual presentation of the virtual hand movement matches the subject’s active hand movement [16,17,1819]. Due to their applicability and expandability, VEs have been introduced as new effective approaches in rehabilitation. For instance, previous studies have demonstrated that VEs could contribute to effective interventions for the improvement of upper limb function, balance, and gait after stroke [20,21,22,23]. Other studies have suggested that VE training could improve balance, gait, motor function, and quality of life in patients with Parkinson’s disease [24,25,26] and motor function in children with cerebral palsy [27]. Furthermore, several studies have reported that VEs also promote motor learning [9, 15, 16]. However, opinions vary concerning how learning in virtual and real environments (REs) could affect motor skill acquisition. For example, a previous study has suggested that post-training performance in virtual and real training is equivalent and both of which significantly exceeds without training [28]. However, another study demonstrated that training in VE cannot promote better performance than the same task in RE [29]. Furthermore, several reports focused on interactions of skill acquisition of motor learning in VEs and REs. For instance, a study in healthy subjects demonstrated that skill acquisition of the sequential motor learning occurs at the same rate in both VE and conventional screen environments, while the transfer of motor skills was not observed from VE to the screen environment [30]. Another study reported that skill acquisition in individuals with the neuromuscular disease transferred from VEs to REs [31]. In contrast, motor learning and motor performance did not transfer from VEs to REs in older adults and individuals with neuromuscular diseases [29, 32, 33]. These results imply the presence of some relationship in skill acquisition of motor learning between VEs and REs. However, whether the transfer of skill acquisition of motor skills occurs between VEs and REs is still controversial. The above-mentioned studies investigated the relationship between motor learning with the same tasks between different environments (VE and RE), whereas few studies focused on motor learning with different tasks in different environments. As for motor learning transfer, previous studies also suggested motor skill learning transfer in the case of the same environments concerning different tasks. For instance, the transfer of partial learning has been reported using SRTT [34], and motor skill transfer from one hand to the other has also been suggested [35]. Furthermore, motor skill transfer from one hand to the other was demonstrated in VEs [36]. Considering the relationship between motor learning skill acquisition between VEs and REs, we hypothesized that motor learning transfer occurs between VEs and REs even in the case of different tasks.

Therefore, the present study was aimed at revealing whether motor learning transfer could occur between VEs and REs even in the case of different tasks. In the present study, participants were randomly assigned to one of two groups. Both groups performed sequential motor learning tasks in both environments. However, one group performed a sequential button-press task in RE first, followed by a sequential reaching task in VE. The second group performed a sequential reaching task in VE, followed by a sequential button-press task in RE. To examine motor learning transfer, we compared the response time between the two motor learning tasks.

Methods

Participants

Thirty healthy volunteers (21.5 ± 3.0 years; 23 women) participated in this study. All participants were right-handed, as determined by the Edinburgh Handedness Inventory Test (Oldfield, 1971). No participant had a history of neurological or psychiatric disease, and all had a normal or corrected-to-normal vision (10 participants wore contact lenses). In accordance with the Declaration of Helsinki, we explained the purpose and possible consequences of this study to all participants and obtained their informed consent before the study commenced.

Experimental design

In order to examine the transfer of motor learning, the participants performed sequential motor learning tasks in both REs and VEs (Fig. 1A). For the motor learning task in a RE, the participants performed a visually cued button-press task (RE task; Fig. 1B). For the motor learning task in a VE, the participants performed a virtual reaching task (VE task; Fig. 1C).

Fig. 1
figure 1

Experimental procedure. A The participants performed sequential motor learning tasks in both real environments (REs); a visually cued button-press task and virtual environments (VEs); a virtual reaching task. After completing all experiments, the participants answered a questionnaire regarding virtual hand illusions. Interval between the tasks was 5-minutes. Task order was randomly and evenly distributed. B In RE task, participants performed a 12-digit visually cued button-press sequence task consisting of six blocks (S1–S6) and two random blocks (R1, R2). Random blocks were set before (R1) and after (R2) sequence blocks. C In the VE task, participants performed a 12-digit virtual reaching sequence task consisting of six blocks (S1-S6) and two random blocks (R1, R2). Random blocks were set before (R1) and after (R2) sequence blocks. Sequential motor learning tasks in both REs and VEs were composed by a 12-digit same sequence

The participants were randomly assigned to two groups to keep a counter balance in the task order; the first group was RE task followed by VE task (RE-VE group) and the second group was VE task followed by RE task (VE-RE group). There was a 5-minute interval between the tasks. After completing all experiments, the participants were asked to answer a virtual hand illusion (VHI) questionnaire. Considering fatigue, the total time of the performed tasks was controlled in both groups (RE task: RE-VE group 570.2 ± 27.0 s, VE-RE group 569.2 ± 27.1 s, VE task: RE-VE group 890.0 ± 143.3 s, VE-RE task 896.9 ± 241.7 s). Three participants (one in the RE-VE group and two in the VE-RE group) were excluded from data analysis as their mean responses were beyond ± 2SD from the mean for subjects. Thus, the final sample size included 27 participants, of which 13 were in the RE-VE group and 14 in the VE-RE group.

Motor learning task in RE (RE task)

The participants performed a visually cued button-press task consisting of a 12-digit motor sequential learning task in which participants were required to react with their four right-hand fingers (Fig. 1A) [14]. Four horizontal bars were displayed on the screen (Fig. 2A). When the color of a bar changed from gray to blue, the participants were instructed to press the corresponding button as quickly and accurately as possible. If a participant pressed the correct button, the next stimulation was presented after 1 s. If a participant pressed an incorrect button, the stimulation was unchanged until the participant pressed the correct button. This motor learning task consisted of five sequence blocks (S1–S5) and two random blocks (R1, R2). Random blocks were set before (R1) and after the five sequence blocks (R2). The sequence blocks comprised five repeats of 12 stimuli in the same sequence. Thus, a total of 300 button presses were performed in a sequence block, whereas 120 button presses were performed in a random block.

Fig. 2
figure 2

Experimental environments. A Real environment; Four horizontal bars were displayed on the screen. When the color of a bar changed from gray to blue, the participants were instructed to press the corresponding button as quickly and accurately as possible. B The participant wore a head-mounted display and sat in a chair at a specific position where they could reach all the targets and the base point easily with minimal arm movement. C Virtual environment; When participants touched the base point with their right virtual hand, the color of target changed from gray to green. The participants were instructed to reach the target as quickly and accurately as possible

Motor learning task in VE (VE task)

In the motor learning task in VE, four transparent gray targets with a cylindrical shape and a transparent blue base point with a hemispherical shape were displayed on a virtual desk located in a VE. The participant was fixed with a head-mounted display (HMD) and instructed to sit in a chair at a specific position where they could reach all the targets and the base point easily with minimal arm movement, and to perform a virtual reaching task (Fig. 2B). The base point disappeared when the participants kept their virtual hand in the hemisphere for 1 s, which meant the beginning of an experimental trial. As the color of a target changed from gray to green, the participants were instructed to put the virtual right hand, which was rendered overlapping at the participant’s hand position in the RE, into the designated target as quickly and accurately as possible. The color of target changed from green to red when the participants reached the target. As the base point was displayed again just after the virtual hand successfully reached the target; the participants could start the next trial whenever they liked by touching it. However, if the virtual hand could not reach the intended target within 2 s, the color of the target changed from green to red together with the re-emergence of the base point. In this case, the color of the target returned to gray when the participant touched the base point, and the next trial was presented.

To examine the transfer of sequential motor learning, the orders of sequence were exactly same in both tasks. Thus, VE task also consisted of five sequence blocks (S1–S5) and two random blocks (R1, R2) and a total of 300 virtual reaching were performed in a sequence block, whereas 120 virtual reaching were performed in a random block.

Apparatuses

In the RE task, visual stimuli were applied by Presentation System (Neurobehavioral Systems, USA) and recording of response times were realized by fiber optic computer response system (PKG-9904, Current Design Inc., USA) (Fig. 2A).

In the VE task, we developed a Virtual Reality experimental system by integrating an HMD (Oculus Rift, Oculus) and a hand tracking system (Leap Motion, Ultraleap Ltd.) into a game engine (Unity 2018.4.24, Unity Technologies) (Fig. 2B). Our VE task mainly consisted of four cylindrical targets, a hemispherical base point, a desk, and a virtual right hand. Leap Motion attached on the HMD tracked the participant’s hand position, orientation, and posture, and the information was applied to render the virtual hand in the VE. The four cylindrical targets were symmetrically allocated every 30 degrees centering around the base point (Fig. 2B); the distance between the base point and each target were 25 cm in the scale of RE. The collision detection with the targets or base point was based on the distance between their center positions and the palm position of virtual hand. It was considered that the hand reached a target or base point when the distance became smaller than their diameters; in the scale of RE, the diameters of targets and base point were 10 cm, respectively. Rendering of VE was performed in 80 Hz which was the same as the refresh rate of Oculus Rift. The sampling time for the experiment control was set in 20 ms (i.e., 50 Hz sampling rate), within which the collision detection, control of experimental condition, and data acquisition were performed.

Table 1 Virtual hand illusion questionnaire (VHI questionnaire)

VHI questionnaire

We subjectively evaluated the participant’s experience or feeling of the right hand during movements of the virtual right hand. The participants were asked to answer a VHI questionnaire with a seven-point Likert scale (− 3 to + 3). In the seven-point Likert scale, − 3 and + 3 were set as “I strongly disagree with the statement” and “I strongly agree with the statement”, respectively; 0 was considered as a neutral rating allocated for unjudgeable experience. The applied questionnaire items, based on the original rubber hand illusion questionnaire [37], are shown in Table 1.

The first two items were designed to correspond to the VHI. The illusion items assessed the embodiment of virtual hand (Q1) and the sense of agency (Q2) during the experiment, respectively. The other items served as control for suggestibility, which were unrelated to the VHI. The suggestibility meant that sometimes the participants rated all the items in the same manner for any reason and was therefore removed from the analysis.

Statistical analysis

Statistical analyses were performed using MATLAB (R2017a) and SPSS (version 25). First, the effects of time (R1 vs. S5) and task order (RE-VE group vs. VE-RE group) on the response times were assessed with a two-way repeated measure analysis of variance (ANOVA). The Greenhouse–Geisser correction was applied to the degrees of freedom when the sphericity assumption was violated. In case of significant effects, post hoc analyses were performed to test interaction effects with unpaired t-tests. Next, the mean rating for Q1 and Q2 was compared with RE-VE group and VE-RE group using a Mann–Whitney U test.

Results

Response time in the RE task

A two-way repeated measure ANOVA with factors time (Blocks) and task order (RE-VE group vs. VE-RE group) showed a significant main effect of time (F(6,25) = 5.121, p = 0.003, η2p = 0.17) but not task order (F(1,25) = 0.197, p = 0.661, η2 p = 0.008) or time × task order interaction (F(6,25) = 0.667, p = 0.568, η2 p = 0.026) (Fig. 3A).

Fig. 3
figure 3

Response times during the RE and VE tasks. A Response times during the RE task. During the RE task, we observed a significant main effect of time (Blocks) (p < 0.05). B Response times during the VE task. During the VE task, we observed no significant main effect of time (Blocks), although we could obtain a significant time × task order (RE-VE group vs. VE-RE group) interaction (p < 0.05). Post hoc analyses revealed that response time was significantly different between two groups only in S5 block (*p < 0.05)

Response time in the VE task

A two-way repeated measure ANOVA with factors time (Blocks) and task order (RE-VE group vs. VE-RE group) revealed no significant main effect of time (F(6,25) = 0.984, p = 0.387, η2 p = 0.038) and task order (F(1,25) = 1.184, p = 0.287, η2 p = 0.045), and a significant time × task order interaction (F(6,25) = 4.835, p = 0.01, η2 p = 0.162) (Fig. 3B). In order to further investigate the significant time × task order interaction, post hoc analyses were performed for each block with Student t-test. The results showed significant differences between the RE-VE and VE-RE groups only in the S5 block (t(25) = 2.551, p = 0.017).

VHI questionnaire

A Mann–Whitney U test showed no significant difference in VHI questionnaire between VE-RE group and RE-VE group (Q1: z = − 0.351, p = 0.725; Q2: z = − 0.30, p = 0.764) (Fig. 4).

Fig. 4
figure 4

Results of virtual hand illusion questionnaire about Q1 and Q2 between VE-RE group and RE-VE group. No significant difference between VE-RE group and RE-VE group was observed

Discussion

The present study investigated the transfer of motor learning between VEs and REs in different tasks. The results suggested that motor learning in VEs may be facilitated after motor learning in REs even if different tasks are applied.

VEs enable individuals to have virtual experiences that are similar to those in REs. However recent studies have shown that the learning mechanism between VEs and REs is different [38]. As for the neurophysiological aspects of visual processes, visual information is processed thorough ventral and dorsal pathways. The ventral path provides perception and identification of visual inputs, and the dorsal path monitors real-time information [39, 40]. In the REs, the visual information within peripersonal space was processed using the dorsal path [41], whereas visual processing in VEs induced the ventral path [42]. These results indicate that processing of sensory information in the brain between VEs and REs is different. In the present study, motor learning in REs improved motor learning in VEs, whereas motor learning in VEs did not improve motor learning in REs. Some studies have demonstrated that motor learning in VEs requires more brain activity than in REs for cognitive and motor control [43, 44]. In addition, Ranganathan et al. [45] reported that motor learning in different environments interferes with each other. If the first task does not share task environments with the later task, there is prolonged interference in learning the later task. However, another study reported that motor learning in REs involved more implicit motor learning compared with motor learning in VEs [46]. In addition, studies on motor learning transfer in REs with different tasks have suggested that the higher the similarity of tasks, the higher is the transfer [47, 48]. Moreover, previous studies have demonstrated that the transfer of implicit motor learning is not observed in the cases of changing response locations [49] or stimulus–response associations [50]. Furthermore, different tasks have been shown to cause interference or inhibit the transfer of motor learning [51, 52]. Given these findings, we would not expect the transfer of motor learning between the sequential button-press task and sequential reaching task to be induced in REs. Thus, these results support our finding that sequential motor learning in VEs is facilitated after sequential motor learning in REs despite interference with different environments and tasks. However, additional research is required to assess this possibility because we did not evaluate neurophysiological changes using electroencephalogram or functional magnetic resonance imaging.

In the present study, the virtual reaching task in VEs did not promote sequential learning in the VE-RE group. Previous research on VEs employed several tools, such as a two-joint mechanical arm [53], joysticks [54] and pinch force sensors [30], which showed improvement in the motor learning ability. These experiments were performed using sensory information as clues instead of visual information, like the arm-reaching task used in the present study. Another study reported that providing tactile feedback using sensor gloves in VEs reduces the discrepancy between the virtual and physical environments [55]. These results indicate that the arm-reaching task in VEs may not facilitate sequential learning because of the lack of tactile stimulation. Furthermore, several studies have reported that motor learning in VEs is influenced by individual factors [30, 56, 57]. For instance, experience with video games showed a positive impact on performance in VEs [30, 58]. Considering the reports of the aforementioned studies, the lack of motor learning capacity in VEs observed in the present study may be attributed to individual factors.

The present study has several limitations. First, although the present study focused on motor learning transfer with different tasks in different environments, motor learning transfer was investigated only between a visual button-press task in RE and a virtual reaching task in VE. Therefore, we could not rule out the impact of task-dependent (button-press task in VE versus arm-reaching task in RE) and environment-dependent (button-press task in RE versus button-press task in VE, arm-reaching task in RE versus arm-reaching task in VE) factors. Also, we could not deny the effects of environmental differences with wearing the HMD since we did not wear the HMD in REs. However, to the best of our knowledge, no study has been published that focuses on motor learning transfer with different tasks in different environments. Therefore, we believe that our findings could trigger the expansion of VE studies focusing on motor learning transfer of different variables, such as tasks and environments. Second, in the present study, the effects of motor learning were evaluated relative to the response time alone. The results of other motor learning studies could be different due to study design, variations of the tasks, methodological differences, and the phase of motor learning [53]. For example, a motor learning study focusing on visuomotor adaptation described investigations based on the movement trajectory and angles as variables [54], suggesting that the present results might represent only parts of the puzzle in the field of motor learning. According to the type of assessed motor learning, the appropriate variables related to motor learning need to be carefully selected. Third, we subjectively evaluated the experience of the participants or their feeling of the right hand during the movements of the virtual right hand using the VHI questionnaire [22]. Interestingly, recent studies also propose further questionnaires that include multiple items of embodiment and sense of agency [59, 60]. These questionnaires might also be used to provide further support. Finally, we used the SRTT proposed by Nissen and Bullemer to assess implicit learning [14]. However, time constraints did not allow us to test offline learning as a consolidation effect. Therefore, we could not deny the possibility that it was the performance with short-term change instead of learning with long-term change. Future studies would be required, spanning over separate days, to assess memory retention.

Conclusions

The present study investigated whether the transfer of motor learning can occur even in different tasks between VEs and REs. In order to examine the transfer of motor learning, we compared the response time between both motor learning tasks. Results showed that the sequential reaching task in VEs was facilitated after the sequential finger task in REs. These results suggested that motor learning in VEs may be facilitated after motor learning in REs despite interference with different environments and tasks. However, we cannot discuss the neurophysiological aspect for the transfer of motor learning between VEs and REs since we did not evaluate the neurophysiological data. Thus, to demonstrate the detailed neural mechanism of sequential learning from RE to VE, further study is needed.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

VEs:

virtual environments.

REs:

real environments.

SRTT:

serial reaction time task.

VHI:

virtual hand illusion.

HMD:

head-mounted display.

References

  1. Krakauer JW, Mazzoni P. Human sensorimotor learning: adaptation, skill, and beyond. Curr Opin Neurobiol. 2011;21:636–44.

    Article  CAS  PubMed  Google Scholar 

  2. Willingham DB. Becoming aware of motor skill. Trends Cogn Sci. 2001;5:181–2.

    Article  PubMed  Google Scholar 

  3. Willingham DB. A neuropsychological theory of motor skill learning. Psychol Rev. 1998;105(3):558–84.

    Article  CAS  PubMed  Google Scholar 

  4. Robertson EM. From creation to consolidation: a novel framework for memory processing. PLoS Biol. 2009;7:e19.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  5. Kantak SS, Mummidisetty CK, Stinear JW. Primary motor and premotor cortex in implicit sequence learning–evidence for competition between implicit and explicit human motor memory systems. Eur J Neurosci. 2012;36:2710–5.

    Article  PubMed  Google Scholar 

  6. Honda M, Deiber MP, Ibáñez V, Pascual-Leone A, Zhuang P, Hallett M. Dynamic cortical involvement in implicit and explicit motor sequence learning. A PET study. Brain. 1998;121(Pt 11):2159–73.

    Article  PubMed  Google Scholar 

  7. Pascual-Leone A, Grafman J, Hallett M. Modulation of cortical motor output maps during development of implicit and explicit knowledge. Science. 1994;263:1287–9.

    Article  CAS  PubMed  Google Scholar 

  8. Destrebecqz A, Peigneux P, Laureys S, Degueldre C, Del Fiore G, Aerts J, et al. The neural correlates of implicit and explicit sequence learning: interacting networks revealed by the process dissociation procedure. Learn Mem. 2005;12:480–90.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Rauch SL, Whalen PJ, Savage CR, Curran T, Kendrick A, Brown HD, et al. Striatal recruitment during an implicit sequence learning task as measured by functional magnetic resonance imaging. Hum Brain Mapp. 1997;5:124–32.

    Article  CAS  PubMed  Google Scholar 

  10. Doyon J, Owen AM, Petrides M, Sziklas V, Evans AC. Functional anatomy of visuomotor skill learning in human subjects examined with positron emission tomography. Eur J Neurosci. 1996;8:637–48.

    Article  CAS  PubMed  Google Scholar 

  11. Doyon J, Laforce R Jr, Bouchard G, Gaudreau D, Roy J, Poirier M, et al. Role of the striatum, cerebellum and frontal lobes in the automatization of a repeated visuomotor sequence of movements. Neuropsychologia. 1998;36:625–41.

    Article  CAS  PubMed  Google Scholar 

  12. Nojima I, Watanabe T, Gyoda T, Sugata H, Ikeda T, Mima T. Transcranial static magnetic stimulation over the primary motor cortex alters sequential implicit motor learning. Neurosci Lett. 2019;696:33–7.

    Article  CAS  PubMed  Google Scholar 

  13. Sugata H, Yagi K, Yazawa S, Nagase Y, Tsuruta K, Ikeda T, et al. Modulation of motor learning capacity by transcranial alternating current stimulation. Neuroscience. 2018;391:131–9.

    Article  CAS  PubMed  Google Scholar 

  14. Nissen MJ, Bullemer P. Attentional requirements of learning: evidence from performance measures. Cogn Psychol. 1987;19:1–32.

    Article  Google Scholar 

  15. Melo M, Goncalves G, Monteiro P, Coelho H, Vasconcelos-Raposo J, Bessa M. Do multisensory stimuli benefit the virtual reality experience? A systematic review. IEEE Trans Vis Comput Graph. 2020;PP.

  16. Ma K, Hommel B. The virtual-hand illusion: effects of impact and threat on perceived ownership and affective resonance. Front Psychol. 2013;4:604.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Llobera J, Sanchez-Vives MV, Slater M. The relationship between virtual body ownership and temperature sensitivity. J R Soc Interface. 2013;10:20130300.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Sanchez-Vives MV, Spanlang B, Frisoli A, Bergamasco M, Slater M. Virtual hand illusion induced by visuomotor correlations. PLoS One. 2010;5(4):e10381.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  19. Slater M, Perez-Marcos D, Ehrsson HH, Sanchez-Vives MV. Inducing illusory ownership of a virtual body. Front Neurosci. 2009;3:214–20.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Karamians R, Proffitt R, Kline D, Gauthier LV. Effectiveness of virtual reality- and gaming-based interventions for upper extremity rehabilitation poststroke: a meta-analysis. Arch Phys Med Rehabil. 2020;101:885–96.

    Article  PubMed  Google Scholar 

  21. de Rooij IJ, van de Port IG, Meijer JG. Effect of virtual reality training on balance and gait ability in patients with stroke: systematic review and meta-analysis. Phys Ther. 2016;96:1905–18.

    Article  PubMed  Google Scholar 

  22. Li Z, Han XG, Sheng J, Ma SJ. Virtual reality for improving balance in patients after stroke: a systematic review and meta-analysis. Clin Rehabil. 2016;30:432–40.

    Article  PubMed  Google Scholar 

  23. Pollock A, Farmer SE, Brady MC, Langhorne P, Mead GE, Mehrholz J, et al. Interventions for improving upper limb function after stroke. Cochrane Database Syst Rev. 2014;2014:Cd010820.

    PubMed Central  Google Scholar 

  24. Triegaardt J, Han TS, Sada C, Sharma S, Sharma P. The role of virtual reality on outcomes in rehabilitation of Parkinson’s disease: meta-analysis and systematic review in 1031 participants. Neurol Sci. 2020;41:529–36.

    Article  PubMed  Google Scholar 

  25. Wang B, Shen M, Wang YX, He ZW, Chi SQ, Yang ZH. Effect of virtual reality on balance and gait ability in patients with Parkinson’s disease: a systematic review and meta-analysis. Clin Rehabil. 2019;33:1130–8.

    Article  PubMed  Google Scholar 

  26. Dockx K, Bekkers EM, Van den Bergh V, Ginis P, Rochester L, Hausdorff JM, et al. Virtual reality for rehabilitation in Parkinson’s disease. Cochrane Database Syst Rev. 2016;12:Cd010760.

    PubMed  Google Scholar 

  27. Chen Y, Fanchiang HD, Howard A. Effectiveness of virtual reality in children with cerebral palsy: a systematic review and meta-analysis of randomized controlled trials. Phys Ther. 2018;98:63–77.

    Article  PubMed  Google Scholar 

  28. Rose FD, Attree EA, Brooks BM, Parslow DM, Penn PR, Ambihaipahan N. Training in virtual environments: transfer to real world tasks and equivalence to real task training. Ergonomics. 2000;43:494–511.

    Article  CAS  PubMed  Google Scholar 

  29. Bezerra ÍMP, Crocetta TB, Massetti T, Silva TDD, Guarnieri R, Meira CM Jr, et al. Functional performance comparison between real and virtual tasks in older adults: a cross-sectional study. Medicine. 2018;97:e9612.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Juliano JM, Liew SL. Transfer of motor skill between virtual reality viewed using a head-mounted display and conventional screen environments. J Neuroeng Rehabil. 2020;17:48.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Quadrado VH, Silva TDD, Favero FM, Tonks J, Massetti T, Monteiro CBM. Motor learning from virtual reality to natural environments in individuals with Duchenne muscular dystrophy. Disabil Rehabil Assist Technol. 2019;14:12–20.

    Article  PubMed  Google Scholar 

  32. Massetti T, Favero FM, Menezes LDC, Alvarez MPB, Crocetta TB, Guarnieri R, et al. Achievement of virtual and real objects using a short-term motor learning protocol in people with Duchenne muscular dystrophy: a crossover randomized controlled trial. Games Health J. 2018;7:107–15.

    Article  PubMed  Google Scholar 

  33. de Mello Monteiro CB, Massetti T, da Silva TD, van der Kamp J, de Abreu LC, Leone C, et al. Transfer of motor learning from virtual to natural environments in individuals with cerebral palsy. Res Dev Disabil. 2014;35:2430–7.

    Article  PubMed  Google Scholar 

  34. Rhein Z, Vakil E. Motor sequence learning and the effect of context on transfer from part-to-whole and from whole-to-part. Psychol Res. 2018;82:448–58.

    Article  PubMed  Google Scholar 

  35. Birbaumer N. Motor learning: passing a skill from one hand to the other. Curr Biol. 2007;17:R1024-6.

    Article  PubMed  CAS  Google Scholar 

  36. Ossmy O, Mukamel R. Using virtual reality to transfer motor skill knowledge from one hand to another. J Vis Exp. 2017;(127):55965.

  37. Botvinick M, Cohen J. Rubber hands ‘feel’ touch that eyes see. Nature. 1998;391:756.

    Article  CAS  PubMed  Google Scholar 

  38. Chu VW, Sanger TD. Two different motor learning mechanisms contribute to learning reaching movements in a rotated visual environment. F1000Res. 2014;3:72.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Goodale MA, Milner AD. Two visual pathways - Where have they taken us and where will they lead in future? Cortex. 2018;98:283–92.

    Article  PubMed  Google Scholar 

  40. Milner AD, Goodale MA. Visual pathways to perception and action. Prog Brain Res. 1993;95:317–37.

    Article  CAS  PubMed  Google Scholar 

  41. Weiss PH, Marshall JC, Zilles K, Fink GR. Are action and perception in near and far space additive or interactive factors? Neuroimage. 2003;18:837–46.

    Article  PubMed  Google Scholar 

  42. Beck L, Wolter M, Mungard NF, Vohn R, Staedtgen M, Kuhlen T, et al. Evaluation of spatial processing in virtual reality using functional magnetic resonance imaging (FMRI). Cyberpsychol Behav Soc Netw. 2010;13:211–5.

    Article  PubMed  Google Scholar 

  43. Rohde M, Narioka K, Steil JJ, Klein LK, Ernst MO. Goal-related feedback guides motor exploration and redundancy resolution in human motor skill acquisition. PLoS Comput Biol. 2019;15:e1006676.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  44. Slobounov SM, Ray W, Johnson B, Slobounov E, Newell KM. Modulation of cortical activity in 2D versus 3D virtual reality environments: an EEG study. Int J Psychophysiol. 2015;95:254–60.

    Article  PubMed  Google Scholar 

  45. Ranganathan R, Wieser J, Mosier KM, Mussa-Ivaldi FA, Scheidt RA. Learning redundant motor tasks with and without overlapping dimensions: facilitation and interference effects. J Neurosci. 2014;34:8289–99.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  46. Anglin JM, Sugiyama T, Liew SL. Visuomotor adaptation in head-mounted virtual reality versus conventional training. Sci Rep. 2017;7:45469.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  47. Livesey JP, Laszlo JI. Effect of task similarity on transfer performance. J Mot Behav. 1979;11:11–21.

    Article  CAS  PubMed  Google Scholar 

  48. Leonard SD, Karnes EW, Oxendine J, Hesson J. Effects of task difficulty on transfer performance on rotary pursuit. Percept Mot Skills. 1970;30:731–6.

    Article  Google Scholar 

  49. Willingham DB, Wells LA, Farrell JM, Stemwedel ME. Implicit motor sequence learning is represented in response locations. Mem Cognit. 2000;28:366–75.

    Article  CAS  PubMed  Google Scholar 

  50. Schwarb H, Schumacher EH. Implicit sequence learning is represented by stimulus-response rules. Mem Cognit. 2010;38:677–88.

    Article  PubMed  Google Scholar 

  51. Caithness G, Osu R, Bays P, Chase H, Klassen J, Kawato M, et al. Failure to consolidate the consolidation theory of learning for sensorimotor adaptation tasks. J Neurosci. 2004;24:8662–71.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  52. Stockinger C, Thürer B, Stein T. Consecutive learning of opposing unimanual motor tasks using the right arm followed by the left arm causes intermanual interference. PLoS One. 2017;12:e0176594.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  53. Shibuya S, Unenaka S, Ohki Y. The relationship between the virtual hand illusion and motor performance. Front Psychol. 2018;9:2242.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Sense F, van Rijn H. Probabilistic motor sequence learning in a virtual reality serial reaction time task. PLoS One. 2018;13:e0198759.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  55. Perez-Marcos D. Virtual reality experiences, embodiment, videogames and their dimensions in neurorehabilitation. J Neuroeng Rehabil. 2018;15:113.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Grassini S, Laumann K, Rasmussen Skogstad M. The use of virtual reality alone does not promote training performance (but sense of presence does). Front Psychol. 2020;11:1743.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Piber D, Nowacki J, Mueller SC, Wingenfeld K, Otte C. Sex effects on spatial learning but not on spatial memory retrieval in healthy young adults. Behav Brain Res. 2018;336:44–50.

    Article  PubMed  Google Scholar 

  58. de Castell S, Larios H, Jenson J. Gender, videogames and navigation in virtual space. Acta Psychol (Amst). 2019;199:102895.

    Article  Google Scholar 

  59. Kalckert A, Ehrsson HH. Moving a rubber hand that feels like your own: a dissociation of ownership and agency. Front Hum Neurosci. 2012;6:40.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Petkova VI, Ehrsson HH. If I were you: perceptual illusion of body swapping. PLoS One. 2008;3(12):e3832.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge all the volunteers who participated in this study.

Funding

The work was supported by a grant from the KAKENHI [18H03132], the Japan Society for the Promotion of Science (JSPS).

Author information

Authors and Affiliations

Authors

Contributions

YT and HS contributed to designing of the experiment, data collection, data analysis, and drafting of the manuscript. MH contributed to the construction of Virtual Reality system. TI contributed to the construction of serial reaction time task system. YS contributed to the recruitment of participants. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Hisato Sugata.

Ethics declarations

Ethics approval and consent to participate

The experimental procedure was approved by the Ethical Committee for Oita University School of Medicine. In accordance with the Declaration of Helsinki, we explained the purpose and possible consequences of this study to all participants and obtained their informed consent before the study commenced.

Consent for publication

Written informed consent for the publication was obtained from all the participants.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Takeo, Y., Hara, M., Shirakawa, Y. et al. Sequential motor learning transfers from real to virtual environment. J NeuroEngineering Rehabil 18, 107 (2021). https://doi.org/10.1186/s12984-021-00903-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12984-021-00903-6

Keywords