Balancing the playing field: collaborative gaming for physical training
- Michael Mace†1Email authorView ORCID ID profile,
- Nawal Kinany†1, 3,
- Paul Rinne1, 2,
- Anthony Rayner2,
- Paul Bentley2 and
- Etienne Burdet1, 4
© The Author(s) 2017
Received: 23 May 2017
Accepted: 16 October 2017
Published: 20 November 2017
Multiplayer video games promoting exercise-based rehabilitation may facilitate motor learning, by increasing motivation through social interaction. However, a major design challenge is to enable meaningful inter-subject interaction, whilst allowing for significant skill differences between players. We present a novel motor-training paradigm that allows real-time collaboration and performance enhancement, across a wide range of inter-subject skill mismatches, including disabled vs. able-bodied partnerships.
A virtual task consisting of a dynamic ball on a beam, is controlled at each end using independent digital force-sensing handgrips. Interaction is mediated through simulated physical coupling and locally-redundant control. Game performance was measured in 16 healthy-healthy and 16 patient-expert dyads, where patients were hemiparetic stroke survivors using their impaired arm. Dual-player was compared to single-player performance, in terms of score, target tracking, stability, effort and smoothness; and questionnaires probing user-experience and engagement.
Performance of less-able subjects (as ranked from single-player ability) was enhanced by dual-player mode, by an amount proportionate to the partnership’s mismatch. The more abled partners’ performances decreased by a similar amount. Such zero-sum interactions were observed for both healthy-healthy and patient-expert interactions. Dual-player was preferred by the majority of players independent of baseline ability and subject group; healthy subjects also felt more challenged, and patients more skilled.
This is the first demonstration of implicit skill balancing in a truly collaborative virtual training task leading to heightened engagement, across both healthy subjects and stroke patients.
Physiotherapy intensity is a well-recognised determinant of stroke recovery, although questions of method, timing, scheduling, etc., are still debated . Video games have been highlighted as a means to increase therapy intensity, by enabling round-the-clock access to exercises, independent of professional supervision, while incentivizing through stimulating feedback. Exercise games (‘exergames’) can replicate aspects of conventional physiotherapy such as repetitive joint stretches, functional manipulation, difficulty adaptation, while manipulating motivational and cognitive variables [2–4]. Incorporation of these factors can increase therapy efficiency, and facilitate skill transfer to real world function .
Recently, virtual therapy involving two or more players has been proposed as a means of further increasing intrinsic motivation, engagement and social inclusion [6–12]. By promoting social interaction alongside entertainment, the appeal of gamification can be extended to a broader audience who may otherwise be disinterested due to age, impairment, cognitive or experiential issues. Furthermore, playing with another patient, a carer, or a relative at the hospital or at home can prevent patient isolation.
Compared to single-player training games, multiplayer games are more engaging, with the level of impact depending partly upon participant personality traits [6, 12]. To date, the majority of multiplayer rehabilitation exergames do not elicit true motor interactions, in the sense of each individual’s performance being directly influenced by the other. For example, it is common for multiplayer games (e.g. [6, 13]) to divide goals into subtasks that can be completed independently by the players (whether or not simultaneously), without the performance of one player being influenced by the other(s) [14, 15]. By contrast, visuomotor learning paradigms that physically connect two subjects, can enforce inter-subject interactions, evident as a performance benefit not only for the weaker, but also the stronger partner (as shown in healthy populations) . This occurs through models of motor planning based upon a connected partner’s intentions, communicated both visually and haptically . However, to provide physical-coupling between two subjects requires the integration of a complicated robotic system which is not broadly applicable during home-based rehabilitation, an area where technology and gamification can make a significant difference. Therefore, this study aims to virtualise many of the latent aspects of a physical connection, using visual-coupling and task design alone, to enable more accessible and cost-effective sensor-based systems (e.g. MusicGlove ) and ultimately for these systems to benefit from such strategies. Despite removing the ability to physically assist patients, by defining a new paradigm in virtual human-human interaction, we aim to promote better (force) control and player engagement, regardless of any underlying skill mismatch between the participants. This should also prevent natural motor ‘slacking’ a common issue when using active assist devices. By utilising sensor-based technology which are both sensitive and work on functional movements (e.g. contributing to activities of daily living), more efficient rehabilitation can be achieved, as active participation from the impaired limb is required if a patient is to ultimately recover volitional and functional movement.
A significant issue in the design of multiplayer games, particularly amongst disabled users, is how to permit differences in skill-levels between players, and allow for effective gameplay, participation and enjoyment by all players [3, 19, 20]. If player abilities are not correctly balanced, the challenge will be too high and quickly lead to frustration for the less skilled player; while the more skilled player will not be challenged and is likely to become bored. A related concern is how to design a multiplayer game that inhibits natural slacking behaviour, in which one player (usually the less-skilled one) becomes disengaged, even though the overall game performance is maintained [21, 22]. For example, in the cooperative-mode of the classic pong game [11, 13], interaction between the partners is not required as the game can be completed with only one player active (e.g. the skilled player can score points even if the less skilled player misses). Although multiplayer functionality can promote exergame engagement, it is unclear which type results in the most effective interaction, especially for less-able subjects who are in danger of ‘falling behind’.
Co-activity characterised by a divisible task that either player can complete independently.
Competition each player interacts with the partner to fulfil their own goal and ultimately prevent the other player fulfilling their aim.
Cooperation the players work together to complete the task but have different roles (such as assistance i.e. master-slave, or educator-student).
Collaboration the interacting players are assigned the same role and need to work together to complete the task.
Previous rehabilitation games involving multiple players have focused on either co-active or competitive ([6, 11, 13]) types of interaction1. However, collaborative and cooperative interactions have several beneficial properties which can further promote motivation [10, 23]. These include: i) players needing to work together to achieve a common goal, thus promoting positive teamwork; ii) neither player is able to slack as the task is not divisible; iii) communication between players can help complete the task and promotes increased social inclusion. Additionally, in the case of collaboration, iv) having similar roles and task-goals enables consensual interaction, potentially empowering the patient by not a priori assigning them the role of the ‘learner’, and ultimately reducing the need for explicit instructions (with the latter requiring linguistic and cognitive aptitude). Given the theoretical advantages of collaboration, relative to other forms of inter-player interactions, we describe here a novel physical-training, social-gaming software, that embodies true collaboration. The aim of this proof-of-concept study is to elucidate on the effects of dual-player collaboration on human-human performance based on individual sensorimotor control whilst interacting in a visually-coupled task (i.e. there is no haptic or physical coupling between the dyads). This is compared with an equivalent single-player version, alongside user-experience, in both able and disabled subjects2.
Balancing act: multiplayer collaborative gaming
A motor-training paradigm was designed such that two subjects could train concurrently, while interacting and skill-sharing, regardless of baseline differences in subject ability. The two players may be, for example, a therapist and a disabled patient, two patients with differing disabilities, or even a sports-person and their coach.
Simple A simplified game, both in terms of strategy and graphics (e.g. 2D), allows individuals to focus on gameplay and sensorimotor control, while reducing distraction.
Dynamic A continuously changing task places higher demands on motor control, and encourages visuomotor coordination, sustained attention, and player engagement.
Multifaceted metrics Performance feedback to subjects in an immediate and readily-comprehensible fashion (e.g. points collected), can motivate them to achieve task goals and maintain practice . Concurrent information can be extracted to quantify how subjects interact, and examine the (social) strategies deployed.
Interactive The partners are virtually connected (visually and/or haptically), with their actions influencing each other’s behaviour. This promotes social interaction and may motivate training.
Collaborative The two players contribute equally to achieving the task goals, thus enhancing positive social interaction.
Locally redundant Redundant control refers to the ability of one partner helping the other achieve a common goal (e.g. a therapist supporting a cup being lifted by a patient). However, to avoid slacking or complacency, which prevents learning, redundancy should be local, meaning the task cannot be achieved by only one of the participants alone.
It was hypothesised that these features should, i) make the task achievable by impaired individuals who could not succeed alone, and ii) increase the difficulty for the better performer by having to compensate for the worse performer. Furthermore, we expect engagement to increase through inter-subject interaction , because of greater task assistance and achievement (for the inferior partner), and being challenged and/or requiring altruistic behaviour (from the superior partner).
Example embodiment: Balloon BuddiesTM
The primary aim of the game is to vary the height of the beam so that the buddy matches a moving target height. A secondary aim is to keep the buddy from rolling off the beam, requiring players to keep the beam horizontal. Players need to simultaneously control the height and inclination of the beam using their combined inputs. The target height is represented by a specified trajectory, shown as stars, which are ‘collected’ by colliding them with the buddy. Star collection results in the visually-presented game score incrementing and is accompanied by positive auditory feedback. If the buddy falls from the beam, it is inactivated for three seconds, before reappearing and dropping onto the beam. During this period, it is not possible to catch stars, thus resulting in a lower final score. For healthy subjects, the target trajectory was described by a pseudo-random function, y= sin(0.15x)+ sin(x)+0.5 sin(0.6x), where x is the horizontal translation, with similar functions selected in previous motor learning studies to ensure random but smooth trajectories . To make it easier for patients, a predictable sinusoidal target trajectory, y=1.5 sin(0.5x), was employed4.
Independently of us, Vanacken et al. have previously introduced a similar ball-balancing task (‘Balance pump’) as a mini-game within their virtual rehabilitation solution targeting multiple sclerosis . The main differences are, (a) their study did not define or explore the implicit skill balancing nature of the elicited interaction, (b) they utilised arbitrarily placed static targets, with no time constraints, and (c) we define a multidimensional scoring system including both performance and motor control measures. We believe (b) is more likely to lead to sequential interaction rather than continuous balanced collaboration as elicited by the smooth continuous trajectory of moving targets which is used in our study. Moreover, by defining additional measures (c), such as stability, it allows patients to achieve targets regardless of their ability to just hit stars.
In order to determine the effectiveness of dual-player functionality, a single-player mode of Balloon BuddiesTM was created. This differs from the above in that the only input is player-mediated grip-control to the left balloon. The right balloon automatically follows the ideal trajectory, independently of the player’s actions.
The game described satisfies the desired properties for a physical-training game, outlined in the previous section. It has simple rules, and uses uncomplicated, intuitive 2D graphics, with minimal distractions. Visual cues and feedback are overlaid onto the buddy system so as to avoid saccades. For example, the buddy’s eyes close (to indicate ‘sleeping’), when the beam is horizontal and buddy is stable. The grip-force applied by each subject is depicted in realtime, by the size of each balloon. The task is dynamic, in that the buddy is free to move continuously (vertically or rolling horizontally) subject to ‘physical’ forces (e.g. gravity, drag, friction). Several metrics have been defined, including number of stars collected, accuracy of trajectory pursuit, and stability of the beam (Fig. 1 b).
Of particular relevance here are the game’s social-interaction features. Thus, the paradigm is interactive, with players connected by the beam such that their collective actions have consequences on both the buddy and one another. For example, Fig. 1 c and d highlights that if either one of the players perform poorly (by either under- or overshooting), for a continuous period, this will lead to the buddy rolling off the beam, unless the other player takes corrective actions e.g. by matching their grip-force. Additionally, the task is collaborative as the players must work together to collect stars. Each player is assigned the same role, i.e. controlling the height of the beam, without a defined leader. Finally, as Fig. 1 c highlights, the task is locally redundant in that the buddy and beam system can tolerate intermittent mistakes whilst maintaining performance. For instance, even if one player falls behind in their trajectory pursuit, the other player can perform a compensatory manoeuver enabling star capture, before returning the balloon to stabilise the beam (Fig. 1 c). However, such compensation is achievable only within a small range of poor performances, hence inhibiting slacking behaviour. This local redundancy enables intrinsic skill balancing within the game without requiring an additional individual skill matching procedure. However, the global difficulty level, affecting both partners, can be adjusted, for instance between healthy-healthy and patient-expert dyads, by specifying different trajectories and/or system parameters.
Study 1: healthy-healthy experiment
Participants: Healthy, right-handed subjects without arm disability or cognitive impairment, were recruited and consented. Handedness was assessed by the Edinburgh Handedness Inventory (EHI). Subjects were paired randomly into dyads for dual-player game participation.
Protocol (Fig. 2 c): Initially, the two participants played the single-player mode (A) on separate tablet-PC screens, (30 stars, 1 min). They then played the dual-player game (B) on a common tablet using constant game parameters. This play order was repeated thrice (i.e. ABABAB). Following this, they played an additional dual-player game where the control of the left player was perturbed (i.e. an increase in their sensitivity). The aim of this was to explore the effects on collaboration, when increasing the difficulty for one of the partners. Subjects were not told about this change and used their right hand for each trial. Participants were requested to refrain from talking or gesturing to each other during gameplay, so as to reduce the possibility that interactions occurred because of factors unrelated to gameplay. At the end of the experiment, participants were provided with questionnaires probing engagement and user experience (Appendix (A) Questionnaires).
Study 2: patient-expert experiment
Participants: Consecutive stroke patients with arm weakness were screened over 3 months at Imperial College NHS Healthcare, within 2-weeks of presentation. Exclusion criteria were: 1) cognitive impairment (Mini-Mental State Examination < 27), 2) premorbid arm disability, or dependency (modified Rankin Score > 2), 3) comprehension difficulty, 4) visual impairments, 5) arm pain, 6) significant co-morbidities, 7) subsequent MRI failed to confirm stroke. No distinction was made between haemorrhagic or ischaemic stroke. Patients were assessed using the Fugl-Meyer Upper Extremity (FMUE: 0-66 scale), and short form of the Fugl-Meyer (S-FM: 0-12 scale), Edinburgh Handedness Inventory (EHI), and Hospital Anxiety and Depression Scale (HADS). Approval for the study was given by the South East Coast Research Ethics Committee and all participants signed an informed consent form prior to any study-related procedure. Each patient was paired with the same healthy expert subject (right-handed male, 25 years old). This healthy subject spent two hours playing the single-player game prior to the study, which was long enough to have a stable performance over the patient-expert trials and is highlighted by their average single-player score. In this paper we denote this trained, healthy individual as ‘expert’, and use this label to differentiate this healthy subject from the novice healthy subjects which participated in Study 1.
Protocol (Fig. 2 d): Patients first played in single-player mode (A), followed by dual-player mode (B) alongside the healthy expert. This order was repeated twice (i.e. ABAB design). Fewer repetitions occurred in this protocol than the healthy-healthy protocol in order to limit patient fatigue. During dual-player games, verbal communication was permitted between patients and expert. All trials were played with the impaired hand by patients, and right-hand by the expert. Calibration of the handgrip-control function relative to the patient’s maximum grip-force was conducted prior to each game. To reduce the level of challenge for the patient-expert dyads, game dynamics were also simplified, by adjusting friction, angular drag of the buddy, control sensitivity (k) and using a simple sine-wave trajectory (see “Game description” section for details).
Nr. of stars collected: A star is ‘collected’ when any part of the buddy diameter contacts any part of a passing star. This is a gross indicator of players’ ability to track the target trajectory, and is presented to subjects in real-time, as a cumulative score in the top right corner of the screen.
Accuracy: Computed as the percentage of time-frames in which the centre of the buddy lies within a narrow vertical margin (< 30% of the buddy’s diameter) of the reference trajectory (line connecting midpoints of stars). Whilst correlated with the ‘nr. of stars collected’, ‘accuracy’ represents finer control, and is a more challenging metric to achieve a high score on, as subjects can collect stars without being very accurate. Accuracy was displayed to participants at the end of the trial.
Stability: Reflects the degree with which the beam is held horizontally, and is computed as the percentage of frames where the vertical difference between the two ends of the beam is less than a certain threshold (< 20% of buddy’s diameter). Compared to other metrics, it is a better indicator of partner cooperation since it requires partner matching, rather than trajectory tracking. It is also a measure of control smoothness since the trajectory can be tracked accurately even though the beam moves chaotically in a seesaw manner (i.e. low stability). Stability feedback is provided during gameplay by the buddy closing its eyes when the stability condition is met. In order to encourage collaborative behaviour, bonuses appear when the plank is stable for a certain time (i.e. four seconds), in the form of stars worth three points instead of one point.
Motor control measures
Effort: Estimated as the root-mean-square of filtered force, which takes into account both expected force bias and variation.
Smoothness: Computed as the spectral arc length (SPARC) of the first derivative of the filtered force data , which is a sensitive and robust measure of smoothness, e.g. for evaluating intra-subject task-differences during motor control experiments.
Following completion of all games, subjects were provided with questionnaires that assessed their engagement and preference of single-versus-dual player modes (Appendix (A) Questionnaires). The engagement questionnaire, based on the Intrinsic Motivation Inventory (IMI) consisted of questions divided into three subscales: enjoyment and interest, perceived competence, effort and importance [30, 31]. Subjects graded their opinion, referring to either single- or dual-player modes, on statements (e.g. ‘I tried very hard on this game’) using a scale from 1 to 7 (1 = ‘completely untrue’, 4 = ‘neutral’ and 7 = ‘very true’). Healthy subjects were provided with five statements per subscale (15 statements in total); for patients this was reduced to two statements per subscale (6 statements in total). The second part of the questionnaire evaluated user preferences of each player mode, as well as being questioned on which player mode subjects felt they ‘put most effort in’, ‘were the most skilled’ and ‘were the most pressured’. A box for free text comments was also provided. Patients were also asked if they wanted to continue playing and for those answering ‘no’, were asked for their reason.
Non-parametric, paired statistical tests were used throughout e.g. Mann-Whitney U (MWU) for testing performance differences between single and multiplayer scores, because of relatively small sample sizes, non-Gaussian distributions of the variables of interest, and an intra-subject design. For comparison of questionnaire results between player modes, a two-way Friedman test for the IMI questionnaire (> 1 question per category) and MWU for the user-experience questionnaire (1 question per category), were used. Correction for multiple comparisons was made using the Bonferroni method. Spearman correlation coefficients (ρ) were computed to measure associations between variables (e.g. IMI subscales, scores, etc.). Standard errors were calculated on the correlational values using a bootstrapping method on the data (e.g. age vs. scores) and 10,000 random resamples . This allowed p-values to be estimated (e.g. between game-modes) to elucidate on significant differences across correlations by taking the difference between the variables of interest and counting the number of samples above or below zero (multiplied by two for a two-tailed test). To highlight relationships (e.g. between single-player and multiplayer scores), best fit lines were computed using ordinary least squares.
Demographics and information for the healthy and patient experimental groups
Group size [nr. of subjects]
Dominant hand [R/L]
Affected side [R/L]
There was no significant difference between single versus dual-player modes with regards to the number of stars collected (p=0.34) or stability (p=0.25). However, on average, accuracy decreased during the dual-player condition (15.1±7.9% vs. 13.0±5.3%; mean ± std; p<0.05). For each trial, the maximum number of stars that could be collected was 40 (including bonuses).
Regardless of the mode of interaction, meaningful engagement in many inter-personal activities e.g. tennis, chess, depends upon ability matching. Therefore, performance as a function of partner disparity (in terms of their individual performances) was analysed. Figure 4 a highlights that there is no tailing off in the (linear) relationship between partner disparity and dual-player benefit at higher disparities (e.g. that would otherwise be seen as a sigmoid or other non-linear shape). This suggests that our paradigm offers the greatest gains for the poorest performers (when playing with the most skillful players). Figure 4 b reinforces this result by showing that there is no association between absolute dual-player performances and partner-mismatch (the latter measured as lower worse-to-better partner score ratios; stars: p=0.58; accuracy: p=0.68; stability: p=0.97). This suggests that the collaborative task is robust across a wide range of partner mismatches. Similarly the control of one player was perturbed in the dual-player game (trial T4), thereby increasing difficulty asymmetrically within a partnership. This was found to significantly deteriorate performance in terms of stability only, but not star collection or accuracy (Appendix (B) Healthy-healthy perturbation results).
Qualitative game assessment
The IMI was answered more positively, in terms of Enjoyment & Interest, during dual-player mode (p<0.001; Fig. 6 b). However, there was no significant difference between game modes for Perceived Competence (p=0.60) or Effort & Importance (p=0.17). Correlations were also compared for the three IMI categories across the two gameplay modes. The only significant differences in correlation was found between Enjoyment & Interest and Perceived Competence (single-player: ρ=0.38, p<0.05; dual-player: ρ=0.007, p=0.97). Significant correlations were found between Enjoyment & Interest and Effort & Importance for both game modes (single-player: ρ=0.39, p<0.05; dual-player: ρ=0.51, p<0.01). No significant correlations were found between Perceived Competence and Effort & Importance in either game mode (single-player: ρ=0.27, p=0.13; dual-player: ρ=0.23, p=0.21).
Average values (mean ± std) for the five metrics (stars, accuracy, stability, effort, smoothness) within the different game modes (single or dual) and trials, during the patient-expert study (key: P - patient, E - expert)
Relationship between impairment, age and performance
Qualitative game assessment
Visual-coupling alone achieves an engaging zero-sum game
Results from the healthy-healthy study showed how collaboration influences the joint performance, by improving the score of the worse player while increasing the challenge for the better partner. Importantly, the difference in individual skill levels of the two players did not influence the performance, while interaction with a more skilled partner did not require more effort during dual-player interaction. The patient-expert study demonstrated that all patients were able to successfully play both the single and dual-player game modes regardless of impairment and age. Game performance was shown to dramatically improve during the dual-player mode, especially for the less skilled patients, with the expert partner providing support and compensation to keep the beam horizontal. Ultimately, this enabled the patients to collect more stars and be more accurate, while having a similar level of effort and smoothness. As expected, scores (i.e. stars and accuracy) generally got worse with impairment and age. However, the relative improvement (in terms of stars collected) during dual-player interaction showed no correlation with either impairment or age.
The results suggest that the joint performances are driven by an averaging process or zero-sum game based on the individual skill levels of the partners. By modifying the level of challenge experienced by each partner, they are more likely to achieve an appropriate ‘challenge point’, whereby the joint challenge and skill level are balanced (regardless of their individual skill levels) . An appropriate challenge point is defined as the perception of engaging in challenges at a level appropriate to one’s capacity, and results in an intense focused concentration in the moment and a perceived sense of control over one’s actions [3, 4]. Moreover, the intrinsic skill balancing is not simply an averaging of the skill levels. Regardless of the ability of an individual, they would not succeed if playing with, for example, a (virtual) partner who was either completely constant or very noisy (i.e. very unskilled). This suggests that there is an operating band associated with the relative skill levels which permits a range of different skill levels to successfully play together while preventing either partner from completing the task alone.
Both healthy-healthy and patient-expert participants indicated a strong preference for the dual-player game over the single-player version. The dual-player mode increased enjoyment, perception of competence and self-reported effort amongst the patients, while giving them the sense of increased competence without increasing the pressure they felt. Therefore, individuals with and without sensorimotor limitations, found the collaborative game significantly more engaging than the single-player equivalent, and can be attributed to the skill balancing and social aspects that the multiplayer game affords.
Collaborative gaming for physical training
The simplicity of the task implies that patients can also use the game to train with a variety of movements (e.g. grip, elbow flexion-extension, ankle plantar flexion-extension) and different rehabilitation devices. By increasing their engagement compared to playing alone, patients are more likely to increase the number of repetitions they perform and the effort they put into the training, which could ultimately lead to greater gains in performance [34, 35]. This game can be used in different rehabilitation scenarios involving, but not limited to, i) patients training with a therapist or relative, for instance a grandmother playing at home with her grandchild; or ii) patient-patient training e.g. whilst still at the hospital bedside or within community centers. Due to the low skill level of both partners in scenario (ii), the game parameters would (in some cases) need to be further adapted. In fact, by modifying different game parameters such as trajectory, background, speed, bonuses, obstacles etc., the game can be designed to incrementally increase the global challenge level for the dyad as their combined skill level increases with practise. For example, more difficult levels can be unlocked as the game progresses.
Local redundancy balances the playing field and prevents slacking
The main focus of this multiplayer gaming concept is collaboration, promoting positive teamwork and social rehabilitation. Competitive games have been previously introduced [11, 13], where competition seemed to motivate some patients, but also discourage a significant proportion of them. However, the pong game used in these studies does not involve continuous interaction, in contrast to our game, and thus the results cannot be directly compared. Andrade et al. have previously developed a multiplayer rehabilitation game involving true interaction and collaboration . The players receive haptic feedback providing additional information of the interaction, but have independent (orthogonal) control inputs so that an individual cannot help a patient to succeed in the task. This means that the game is not redundant, as one player’s action cannot compensate for a mistake from the other. In fact, it is the locally redundant nature of our interactive task that produces a challenging, but accessible exergame, for both partners independent of their relative skills, without requiring an additional skill-rating or skill-balancing algorithm (e.g. ). Previously, Vanacken et al. have introduced a ball-balancing concept utilising arbitrarily placed static targets, in contrast to a smooth continuous trajectory which is used in this study . Our analysis has shown that, beyond just collaborative interaction, individuals of different skill levels can play together continuously (and without slacking), ultimately enjoying it more than single-player mode and suggesting that participants are more likely to exercise longer during dynamic multiplayer collaboration.
Local redundancy is achieved by ensuring that the players’ control inputs are non-orthogonal so that the actions of one player can compensate for the incorrect actions of another player, i.e. the control inputs are redundant. However, fully redundant inputs can easily lead to slacking behaviour, as either of the inputs can perform the actions for the other player and human motor control naturally minimises effort . Therefore, the two inputs are ‘physically’ coupled (in the virtual world) so that only through active control from both inputs can it ensure that the end-effector (e.g. the buddy) can be moved correctly (without allowing the buddy to fall). Furthermore, defining the interaction in this manner allows the dyad to employ different strategies to complete the task. For example, during patient-expert collaboration, the expert seems to concentrate on minimising the buddy falling by increasing stability (i.e. by following the movements of the patient).
Relation to actual physically-coupled paradigms
The collaborative rehabilitation games outlined in this paper are related to recent work investigating sensorimotor interaction in humans [16, 17, 37–39]. In [16, 17], pairs of subjects were connected by a virtual, but physically rendered, elastic band providing additional haptic information to the partners. The elasticity of the connection, meant that the partners could not rely on each other in order to succeed, implying neither could slack, a similar property elicited by this game. In contrast to our task, the partners could also work independently, which would not be adequate for neurorehabilitation where the patient requires assistance to move or control their limb. Both worse and better partners improved performance in , which is likely due to the additional haptic communication . It would be interesting to study whether haptic feedback in combination with local redundancy could enhance the social rehabilitation experience further. However, using sensor-based technology (without active haptic feedback) provides decentralised therapy tools that are affordable and can be used both in-hospital and at-home. By combining these tools, such as the grip-force sensor used in this study, with socially engaging gaming concepts, patient engagement can be increased, ultimately leading to better patient compliance during rehabilitation.
Limitations of the current study
The lack of a reactive single-player mode, e.g. based on an intelligent agent, could also be a factor as to why subjects had reduced performance and preference during the single-player version. A reactive agent, that could perform compensatory behaviour similar to the expert partner, could potentially increase the joint performance and also adapt to the partner as their ability progressed [16, 17]. Whether a patient would prefer playing with a human partner or computer agent would need to be further explored alongside any performance gains, which was beyond the scope of this study. Another limitation of the current study, necessary due to practical considerations, is the limited number of trials performed. This meant that patient motivation over longer training times could not be explored. Therefore, the next steps would be to explore the effect of our collaborative task during a longer motor learning paradigm involving healthy subjects and patients to see if (a) more efficient learning occurs and, (b) to examine if patients are more motivated to train for longer periods. We will also explore in more detail social aspects of interaction (e.g. conversation, playing with a relative vs. stranger, etc.) which are important to both performance and motivation [13, 40]. For instance, we will explore conditions where the dyads are either permitted or prevented to communicate during interaction and analyse the effect on their performance and qualitative evaluation. Beyond conversation, complete blinding of the participants to the gender, age, and demographic of their partner would also be an interesting avenue to explore.
We have presented a framework to develop truly collaborative multiplayer gaming enabling two players to train together. The framework allows for the development of games that are simple, dynamic and interactive. A central property of the concept is its local redundancy, enabling players to help each other to succeed at the task, without replacing each other’s action entirely. This forces them to actively participate concurrently. Results from our healthy-healthy and patient-expert experiments highlight that: i) due to local redundancy, the game and scores can be modulated by the more skilled partner, although only within the bounds that the impairment or skill of the weaker partner allows, and ii) neither partner is able to ‘slack’ regardless of impairment, age and differences in relative skill levels. In the future, we expect new ‘collaborative gaming for physical training’ concepts to be developed, based on this simple framework, with the aim of increasing motor learning efficiency and patient engagement during virtual therapy tasks. The exploration of human-like agents during human-computer interaction scenarios alongside increased training times and the influence of social aspects, and their effect on performance, long term motivation and motor transfer, should also be studied.
1 Note that the interactions in many previous studies are denoted as collaborative or cooperative. However the tasks specified in these studies do not require an exchange of information between the partners, e.g. in the Pong game, only an individual working alone is required to return the puck at any point in time [6, 11, 13]. Relative to Jarrassé et al.’s comprehensive taxonomy of interactive behaviours  these definitions have been used inconsistently and should actually be classified as co-active interaction.
2 Despite the many social implications of such a collaborative virtual task, examining social elements such as the effect of verbal communication was not considered during this study.
3 This force-to-height mapping is implemented using the Unity Ⓒ ‘SmoothDamp’ function.
4 A short video showing the game being played by a patient and therapist is provided as Additional file 1.
Additional file 1: Video showing the Balloon Buddies™ game being played by a patient and therapist. (MOV 73318 kb)
The following questions were asked to assess the experience of the players during the game and compare the single and multiplayer modes: QD Rate the difficulty of the 2 game conditions, from 0 to 10. QP Which game condition did you like the most? [Single, Same or Multi], Why? QE Which game condition did you put the most effort into? [Single, Same or Multi] QS During which game condition did you feel the most skilled? [Single, Same or Multi] QP During which game condition did you feel the most pressured? [Single, Same or Multi] QC Any comments (e.g. gameplay, feedback, visuals)?
Intrinsic motivation inventory
I tried very hard on this game [P]
I think I am pretty good at this game [P]
This game was fun to play [P]
I did not put much energy into this
This game did not hold my attention at all
I was pretty skilled at this game
I thought this was a boring game [P]
I am satisfied with my performance at this game
I put a lot of effort into this
I enjoyed playing this game very much
I did not try very hard to do well at this game
This was a game that I could not play very well [P]
I thought this game was quite enjoyable
It was important to me to do well at this game [P]
I think I did pretty well at this game, compared with the others
Note: [P] indicates the questions selected in the patient version. This questionnaire uses a Likert scale from 1 to 7 (1= not at all true, 4= somewhat true and 7= very true)
(B) Healthy-healthy perturbation results
This work was supported in part by an Imperial Confidence in Concept (ICiC) Award, Imperial College BRC award, NHS England Innovation Challenge Prize, by EU-FP7 grants PEOPLE-ITN-317488-CONTEST, ICT-601003 BALANCE, ICT-2013-10 SYMBITRON, EU-H2020 ICT-644727 COGIMON, EPSRC grant EP/N029003/1 MOTION.
Availability of data and materials
Please contact author for data requests.
MM, NK, PR, PB, EB devised and developed the Balloon BuddiesTM concept, and wrote the manuscript. NK wrote the code, designed the graphics and implemented the game into UnityⒸ. NK supervised and collected the healthy-healthy study data. AR supervised and collected the patient-expert study data. MM and NK performed the data and statistical analysis in MatlabⒸ. All authors read and approved the final manuscript.
Ethics approval and consent to participate
Approval for the study was given by the South East Coast Research Ethics Committee and all participants signed an informed consent form prior to any study-related procedure.
Consent for publication
All authors have approved the manuscript for publication.
The grip-force sensor technology reported is patented by authors MM, PR, PB, EB, through Imperial Innovations. A company has been incorporated with the intention of commercialising both the handgrip and software.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License(http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver(http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Veerbeek JM, et al. What is the evidence for physical therapy poststroke? A systematic review and meta-analysis. PLoS ONE. 2014; 9(2):1–33.View ArticleGoogle Scholar
- Schweighofer N, et al. Mechanisms of the contextual interference effect in individuals poststroke. J Neurophysiol. 2011; 106(5):2632–41.View ArticlePubMedPubMed CentralGoogle Scholar
- Guadagnoli MA, Lee TD. Challenge point: a framework for conceptualizing the effects of various practice conditions in motor learning. J Mot Behav. 2004; 36(2):212–24.View ArticlePubMedGoogle Scholar
- Nakamura J, Csikszentmihalyi M. The Concept of Flow In: Snyder C, Lopez S, editors. Oxford Handbook of Positive Psychology: 2002. p. 89–105.Google Scholar
- Reinkensmeyer DJ, Burdet E, Casadio M, Krakauer JW, Kwakkel G, Lang CE, Swinnen SP, Ward NS, Schweighofer N. Computational neurorehabilitation: modeling plasticity and learning to predict recovery. J Neuroeng Rehab. 2016; 13(1):1–25.View ArticleGoogle Scholar
- Johnson MJ, Loureiro RCV, Harwin WS. Collaborative tele-rehabilitation and robot-mediated therapy for stroke rehabilitation at home or clinic. Intell Serv Robot. 2008; 1(2):109–21.View ArticleGoogle Scholar
- Caurin GAP, Siqueira AAG, Andrade KO, Joaquim RC, Krebs HI. Adaptive strategy for multi-user robotic rehabilitation games. Proc IEEE Annul Int Conf Eng Med Biol Soc (EMBS). 2011;:1395–8.Google Scholar
- Andrade KDO, Caurin GAP, Joaquim RC, Fernandes G. Relative performance analysis for robot rehabilitation procedure with two simultaneous users. Proc IEEE RAS EMBS Int Conf Biomed Robot Biomechatronics. 2012;:1530–4.Google Scholar
- Holt RJ, et al. A System in the Wild: Deploying a Two Player Arm Rehabilitation System for Children with Cerebral Palsy in a School Environment. J Usability Stud. 2013; 8(4):111–26.Google Scholar
- Andrade KDO, Fernandes G, Martins J, Roma VC, Joaquim RC, Caurin GAP. Rehabilitation robotics and serious games: An initial architecture for simultaneous players. Proc Biosig Biorobot Conf (BRC). 2013;:1–6.Google Scholar
- Novak D, Nagle A, Keller U, Riener R. Increasing motivation in robot-aided arm rehabilitation with competitive and cooperative gameplay. J Neuroeng Rehabil. 2014; 11:1–15.View ArticleGoogle Scholar
- Le HH, Loureiro RCV, Dussopt F, Phillips N, Zivanovic A, Loomes MJ. Soundscape and haptic cues in an interactive painting: A study with autistic children. Proc 5th IEEE RAS/EMBS Int Conf Biomed Robot Biomech. 2014;:375–80.Google Scholar
- Gorsic M, Cikajlo I, Novak D. Competitive and cooperative arm rehabilitation games played by a patient and unimpaired person: effects on motivation and exercise intensity. J Neuroeng Rehabil. 2017; 14(23):1–18.Google Scholar
- Jarrassé N, Charalambous T, Burdet E. A Framework to Describe, Analyze and Generate Interactive Motor Behaviors. PLoS ONE. 2012; 7(11):1–13.View ArticleGoogle Scholar
- Sawers A, Ting L. Perspectives on human-human sensorimotor interactions for the design of rehabilitation robots. J Neuroeng Rehabil. 2014; 11(142):1–13.Google Scholar
- Ganesh G, Takagi A, Osu R, Yoshioka T, Kawato M, Burdet E. Two is better than one: Physical interactions improve motor performance in humans. Sci Rep. 2014; 4:1–6.Google Scholar
- Takagi A, Ganesh G, Yoshioka T, Kawato M, Burdet E. Physically interacting individuals estimate their partner’s movement goal to enhance motor abilities. Nat Hum Behav. 2017; 1:1–6.View ArticleGoogle Scholar
- Friedman N, Chan V, Reinkensmeyer AN, Beroukhim A, Zambrano GJ, Bachman M, Reinkensmeyer DJ. Retraining and assessing hand movement after stroke using the MusicGlove: comparison with conventional hand therapy and isometric grip training. J Neuroeng Rehabil. 2014; 11:1–14.View ArticleGoogle Scholar
- Andrade KDO, Fernandes G, Caurin GAP, Siqueira AAG, Romero RAF, Pereira RDL. Dynamic player modelling in serious games applied to rehabilitation robotics. Proc Joint Conf on Robot: SBR-LARS Robotics Symp Robocontrol. 2014;:211–16.Google Scholar
- Andrade KDO, Crocomo MK, Pasqual TB, Caurin GAP. Dynamic Difficulty Adjustment with Evolutionary Algorithm in Games for Rehabilitation Robotics. Proc IEEE 4th Int Conf Serious Games App Health. 2016;:1–8.Google Scholar
- Emken JL, Benitez R, Sideris A, Bobrow JE, Reinkensmeyer DJ. Motor adaptation as a greedy optimization of error and effort. J Neurophy. 2007; 97:3997–4006.View ArticleGoogle Scholar
- Franklin DW, Burdet E, Tee KP, Milner T, Osu R, Kawato M. CNS learns stable, accurate and efficient movements using a simple algorithm. J Neurosci. 2008; 28(44):11165–73.View ArticlePubMedGoogle Scholar
- Vanacken L, Notelaers S, Raymaekers C, Coninx K, van den Hoogen W, Ijsselsteijn W, Feys P. Game-Based Collaborative Training for Arm Rehabilitation of MS Patients: A Proof-of-concept Game. Proc GameDays Conf. 2010;:65–75.Google Scholar
- Colombo R, Pisano F, Mazzone A, Delconte C, Micera S, Chiara Carrozza M, Dario P, Minuco G. Design strategies to improve patient motivation during robot-aided rehabilitation. J Neuroeng Rehabil. 2007; 4:1–12.View ArticlePubMedPubMed CentralGoogle Scholar
- Burdet E, Mace M, Liardon JL, Bentley P, Rinne P. A force measurement mechanism. GB PCT patent (PWO2016/116738 A1). 2016;:1–25.Google Scholar
- Rinne P, et al. Democratizing Neurorehabilitation: How Accessible are Low-Cost Mobile-Gaming Technologies for Self-Rehabilitation of Arm Disability in Stroke?PLoS ONE. 2016; 11(10):1–12.View ArticleGoogle Scholar
- Mace M, Rinne P, Liardon JL, Uhomoibhi C, Bentley P, Burdet E. Elasticity improves handgrip performance and user experience during visuomotor control. Royal Soc Open Sci. 2017; 4(2):1–13.View ArticleGoogle Scholar
- Wulf G, Schmidt RA. Variability of practise and implicit motor learning. J Exp Psych. 1997; 23(4):987–1006.Google Scholar
- Balasubramanian S, Melendez-Calderon A, Roby-Brami A, Burdet E. On the analysis of movement smoothness. J Neuroeng Rehabil. 2015; 12:1–12.View ArticleGoogle Scholar
- Vos N, van der Meijden H, Denessen E. Effects of constructing versus playing an educational game on student motivation and deep learning strategy use. Comput Educ. 2011; 6:127–37.View ArticleGoogle Scholar
- McAuley E, Duncan T. Psychometric properties of the Intrinsic Motivation Inventory in a competitive sport setting: A confirmatory factor analysis. Res Q Exerc Sport. 1989; 60:48–58.View ArticlePubMedGoogle Scholar
- Efron B, Tibshirani R. Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Stat Sci. 1986; 1:54–77.View ArticleGoogle Scholar
- Baur K, Wolf P, Reiner R, Duarte J. Making neurorehabilitation fun: Multiplayer training via damping forces balancing differences in skill levels. Proc IEEE Int Conf on Rehab Robot (ICORR). 2017;:1–6.Google Scholar
- Remple MS, Bruneau RM, VandenBerg PM, Goertzen C, Kleim JA. Sensitivity of cortical movement representations to motor experience: evidence that skill learning but not strength training induces cortical reorganization. Behav Brain Res. 2001; 123(2):133–41.View ArticlePubMedGoogle Scholar
- Wulf G, Lewthwaite R. Optimizing Performance through Intrinsic Motivation and Attention for Learning: The OPTIMAL theory of motor learning. Psych Bullet Rev. 2016; 22(6):1382–414.View ArticleGoogle Scholar
- Herbrich R, Minka T, Graepel T. TrueSkillTM: A Bayesian skill rating system. Adv Neural Inf Process Syst. 2006;:569–576.Google Scholar
- Basdogen C, Ho C-H, Srinivasan MA, Slater M. An Experimental Study on the Role of Touch in Shared Virtual Environments. ACM Trans Computer-Human Int. 2000; 7:443–60.View ArticleGoogle Scholar
- Reed K, Peshkin M, Hartmann MJ, Grabowecky M, Patton J, Vishton PM. Haptically linked dyads: are two motor-control systems better than one?Psychol Sci. 2006; 17:365–6.View ArticlePubMedGoogle Scholar
- Sawers A, Bhattacharjee T, McKay JL, Hackney ME, Kemp CC, Ting LH. Small forces that differ with prior motor experience can communicate movement goals during human-human physical interaction. J Neuroeng Rehabil. 2017; 14:1–13.View ArticleGoogle Scholar
- Takagi A, Bagnato C, Burdet E. Facing the partner influences exchanges in force. Sci Rep. 2016; 6:1–6.View ArticleGoogle Scholar