Skip to main content
Download PDF
Download ePub

Gait analysis with the Kinect v2: normative study with healthy individuals and comprehensive study of its sensitivity, validity, and reliability in individuals with stroke

Journal of NeuroEngineering and Rehabilitation volume 16, Article number: 97 (2019) Cite this article

Abstract

Background

Gait is usually assessed by clinical tests, which may have poor accuracy and be biased, or instrumented systems, which potentially solve these limitations at the cost of being time-consuming and expensive. The different versions of the Microsoft Kinect have enabled human motion tracking without using wearable sensors at a low-cost and with acceptable reliability. This study aims: First, to determine the sensitivity of an open-access Kinect v2-based gait analysis system to motor disability and aging; Second, to determine its concurrent validity with standardized clinical tests in individuals with stroke; Third, to quantify its inter and intra-rater reliability, standard error of measurement, minimal detectable change; And, finally, to investigate its ability to identify fall risk after stroke.

Methods

The most widely used spatiotemporal and kinematic gait parameters of 82 individuals post-stroke and 355 healthy subjects were estimated with the Kinect v2-based system. In addition, participants with stroke were assessed with the Dynamic Gait Index, the 1-min Walking Test, and the 10-m Walking Test.

Results

The system successfully characterized the performance of both groups. Significant concurrent validity with correlations of variable strength was detected between all clinical tests and gait measures. Excellent inter and intra-rater reliability was evidenced for almost all measures. Minimal detectable change was variable, with poorer results for kinematic parameters. Almost all gait parameters proved to identify fall risk.

Conclusions

Results suggest that although its limited sensitivity to kinematic parameters, the Kinect v2-based gait analysis could be used as a low-cost alternative to laboratory-grade systems to complement gait assessment in clinical settings.

Background

The physiological basis of cerebrovascular accidents make gait deficits a common sequelae after stroke [1]. More than 60% of stroke survivors are unable to walk independently after the injury [2] and, even after rehabilitation, more than half of the cases still present gait-related deficits [3]. Most prevailing deficits after stroke include reduced speed [4] and increased gait inter-limb asymmetry [5]. These gait impairments can be aggravated in the elderly, due to the natural musculoskeletal and cognitive decline with age [6, 7], where the incidence of stroke is higher [8]. Importance of these deficits relies on their great impact on independence [9], quality of life [10], and fall risk [11]. Consequently, their adequate assessment is necessary for a proper diagnosis and to plan, if required, customized interventions to each individual’s condition and evaluate the effectiveness of these interventions.

Assessment of gait is commonly performed in the clinical setting using standardized scales and tests that evaluate different aspects of human locomotion and, in some cases, compare the results of the person being tested with those obtained by a matched healthy sample [12]. Although these tools are easy to administer and, in general, not time-consuming, they can present lack of specificity and, more importantly, may have poor accuracy and be biased by subjective evaluations [13]. Over the years, different technological solutions have been proposed to overcome these limitations. Accurate estimation of spatiotemporal parameters has been enabled by instrumented walkways [14] and force plates [15], generally, from ground reaction forces during walking. Estimation of kinematic parameters, however, require the position of several joints to be tracked during the test, which has been indirectly facilitated by different technological solutions that estimate the position of some sensors that are attached to specific body parts [16,17,18]. Among them, optical motion tracking has become the most common alternative for accurate investigation of kinematic gait parameters [19]. Although instrumented systems allow for accurate spatiotemporal and kinematic analysis, their high cost and large size have restricted their use to research laboratories and large clinical centers with high economic resources [20].

In the last years, the Microsoft Kinect (Microsoft, Redmond, WA), a portable off-the-shelf infrared camera originally intended for entertainment, has enabled human motion tracking without using wearable sensors at a very low-cost. Reliability studies have shown comparable performance of the Kinect to laboratory-grade gait analysis systems, for both the first [21, 22] and the second version of the device [23], known as the Kinect v2, which features improved depth accuracy and number of joints tracked [24]. Characteristics of the Kinect v2 have motivated their use for assessing spatiotemporal [25,26,27] and kinematic parameters of gait [26, 28] with promising results in healthy individuals, even on treadmills [28, 29]. Its reliability in stroke population, however, remains almost unexplored. Little evidence suggests that data retrieved from the Kinect v2 can be used to differentiate healthy subjects from individuals with stroke [30] and to complement clinical assessment [31]. Despite of the existing data supporting the reliability of the Kinect v2 to assess spatiotemporal and kinematic gait parameters, the unavailability of the software, the limited investigation in individuals with stroke, and the unknown psychometric properties of Kinect-based tests in this population could compromise the clinical relevance of these results.

The objective of this study was fourfold. First, to compare a cohort of individuals with stroke with respect to a group of healthy controls to determine the sensitivity of an open-access Kinect v2-based gait analysis system to motor disability and aging. Second, to determine the concurrent validity of the system with standardized clinical tests in individuals with stroke. Third, to quantify its reliability as defined by the inter and intra-rater reliability, the standard error of measurement, and the minimal detectable change. And, finally, to investigate the ability of the system to identify risk of falls after stroke.

Methods

Participants

Individuals with stroke were recruited from the outpatient service of a long-term neurorehabilitation unit. Inclusion criteria in this group were: 1) age ≥ 10; 2) ability to walk 10 m indoors with or without assistance; and 3) ability to understand instructions (Mini-Mental State Examination [32]> 23). Exclusion criteria were: 1) individuals with severe aphasia (Mississippi Aphasia Screening Test [33]< 45); 2) individuals with permanent fixed contracture of joints in the legs; 3) individuals with arthritic or orthopedic conditions affecting the lower limbs; and 4) individuals with severe hemispatial neglect. A sample size of 82 post-stroke participants was calculated for an effect size of 0.3, a power of 0.80, an alpha of 0.05, and two tails.

Healthy subjects older than 10 years old with no known musculoskeletal or vestibular disease and/or prosthetic surgery were potential candidates to participate in the study. A minimum sample size of 328 healthy participants, four times the number of participants post-stroke was required. A minimum of 40 healthy participants per decade was also required to avoid a heterogeneous distribution.

Ethical approval for the study was granted by the Institutional Review Board of Vithas Hospital Valencia al Mar. All eligible candidates who agreed to take part in the study provided written informed consent.

Instrumentation

A Kinect v2 was used to retrieve the 3D pose of the participants and to provide a RGB video of their performance at 30 Hz during the assessment [34] using the Kinect for Windows Software Development Kit 2.0. An MSI GT70-066ES (Micro-Star International Co., Ltd., Zhonghe, New Taipei, Taiwan) which included an 8-core Intel® Core™ i7-3610QM @3.30 GHz, 8 GB of RAM, and NVIDIA® GeForce® GTX670M (Nvidia Corporation, Santa Clara, CA, USA) run a custom-made gait analysis software.

A dedicated application was designed to register the 3D position and orientation of the 25 human joints provided by the Kinect v2 while they approach to the device from the maximum (5 m) to the minimum distance covered (0.5 m), it is, for a total of 4.5 m [35]. After each trial, the application estimates and stores the most widely used spatiotemporal and kinematic gait parameters. Parameters that involved ankle kinematics were discarded, as the Kinect v2 has been reported to have poor reliability in ankle detection [36] and step asymmetry was calculated as the difference between right and left step length. All other kinematic parameters, and the speed, stride, and step measures were computed from the speed of the ankles. Shorter events were estimated from the distance between the sacrum and the ankles and toes. These methods have been shown to provide the best accuracy from data retrieved by the Kinect v2 [31].

Procedure

Participants were assessed in dedicated areas, clear and free of distractors. Use of close-fitting, pale, and non-reflective clothes was indicated to limit the tracking errors. Participants were initially located at a distance of 6 m from the Kinect v2 in its longitudinal axis. Initial position was marked on the floor using a tape strap. An experimenter asked participants to walk towards the camera until reaching the device at a comfortable speed with a self-initiated movement. Prior to the experiment, all the participants were allowed to practice until they achieved a valid repetition. The position and orientation of the participants’ joints were registered and the gait parameters were computed and provided after each repetition. The experimenter checked the performance of the participants and discarded those repetitions that were affected by tracking errors or unusual performance, such as sudden stops during the repetition. A minimum of three valid repetitions were required to ensure repeatability.

In addition, the gait characteristics of participants with stroke was assessed with the Dynamic Gait Index (DGI) [37, 38], the 1-min Walking Test (1mWT) [39], and the 10-m Walking Test (10MWT) [40]. In addition, their balance was assessed with the Berg Balance Scale (BBS) [41] to determine their risk of falling. All assessments took place within 24 h.

Finally, half the participants post-stroke were randomly considered to estimate the inter and intra-rater reliability. The gait parameters of 21 individuals with were assessed with the Kinect v2-based gait analysis by two different experimenters to determine the inter-rater reliability, and other different 21 subjects were assessed twice by the same experimenter to determine the intra-rater reliability. These tests were also performed within 24 h.

Data analysis

For each age decade, gait parameters were defined as the average performance of all the subjects in each group. Performance of each subject was computed as his or her average performance in all the existing repetitions. Kinematic parameters were characterized by the range of motion of the joint involved in each parameter. Different statistical analysis were performed to investigate each objective.

First, paired t-tests were used to describe differences in the gait parameters between populations.

Second, Pearson correlation coefficients were calculated to determine the age effect on all measures and the concurrent validity of the Kinect v2-based gait analysis system with clinical tests. Correlations illustrating concurrent validity reflected the extent to which gait measures and clinical tests were related, and consequently, depicted similar motor components.

Third, a two-way random effects model intra-class correlation coefficient with a single rate/measurement (ICC [1, 2]) was used to summarize the strength of the reliability. Values of 0.8 or higher were accepted as indicating very strong reliability. Values in the range of 0.6 to 0.8 and 0.4 to 0.6 were considered indicators of strong and moderate reliability, respectively. Values in the range of 0.2 to 0.4 and below 0.2 were analogously considered indicators of weak and very weak reliability, respectively [42]. The standard error of measurement and the minimal detectable change were also obtained. Minimal detectable change scores higher than 30% were considered poor, from 10 to 30% were considered acceptable, and those lower than 10% were considered excellent [43].

Finally, to determine the ability of the system to identify fall risk in people with stroke, their risk of falling was categorized according to their scores in the BBS. Participants with stroke were classified as fallers (scores below 49) and non-fallers (scores greater or equal to 49) [44], accordingly. Paired t-tests were performed to investigate differences between both groups of participants and a receiver operating characteristic (ROC) area was estimated to determine the ability of each variable to discriminate between fallers and non-fallers. Values of the ROC from 0.9 to 1 were considered excellent, from 0.8 to 0.9 were considered good, from 0.7 to 0.8 were considered fair, from 0.6 to 0.7 were considered poor, and from 0.5 to 0.6 were considered fail [45, 46].

All statistical analyses were performed using IBM SPSS Statistics version 22 (IBM, New York, NY). Two-sided p-values below 0.05 were considered statistically significant.

Results

Participants

Eighty-two individuals with stroke (55 men and 27 women) participated in the study (Table 1). Post-stroke participants had a mean age of 48.3 ± 16.14 years old and presented either ischemic (n = 41) or hemorrhagic stroke (n = 41), with a mean time since injury of 748.55 ± 785.12 days.

Table 1 Distribution of participants by age and gender
Full size table

A total of 355 healthy individuals (169 men and 186 women), with a mean age of 43.3 ± 18.6 years old were also enrolled (Table 1).

Performance comparison

The motor performance of both groups evidenced significant differences in most of the spatiotemporal gait values. Healthy participants showed higher gait speed values in comparison with participants with stroke. Stride and step length were slightly higher in healthy individuals and stride and step time evidenced higher values in individuals post-stroke. Step width reflected higher values in individuals with stroke. Participants post-stroke also showed higher double support time in comparison to healthy individuals, which reached statistical significance in adults. Regarding kinematics values, participants with stroke evidenced higher trunk tilt compared with healthy controls. Other spatiotemporal and kinematic parameters evidenced different performance in both populations, which gave rise to multiple statistical significant differences (Tables 2 and 3).

Table 2 Mean values of gait parameters for healthy subjects (normative values)
Full size table
Table 3 Mean values of gait parameters for individuals post-stroke
Full size table

The effects of age were also evidenced in the performance of both groups. All the participants showed almost invariable gait speed, which decreased for those older than 60. This negative effect of age on gait speed was evidenced in both healthy (r = − 0.377; p = 0.000) and participants with stroke (r = − 0.471; p = 0.000) (Tables 2 and 3). Stride and step length showed a clear decrease with age in healthy adults (r = − 0.385; p = 0.000 and r = − 0.423; p = 0.000, respectively) and adults with stroke (r = − 0.519; p = 0.000 and r = − 0.519; p = 0.000, respectively). In contrast, stride and step time remained more stable for all the participants. Healthy participants showed increased double support time at older ages (r = 0.340; p = 0.000), which was also reflected by participants post-stroke (r = 0.295; p = 0.009). Knee flexion-extension also evidenced a decrease with age in the healthy group (r = 0.334; p = 0.001), which was not reflected by individuals with stroke (r = − 0.150; p = 0.187). A similar age-effect was detected for trunk tilt. While healthy individuals showed decreasing trunk tilt with age (r = − 0.232; p = 0.025), individuals post-stroke did not showed a clear tendency (r = 0.162; p = 0.152). Other spatiotemporal and kinematic parameters did not show a clear age-related tendency.

Concurrent validity

Significant correlations were detected between all the clinical tests and all spatiotemporal parameters obtained by the Kinect v2-based gait analysis, but for the step asymmetry (Table 4). Strong correlations were found between all the clinical tests and speed, stride, step, and cadence, but those between the DGI and stride and step length, which were very strong, and those between the 10MWT and stride time and cadence, which were moderate. Correlations between clinical scales and double support time were moderate, while correlations between clinical scales and step width and swing time were weak, but for that between the 10MWT and the swing time, which was moderate.

Table 4 Concurrent validity of the spatiotemporal and kinematic parameters with clinical measures
Full size table

Significant correlations were also found between the clinical scales and the kinematic parameters. Strength of the correlation with clinical scales was moderate for hip flexion-extension, ankle height variation and trunk obliquity and tilt, with the exception of that between trunk tilt and the 10MWT, which was strong and between hip flexion-extension and ankle height variation with 10MWT, which were weak. Correlations between pelvic tilt, hip abduction, and knee flexion-extension with clinical scales were weak but those between hip abduction and knee flexion-extension with the 1mWT, where no significant correlations were found. An addition moderate correlation was also found between hip height variation and the 1mWT. No correlations were found for trunk rotation, pelvic obliquity and rotation, knee valgus-varus alignment and knee height variation.

Inter and intra-rater reliability, standard error of measurement, and minimal detectable change

Results evidenced excellent inter and intra-rater reliability for all measures but for step asymmetry, inter-rater reliability of hip abduction, and intra-rater reliability of knee height variation, which were all good (Table 5).

Table 5 Inter and intra-rater reliability, standard error of measurement, and minimal detectable change of gait parameters
Full size table

The minimal detectable change for spatiotemporal measures was excellent for step time and stride measures, moderate for speed, step length, and poor for step asymmetry, swing, and double support time. For kinematic measures, minimal detectable change was moderate for trunk tilt and rotation, hip and knee flexion, and ankle height variation, and was poor for the all other measures.

Ability to discriminate between fallers and non-fallers

Eighteen participants were categorized as more likely to fall and the remaining were categorized with lower fall risk. Significant differences were found in all spatiotemporal parameters, but in step asymmetry and several kinematic parameters, as trunk obliquity and tilt, pelvic tilt, hip abduction and flexion, and ankle height variation (Table 6). Results indicated that participants with higher fall risk had remarkably lower speed and cadence, shorter stride and step length and time, and higher double support time. Step asymmetry was, in contrast, similar in both groups. Fall risk was also associated to increased trunk and pelvic obliquity and tilt, and to decreased hip flexion-extension and ankle height variation. Other kinematic measures were similar between groups and did not reach statistical significance. Finally, results of the ROC analysis showed that speed, stride and step length, stride and step time and cadence had high sensitivity and specificity and, consequently, were good predictors of fall risk. In turn, swing and double support time, trunk obliquity and tilt, hip flexion, and ankle height variation proved to be fair predictors of fall risk.

Table 6 Ability of gait parameters to discriminate between fallers and non-fallers
Full size table

Discussion

This study investigates the sensitivity of an open-access Kinect v2-based gait analysis system to motor disability and risk of fall, its concurrent validity with clinical scales, inter and intra-rater reliability, minimal detectable change. Results revealed different performance not only between healthy subjects and individuals with stroke, but also between individuals post-stroke with and without risk of fall and evidenced significant but variable concurrent validity of gait parameters with clinical scales, good to excellent inter and intra-rater reliability, and also variable minimal detectable change. These results support the validity and reliability of the Kinect v2-based gait analysis, which could complement clinical gait evaluations.

Mean speed values exhibited by healthy controls in our study were lower than those reported in other studies [47,48,49]. This could be derived from an effect of the acceleration and deceleration phases [50], which are conventionally excluded from analysis to investigate gait at a constant speed [50]. In our study, although the effect of the acceleration phase could be partially avoided, as the first meter of walking was not registered by the Kinect v2, the deceleration phase was almost entirely included for analysis, given that participants reduced speed as they approached the device. This difference in the procedure, derived from the technical limitations of the Kinect v2, might have affected the results and, therefore, could explain the incongruences with previously reported normative values [49, 51]. As a proof, comparable results to ours have been shown with comparable procedures [50].

However, in spite this discrepancy and the heterogeneity in the distribution of participants by age decade (more pronounced in the stroke group), the well-known gait decline with age [52] was evidenced by both healthy controls and participants post-stroke. In addition, differences between the performances of both populations, which are largely supported by the literature, were also evident. The slower speed and cadence and shorter stride length shown by participants with stroke are characteristic of hemiparetic gait post-stroke [53]. The increased trunk and pelvic kinematics detected in this group could be explained by an impaired coordination and decreased muscle strength, which are common after stroke [54]. The limited hip and knee flexion-extension detected in participants with stroke is also a distinctive impairment in this population [55]. The inclusion of both sides for analysis could have prevented even greater differences between groups, as an increased flexion of the less affected leg of individuals with stroke could have overcompensated the limited flexion in the more affected side, as previously reported [53]. Nonetheless, the results of participants post-stroke should be examined with caution as they have been reported to show high variability [56] and, in addition, a wide deviation is expected in hemiplegic individuals [2]. Even so, the performance of participants with stroke was similar to that reported by other studies including similar population [57,58,59].

The concurrent validity of the Kinect v2-based gait analysis with traditional scales is comparable not only to that of the clinical tools used in the study [60] but also to laboratory-grade and gold-standard systems [61, 62]. The sign of the correlations, in turn, supported the consistency of the gait measures, as better performance in all gait parameters were related to better performance in the clinical scales. For instance, higher gait speed was associated to higher score in the DGI, higher distance walked in the 1mWT, and shorter time on the 10MWT. The inter-rater and intra-rater reliability of the gait measures was comparable to those obtained by both clinical tools, such as the 10MWT [63, 64] or the DGI [38], and instrumented systems [25, 26] in a stroke sample, and more importantly, are supported by preliminary studies exploring spatiotemporal [25] and kinematic gait analysis [26] with the Kinect v2. Accuracy of spatiotemporal analysis, as represented by the standard error of measurement, is in line with previous reports [31]. Although results might vary according to the population being tested, the sensitivity to detect small changes of the Kinect v2-based gait speed measurement was comparable not only to walking tests including similar distances, such as the three-meter walking test [65] and the four-meter gait speed [66], but also to instrumented walkways [65] and optical motion tracking systems [67]. Sensitivity to changes in step and stride measures was also comparable to optical motion tracking [67] and poorer for other parameters. The minimal detectable change of some gait parameters should be highlighted as they allow for detecting changes that could be clinically important. For instance, the minimal detectable change of the Kinect v2-based system in gait speed was 0.12 m/s, which is almost a third of that using a stopwatch [68]. Importance of this accuracy relies on its potential capacity to detect minimal clinically important changes in the gait speed, which have been established by different studies as being 0.13 m/s [69], 0.16 m/s [70], and 0.19 m/s [71] in individuals with subacute stroke and different disabilities.

The ability of almost all Kinect v2-based gait parameters to examine fall risk should be highlighted as increased fall risk is a well-known affliction after stroke during rehabilitation [72] and after discharge [73]. Other systems based on wearable inertial sensors [74] and Kinect-based data have been presented to assess fall risk [75]. The Kinect v2-based gait analysis could successfully identify those individuals who might need more rehabilitative attention to prevent future falls according to the BBS in a shorter time than not only the mentioned instrumented systems but also than the clinical scale itself.

All these results support that, despite the limited sensitivity of the kinematic parameters, the Kinect v2-based gait analysis was able to successfully evidence the performance of both healthy controls and individuals post-stroke, showing good concurrent validity with clinical scales, excellent reliability, and excellent ability to discriminate fall risk after stroke. These features, together with the low-cost, availability, and portability of the device, could support the use of the Kinect v2-based gait analysis as a low-cost alternative to laboratory-grade systems in the clinical setting, to complement gait assessment.

Conclusions

The Kinect v2-based gait analysis successfully characterized a cohort of individuals with stroke in comparison to age-matched healthy subjects, showed concurrent validity with clinical scales, excellent reliability, variable sensitivity, and also excellent ability to identify risk fall, which supports its use as a low-cost alternative to laboratory-grade systems under certain circumstances to complement clinical gait assessment.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

10MWT:

10-m Walking Test

1mWT:

1-min Walking Test

BBS:

Berg Balance Scale

DGI:

Dynamic Gait Index

References

  1. Balaban B, Tok F. Gait disturbances in patients with stroke. PM&R. 2014;6(7):635–42.

    Article  Google Scholar 

  2. Woolley SM. Characteristics of gait in hemiplegia. Top Stroke Rehabil. 2001;7(4):1–18.

    Article  CAS  Google Scholar 

  3. Schaechter JD. Motor rehabilitation and brain plasticity after hemiparetic stroke. Progress Neurobiol. 2004;73:61–72.

    Article  Google Scholar 

  4. An S, Lee Y, Shin H, Lee G. Gait velocity and walking distance to predict community walking after stroke. Nurs Health Sci. 2015;17(4):533–8.

    Article  Google Scholar 

  5. Moon Y, Sung J, An R, Hernandez ME, Sosnoff JJ. Gait variability in people with neurological disorders: a systematic review and meta-analysis. Hum Mov Sci. 2016;47:197–208.

    Article  Google Scholar 

  6. Kobsar D, Olson C, Paranjape R, Hadjistavropoulos T, Barden JM. Evaluation of age-related differences in the stride-to-stride fluctuations, regularity and symmetry of gait using a waist-mounted tri-axial accelerometer. Gait Posture. 2014;39(1):553–7.

    Article  Google Scholar 

  7. Almarwani M, Perera S, VanSwearingen JM, Sparto PJ, Brach JS. The test–retest reliability and minimal detectable change of spatial and temporal gait variability during usual over-ground walking for younger and older adults. Gait Posture. 2016;44:94–9.

    Article  Google Scholar 

  8. Hollander M, Koudstaal PJ, Bots ML, Grobbee DE, Hofman A. Incidence, risk, and case fatality of first ever stroke in the elderly population. The Rotterdam Study. J Neurol Neurosurg Psychiatry. 2003;74(3):317–21

    Article  CAS  Google Scholar 

  9. Lipskaya-Velikovsky L, Zeilig G, Weingarden H, Rozental-Iluz C, Rand D. Executive functioning and daily living of individuals with chronic stroke. Int J Rehabil Res. 2018;41(2):122–7.

    Article  Google Scholar 

  10. Mayo NE, Wood-Dauphinee S, Cote R, Durcan L, Carlton J. Activity, participation, and quality of life 6 months poststroke. Arch Phys Med Rehabil. 2002;83(8):1035–42.

    Article  Google Scholar 

  11. Sudarsky L. Gait disorders: prevalence, morbidity, and etiology. Adv Neurol. 2001;87:111–7.

    CAS  PubMed  Google Scholar 

  12. Salbach NM, O’Brien KK, Brooks D, Irvin E, Martino R, Takhar P, et al. Reference values for standardized tests of walking speed and distance: a systematic review. Gait Posture. 2015;41(2):341–60.

    Article  Google Scholar 

  13. Mancini M, King L, Salarian A, et al. Mobility lab to assess balance and gait with synchronized body-worn sensors. J Bioeng Biomed Sci. 2011. p. 007.

  14. Menz HB, Latt MD, Tiedemann A, Kwan MMS, Lord SR. Reliability of the GAITRite® walkway system for the quantification of temporo-spatial parameters of gait in young and older people. Gait Posture. 2004;20(1):20–5.

    Article  Google Scholar 

  15. Hansen AH, Childress DS, Meier MR. A simple method for determination of gait events. J Biomech. 2002;35(1):135–8.

    Article  Google Scholar 

  16. Chen S, Lach J, Lo B, Yang GZ. Toward Pervasive Gait Analysis With Wearable Sensors: A Systematic Review. IEEE Journal of Biomedical and Health Informatics; 2016.

    Google Scholar 

  17. Sprager S, Juric M. Inertial sensor-based gait recognition: a review. Sensors. 2015;15(9):22089–127.

    Article  Google Scholar 

  18. Lloréns R, Noé E, Naranjo V, Borrego A, Latorre J, Alcañiz M. Tracking Systems for Virtual Rehabilitation: objective performance vs. Subjective Experience A Practical Scenario. Sensors. 2015;15(3):6586–606.

    Article  Google Scholar 

  19. Ali A, Sundaraj K, Ahmad B, Ahamed N, Islam A. Gait disorder rehabilitation using vision and non-vision based sensors: a systematic review. Bosn J Basic Med Sci. 2012;12(3):193.

    Article  Google Scholar 

  20. Krebs DE, Edelstein JE, Fishman S. Reliability of observational kinematic gait analysis. Phys Ther. 1985;65(7):1027–33.

    Article  CAS  Google Scholar 

  21. Clark RA, Bower KJ, Mentiplay BF, Paterson K, Pua YH. Concurrent validity of the Microsoft Kinect for assessment of spatiotemporal gait variables. J Biomech. 2013;46(15):2722–5.

    Article  Google Scholar 

  22. Springer S, Yogev SG. Validity of the Kinect for gait assessment: a focused review. Sensors. 2016;16(2):194.

    Article  Google Scholar 

  23. Clark RA, Pua YH, Oliveira CC, Bower KJ, Thilarajah S, McGaw R, et al. Reliability and concurrent validity of the Microsoft Xbox one Kinect for assessment of standing balance and postural control. Gait Posture. 2015;42(2):210–3.

    Article  Google Scholar 

  24. Gonzalez-Jorge H, Rodríguez-Gonzálvez P, Martínez-Sánchez J, González-Aguilera D, Arias P, Gesto M, et al. Metrological comparison between Kinect i and Kinect II sensors. Meas J Int Meas Confed. 2015;70:21–6.

    Article  Google Scholar 

  25. Dolatabadi E, Taati B, Mihailidis A. Concurrent validity of the Microsoft Kinect for windows v2 for measuring spatiotemporal gait parameters. Med Eng Phys. 2016;38(9):952–8.

    Article  Google Scholar 

  26. Mentiplay BF, Perraton LG, Bower KJ, Pua YH, McGaw R, Heywood S, et al. Gait assessment using the Microsoft Xbox one Kinect: concurrent validity and inter-day reliability of spatiotemporal and kinematic variables. J Biomech. 2015;48(10):2166–70.

    Article  Google Scholar 

  27. Geerse DJ, Coolen BH, Roerdink M. Kinematic validation of a multi-Kinect v2 instrumented 10-meter walkway for quantitative gait assessments. PLoS One. 2015;10(10):e0139913.

    Article  Google Scholar 

  28. Eltoukhy M, Oh J, Kuenze C, Signorile J. Improved kinect-based spatiotemporal and kinematic treadmill gait assessment. Gait Posture. 2017;51:77–83.

    Article  Google Scholar 

  29. Auvinet E, Multon F, Aubin CE, Meunier J, Raison M. Detection of gait cycles in treadmill walking using a Kinect. Gait Posture. 2015;41(2):722–5.

    Article  Google Scholar 

  30. Dolatabadi E, Taati B, Mihailidis A. An automated classification of pathological gait using unobtrusive sensing technology. IEEE Trans Neural Syst Rehabil Eng. 2017;25(12):2336–46.

    Article  Google Scholar 

  31. Latorre J, Llorens R, Colomer C, Alcañiz M. Reliability and comparison of Kinect-based methods for estimating spatiotemporal gait parameters of healthy and post-stroke individuals. J Biomech. 2018;72:268–73.

    Article  Google Scholar 

  32. Green J, Forster A, Young J. Reliability of gait speed measured by a timed walking test in patients one year after stroke. Clin Rehabil. 2002;16(3):306–14.

    Article  Google Scholar 

  33. Romero M, Sánchez A, Marín C, Navarro MD, Ferri J, Noé E. Clinical usefulness of the Spanish version of the Mississippi aphasia screening test (MASTsp): validation in stroke patients. Neurología. 2012;27(4):216–24.

    Article  CAS  Google Scholar 

  34. Kinect hardware [Internet]. [cited 2017 Jul 19]. Available from: https://developer.microsoft.com/en-us/windows/kinect/hardware

  35. Latorre J, Lloréns R, Noé. E. http://www.gait.upv.es [Internet]. 2018. Available from: http://www.gait.upv.es

  36. Eltoukhy M, Kuenze C, Oh J, Jacopetti M, Wooten S, Signorile J. Microsoft Kinect can distinguish differences in over-ground gait between older persons with and without Parkinson’s disease. Med Eng Phys. 2017;44:1–7.

    Article  Google Scholar 

  37. Shumway-Cook A, Woollacott M. Motor control: theory and practical applications. 2nd ed. Int J Peadiatric. 1995.

  38. Jonsdottir J, Cattaneo D. Reliability and validity of the dynamic gait index in persons with chronic stroke. Arch Phys Med Rehabil. 2007;88(11):1410–5.

    Article  Google Scholar 

  39. McDowell BC, Kerr C, Parkes J, Cosgrove A. Validity of a 1 minute walk test for children with cerebral palsy. Dev Med Child Neurol. 2005;47(11):744.

    Article  Google Scholar 

  40. Rossier P, Wade DT. Validity and reliability comparison of 4 mobility measures in patients presenting with neurologic impairment. Arch Phys Med Rehabil. 2001;82(1):9–13.

    Article  CAS  Google Scholar 

  41. Berg KO, Wood-Dauphinee SL, Williams JI, Maki B. Measuring balance in the elderly: validation of an instrument. Can J Public Health. 83 Suppl 2:S7–11.

  42. Evans JD. Straightforward statistics for the behavioral sciences. 1st ed. Brooks/Cole Pub. Co; 1996.

  43. Llorens R, Latorre J, Noe E, Keshner EA. A low-cost Wii Balance Board™-based posturography system: An efficacy study with healthy subjects and individuals with stroke. In: International Conference on Virtual Rehabilitation, ICVR. 2015. 80–5.

  44. Simpson LA, Miller WC, Eng JJ. Effect of Stroke on Fall Rate, Location and Predictors: A Prospective Comparison of Older Adults with and without Stroke. PLoS One. 2011;6(4):e19431.

    Article  CAS  Google Scholar 

  45. Fawcett T. An introduction to ROC analysis. Pattern Recogn Lett. 2006;27(8):861–74.

    Article  Google Scholar 

  46. Bradley AP. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recogn. 1997;30(7):1145–59.

    Article  Google Scholar 

  47. Bohannon RW, Williams Andrews A. Normal walking speed: A descriptive meta-analysis. Physiotherapy. 2011;97:182–9.

    Article  Google Scholar 

  48. Perry J. Gait Analysis - Normal and Pathological Function. Book by SLACKIncorporated; 1992. p. 1–19.

    Google Scholar 

  49. Oberg T, Karsznia A, Oberg K. Basic gait parameters: reference data for normal subjects, 10-79 years of age. J Rehabil Res Dev. 1993;30(2):210–23.

    CAS  PubMed  Google Scholar 

  50. Wang C-Y, Lin Y-H, Chen T-R, Liu M-H, Chen Y-C. Gait speed measure: the effect of different measuring distances and the inclusion and exclusion of acceleration and deceleration. Percept Mot Skills. 2012;114(2):469–78.

    Article  Google Scholar 

  51. Murray MP, Kory RC, Clarkson BH, Sepic SB. Comparison of free and fast speed walking patterns of normal men. Am J Phys Med. 1966;45(1):8–23.

    Article  CAS  Google Scholar 

  52. Samson MM, Crowe A, de Vreede PL, Dessens JAG, Duursma SA, HJJ V. Differences in gait parameters at a preferred walking speed in healthy subjects due to age, height and body weight. Aging Clin Exp Res. 2001;13(1):16–21.

    Article  CAS  Google Scholar 

  53. Chen G, Patten C, Kothari DH, Zajac FE. Gait differences between individuals with post-stroke hemiparesis and non-disabled controls at matched speeds. Gait Posture. 2005;22(1):51–6.

    Article  Google Scholar 

  54. Van Criekinge T, Saeys W, Hallemans A, Velghe S, Viskens P-J, Vereeck L, et al. Trunk biomechanics during hemiplegic gait after stroke: a systematic review. Gait Posture. 2017;54:133–43.

    Article  Google Scholar 

  55. Boudarham J, Roche N, Pradon D, Bonnyaud C, Bensmail D, Zory R. Variations in kinematics during clinical gait analysis in stroke patients. PLoS One. 2013;8(6):e66421.

    Article  CAS  Google Scholar 

  56. Chisholm AE, Makepeace S, Inness EL, Perry SD, McIlroy WE, Mansfield A. Spatial-temporal gait variability Poststroke: variations in measurement and implications for measuring change. Arch Phys Med Rehabil. 2014;95(7):1335–41.

    Article  Google Scholar 

  57. Olney SJ, Richards C. Hemiparetic gait following stroke. Part I: Characteristics. Gait Posture. 1996;4(2):136–48.

    Article  Google Scholar 

  58. Vernon S, Paterson K, Bower K, Mcginley J, Miller K, Pua Y, et al. Quantifying individual components of the timed up and go using the Kinect in people living with stroke. Neurorehabil Neural Repair. 2015;29(1):48–53.

    Article  Google Scholar 

  59. Clark RA, Vernon S, Mentiplay BF, Miller KJ, Mcginley JL, Pua YH, et al. Instrumenting gait assessment using the Kinect in people living with stroke: reliability and association with balance tests. J Neuroeng Rehabil. 2012;12:15.

    Article  Google Scholar 

  60. Lin J-H, Hsu M-J, Hsu H-W, Wu H-C, Hsieh C-L. Psychometric comparisons of 3 functional ambulation measures for patients with stroke. Stroke. 2010;41(9):2021–5.

    Article  Google Scholar 

  61. McDonough AL, Batavia M, Chen FC, Kwon S, Ziai J. The validity and reliability of the GAITRite system’s measurements: a preliminary evaluation. Arch Phys Med Rehabil. 2001;82(3):419–25.

    Article  CAS  Google Scholar 

  62. Greenberg M, Gronley J, Perry J, Lawthwaite R. Concurrent Validity of Observational Gait Analysis Using the Vicon Motion Analysis System. Gait Posture. 1996;4:167–8.

    Article  Google Scholar 

  63. Collen FM, Wade DT, Bradshaw CM. Mobility after stroke: reliability of measures of impairment and disability. Disabil Rehabil. 1990;12(1):6–9.

    CAS  Google Scholar 

  64. Wolf SL, Catlin PA, Gage K, Gurucharri K, Robertson R, Stephen K. Establishing the reliability and validity of measurements of walking time using the Emory functional ambulation profile. Phys Ther. 1999;79(12):1122–33.

    CAS  PubMed  Google Scholar 

  65. Peters DM, Middleton A, Donley JW, Blanck EL, Fritz SL. Concurrent validity of walking speed values calculated via the GAITRite electronic walkway and 3 meter walk test in the chronic stroke population. Physiother Theory Pract. 2014;30(3):183–8.

    Article  Google Scholar 

  66. Perera S, Mody SH, Woodman RC, Studenski SA. Meaningful change and responsiveness in common physical performance measures in older adults. J Am Geriatr Soc. 2006;54(5):743–9.

    Article  Google Scholar 

  67. Meldrum D, Shouldice C, Conroy R, Jones K, Forward M. Test–retest reliability of three dimensional gait analysis: including a novel approach to visualising agreement of gait cycle waveforms with bland and Altman plots. Gait Posture. 2014;39(1):265–71.

    Article  Google Scholar 

  68. Fulk GD, Echternach JL. Test-retest reliability and minimal detectable change of gait speed in individuals undergoing rehabilitation after stroke. J Neurol Phys Ther. 2008;32:8–13.

    Article  Google Scholar 

  69. Bohannon RW, Andrews AW, Glenney SS. Minimal clinically important difference for comfortable speed as a measure of gait performance in patients undergoing inpatient rehabilitation after stroke. J Phys Ther Sci. 2013;25:1223–25.

    Article  Google Scholar 

  70. Tilson JK, Sullivan KJ, Cen SY, Rose DK, Koradia CH, Azen SP, et al. Meaningful gait speed improvement during the first 60 days Poststroke: minimal clinically important difference. Phys Ther. 2010;90(2):196–208. 

    Article  Google Scholar 

  71. Fulk GD, Ludwig M, Dunning K, Golden S, Boyne P, West T. Estimating clinically important change in gait speed in people with stroke undergoing outpatient rehabilitation. J Neurol Phys Ther. 2011;35(2):82–89.

    Article  Google Scholar 

  72. Breisinger TP, Skidmore ER, Niyonkuru C, Terhorst L, Campbell GB. The stroke assessment of fall risk (SAFR): predictive validity in inpatient stroke rehabilitation. Clin Rehabil. 2014;28(12):1218–24.

    Article  Google Scholar 

  73. Ashburn A, Hyndman D, Pickering R, Yardley L, Harris S. Predicting people with stroke at risk of falls. Age Ageing. 2008;37(3):270–6.

    Article  CAS  Google Scholar 

  74. Bergamini E, Iosa M, Belluscio V, Morone G, Tramontano M, Vannozzi G. Multi-sensor assessment of dynamic balance during gait in patients with subacute stroke. J Biomech. 2017;61:208–15.

    Article  Google Scholar 

  75. Colagiorgio P, Romano F, Sardi F, Moraschini M, Sozzi A, Bejor M, et al. Affordable, automatic quantitative fall risk assessment based on clinical balance scales and Kinect data. In: 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE; 2014. 3500–3503.

Download references

Acknowledgements

The authors wish to thank the staff of NEURORHB. Servicio de Neurorrehabilitación de Hospitales Vithas and the staff of Instituto de Investigación e Innovación en Bioingeniería for their support in this project, especially Adrián Borrego González for their assistance.

Funding

This study was funded by project VALORA, grant 201701–10 of the Fundació la Marató de la TV3 (Barcelona, Spain), and grant “Ayuda a Primeros Proyectos de Investigación (PAID-06-18), Vicerrectorado de Investigación, Innovación y Transferencia de la Universitat Politècnica de València” (València, Spain).

Author information

Authors and Affiliations

  1. Neurorehabilitation and Brain Research Group, Instituto de Investigación e Innovación en Bioingeniería, Universitat Politècnica de València, Camino de Vera s/n, 46022, Valencia, Spain

    Jorge Latorre, Mariano Alcañiz & Roberto Llorens

  2. NEURORHB, Servicio de Neurorrehabilitación de Hospitales Vithas, Río Tajo 1, 46011, Valencia, Spain

    Jorge Latorre, Carolina Colomer & Roberto Llorens

Authors
  1. Jorge Latorre
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carolina Colomer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mariano Alcañiz
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Roberto Llorens
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All the authors participated in the design of the study and interpretation of the results. In addition, JL and CC contributed to the data acquisition, and JL, MA, and RL designed the hardware and software components of the system. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Roberto Llorens.

Ethics declarations

Ethics approval and consent to participate

Ethical approval for the study was granted by the Institutional Review Board of Vithas Hospital Valencia al Mar. All eligible candidates who agreed to take part in the study provided written informed consent.

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Latorre, J., Colomer, C., Alcañiz, M. et al. Gait analysis with the Kinect v2: normative study with healthy individuals and comprehensive study of its sensitivity, validity, and reliability in individuals with stroke. J NeuroEngineering Rehabil 16, 97 (2019). https://doi.org/10.1186/s12984-019-0568-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12984-019-0568-y

Keywords

Journal of NeuroEngineering and Rehabilitation

ISSN: 1743-0003

Contact us