Skip to main content

Design, development, and evaluation of a local sensor-based gait phase recognition system using a logistic model decision tree for orthosis-control

Abstract

Background

Functionality and versatility of microprocessor-controlled stance-control knee-ankle-foot orthoses (M-SCKAFO) are dictated by their embedded control systems. Proper gait phase recognition (GPR) is required to enable these devices to provide sufficient knee-control at the appropriate time, thereby reducing the incidence of knee-collapse and fall events. Ideally, the M-SCKAFO sensor system would be local to the thigh and knee, to facilitate innovative orthosis designs that allow more flexibility for ankle joint selection and other orthosis components. We hypothesized that machine learning with local sensor signals from the thigh and knee could effectively distinguish gait phases across different walking conditions (i.e., surface levels, walking speeds) and that performance would improve with gait phase transition criteria (i.e., current states depend on previous states).

Methods

A logistic model decision tree (LMT) classifier was trained and tested (five-fold cross-validation) on gait data that included knee flexion angle, thigh-segment angular velocity, and thigh-segment acceleration. Twenty features were extracted from 0.1 s sliding windows for 30 able-bodied participants that walked on different surfaces (level, down-slope, up-slope, right cross-slope, left cross-slope) at a various walking speeds (self-paced (1.33 m/s, SD = 0.04 m/s), 0.8, 0.6, 0.4 m/s). The LMT-based GPR model was also tested with another validation set containing similar features and surfaces from 12 able-bodied volunteers at self-paced walking speeds (1.41 m/s, SD = 0.34 m/s). A “Transition Sequence Verification and Correction” (TSVC) algorithm was applied to correct for continuous class prediction and to improve GPR performance.

Results

The LMT had a tree size of 1643 with 822 leaf nodes, with a logistic regression model at each leaf node. The local sensor LMT-based GPR model identified loading response, push-off, swing, and terminal swing phases with overall classification accuracy of 98.38 for the initial training set (five-fold cross-validation) and 90.60% for the validation set. Applying TSVC increased classification accuracy to 98.72% for the initial training set and 98.61% for the validation set. Sensitivity, specificity, precision, F-score, and Matthew’s correlation coefficient results suggest strong evidence for the feasibility of an LMT-based GPR system for real-time orthosis control.

Conclusions

The novel machine learning GPR model that used sensor features local to the thigh and knee was viable for dynamic knee-ankle-foot orthosis-control. This highly accurate GPR model was generalizable when combined with TSVC. Our approach could reduce sensor system complexity as compared with other M-SCKAFO approaches, thereby enabling customizable advantages for end-users through modular unit orthosis designs.

Introduction

Stance-Control Knee-Ankle-Foot Orthoses (SCKAFO) are wearable walk-assist devices that prevent the knee from collapsing during weight-bearing and provide unhindered knee motion during swing. SCKAFO can improve mobility and provide more natural gait than conventional fixed-knee KAFOs for people with knee-extensor pathologies [1,2,3,4,5]. Fewer compensatory gait mechanisms (i.e., knee hyperextension, hip-hiking, circumduction, vaulting [1]) can reduce associated joint loads, reduce energy consumption [6, 7], increase foot clearance, increase walking speeds, and improve overall user satisfaction [1, 2, 4,5,6].

SCKAFO mechanical knee joint designs have their own advantages and disadvantages [4, 5]. Some designs use weighted/spring-loaded pawls or belt clamping [1, 2, 4] to lock the knee at initial contact and disengage at foot-off, based on leg position. Most mechanically-controlled SCKAFO require full knee extension to engage knee-lock [4, 5, 8]. This can present difficulties for individuals who cannot extend their leg at each step, making continuous and reliable stance-control more difficult. Persons with knee-extensor weakness that have sufficient hip-flexion control could also use angular velocity based stance-control [3, 8, 9], where mechanical components at the knee engage knee-flexion resistance at any knee angle once an angular velocity threshold is passed, such as during a knee collapse or fall event (i.e., body weight sensing not required).

The main advantages of mechanically-controlled SCKAFO include free knee motion during swing, simpler stance-control systems that do not require external power sources, low profile, lightweight, and ability to fit under trousers. Unfortunately, mechanically-controlled SCKAFO can have inconsistent stance/swing phase recognition, leading to unreliable locking and unlocking and poor functional versatility across different walking conditions. Mechanically-controlled SCKAFO can also have difficulty negotiating between different walking speeds, gait modes, terrains, and daily living environments (i.e., stairs, ramps, uneven ground) [3,4,5, 8, 10,11,12].

Microprocessor-controlled SCKAFO (M-SCKAFO) guide knee control by regulating between stance and swing using multiple electronic sensors attached to various orthotic-limb segments [4,5,6, 9, 10, 12,13,14,15,16,17,18,19,20]. These electronic sensors, coupled with computational algorithms, dictate when to engage/disengage knee-flexion resistance. This provides enhanced knee-control functionality, reliability, and versatility across surfaces and walking speeds. M-SCKAFO may also toggle between different gait modes (i.e., ramps, curbs, stairs) [4, 5, 12]. These devices rely on many sensors and complex algorithms that can have high computational costs and require external power sources that require regular charging. M-SCKAFO drawbacks include sensors located at many orthosis segments, bulk (i.e., cannot fit under trousers), lack of aesthetics, high cost, and fewer orthotic component choices.

The Otto Bock C-Brace [21] is currently the most versatile commercially available M-SCKAFO, using a hydraulic linear damper for knee control. C-Brace is the only M-SCKAFO on the market with in-stance knee flexion dampening (i.e., gradually allows the knee to flex during stance). With partial knee-flexion resistances, some individuals with lower limb muscle impairment could re-establish sufficient strength and mobility to eliminate the need for ambulatory assistance. The C-Brace uses two sets of sensors at the knee to determine knee angle and a dorsal shank spring (strain-gauge ankle-moment sensor) to determine when the person is weight-bearing [5].

Electronic sensors, such as inertial measurement units (IMU), enable signal-processing algorithms to determine limb orientation and/or position in the gait cycle and prompt the knee joint mechanism to switch to a locked, free, or partial knee flexion-resistance setting. Ideally, an effective stance-control system would provide support during stance and unhampered knee motion during swing, for natural gait. Knee stability is of paramount importance for safe gait, but does not always require knee extensor contributions [22]. During stance, knee motion is predominantly in extension. However, the onset of knee flexion occurs between terminal stance and pre-swing. The body has forward impetus during this phase, with controlled ankle and hip removing the need for knee extensor control [22]. Safe knee-release must occur without active quadriceps muscle activation, prior to knee-flexion during swing, and after the contralateral limb is in contact with the floor. Moreover, stance-control systems must identify loading response to securely lock and keep the knee from collapsing. These criteria provide knee-release transition points that ensure safe-gait by not imposing unmanageable loads on weak knee-extensors. Consequently, accurate gait phase recognition (GPR) from wearable sensor data becomes essential for real-time orthosis-control.

Emerging gait analysis techniques use embedded sensors in wearables and offer practical modalities for gait monitoring, human activity recognition (HAR), and prosthesis and orthosis control. Electronic sensors such as strain gauges [21], pressure sensors [23], electromyography (EMG) [17], force sensitive resistors [24,25,26], goniometers [27, 28], and IMU [10, 12, 23,24,25,26, 29,30,31,32,33,34] can be combined to give highly accurate and real-time gait monitoring.

Liu, et al. [35] placed a two-axis accelerometer and three gyroscopes on the foot, shank and thigh to detect gait phases (initial contact, loading response, mid-stance, terminal stance, pre-swing, initial swing, mid-swing, terminal swing) and provide limb segment orientation. Pappas et al. [25] reported a rule-based gait phase identification system across able-bodied and impaired individuals, with states identified by prior characterization of IMU signals. Their system used foot angular velocity and three force sensitive resistors to determine weight-bearing. To improve GPR performance, they implemented knowledge-based gait phase transitions to determine possible changes of state during the gait cycle. Gorsic et al. [23] developed a gait phase identification system to provide feedback for a lower-limb robotic prosthesis. The system used IMU attached to body segments and shoe insole sensors to determine four gait phases (left stance, left-right double stance, right stance, right-left double stance). Another study [36] attempted to localize a GPR sensor system using a single IMU in a trouser pocket. They did not implement a computer-based algorithm to determine gait phases but showed that major gait phases could be visually identified from the thigh-angle signature. This is important for lower limb orthosis-control since many M-SCKAFO can benefit from computer-based/real-time GPR, along with modular electronic components located only at the thigh [10, 12].

Machine learning and artificial intelligence approaches related to HAR are becoming increasingly popular [31, 37,38,39,40]. Machine learning classifiers can provide robust, fast, and accurate classification from simple features extracted from biomechanical data, making them highly attractive for use in GPR [10, 23, 24, 41]. Machine learning algorithms coupled with local sensor systems have demonstrated sufficiently good performance to make this a potentially viable approach for identifying current states and recognizing human intent for control system feedback.

The objective of this research is to propose a method for identifying walking phases with only local gait data from the thigh and knee. Accurate GPR would provide essential information for M-SCKAFO control if the approach works in real-time, across different surface-levels, and across walking speeds. We hypothesized that signal features from the thigh and knee with a logistic decision tree machine learning model could provide highly accurate GPR performance. Secondly, a “Transition Sequence Verification and Correction” (TSVC) algorithm should improve classification results. The model should classify walking phases regardless of surface-level, walking speed, or individual walking variability. Appropriate GPR with sensors about the knee will enable new M-SCKAFO approaches that allow orthotists to use the most appropriate ankle and foot designs for the user, without limitations due to ankle-foot sensor system requirements in current devices.

Methods

Data set

A de-identified data set from 30 able-bodied participants was used in this study (Ottawa Health Science Network Research Ethics Board approval (20140825-01H). Walking data were collected in a Computer-Assisted Rehabilitation Environment (CAREN-Extended) (Motek Medical, Amsterdam, NL) virtual environment system. CAREN-Extended consists of a six degree-of-freedom force-plate platform with 1 m × 2 m dual tread instrumented treadmill (Bertec Corp., Columbus, OH), 180° screen for virtual world projection, and a 12-camera 3D motion capture system (Vicon Inc., Oxford, UK). A full body marker set defined all joint and body-segment positions [42, 43]. Marker data were recorded at 100 Hz and ground reaction forces were recorded at 1000 Hz.

Each volunteer walked in a custom-built virtual park application on level (LG), 7° declination down-slope (DS), 7° inclination up-slope (US), 5° inclination right cross-slope (RS), and 5° inclination left cross-slope (LS), at self-paced (SP) speed (1.33 m/s, SD = 0.04 m/s), 0.8 m/s, 0.6 m/s, and 0.4 m/s. Joint and body-segment trajectories were imported into Visual 3D (C-Motion Inc., Germantown, MD) for biomechanical analyses. A fourth order low pass Butterworth filter with 10 Hz cut-off frequency was applied to the marker data before calculating joint and segment kinematics.

Ten strides for knee flexion-extension angle (KA), thigh-segment angular velocity in each axis (AngVel), and thigh-segment acceleration in each axis (Acc) were extracted from each walking condition (surface and speed) and imported into Matlab. All data were linearly interpolated to 200 Hz to mimic an IMU internal sampling rate for M-SCKAFO control systems.

Validation set

A separate de-identified data set from 12 able-bodied participants provided analogous gait data to the training data set, using the same testing protocol. Six strides from each surface condition were extracted for SP walking (1.41 m/s, SD = 0.34 m/s). This set can be considered as unseen data.

Gait phase recognition

Gait phase segmentation was implemented using a custom Matlab program with predefined gait events that directly corresponded to gait signatures used. KA, AngVel (x, y, z), and Acc (x, y, z) signals were partitioned into four gait phases: Loading Response (LR), Push-Off (PO), Swing, and Terminal Swing (TSw) according to initial contact, mid-stance, foot-off, and maximum knee flexion angle gait events [10, 12]. AngVel and Acc resultants were used as supplementary signals from which features were extracted for machine learning implementation. Equation (1) describes the resultant signal for AngVel and Acc.

$$ \sqrt{a_x^2+{a}_y^2+{a}_z^2,} $$
(1)

where ax, ay, and az are the AngVel and Acc signals from x, y, z orientations, respectively.

Correlation-based feature selection was applied in a preliminary analysis [12], providing 20 features: KA mean (x-axis), AngVel mean (x-axis, y-axis), Acc mean (y-axis, z-axis), KA variance (x-axis), KA maximum difference (x-axis), AngVel maximum difference (x-axis), KA minimum (x-axis), AngVel minimum (y-axis), Acc maximum (y-axis), AngVel sign-sum (x-axis, y-axis, z-axis), Acc sign-sum (x-axis, y-axis, z-axis), resultant Acc sum of peaks (total number of peaks), AngVel principal frequency (the frequency component with the greatest magnitude with a Fast Fourier Transform (FFT), y-axis), and the correlation coefficient between the z-axis (parallel to gravity during stance) and y-axis (parallel to heading during stance and swing) acceleration. The sign-sum was defined as the sum of scores for each data point in a sliding window (negative values were scored as − 1, and positive values were scored as + 1). All features were extracted from a 0.1-s sliding window with 90% overlap (incremented at 0.01 s) and labelled as LR, PO, swing, or TSw according to the last data point [10, 12] in each window.

Logistic model decision tree

The feature vector was imported into the Waikato Environment for Knowledge Analysis (WEKA) for machine learning implementation. A logistic model decision tree (LMT) [44] classifier was trained and tested with 5-Fold Cross Validation (5-FCV) using stratified data splits. Performance metrics were obtained by reiterating through the supplied training set. The LMT was constructed as a J-48 Decision Tree with logistic regression models at terminal leaf nodes. Node splitting involved the C4.5 decision tree splitting criterion [44,45,46], using information gain on the class variable. Logistic regression functions at leaf nodes were determined using LogitBoost heuristic [44]. Default LMT parameters were used to construct the tree (i.e., convertNominal = False, debug = False, errorOnProbabilities = False, fastRegression = True, minNumInstances = 15, numBoostingIterations = − 1, splitOnResiduals = False, useAIC = False, weightTrimBeta = 0).

The LMT was manually implemented into a Matlab script as a function. The function took instances (vector containing features computed from sliding window signature) as input and returned the gait phase corresponding to the LMT model with the greatest probability as the gait phase prediction. The logistic function, shown by Eq. (2) is a sigmoid function and computes the probability of being in a gait phase.

$$ P\left({\gamma}_i\right)=\frac{e^{\gamma_i}}{1+{e}^{\gamma_i}} $$
(2)

where γi contains the coefficients of determination that form the linear combination of multiple variables (i.e., features) for logistic regression and correspond to the gait phase, i.

Transition sequence verification and correction

A “transition sequence verification and correction” (TSVC) algorithm was applied after the GPR function class output to resolve discontinuous class complications. The continuous sequence was defined as LR, PO, Swing, TSw, and repeated for the following stride. TSVC checks if the current instance is different than the three previous instances. If different and not the next phase in the sequence, the instance would be relabeled as the previous instance (e.g., “LR, LR, LR, Swing” relabelled as “LR, LR, LR, LR”). Additionally, if an outlier classification occurred between four consecutive instances, the set of three previous and a single next instance are evaluated for an outlier classification where the outlier would be relabelled as the previous instance (e.g., “LR, LR, LR, PO, LR” relabelled as “LR, LR, LR, LR, LR”). This GPR model and TSVC process also indirectly identified gait events (e.g., transition between TSw and LR indicates initial contact).

As shown in Fig. 1, sensor input from KA, AngVel, and Acc were stored in a 0.1 s sliding window (20 data points, 200 Hz sampling rate) for feature extraction and LMT-based GPR would be performed. TSVC verified and corrected for continuous gait phase sequence and output a classification. The system then incremented the sliding window by 0.01 s to classify the next instance.

Fig. 1
figure 1

Gait phase recognition flow diagram

Classifier evaluation

Classification performance metrics included tree size, number of leaf nodes, overall classification accuracy, sensitivity (Sens), specificity (Spec), precision (Prec), F-score (FS), Matthews Correlation Coefficient (MCC). Classification metrics were computed from true positives (TP), true negatives (TN), false positives (FP), and false negatives (FN) using WEKA by supplying the feature matrix as the test set. Classification metrics for LMT with TSVC were computed from a confusion matrix implemented in Matlab2016b, with weighted averages given by

$$ {W}_m=\frac{\sum_i{m_i}^{\ast }{I}_i}{\sum_i{I}_i}, $$
(3)

where m denotes a classification metric, i denotes a specific gait phase, I denotes the total number of instances in the total feature matrix relating to each gait phase.

Results

Gait phase recognition

The LMT size was 1643 with 822 leaf nodes, with a logistic regression function at each leaf node. Predicted gait phases for KA (Fig. 2), resultant AngVel (Fig. 3), and resultant Acc (Fig. 4) show partitioned gait phases during strides with LMT classification and coincide well with true classes (shaded areas). Vertical lines shown between shaded areas represent gait events used for stride segmentation. Applying LMT classification indicates that our GPR model can indirectly detect those events across walking conditions. Similar curve shapes are observed across different surfaces and signal variation increases for slower walking speeds. Fig. 2 shows that for slower speeds the stance phase (i.e., LR, PO), knee motion decreases. However, the GPR model was able to distinguish all gait phases regardless of surface condition and walking speed.

Fig. 2
figure 2

Average knee angle (degrees) and standard deviation from a single participant for each surface condition (rows) and walking speed (columns), showing classified gait phases: Loading Response (blue), Push-Off (red), Swing (cyan), Terminal Swing (teal) for the training set. Shaded areas behind the signatures show true classes along the stride and vertical lines represent gait events

Fig. 3
figure 3

Average thigh-segment angular velocity (rad/s) and standard deviation (shaded) from a single participant for each surface condition (rows) and walking speed (columns), showing classified gait phases: Loading Response (blue), Push-Off (red), Swing (cyan), Terminal Swing (teal) for the training set. Shaded areas behind the signatures show true classes along the stride and vertical lines represent gait events

Fig. 4
figure 4

Average thigh-segment acceleration (m/s2) from a single participant for each surface condition (rows) and walking speed (columns), showing classified gait phases; Loading Response (blue), Push-Off (red), Swing (cyan), Terminal Swing (teal) for the training set. Shaded areas behind the signatures show true classes along the stride and vertical lines represent gait events

Table 1 presents the confusion matrix for the training set and Table 2 presents the confusion matrix for the validation set. Shaded boxes represent TP classifications where the GPR model successfully identified gait phases, whereas off-diagonal boxes indicate a misclassification.

Table 1 Training Set Confusion Matrix
Table 2 Validation set confusion matrix

Table 3 presents the LMT classification metrics for training set (30 able-bodied participants) and validation set (12 able-bodied participants). Weighted averages are with and without TSVC.

Table 3 Logistic model tree classification performance

Gait phase classification performed well for the training set, with 98.38% overall accuracy and all classification metrics greater than 0.98. TSVC increased accuracy by 0.38%; sensitivity, and FS decreased by 1%; MCC decreased by 2%; and specificity remained the same.

Validation set metrics were less than the training set, with lower accuracy (− 7.78%), sensitivity (− 7%), specificity (− 2%), precision (− 7%), FS (− 7%), and MCC (− 11%). However, after applying TSVC, all validation set classification metrics improved. Accuracy increased by 8.01%, sensitivity, precision and FS increased by 6%, specificity increased by 2%, and MCC increased by 9%, with all results greater than 0.96.

Table 4 shows classification metrics for each gait phase. All classification metrics were greater than or equal to 0.97 across all gait phases. TSw performed the best with all classification metrics at 0.99. Swing had the lowest precision and FS. For the validation set, excluding PO, classification metrics were all greater than 0.85. PO had the lowest sensitivity, FS, MCC. LR had the second lowest sensitivity and the lowest specificity. In terms of classification performance metrics, Swing and TSw performed similarly and outperformed LR and PO for unseen data.

Table 4 LMT-GPR performance by gait phase

Table 5 shows performance metrics for the LMT with TSCV, for specific gait phases. All results were greater than 0.91, for the training set. Compared to results in Table 4, sensitivity decreased for PO and Swing, and remained the same for LR and TSw. Swing had the lowest sensitivity, FS, and MCC. TSw had the best performance across all classification metrics equal to 0.99, apart from MCC. However, MCC was still greater for the TSw phase than MCC for all other gait phases.

Table 5 LMT + TSVC GPR performance by gait phase

For the validation set, all but one metric (0.87) was greater than 0.90. Compared to the training set, all classification metrics increased for LR and TSw. All metrics increased for PO for the validation set apart from precision (decreased by 8%). Swing decreased for sensitivity (9%), FS (3%), MCC (3%). LR classification performance for the validation set outperformed all other gait phases.

Discussion

This research demonstrated the viability of a local sensor, machine learning-based, gait phase recognition system to guide decision-making for orthosis-control and safe mobility. The LMT machine learning classifier successfully performed GPR for small data windows, enabling real-time device control across different surfaces and walking speeds encountered throughout daily living activities.

Gait phase recognition classifier design and development

The machine-learning model reliably recognized LR, PO, Swing, and TSw, defined by gait events [10], across LG, DS, US, RS, and LS at different walking speeds. In the literature, most GPR models were trained and tested on level-ground walking at self-paced speeds [10, 24, 26, 30, 41], with few studies testing on a variety of surfaces [12, 25]. Models trained with multiple walking conditions that occur throughout daily living activities could enhance generalizability [15] and overall system functionality across daily living activities.

Since our GPR model was trained from a data set that contained simple data features extracted from small data windows (overlapping 0.1 s sliding window) from local thigh and knee signals across a variety of walking conditions, results can be directly translated to real-time lower-limb orthosis control. These features are not computationally intensive, facilitating fast GPR decision-making throughout the gait cycle on embedded joint electronics.

In a preliminary analysis [10, 12], a J-48 DT was chosen as the machine learning classifier due to success in activity recognition and gait applications [25, 29, 38,39,40], exceptional gait phase classification performance [10, 12], and ability to work in real-time. In this study, the classifier implemented logistic regression models at each terminal node to handle multi-class target variables. This provided gait phase probability estimates rather than just a classification output, and when correctly pruned produced a smaller tree than ordinary classification trees [44]. The J-48 DT previously used for local sensor GPR was very large, with a tree size of 16,103 and 8052 leaf nodes [12]. Generally, a smaller decision tree is a simpler model and is expected to provide computational efficiency in terms of battery consumption and classification time on a M-SCKAFO onboard microprocessor. The machine learning classifier constructed in this study, with the same training data and walking conditions, produced a tree that was approximately 90% smaller and had 90% fewer terminal leaf nodes than J-48 DT [12]. For GPR in real-time orthosis control, high accuracy and generalizability becomes more important than tree size, as long as classification decisions can be made within an appropriate period.

Classification performance also improved for all metrics. These results are in agreement with Landwehr, et al. [44] where LMT outperformed C4.5 DT (similar to J-48 DT) on 14 different data sets and LMT size was significantly less than C4.5 DT size for 16 data sets. For our study, improved gait phase classification was likely due to the probability estimates from logistic regression functions at each node. Branches in the tree would guide input information towards a node based on our highly representative training set (i.e., 30 able-bodied participants, surface levels, walking speeds), and introduced an additional probabilistic measure (i.e., logistic regression at terminal nodes) to determine class output. The LMT model’s structure and characteristics enable easier, faster, and more accurate GPR implementation on a microprocessor simply due to the model’s size and therefore computational complexity. In addition, a simpler model is more practical for adding deeper, supplementary rule-based algorithms (i.e., sequence transitions, knee-release, stumble control) thereby improving assistive-device designs, and machine learning-based stance-control feasibility.

Results from 5-FCV on the training set were very good, across all gait phases. MCC values suggest that, regardless of class imbalances within our data set, PO and Swing classifications performed well with TSVC. Sensitivity was less than specificity in all cases. High sensitivity and specificity are essential since specificity errors could result in the system switching to a knee-release setting during weight-bearing (e.g., mistaking LR for Swing), putting the user at risk of falling. Similarly, sensitivity errors could result in the joint failing to switch to knee-release when transitioning from PO to Swing. In practice, maintaining knee support during weight bearing is a priority for fall-prevention. Therefore, high specificity is advantageous for stance-control applications.

Overall classification accuracy improved with TSVC algorithm implementation, but some evaluation metrics diminished slightly. Interestingly, implementing the model on the full training set with the TSVC algorithm improved overall classification accuracy. The decrease in sensitivity for PO and Swing meant that TP were missed (i.e. FN), likely due to forcing a transition if a particular class was mistaken for any another class. Swing phase was expected to occur after PO and had fewer data instances; hence the greater decrease in sensitivity for Swing. During the transition from PO to Swing, Swing onset could be classified as PO for slower walking speeds where the signals appear similar (Figs. 2, 3 and 4). Stance phase increases for slower speeds to increase double support time and maintain stability [47]. Certain implications and difficulties arise when implementing stance-control at extremely slow walking speeds, such as 0.4 m/s. This is mainly due to the lack of signal variation at these locations during the stride, as the mean standard deviations (MSD) are close to zero. Ideally, with a sufficient static versus dynamic state decision algorithm [48], stance-control could be applied with a local sensor system at very slow walking speeds. Literature regarding GPR for very slow walking is sparse. Multiple GPR models trained to particular walking speeds (i.e., walking speeds ≤0.4 m/s) may be better to determine appropriate knee flexion resistance engagement/disengagement. Since this would require an algorithm for determining walking speed, which is difficult to accurately determine from IMU data, surrogate measures such as cadence or step time could be considered.

The GPR model had promising classification performances and demonstrated that our model could be a viable solution in localized intelligent sensor systems for M-SCKAFO applications. Based on overall classification accuracy, both of hypotheses are valid (i.e., sensor signal features from the thigh and knee with a LMT model could provide highly accurate GPR performance; a TSVC algorithm should improve classification results). However, given that decision trees are low-bias classifiers, they are expected to capture regularities in the training data. Hence, the GPR model was also evaluated with a different data (validation set).

Validation set evaluation

As expected, LMT classifier results were less with the validation set (12 different participants) than the training set. While overall classification accuracy was still greater than 90% for all evaluation metrics, a 10% error rate is not appropriate for assistive device-control, indicating that our initial hypothesis was not valid when the model was applied generally. The TSVC algorithm improved classification accuracy with the validation set since gait phases are sequential when walking. This suggests that transition correction algorithms may improve GPR models and validates the second hypothesis for new gait data.

Knowing where and when misclassifications occur is important for knee engagement/disengagement in M-SCKAFO implementation. FN occurred during gait phase transitions, where gait signals exit one phase and enter the next. For small data windows (0.1 s), feature values could be similar for consecutive windows with 90% overlap. Therefore, at regions where one gait phase transitions into another, class distributions will not vary without compelling gradient-changes in the signal. For example, if misclassifications are present at the beginning of swing, these instances would be classified as PO, thereby engaging knee-release. However, misclassifying instances near the middle or end of Swing may engage knee-flexion-resistance too early and perturb free knee-motion. As shown by Fig. 2 (KA), Fig. 3 (AngVel), and Fig. 4 (Acc) gait phase transitions are late for LR to PO. For the LMT tested with the validation set and TSVC, results showed that 1.8% of instances were classified as PO but were actually Swing and 0.5% of instances were classified as Swing but were actually TSw (i.e., misclassification at the beginning of swing, rather than at the end). Misclassifications at the beginning of Swing are shown in Figs. 2, 3 and 4 for US and LS surfaces at 0.4 m/s walking speed. Since this study involved analysis on right limb data only, right limb range of motions are similar for US and LS surfaces. This is important for misclassified instances at the beginning of swing for initiating knee-engagement or knee-disengagement. For an M-SCKAFO, knee-release would ideally occur during PO, at the earliest safe knee-release point (i.e., onset of knee flexion during in pre-swing, when weight-bearing is declining). Custom M-SCKAFO control adjustments for the participant could help achieve this ideal PO-swing transition point.

In summary, GPR model classification performance with the validation set improved with TSVC and was comparable to training set results.

Limitations

The Vicon motion analysis system provided very accurate thigh and knee data. Depending on the sensors used in the orthotic application (i.e., IMU, etc.), data in practice may be of lower quality, or have additional noise and errors due to the environment. Appropriate sensor technologies are needed to ensure translation of the research outcomes.

Conclusion

A logistic decision tree gait phase recognition model successfully identified loading response, push-off, swing, and terminal swing gait phases for five different surfaces and a range of walking speeds, with input data localized to the thigh and knee. The logistic model decision tree classifier was robust for many simulated walking conditions experienced throughout daily living and was generalizable to unseen data from a different participant group. A gait phase transition sequence verification and correction algorithm was essential to achieve appropriate GPR performance results. This research provides supporting evidence that machine learning can provide enhanced gait phase recognition for real-time orthosis-control across multiple real-world walking scenarios. Local sensors at the thigh and knee reduce sensor system complexity and help to provide an integrated, modular unit for microprocessor-controlled stance-control knee-ankle-foot orthoses.

Abbreviations

5-FCV:

5-Fold Cross Validation

Acc:

Thigh-Segment Acceleration

AngVel:

Thigh-Segment Angular Velocity

CAGH:

Correlation Along Gravity (z-axis acceleration) and Heading (y-axis acceleration)

CAREN-Extended:

Computer Assisted Rehabilitation Environment

CFS:

Correlation-Based feature selection

DS:

Down Slope

FN:

False Negative

FP:

False Positive

FS:

F-Score

GPR:

Gait Phase Recognition

HAR:

Human Activity Recognition

IMU:

Inertial Measurement Unit

J-48 DT:

J-48 Decision Tree

KA:

Knee Angle

KAFO:

Knee-Ankle-Foot Orthoses

LG:

Level Ground

LG-DS-US:

Level Ground-Down Slope-Up Slope

LG-RS-LS:

Level Ground-Right Slope-Left Slope

LMT:

Logistic Model Tree

LR:

Loading Response

LS:

Left cross-Slope

MCC:

Matthew’s Correlation Coefficient

M-SCKAFO:

Microprocessor-controlled Stance-Control Knee-Ankle-Foot Orthoses

MSD:

Mean Standard Deviation

PO:

Push-Off

RS:

Right cross-Slope

SCKAFO:

Stance-Control Knee-Ankle-Foot Orthoses

SP:

Self-Paced

TN:

True Negative

TP:

True Positive

TSVC:

Transition Sequence Verification and Correction

TSw:

Terminal Swing

US:

Up Slope

WEKA:

Waikato Environment for Knowledge and Analysis

References

  1. Yakimovich T, Kofman J, Lemaire E. Design, construction and evaluation of an electromechanical stance-control knee-ankle-foot orthosis, Eng Med Biol Soc 2005 IEEE-EMBS 2005 27th Annu Int Conf Of; 2005. p. 6934–41. https://doi.org/10.1109/IEMBS.2005.1616934.

  2. Yakimovich T, Kofman J, Lemaire ED. Design and evaluation of a stance-control knee-ankle-foot orthosis knee joint. IEEE Trans Neural Syst Rehabil Eng. 2006;14:361–9.

    Article  Google Scholar 

  3. Lemaire ED, Goudreau L, Yakimovich T, Kofman J. Angular-velocity control approach for stance-control orthoses. IEEE Trans Neural Syst Rehabil Eng Publ IEEE Eng Med Biol Soc. 2009;17:497–503.

    Article  Google Scholar 

  4. Yakimovich T, Lemaire ED, Kofman J. Engineering design review of stance-control knee-ankle-foot orthoses. J Rehabil Res Dev. 2009;46:257–67.

    Article  Google Scholar 

  5. Tian F, Hefzy MS, Elahinia M. State of the art review of knee–ankle–foot orthoses. Ann Biomed Eng. 2015;43:427–41.

    Article  Google Scholar 

  6. Kaufman KR, Irby SE, Mathewson JW, Wirta RW, Sutherland DH. Energy-efficient knee-ankle-foot orthosis: a case study. J Prosthet Orthot. 1996;8:79–85.

    Article  Google Scholar 

  7. Cullell A, Moreno JC, Rocon E, Forner-Cordero A, Pons JL. Biologically based design of an actuator system for a knee–ankle–foot orthosis. Mech Mach Theory. 2009;44:860–72.

    Article  Google Scholar 

  8. Lemaire ED, Samadi R, Goudreau L, Kofman J. Mechanical and biomechanical analysis of a linear piston design for angular-velocity-based orthotic control. J Rehabil Res Dev. 2013;50:43–52.

    Article  Google Scholar 

  9. Moreno JC, Brunetti F, Rocon E, Pons JL. Immediate effects of a controllable knee ankle foot orthosis for functional compensation of gait in patients with proximal leg weakness. Med Biol Eng Comput. 2008;46:43–53.

    Article  Google Scholar 

  10. Farah JD, Lemaire ED, Baddour N. Gait phase detection from thigh kinematics using machine learning techniques. IEEE Symp Med Meas Appl. 2017:​263–8. https://doi.org/10.1109/MeMeA.2017.7985886.

  11. Zissimopoulos A, Fatone S, Gard S. Biomechanical and energetic effects of a stance-control orthotic knee joint. J Rehabil Res Dev. 2007;44(4):503–13.

  12. Farah JD, Lemaire ED, Baddour N. Machine learning-based gait phase recognition for lower limb orthosis-control. Trans neural Syst Rehabil Eng Publ. 2017.

  13. Thiele J, Westebbe B, Bellmann M, Kraft M. Designs and performance of microprocessor-controlled knee joints. Biomedizinische Technik. Biomed Eng. 2014;59(1):65–77.

  14. Lawn MJ, Takashima M, Ninomiya M, Yu J, Soma K, Ishimatsu T. Development of an actuation system for a rotary hydraulic brake on a low cost light weight knee-ankle-foot orthosis, 2015 IEEE Sens, vol. 2015. p. 1–4.

  15. Irby SE, Kaufman KR, Wirta RW, Sutherland DH. Optimization and application of a wrap-spring clutch to a dynamic knee-ankle-foot orthosis. IEEE Trans Rehabil Eng. 1999;7:130–4.

    Article  CAS  Google Scholar 

  16. Schmalz T, Pröbsting E, Auberger R, Siewert G. A functional comparison of conventional knee–ankle–foot orthoses and a microprocessor-controlled leg orthosis system based on biomechanical parameters. Prosthetics Orthot Int. 2016;40:277–86.

    Article  Google Scholar 

  17. Sawicki GS, Ferris DP. A pneumatically powered knee-ankle-foot orthosis (KAFO) with myoelectric activation and inhibition. J NeuroEngineering Rehabil. 2009;6:23.

    Article  Google Scholar 

  18. Otto Bock Health Care. Ottobock advanced orthotics: stance control KAFOs and unilateral joints [internet]. 2013. Available from: https://www.ottobockus.com.

  19. Edeer D. E-MAG active, a newer stance control knee ankle foot orthosis (SCKAFO) in the context of workers’ compensation [Internet]. Richmond.: WorkSafeBC; 2010 [cited 2017 Oct 2]. Available from: https://books-scholarsportal-info.proxy.bib.uottawa.ca/uri/ebooks/ebooks1/gibson_chrc/2011-08-22/1/10478629.

  20. Ottobock. Ottobock C-Brace Brochure [Internet]. 2012 [cited 2013 Nov 4]. Available from: https://media.ottobock.com/orthotics/c-brace/files/c-brace-brochure.pdf.

  21. C-Brace Orthotronic Mobility System — Ottobock [Internet]. [cited 2017 Oct 2]. Available from: http://www.ottobockus.com/orthotics/solution-overview/orthotronic-mobility-system-c-brace/

  22. Bowker P. Biomechanical basis of orthotic management, Oxford England; Boston: Butterworth-Heinemann; 1993.

  23. Goršič M, Kamnik R, Ambrožič L, Vitiello N, Lefeber D, Pasquini G, et al. Online phase detection using wearable sensors for walking with a robotic prosthesis. Sensors. 2014;14:2776–94.

    Article  Google Scholar 

  24. Jung J-Y, Heo W, Yang H, Park H. A neural network-based gait phase classification method using sensors equipped on lower limb exoskeleton robots. Sensors. 2015;15:27738–59.

    Article  Google Scholar 

  25. Pappas IPI, Popovic MR, Keller T, Dietz V, Morari M. A reliable gait phase detection system. IEEE Trans Neural Syst Rehabil Eng. 2001;9:113–25.

    Article  CAS  Google Scholar 

  26. Rafajlović S, Gavrilović M, Mijailović N. Gait phases recognition from accelerations and ground reaction forces: application of neural networks. Telfor J. 2009;1:34–7.

    Google Scholar 

  27. Ng SK, Chizeck HJ. Fuzzy model identification for classification of gait events in paraplegics. IEEE Trans Fuzzy Syst. 1997;5:536–44.

    Article  Google Scholar 

  28. Kettelkamp DB, Johnson RJ, Smidt GL, Chao EYS, Walker M. An Electrogoniometric study of knee motion in Normal gait. J Bone Jt Surg Am. 1970;52:775–90.

    Article  CAS  Google Scholar 

  29. Chan H, Yang M, Wang H, Zheng H, McClean S, Sterritt R, et al. Assessing gait patterns of healthy adults climbing stairs employing machine learning techniques. Int J Intell Syst. 2003;28:257–70.

    Article  Google Scholar 

  30. Choi S, Youn I-H, LeMay R, Burns S, Youn J-H. Biometric gait recognition based on wireless acceleration sensor using k-nearest neighbor classification, 2014 Int Conf Comput Netw Commun ICNC; 2014. p. 1091–5.

    Google Scholar 

  31. Mannini A, Sabatini AM. Machine learning methods for classifying human physical activity from on-body accelerometers. Sensors. 2010;10:1154–75.

    Article  Google Scholar 

  32. Wang N, Ambikairajah E, Lovell NH, Celler BG. Accelerometry based classification of walking patterns using time-frequency analysis, 29th Annu Int Conf IEEE Eng med biol Soc 2007 EMBS 2007; 2007. p. 4899–902.

    Google Scholar 

  33. Alonge F, Cucco E, D’Ippolito F, Pulizzotto A. The use of accelerometers and gyroscopes to estimate hip and knee angles on gait analysis. Sensors. 2014;14:8430–46.

    Article  Google Scholar 

  34. Farah J, Lemaire E, Baddour N. Comparison of inertial sensor data from the wrist and mid-lower back during a 2-minute walk test, 2016 IEEE EMBS Int Stud Conf ISC; 2016. p. 1–4.

    Google Scholar 

  35. Liu T, Inoue Y, Shibata K. Development of a wearable sensor system for quantitative gait analysis. Measurement. 2009;42:978–88.

    Article  Google Scholar 

  36. Abhayasinghe N, Murray I. Human gait phase recognition based on thigh movement computed using IMUs, 2014 IEEE Ninth Int Conf Intell Sens Sens Netw Inf Process ISSNIP; 2014. p. 1–4.

    Google Scholar 

  37. Capela NA, Lemaire ED, Baddour N. Feature selection for wearable smartphone-based human activity recognition with able bodied, elderly, and stroke patients. PLoS One. 2015;10:e0124414.

    Article  Google Scholar 

  38. Avci A, Bosch S, Marin-Perianu M, Marin-Perianu R, Havinga P. Activity recognition using inertial sensing for healthcare, wellbeing and sports applications: a survey, 23th Int Conf Archit Comput Syst 2010; 2010. p. 1–10.

    Google Scholar 

  39. Wang S, Yang J, Chen N, Chen X, Zhang Q. Human activity recognition with user-free accelerometers in the sensor networks, 2005 Int Conf Neural Netw Brain; 2005. p. 1212–7.

    Google Scholar 

  40. Bao L, Intille SS. Activity recognition from user-annotated acceleration data. In: Ferscha A, Mattern F, (eds). Pervasive computing. Pervasive 2004. Lecture notes in computer science, vol 3001. Berlin: Springer; 2004.

  41. Taborri J, Rossi S, Palermo E, Patanè F, Cappa P. A novel HMM distributed classifier for the detection of gait phases by means of a wearable inertial sensor network. Sensors. 2014;14:16212–34.

    Article  Google Scholar 

  42. Sinitski EH, Lemaire ED, Baddour N, Besemann M, Dudek NL, Hebert JS. Fixed and self-paced treadmill walking for able-bodied and transtibial amputees in a multi-terrain virtual environment. Gait Posture. 2015;41:568–73.

    Article  Google Scholar 

  43. Wilken JM, Rodriguez KM, Brawner M, Darter BJ. Reliability and minimal detectible change values for gait kinematics and kinetics in healthy adults. Gait Posture. 2012;35:301–7.

    Article  Google Scholar 

  44. Landwehr N, Hall M, Frank E. Logistic model trees. Mach Learn. 2005;59:161–205.

    Article  Google Scholar 

  45. Polat K, Güneş S. A novel hybrid intelligent method based on C4.5 decision tree classifier and one-against-all approach for multi-class classification problems. Expert Syst Appl. 2009;36:1587–92.

    Article  Google Scholar 

  46. Loh W-Y. Classification and regression trees. Wiley Interdiscip Rev Data Min Knowl Discov. 2011;1:14–23.

    Article  Google Scholar 

  47. Smith AJJ, Lemaire ED. Temporal-spatial gait parameter models of very slow walking. Gait Posture. 2017.

  48. Capela NA, Lemaire E, Baddour N. Improving a smartphone wearable mobility monitoring system with feature selection and transition recognition. Ottawa-Carleton Institute for Biomedical Engineering. Theses, & University of Ottawa. Department of Mechanical Engineering. 2015. https://ruor.uottawa.ca/handle/10393/32793.

Download references

Acknowledgments

Brandon Fournier, Andrew Smith, Hossein Gholizadeh are acknowledged for their technical support and insight on gait analysis. The Natural Science and Engineering Research Council CREATE program is acknowledged for funding this project.

Funding

This work was financially supported by the Natural Sciences and Engineering Research Council of Canada.

Availability of data and materials

All test results are reported in the manuscript. The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

Authors

Contributions

JF carried out data characterization, feature extraction, feature selection, model interpretation, machine learning implementation, algorithm development, statistical analysis, and drafted the manuscript. ED and NB conceived of the study and participated in its design, coordination and helped draft the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Johnny D. Farah.

Ethics declarations

Ethics approval and consent to participate

This research was approved by the Ottawa Health Science Network Research Ethics Board (20140825-01H).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Farah, J.D., Baddour, N. & Lemaire, E.D. Design, development, and evaluation of a local sensor-based gait phase recognition system using a logistic model decision tree for orthosis-control. J NeuroEngineering Rehabil 16, 22 (2019). https://doi.org/10.1186/s12984-019-0486-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12984-019-0486-z

Keywords