Infant trunk posture and arm movement assessment using pressure mattress, inertial and magnetic measurement units (IMUs)
Journal of NeuroEngineering and Rehabilitation volume 11, Article number: 133 (2014)
Existing motor pattern assessment methods, such as digital cameras and optoelectronic systems, suffer from object obstruction and require complex setups. To overcome these drawbacks, this paper presents a novel approach for biomechanical evaluation of newborn motor skills development. Multi-sensor measurement system comprising pressure mattress and IMUs fixed on trunk and arms is proposed and used as alternative to existing methods. Observed advantages seem appealing for the focused field and in general. Combined use of pressure distribution data and kinematic information is important also for posture assessment, ulcer prevention, and non-invasive sleep pattern analysis of adults.
Arm kinematic parameters, such as root-mean-square acceleration, spectral arc length of hand velocity profile, including arm workspace surface area, and travelled hand path are obtained with the multi-sensor measurement system and compared to normative motion capture data for evaluation of adequacy. Two IMUs per arm, only one IMU on upper arm, and only one IMU on forearm sensor placement options are studied to assess influence of system configuration on method precision. Combination of pressure mattress and IMU fixed on the trunk is used to measure trunk position (obtained from mat), rotation (from IMUs) and associated movements on surface (from both). Measurement system is first validated on spontaneous arm and trunk movements of a dedicated baby doll having realistic anthropometric characteristics of newborns. Next, parameters of movements in a healthy infant are obtained with pressure mattress, along with trunk and forearm IMU sensors to verify appropriateness of method and parameters.
Evaluation results confirm that full sensor set, comprising pressure mattress and two IMUs per arm is a reliable substitution to optoelectronic systems. Motor pattern parameter errors are under 10% and kinematic estimation error is in range of 2 cm. Although, use of only forearm IMU is not providing best possible kinematic precision, the simplicity of use and still acceptable accuracy are convincing for frequent practical use. Measurements demonstrated system high mobility and usability.
Study results confirm adequacy of the proposed multi-sensor measurement system, indicating its enviable potential for accurate infant trunk posture and arm movement assessment.
Early infancy is an important segment of infant’s life, as during the first six months infants gradually achieve some main developmental milestones and set the foundations for their upcoming life . Reliable infant’s motor pattern assessment can ensure detection of atypical development  and subsequent early intervention, which in case of developmental disorders holds an important role in effective rehabilitation [3, 4].
Typically applied clinical methods for assessment of developmental patterns, such as AIMS, TIMP, and Bayley III , despite comprehensive knowledge, experience, and keen eye of clinicians, lack objectivity and precision. To avoid such drawbacks and ensure reliable, repeatable, and accurate results, use of measurement systems with optical, inertial, and other similar motion capture sensors, seems sensible and reasonable. Although, it has received notable attention in the last decades , widespread use is limited by specific anthropometric characteristics of infants, such as shorter segment lengths, lower weight, and intolerance to longer, invasive measurement sessions with complex setup preparation routines .
Digital camera systems have been used with additional videotape coding and classification, such as Observer coding program to study the influence of postural control on hand behaviour , and infant’s reaching behaviour in relation to hand preference . Precision was improved with use of reflexive markers and integration of Dvideow image analysis system  for reconstruction of 3D head movement  and goal-directed reaching behaviour . Digital camera systems are low-cost, but suffer from object obstruction, need of complex camera calibration, illumination of markers, and careful adjustments of zoom and focus .
Optoelectronic multi-camera systems (Optotrak, Vicon, Qualisys motion capture) exploit advantages of infrared spectrum (infrared emitting diodes) and ensure precision of under 1 mm even at high sampling frequencies . Simultaneous videotape recording and coding ensures intuitive interpretation of infant’s actions. Such combinations have been used for studying reach and grasp development , head , arm and trunk movement [16, 17]. System disadvantages are high number of needed markers, invasiveness, time-consuming preparation of the measurement subject and measurement system. While system complexity was reduced with marker clusters , large segments of missing data due to unexpected infant’s movement and self-occlusion remain a problem [7, 19].
Electromyography (EMG) measurements have been used as supplement to optical camera-based experimental setup to extract enhanced movement information and muscle activation data, focusing on studying postural control during infant’s reaching tasks [20, 21].
Force plates have been used in combination with movement analysis systems to analyse goal-directed reaching and postural control of healthy infants in supine position . Kyvelidou et al. studied sitting postural control, in terms of centre-of-pressure (COP) movement, by using force plates alone .
Electromagnetic (EM) tracking systems have been used in cooperation with motion sensor displacement removal methods  to surpass the line-of-sight requirements of optical systems, but suffer from movement limitations due to wiring.
Wireless inertial and magnetic measurement units (IMUs) are a wearable, non-invasive, low-cost system, consisting of a three-axis gyroscope, three-axis accelerometer, and a three-axis magnetometer. Such set of sensors measures three-dimensional angular velocity, acceleration, and magnetic field vectors. These mechanical sensor signals can be merged using sensor fusion methods to estimate orientation [28–30]. Sensor fusion in this context is covering statistical and deterministic fusion methodology  and is needed to overcome the shortcomings of using sensors individually. IMUs have been intensively and reliably used for movement tracking of adults [29, 30, 32], as well as upper extremity motion measurements of primary school children . To the best knowledge of authors, IMU applications for infant movement tracking are rare. Although, Taffoni and colleagues  reported of a wired magneto-inertial wearable device design for behavioral analysis of infants, authors presented only preliminary performance results.
Pressure distribution mattresses are matrices of usually piezoresistive effect based sensors. Boughorbel et al. reported of basic, non-invasive infant trunk posture analysis with feature selection methods. The classification process was performed by majority vote fusion of linear, quadratic, support vector machines (SVM), and k-nearest neighbour (kNN) classifiers . Dusing et al. reported of trunk extension and flexion tendencies assessment of infants in supine , as well as COP movement analysis . More existing applications are in the field of posture analysis of adults, such as non-invasive sleep pattern analysis [38, 39], ulcer prevention methods , and posture classification during diagnostic tomography imaging . Despite disadvantages, good reliability and precision are obtained with implementation of data processing and machine learning methods, such as principal component analysis (PCA), SVM , kNN , Naïve Bayes classifiers, and hidden Markov models .
A dedicated multi-sensor based gym for measurement and rehabilitation of pre-term infants is being developed by the FP7 EU project CareToy consortium. As part of the sensor system, a combination of pressure mattresses and IMUs fixed on trunk and arms is proposed for infant’s movement recognition and motor pattern assessment, in view of avoiding the listed drawbacks of other measurement systems.
While the area of sensor based assessment of infant arm motor patterns still lacks a non-invasive, objective, low-cost measurement system, the proposed combination of sensors has not yet been used for such analysis. Therefore, the presented study has several purposes. Firstly, the main intention is to validate the proposed sensor set for analysis of infant arm motor pattern parameters by comparison to referential optoelectronic motion capture (Optotrak) data. The second purpose is to study the dependency of arm kinematic parameters determination in relation to the selected type of IMU sensor placement. Unknown is the influence of system configuration on method precision. Finally, the sensor set is used in a measurement session of a healthy infant to support appropriateness of method and parameters.
This section is organized as follows. Initially, the measurement procedure and the experimental setup are presented. Following this, the sensor data processing methodology of trunk and arm posture analysis is described. Finally, the proposed motor pattern parameters are listed, and measurement procedure of the infant is given.
Experimental setup and measurement procedure
Experimental setup comprised two pressure distribution mattresses, six wireless IMUs, a two-camera optoelectronic measurement system, and a digital video camera.
Two commercially available pressure distribution mattresses (CONFORMat System, Model 5330, Tekscan, Inc., USA) were used for pressure distribution measurement. Approximately 80 cm × 47 cm of total pressure sensitive area was covered with 1760 (55 × 32) piezoresistive pressure sensors.
Six wireless IMUs, designed exclusively for the EU project CareToy by STMicroelectronics, Italy were used for trunk and arm segment orientation measurements.
Two-camera optoelectronic measurement system Optotrak Certus (Northern Digital Inc., Waterloo, ON, Canada) with thirteen infrared emitting diodes as active markers was used for referential measurements of trunk and arm segment positions.
A large number of wired active markers makes validation of the measurement system on an infant practically impossible and ethically controversial. Therefore, a dedicated baby doll, having realistic anthropometric characteristics (trunk weight, arm segment lengths, and elbow joints) of a preterm newborn, was used as a test subject for this purpose.
The test subject was equipped with five IMUs (trunk and each arm segment), set inside specially designed silicone bracelets and ten Optotrak markers, fitted on test subject’s anatomical landmarks (Figure 1). One IMU and three Optotrak markers were placed in the corner of the pressure mattress to determine the referential IMU and Optotrak coordinate system (Figure 1). A digital USB video camera was placed above the experimental setup for easier interpretation of numerical results.
MATLAB/Simulink was used for synchronous sensor data acquisition of Optotrak (100 Hz), IMUs (100 Hz), pressure distribution mattress data (30 Hz), and video (10 Hz). Acquired data were stored on a computer hard drive for post processing.
Subject’s arms and trunk were moved by an experienced experimenter similarly to realistic movements of an infant, trying to avoid marker occlusion. Movement activity around the longitudinal (cranial-caudal) axis of the trunk was simulated as rolling over from back to side position in a corkscrew fashion . Simultaneously, spontaneous arm movements were performed on the frontal side of coronal plane around cranial-caudal, ventral-dorsal, and medial-lateral axis. Realistic goal-oriented reach to grasp behaviour was simulated by changing the elbow angle from elbow flexion to elbow extension and vice versa. Average movement speed was approximately 13 cm/s, similar to .
Sensor data processing
Several coordinate systems are used for trunk and arm posture description. Earth coordinate system (E) is defined with orientations of gravity and Earth magnetic field vectors. Trunk coordinate system (T) is defined with directions of medial-lateral (x), caudal-cranial (y), and dorsal-ventral (z) axes. Arm segment coordinate systems (upper arm - UA, forearm - FA) are defined with posterior-anterior (x), proximal-distal (y), and medial-lateral (z) axes (Figure 2). Referential Optotrak and IMU coordinate system is defined with orientation of the pressure mattress (Figure 1). In example, presents forearm coordinate system orientation, expressed in trunk coordinate system.
Trunk posture analysis
Trunk posture analysis comprises data pre-processing and sensor data fusion. Pressure distribution data is a digital grayscale image (55 pixels × 32 pixels) and can be processed with effective digital image processing techniques.
Pressure mattress modules have unique default offset level, dependent of the surrounding temperature. Bias values reach up to twenty percent of pixel value range and are noticeable on the loaded pressure distribution matrix (Figure 3b). Therefore, a bias values matrix (Figure 3a), recorded on a regular basis, is used for offset data removal. Noise values, such as oscillations of the output, are removed by data comparison to pre-set thresholds.
A two dimensional eight-connected neighborhood connectivity algorithm of the built-in MATLAB function bwconncomp is used to group pressure data into objects. Object properties, such as area, load, and values of minimally and maximally loaded pixels are calculated with the built-in function regionprops, and compared to pre-set thresholds for thorough removal of small artefacts (cross-talk).
Successful noise and offset removal ensures extraction of the infant’s pressure imprint matrix (Figure 3c). Linear interpolation method, based on triangles formed by Delaunay triangulation , provides higher resolution and accuracy of processed images, resulting in pressure distribution image of 165 pixels × 96 pixels (Figure 3d).
Pressure distribution matrix centre-of-pressure (C O P mat ) coordinates are calculated with regard to pixel load values and coordinates. Orientation of IMUs, relative to E is determined with the Unscented Kalman filter (UKF). UKF is a sensor fusion algorithm for estimation of nonlinear systems and represents an upgrade to the more frequently used extended Kalman filter [28, 29, 45]. T orientation is expressed relative to referential IMU coordinate system and is a good estimate of infant’s orientation on the pressure mattress. The trunk IMU can occasionally be displaced and minimally rotated during a measurement session. Therefore, determination of infant’s trunk orientation on the pressure mattress is improved by combined use of trunk IMU and pressure data. Trunk imprint on the pressure mattress is recognized as combination of pixels and objects in close surroundings of C O P mat . Two-dimensional trunk imprint orientation on the pressure mattress is extracted with contrast enhancement method  and central image moments calculation . Trust levels of acquired data are determined considering trunk imprint load and length, and distance of C O P mat to centre of the pressure mattress. According to the extracted trust level and the determined two-dimensional trunk imprint orientation, trunk IMU orientation is adjusted in order to ensure precise and exact three-dimensional orientation of infant’s trunk on the pressure mattress. Whenever trust levels are too low (insufficient trunk imprint load or length), trunk IMU orientation is adjusted with last reliable offset data.
Approximate three-dimensional shoulder coordinates on the pressure mattress are determined using pre-set distances. Rolling, trunk flexion, and extension activity is detected by the trunk IMU and considered as the shoulder position adjustments. Coordinates are adjusted with respect to the occurring activity in direction towards or away from the trunk midline, as well as towards or away from the trunk centre-of-pressure. Whenever possible, double-histogram analysis, similar to , is performed on trunk imprint data to acquire position of shoulders on the pressure mattress. This feature improves precision of the shoulder determination phase and is especially important in case of distinct rolling activity.
Arm posture analysis
Pre-multiplication (1) is used to express upper and forearm segment orientations relative to the adjusted and improved T. In (1), R is the rotation matrix, while T, E, and A represent trunk, Earth, and arm segment coordinate systems (UA and FA), respectively.
Elbow (p EL ) and hand (p H ) position, describing full arm kinematics (Figure 2), can be calculated with (2), using upper and forearm orientation data (relative to T), and arm segment length vectors (). l UA and l FA represent upper and forearm segment lengths.
Since a simple system is needed, arm kinematics can be described with only upper or forearm IMU sensor orientation information (Figure 2). Consequently, and in (2) become in (3), whereas A now represents either upper (UA) or forearm (FA) coordinate system. The choice depends on the currently analysed system simplification.
The elbow is a hinge-joint with flexion and extension movements, defined with the angle φ (Figure 2). Sensor system simplifications with only 1 IMU per arm therefore mostly result in imprecision of elbow angle and can be described with (4), where ε UA and ε FA are the errors (Euclidean distances) of upper and forearm IMU sensor placement options (Figure 2). Error dependencies are a cosine theorem variation and are dependent on arm segment length and elbow flexion angle φ.
Optotrak marker positions are transformed to the actual anatomical landmark positions (shoulder, abdomen, head) by recalculation of trunk and head plane normal vectors. Elbow and hand marker positions are expressed relative to T. Average distances between Optotrak markers, positioned at anatomical landmarks, can be used for arm segment lengths (l UA , l FA ) determination. These lengths can also be determined by segment length measurements. Optotrak centre-of-pressure coordinates (C O P opto ) are calculated as transformed centre of shoulders and lower abdomen marker positions. Comparison to IMU based results is performed by root-mean-square Euclidean distance values (RMSE) calculation.
Considering three-dimensional shoulder coordinates and trunk orientation on the pressure mattress, elbow and hand coordinates are expressed relative to the pressure mattress. This is important for identification of infant’s interaction with the gym.
Head imprint is recognized with a series of implemented search algorithms, such as adaptive line-of-sight algorithm, histogram analysis, and the object tracking method (Rihar A, Mihelj M, Kolar J, Pašič J, Munih M: Sensory data fusion of pressure mattress and wireless inertial magnetic measurement units, submitted). First, head imprint is identified through analysis of coordinates, load, and area of objects in proximity of shoulder coordinates. Whenever head and trunk imprints are connected, head cannot be recognized by using the described algorithm and is determined with double histogram analysis, similar to . Head-tracking algorithm is based on limited dynamics of human head movement and ensures higher reliability and robustness. Relevant anatomical landmark coordinates and recognized significant imprint objects can be presented visually (Figure 3e).
Motor pattern parameters
To validate the pressure mattress and IMU data in comparison to normative optoelectronic motion capture (Optotrak) data, typical arm motor pattern assessment parameters were calculated. Among these are mean absolute jerk, root-mean-square jerk, spectral arc length , root-mean-square acceleration, normalized arm workspace surface envelope area , normalized arm workspace volume, reachable workspace volume, travelled path , and the hand average speed .
Hand velocity v H is determined with (5), where w UA , w FA , r UA , and r FA denote the upper and forearm angular velocities, shoulder to elbow (upper arm), and elbow to hand (forearm) vectors, respectively. Angular velocities and acceleration data are measured by the IMU gyroscopes and accelerometers and are expressed relative to the referential coordinate system.
Dynamic acceleration of IMU is determined with gravity deduction from the acceleration vector, expressed in the referential coordinate system.
Jerk is calculated as the first derivative of acceleration.
Hand velocity v H can be calculated by integration of IMU dynamic acceleration, but due to acceleration data bias, velocity tends to drift. Such approach is appropriate only for velocity calculation of arm movements with shorter time periods, such as reach to grasp and similar arm movements. Band pass filter eliminates the low frequencies and resolves the drift related problems.
Spectral arc length SAL metric is appropriate for movement smoothness assessment and was calculated for 150 determined arm movement intervals with (6), where V(w) is the Fourier magnitude spectrum of v H , and [ 0,w c ] is the frequency band, occupied by the given movement .
Velocity, acceleration, and jerk are calculated also from referential motion capture (Optotrak) position data as the first, second, and third derivative, respectively. Derivation is subject to noise, therefore data is filtered with a cut-off frequency of 6 Hz [21, 22, 52].
Pearson correlation coefficient R is used to determine correlation of referential motion capture system (Optotrak) and IMU based results.
Root-mean-square Euclidean distances R M S E arm are calculated to provide comparison for elbow and hand coordinates, which are obtained by referential motion capture system (Optotrak) as well as determined by combined use of pressure mattress and IMU data.
Arm workspace is described with normalized workspace surface area  and normalized workspace volume values. In case of 2 IMUs per arm sensor placement, transformation of hand coordinates from Cartesian to spherical coordinate system is performed. Radius values vary over time, therefore optimum workspace radius is calculated with the least squares method  and transformation back to Cartesian coordinate system is performed. In case of 1 IMU per arm, orientation of both arm segments is considered identical, resulting in constant hand to shoulder distance, therefore described transformations are unnecessary.
Workspace surface envelope area is calculated with the alpha shapes method  that determines the concave polygon object of hand kinematic data and its surface area value. Normalization to the frontal hemisphere area, which presents the maximum possible arm workspace surface of an infant’s hand, eliminates the influence of segment length measurement errors and makes inter-subject comparison possible.
Workspace volume is determined by processing of hand kinematic data with Delaunay triangulation method , the “quickhull” algorithm  for determination of convex hull object, and subsequent calculation of the corresponding volume. The value is again normalized to the frontal hemisphere volume.
Reachable workspace is described by calculation of concave and convex volume. The first one is calculated with the alpha shapes method , while the second one is determined with Delaunay triangulation method  and the “quickhull” algorithm . As arm coordinates are expressed relative to the pressure mattress and not relative to the trunk, optimum radius determination and coordinate system transformations are not needed.
Travelled path P is calculated with (7), where n, x, y, and z represent number of samples in the time-series data and hand coordinates, respectively.
Average speed S is calculated as normalized travelled path with respect to the measurement session duration, which makes inter-hand, inter-session, and inter-subject comparison possible.
Measures from a healthy infant
To support adequacy of method and parameters, parameters of movements in a healthy, five month old infant were acquired using the dedicated multi-sensor based gym with two pressure mattresses, one referential IMU, and one trunk IMU. 1 IMU per forearm sensor placement was chosen to simplify the measurement procedure. The measurements were performed in compliance with the Helsinki Declaration as part of the FP7 EU project CareToy and were overseen by a child therapist. The measurement protocol was approved by the Italian Ministry of Health (DGDFSC 0066613-P-17/09/2013). Proper informed consent was obtained from the parents, who were present throughout the measurement procedure. Referential video recordings were acquired with a digital USB video camera.
This section provides the validation results. First, dependency of arm kinematics estimation to IMU sensor placement is presented. The velocity, acceleration, and jerk based motor pattern parameter values are given for referential optoelectronic motion capture (Optotrak) and IMU data. Arm workspace results are provided both, visually and numerically. Following this, reachable workspace volume and travelled path parameters are listed. Finally, measures from the infant are presented.
Arm kinematics estimation
Precision results of arm kinematics estimation are presented in Figure 4. R M S E arm values of elbow (EL) and hand (H) coordinates are given for all three IMU sensor placement options, compared to referential optoelectronic motion capture (Optotrak) values.
Motor pattern parameters
Dynamic acceleration and jerk parameters of spontaneous arm movements are shown in Table 1. The values are calculated from referential motion capture (Optotrak) position data and the forearm IMU accelerometer signal. Pearson correlation coefficients R are listed for acceleration, jerk, and velocity signals. They are calculated for referential optoelectronic motion capture system (Optotrak) and IMU based approaches.
SAL parameter values are presented in Figure 5 and are calculated from referential motion capture system (Optotrak) and IMU based hand velocity of spontaneous arm movements. SAL values, based on hand velocity for 2 IMUs per arm sensor placement, are shown along with hand velocity and acceleration integration approach for 1 IMU per forearm sensor placement. Correlation coefficients are given for all three options. Absolute SAL differences for referential motion capture system (Optotrak) based hand velocity and the aforementioned IMU based approaches are shown in Figure 6. Box plots are used to present the mean values and level of dispersion.
Arm workspace surface envelope patches for referential motion capture system (Opto), 2 IMUs per arm (2IMUs), 1 IMU per upper (1UA), and 1 IMU per forearm (1FA) sensor placements are presented in Figure 7. Various views on baby doll’s coronal, sagittal, and transverse planes are used to ensure intuitive three-dimensional result interpretation. Figure 8 shows normalized workspace volume and normalized surface area values for the aforementioned approaches. This provides the possibility of volume and surface area percentage comparison. RMSE values for centre-of-pressure, shoulders, and head coordinates are given in Figure 9.
Reachable volume space results, along with travelled path P and average speed S values are presented for the same movements in Tables 2 and 3, respectively. Results are given for referential motion capture system (Optotrak) based approach and three IMU sensor placement options. IMU based results are normalized to referential motion capture (Optotrak) values to ensure intuitive comparison.
Measures from a healthy infant
Right arm workspace surface envelope results from a healthy infant are presented in Figure 10. Various views are used to ensure intuitive three-dimensional interpretation. Figure 11 in a sequence shows the representative frames of acquired video recordings, which were used for arm workspace validation in Figure 10. Motor pattern parameters of the infant’s movement are given in Table 4. Acceleration and jerk based parameters, SAL, arm workspace surface area and volume results are listed along with travelled path P and the average speed S values.
This section first presents discussion of arm kinematics estimation values and motor pattern parameter validation results. Following this, a discussion of acquired measures from a healthy infant is given. Finally, advantages of combining sensor data are emphasized.
Arm kinematics estimation
Elbow (EL2IMUs) and hand (H2IMUs) R M S E arm values are in range of 2 cm (Figure 4), which confirms that 2 IMUs per arm sensor placement ensures high arm kinematic precision capture. Position errors are a consequence of several factors. Most important are the skin movement and consequently slight displacement of IMU in relation to arm segment orientation and possible incorrect arm segment length measurements. Use of only upper or forearm IMU provides additional measurement system simplification, but directly affects accuracy of elbow and hand position estimation. The reason for this is lack of elbow flexion angle information. In case that only upper arm IMU is used, only hand (H1UA) R M S E arm values are higher, while in case of forearm IMU use, elbow angle affects accuracy of both anatomical landmarks position estimation (elbow - EL1FA, hand - H1FA) (Figures 2 and 4).
Arm kinematics equations (see Methods) provide description of precision dependency. Euclidean distance values for 1 IMU sensor placements depend on arm segment lengths and elbow flexion angle. Infants under 6 months of age usually have equal upper and forearm segment lengths, therefore in view of extracting precise kinematics this parameter should not affect the choice of sensor placement. Kinematics estimation depends also on the elbow angle, reaching highest precision in case of elbow extension. Infants mostly hold the arms in slight elbow flexion, therefore some level of error is expected in either case of 1 IMU sensor placement. Berthier et al. studied that before the reaching onset period, most of the movements are performed with mainly locked elbow angle. The kinematic error should therefore be considerably small. The elbow angle affects kinematic data precision equally for upper and forearm 1 IMU sensor placements, having no effect on the choice of sensor placement. The decision, regarding simplification of system configuration, should be made with respect to other parameter results.
Motor pattern parameters
Dynamic acceleration and jerk parameter values, calculated from forearm IMU accelerometer deviate from referential motion capture system (Optotrak) based results for less than 20% (Table 1). Referential motion capture system (Optotrak) based acceleration and jerk are determined as second and third derivatives of position. Consequently, the signal noise levels are increasingly high. Despite this, Pearson correlation coefficients for acceleration and jerk are near 0.8. This confirms correlation of both referential motion capture system (Optotrak) and IMU accelerometer based signals. Referential motion capture system (Optotrak) based hand velocity is calculated as the first derivative of position, therefore less noise and thus higher correlation is expected for hand velocity. Correlation coefficients R of hand velocity values, determined via angular velocity for 1 IMU per forearm and 2 IMUs per arm sensor placement and by referential motion capture system (Optotrak) are above 0.9 (Table 1). High level of correlation confirms the given hypothesis and verifies adequacy of IMUs for hand velocity studies.
SAL results suggest that angular velocity based approach with 2 IMUs per arm (S A L G y r o 2) sensor placement provides best linear dependency results (Figure 5). Pearson correlation coefficient R G y r o 2 is above 0.9, which confirms the high correlation to referential motion capture system (Optotrak) based SAL results (Figure 5). Absolute SAL differences are lowest for such approach and have small value dispersion (Figure 6). This verifies appropriateness for movement smoothness assessment. Dependency results for angular velocity based approach with only 1 IMU on the forearm (S A L G y r o 1) are less linear than 2 IMU approach (S A L G y r o 2). Despite this, values still highly correlate to referential motion capture values (R G y r o 1 above 0.8) with low mean absolute SAL difference and modest value dispersion. Lower precision is a consequence of lack of elbow flexion angle information, but such approach is still accurate enough for reliable movement smoothness evaluation. In case of only forearm IMU use and integration of acceleration in order to calculate the hand velocity, SAL dependency is least linear of the three options with correlation coefficient R A c c of 0.6 (Figure 5). Absolute SAL differences are highly dispersed with mean value of almost 0.5 (Figure 6). Higher level of linearity (correlation) is also demonstrated by narrower best fitting ellipses. Results suggest that acceleration based approach is not as suitable for movement smoothness assessment, as angular velocity based approaches.
Arm workspace surface envelope patches for referential motion capture system (Opto), 2 IMUs per arm (2IMUs), 1 IMU per upper (1UA), and 1 IMU per forearm (1FA) sensor placements again confirm that the 2 IMUs per arm sensor placement approach is most similar to referential optoelectronic motion capture data (Figure 7). This is verified also numerically with normalized arm workspace volume and surface area values (Figure 8), which are in general similar for the different approaches. Slight differences presumably arise from incorrect arm segment length measurements and possible IMU displacements. Although, comparison of 1 IMU per arm sensor placement results (Figure 8) confirms elbow angle influence on the surface envelope shape, such approach still offers good insight into arm workspace characteristics (red and blue patches in Figure 7).
RMSE values for centre-of-pressure, shoulders, and head coordinates are all under 2 cm, confirming adequacy of incorporated digital image (pressure mattress data) processing techniques for such data extraction (Figure 9).
In case of 2 IMUs per arm sensor placement approach, both concave (96.4%) and convex (107.4%) shape types are appropriate for assessment of reachable volume (Table 2). The values deviate from referential motion capture system (Optotrak) based results for less than 10%. In case that only 1 IMU per arm approach is used, upper arm sensor placement and convex shape determination provide best results (95.4%). Only forearm IMU use is giving less precise reachable volume results (Table 2), which is a consequence of lack of elbow flexion angle data.
As concerned to travelled path P and average speed S results (Table 3), the 2 IMUs per arm approach is most accurate in comparison to referential optoelectronic motion capture values with estimation error of 10% (normalized average speed value 110%). Results for only 1 IMU per arm sensor placements are less accurate with estimation error under 20% (normalized average speed values 118% and 111%), but still offer insight into infant’s arm and trunk activity. Obtained values represent combined arm and shoulder movement.
Finally, all the evaluation results above confirm that full sensor set, consisting of pressure mattress and 2 IMUs per arm is a reliable substitution to optoelectronic systems for the given application. Motor pattern parameter errors are under 10%, while kinematic estimation error of arm position is less than 2 cm. Along with its simple-to-use character, such system is appropriate for quick, non-invasive, intensive, several times per day measurements of infant kinematics and corresponding motor patterns. Method does not suffer from drawbacks, such as self-occlusion or intolerance to high number of optical markers. Use of simplified system configuration with only 1 IMU per arm does not provide the best possible kinematic precision. Nevertheless, simplicity of use, shorter system preparation time, lower cost, and still acceptable accuracy of motor pattern assessment are convincing for frequent practical use. Approach with only upper arm IMU provides accurate normalized workspace volume and reachable volume results, while normalized workspace surface area, travelled path P, and average speed S parameters are estimated more accurately with use of only forearm IMU. The latter not only gives better insight into arm’s end-effector (the hand) orientation, but forearm IMU gyroscope and accelerometer additionally ensure good estimation of hand velocity, acceleration, and jerk (Table 1). Accelerometers alone could also be used for hand accelerometry analysis . Therefore, use of only forearm IMU seems more reasonable, sensible, and useful.
Measures from a healthy infant
Video recordings of arm movement from a healthy infant (Figure 11) were used to perform validation of the determined arm workspace results (Figure 10). Video confirms that the infant held his right arm extended mostly in the lateral, cranial, and ventral-lateral direction. Motor pattern parameter results (Table 4), especially average hand movement speed S (8.3 c m/s), normalized workspace surface area (40.1%), and SAL value of -3.3 (1.0) acknowledge that simulated baby doll’s trunk and arm movements were sufficiently similar to movements of real infants. These comparisons demonstrate appropriateness of method and parameters.
Advantages of combining sensor data
It is important to emphasize that combined use of pressure mattress information and IMU data not only provides higher precision in comparison to using the IMU data alone, but also makes calculation of parameters, describing infant’s activity levels, possible (travelled path P and average speed S). By incorporating results of infant’s trunk orientation with regard to the pressure mattress, extracted by image moments calculation and digital image processing techniques, performance improvement is accomplished by applying adjustments to the trunk IMU orientation data. Therewith, the determined arm relative to the trunk kinematics is more precise and exact, providing very accurate motor pattern parameter results.
To conclude, validation results of multi-sensor measurement system comprising two pressure mattresses and IMUs fixed on trunk and arms demonstrate the system usability and precision, while the general approach demonstrates the simplicity to use, high mobility, and non-invasiveness. While use of 2 IMUs per arm provides best results, approach with only 1 IMU per arm is still accurate enough for frequent practical use. Since the system is not limited to laboratory based settings, it could be utilized as part of structured play sessions several times per day at infant’s homes with parents as potential supervisors. Importantly, frequent measurements also reduce the influence of infant’s day-to-day mood and give full insight into infant movement and motor skills. Due to excellent complementarity of system components, the system holds an enviable potential for accurate, sensor based infant trunk posture and arm movement assessment.
Written informed consent was obtained from the infant’s parent for the publication of this report and any accompanying images.
Adolph KE, Berger SE: Physical and motor development. In Developmental Science: An Advanced Textbook. Edited by: Bornstein MH, Lamb ME. Mahwah: Lawrence Erlbaum Associates, Inc.; 2005:223-281.
Palmer FB: Strategies for the early diagnosis of cerebral palsy. J Pediatr 2004,145(2):8-11.
Orton J, Spittle A, Doyle L, Anderson P, Boyd R: Do early intervention programmes improve cognitive and motor outcomes for preterm infants after discharge? A systematic review. Dev Med Child Neurol 2009,51(11):851-859.
Spittle A, Orton J, Anderson P, Boyd R, Doyle LW: Early developmental intervention programmes post-hospital discharge to prevent motor and cognitive impairments in preterm infants. Cochrane Db Syst Rev 2012. 12. Art. No.: CD005495
Spittle AJ, Doyle LW, Boyd RN: A systematic review of the clinimetric properties of neuromotor assessments for preterm infants during the first year of life. Dev Med Child Neurol 2008,50(4):254-266.
Jaspers E, Desloovere K, Bruyninckx H, Molenaers G, Klingels K, Feys H: Review of quantitative measurements of upper limb movements in hemiplegic cerebral palsy. Gait Posture 2009,30(4):395-404.
Berthier NE, Keen R: Development of reaching in infancy. Exp Brain Res 2006,169(4):507-518.
Rocha NACF, Tudella E: The influence of lying positions and postural control on hand–mouth and hand–hand behaviors in 0–4-month-old infants. Infant Behav Dev 2008,31(1):107-114.
Marschik PB, Einspieler C, Strohmeier A, Plienegger J, Garzarolli B, Prechtl HF: From the reaching behavior at 5 months of age to hand preference at preschool age. Dev Psychobiol 2008,50(5):511-518.
Rocha NACF, Silva FPdS, Tudella E: The impact of object size and rigidity on infant reaching. Infant Behav Dev 2006,29(2):251-261.
Lima C, Carvalho R, Barros R, Tudella E: Two different methods for kinematic analysis of head movements relating to eye-head coordination in infants. Brazilian J Phys Ther 2008,12(5):425-431.
Soares DdA, van der Kamp J, Savelsbergh GJ, Tudella E: The effect of a short bout of practice on reaching behavior in late preterm infants at the onset of reaching: a randomized controlled trial. Res Dev Disabil 2013,34(12):4546-4558.
Petitto LA, Holowka S, Sergio LE, Levy B, Ostry DJ: Baby hands that move to the rhythm of language: hearing babies acquiring sign languages babble silently on the hands. Cognition 2004,93(1):43-73.
Fallang B, Saugstad OD, Grøgaard J, Hadders-Algra M: Kinematic quality of reaching movements in preterm infants. Pediatr Res 2003,53(5):836-842.
Lee H-M, Galloway JC: Early intensive postural and movement training advances head control in very young infants. Phys Ther 2012,92(7):935-947.
Lee H, Bhat A, Scholz J, Galloway J: Toy-oriented changes during early arm movements: Iv: shoulder–elbow coordination. Infant Behav Dev 2008,31(3):447-469.
Meinecke L, Breitbach-Faller N, Bartz C, Damen R, Rau G, Disselhorst-Klug C: Movement analysis in the early detection of newborns at risk for developing spasticity due to infantile cerebral palsy. Hum Movement Sci 2006,25(2):125-144.
Berthouze L, Mayston M: Design and validation of surface-marker clusters for the quantification of joint rotations in general movements in early infancy. J Biomech 2011,44(6):1212-1215.
Harbourne RT, Lobo MA, Karst GM, Galloway JC: Sit happens: does sitting development perturb reaching development, or vice versa? Infant Behav Dev 2013,36(3):438-450.
Van der Fits I, Klip A, Van Eykern L, Hadders-Algra M: Postural adjustments during spontaneous and goal-directed arm movements in the first half year of life. Behav Brain Res 1999,106(1):75-90.
de Graaf-Peters VB, Bakker H, van Eykern LA, Otten B, Hadders-Algra M: Postural adjustments and reaching in 4-and 6-month-old infants: an emg and kinematical study. Exp Brain Res 2007,181(4):647-656.
Fallang B, Saugstad OD, Hadders-Algra M: Goal directed reaching and postural control in supine position in healthy infants. Behav Brain Res 2000,115(1):9-18.
Kyvelidou A, Harbourne RT, Shostrom VK, Stergiou N: Reliability of center of pressure measures for assessing the development of sitting postural control in infants with or at risk of cerebral palsy. Arch Phys Med Rehab 2010,91(10):1593-1601.
Karch D, Kim K-S, Wochner K, Pietz J, Dickhaus H, Philippi H: Quantification of the segmental kinematics of spontaneous infant movements. J Biomech 2008,41(13):2860-2867.
Karch D, Kim K-S, Wochner K, Philippi H, Pietz J, Dickhaus H: Compensation of large motion sensor displacements during long recordings of limb movements. J Biomech 2010,43(9):1844-1848.
Ohgi S, Morita S, Loo KK, Mizuike C: Time series analysis of spontaneous upper-extremity movements of premature infants with brain injuries. Phys Ther 2008,88(9):1022-1033.
Gima H, Ohgi S, Morita S, Karasuno H, Fujiwara T, Abe K: A dynamical system analysis of the development of spontaneous lower extremity movements in newborn and young infants. J Physiol Anthropol 2010,30(5):179-186.
Beravs T, Podobnik J, Munih M: Three-axial accelerometer calibration using kalman filter covariance matrix for online estimation of optimal sensor orientation. IEEE T Instrum Meas 2012,61(9):2501-2511.
Šlajpah S, Kamnik R, Munih M: Kinematics based sensory fusion for wearable motion assessment in human walking. Comput Meth Prog Bio 2014,116(2):131-144.
Kortier HG, Sluiter VI, Roetenberg D, Veltink PH: Assessment of hand kinematics using inertial and magnetic sensors. J Neuroeng Rehabil 2014,11(1):70.
Brooks RR, Iyengar SS: Multi-sensor Fusion: Fundamentals and Applications with Software. Upper Saddle River: Prentice-Hall Inc.; 1998.
Luinge HJ, Veltink PH, Baten CT: Ambulatory measurement of arm orientation. J Biomech 2007,40(1):78-85.
Ricci L, Formica D, Sparaci L, Lasorsa FR, Taffoni F, Tamilia E, Guglielmelli E: A new calibration methodology for thorax and upper limbs motion capture in children using magneto and inertial sensors. Sensors 2014,14(1):1057-1072.
Taffoni F, Campolo D, Delafield-Butt J, Keller F, Guglielmelli E: Design and assembling of a magneto-inertial wearable device for ecological behavioral analysis of infants. In IEEE/RSJ Int Conf Intell Robot Syst, IROS 2008. New York: IEEE; 2008:3832-3837.
Boughorbel S, Bruekers F, Breebaart J: Baby-posture classification from pressure-sensor data. In Pattern Recogn (ICPR), 2010 20th Int Conf. New York: IEEE; 2010:556-559.
Dusing S, Mercer V, Yu B, Reilly M, Thorpe D: Trunk position in supine of infants born preterm and at term: an assessment using a computerized pressure mat. Pediatr Phys Ther 2005,17(1):2-10.
Dusing SC, Kyvelidou A, Mercer VS, Stergiou N: Infants born preterm exhibit different patterns of center-of-pressure movement than infants born at full term. Phys Ther 2009,89(12):1354-1362.
Ni H, Abdulrazak B, Zhang D, Wu S, Yu Z, Zhou X, Wang S: Towards non-intrusive sleep pattern recognition in elder assistive environment. J Amb Intel Humanized Comp 2012,3(2):167-175.
Metsis V, Kosmopoulos D, Athitsos V, Makedon F: Non-invasive analysis of sleep patterns via multimodal sensor input. Pers Ubiq Comput 2014,18(1):19-26.
Yousefi R, Ostadabbas S, Faezipour M, Farshbaf M, Nourani M, Tamil L, Pompeo M: Bed posture classification for pressure ulcer prevention. In Eng Med Biol Soc, EMBC, 2011 Annu Int Conf IEEE. New York: IEEE; 2011:7175-7178.
Grimm R, Bauer S, Sukkau J, Hornegger J, Greiner G: Markerless estimation of patient orientation, posture and pose using range and pressure imaging. Int J Comput Ass Radiol Surg 2012,7(6):921-929.
Teitelbaum P, Teitelbaum O, Nye J, Fryman J, Maurer RG: Movement analysis in infancy may be useful for early diagnosis of autism. P Natl Acad Sci USA 1998,95(23):13982-13987.
Lee M-H, Ranganathan R, Newell KM: Changes in object-oriented arm movements that precede the transition to goal-directed reaching in infancy. Dev Psychobiol 2011,53(7):685-693.
Delaunay B: Sur la sphere vide. Izv Akad Nauk SSSR, Otdelenie Matematicheskii i Estestvennyka Nauk 1934,7(793–800):1-2.
Van Der Merwe R: Sigma-point kalman filters for probabilistic inference in dynamic state-space models. PhD thesis. Oregon Health Sci. Univ., Portland, OR; 2004
Gonzalez RC, Woods RE: Digital Image Processing, 2nd. Upper Saddle River: SL: Prentice Hall; 2002.
Hu M-K: Visual pattern recognition by moment invariants. IEEE T Inform Theory 1962,8(2):179-187.
Balasubramanian S, Melendez-Calderon A, Burdet E: A robust and sensitive metric for quantifying movement smoothness. IEEE T Bio-Med Eng 2012,59(8):2126-2136.
Kurillo G, Han JJ, Abresch RT, Nicorici A, Yan P, Bajcsy R: Development and application of stereo camera-based upper extremity workspace evaluation in patients with neuromuscular diseases. PloS One 2012,7(9):45341.
Bhat A, Heathcock J: Galloway J: Toy-oriented changes in hand and joint kinematics during the emergence of purposeful reaching. Infant Behav Dev 2005,28(4):445-465.
Bhat A, Galloway J: Toy-oriented changes during early arm movements: hand kinematics. Infant Behav Dev 2006,29(3):358-372.
Coluccini M, Maini ES, Martelloni C, Sgandurra G, Cioni G: Kinematic characterization of functional reach to grasp in normal and in motor disabled children. Gait Posture 2007,25(4):493-501.
Sengupta AK, Das B: A model of three dimensional maximum reach envelope based on structural anthropometric measurements. In Adv Occup Ergonomics Safety, 1998 XIIIth Annu Int Conf, vol. 2. Edited by: Kumar S. Amsterdam: IOS Press; 1998:256-259.
Edelsbrunner H, Mücke EP: Three-dimensional alpha shapes. ACM T Graph (TOG) 1994,13(1):43-72.
Barber CB, Dobkin DP, Huhdanpaa H: The quickhull algorithm for convex hulls. ACM T Math Softw (TOMS) 1996,22(4):469-483.
Heinze F, Hesels K, Breitbach-Faller N, Schmitz-Rode T, Disselhorst-Klug C: Movement analysis by accelerometry of newborns and infants for the early detection of movement disorders due to infantile cerebral palsy. Med Biol Eng Comput 2010,48(8):765-772.
This work was funded by the European Union Collaborative Project CareToy grant ICT-2011.5.1- 287932 and additionally supported by the Slovenian Research Agency. Authors gratefully thank Giuseppina Sgandurra, Giovanni Cioni, Francesca Cecchi, and Paolo Dario for the support within CareToy project.
The authors declare that they have no competing interests.
AR developed the data processing algorithms, performed referential measurements, and drafted the manuscript. JP and JK developed the data acquisition software. MMi and MM participated in the study design, helped with data analysis, and revised the manuscript. All authors read and approved the final manuscript.
About this article
Cite this article
Rihar, A., Mihelj, M., Pašič, J. et al. Infant trunk posture and arm movement assessment using pressure mattress, inertial and magnetic measurement units (IMUs). J NeuroEngineering Rehabil 11, 133 (2014). https://doi.org/10.1186/1743-0003-11-133