Fig. 1

An overview of the augmented reality (AR) system. The head-mounted display (HMD) uses anterior, stereo cameras to pass-through the physical environment to the participant. This pass-through video is combined with virtual representations of a prosthetic limb as well as the AR-PHAM to create the AR scene. Virtual objects are anchored to locations in the physical environment through the kinematic trackers. Participants are tasked to complete a series of object manipulations in this AR environment. To control the virtual prosthesis, participants wear an EMG band on their dominant limb. The resultant EMG signals are then fed into an LDA classifier, translating the EMG data into one of five hand movement classes: rest (RE), hand open (HO), hand close (HC), wrist pronate (WP), or wrist supinate (WS)