Fig. 2

Overall system architecture with main components and data flow: BioPatRec was used for classification, marker tracking located the Arm and scene markers, and animation controller displayed the model of the arm (11 different movements) as well as virtual objects placed in the scene. The virtual models were integrated into the real scene recorded by the stereo camera and the final images were projected to the HMD. The details are explained in the text