- Open Access
Discriminability of multiple cutaneous and proprioceptive hand percepts evoked by intraneural stimulation with Utah slanted electrode arrays in human amputees
Journal of NeuroEngineering and Rehabilitation volume 18, Article number: 12 (2021)
Electrical stimulation of residual afferent nerve fibers can evoke sensations from a missing limb after amputation, and bionic arms endowed with artificial sensory feedback have been shown to confer functional and psychological benefits. Here we explore the extent to which artificial sensations can be discriminated based on location, quality, and intensity.
We implanted Utah Slanted Electrode Arrays (USEAs) in the arm nerves of three transradial amputees and delivered electrical stimulation via different electrodes and frequencies to produce sensations on the missing hand with various locations, qualities, and intensities. Participants performed blind discrimination trials to discriminate among these artificial sensations.
Participants successfully discriminated cutaneous and proprioceptive sensations ranging in location, quality and intensity. Performance was significantly greater than chance for all discrimination tasks, including discrimination among up to ten different cutaneous location-intensity combinations (15/30 successes, p < 0.0001) and seven different proprioceptive location-intensity combinations (21/40 successes, p < 0.0001). Variations in the site of stimulation within the nerve, via electrode selection, enabled discrimination among up to five locations and qualities (35/35 successes, p < 0.0001). Variations in the stimulation frequency enabled discrimination among four different intensities at the same location (13/20 successes, p < 0.0005). One participant also discriminated among individual stimulation of two different USEA electrodes, simultaneous stimulation on both electrodes, and interleaved stimulation on both electrodes (20/24 successes, p < 0.0001).
Electrode location, stimulation frequency, and stimulation pattern can be modulated to evoke functionally discriminable sensations with a range of locations, qualities, and intensities. This rich source of artificial sensory feedback may enhance functional performance and embodiment of bionic arms endowed with a sense of touch.
Most commercially-available upper-limb prostheses do not provide amputees with sensory feedback. Sensation from a prosthesis has been shown to be important for performance of functional tasks and for prosthesis embodiment [1,2,3,4], and amputees indicate interest in having sensory feedback from their prosthesis [5,6,7,8,9,10]. Peripheral-nerve interface approaches, such as Utah Slanted Electrode Arrays (USEAs) [3, 4, 11,12,13,14,15], cuff electrodes [16, 17], transverse intrafascicular multichannel electrodes [1, 18,19,20,21,22], flat interface nerve electrodes [23,24,25,26], and longitudinal intrafascicular electrodes [27,28,29,30] have demonstrated the ability to evoke sensory percepts at different locations, and of different qualities (e.g., submodalities) and intensities on the missing hand of amputees. These sensory percepts have been shown to be important for identifying objects of different shapes/sizes and compliances during closed-loop prosthesis control [1, 4, 11, 29, 31,32,33].
The discriminability (greater than chance) of the evoked sensory percepts is critical for closed-loop prosthesis control. Discriminability among sensory percepts at different locations and with different qualities has been reported for cuff electrodes , transverse intrafascicular multichannel electrodes [21, 31, 35], and flat interface nerve electrodes . However, reports on the discriminability of USEA-evoked percepts have been limited to a small number of percepts , despite the fact that USEAs can evoke numerous sensory percepts [4, 13].
The USEA provides intrafascicular access to nerve fibers spanning the cross-section of a peripheral nerve via 100 penetrating microelectrodes. In contrast to other peripheral nerve interfaces, USEAs offer cross-sectional nerve access via many channels, enabling activation of numerous sensory percepts spanning the hand . The selection of different USEA electrodes enables activation of different axons or subsets of axons with different projected field locations on the hand and with different sensory qualities. The intensity of each percept can be encoded based on the amplitude or frequency of stimulation . Despite this understanding, prior publications using USEAs have not fully tested the extent to which human subjects can discriminate among multiple proprioceptive and cutaneous sensory percepts at different locations, and of different qualities and intensities, such as would be desirable during multi-sensor closed-loop prosthesis control.
The impact of increasing the resolution of sensory percepts on the functionality and naturalism of artificially evoked sensory feedback has not been documented empirically. However, discrimination tasks in intact human hands suggest that encoding of many locations, qualities and intensities, potentially via different receptor subtypes, is likely needed to recreate the full sensory experience of the human hand. For example, cutaneous location discrimination in the intact hand has been performed previously via a 2-point discrimination task, in which discriminability (greater than chance alone) was achievable for stimuli as close as 0.55 mm apart on the fingertips . This high level of discriminability is likely attributable to intensity encoding via a population of afferents around the site of applied tactile pressure (receptor density is on the order of 1 per square millimeter on the palmar hand [38, 39]). Natural activation patterns in the human hand include activation of several different cutaneous mechanoreceptor subtypes innervating many different locations on the hand. The number of discriminable locations on an intact human hand has not been formally quantified, but, on the basis of these prior publications, is likely on the order of hundreds of sensory locations.
In microneurography studies, intact subjects have also discriminated among tactile percepts with the same location, but with different intensities. A roughly linear, nearly threefold increase in perceived intensity was noted both for normal cutaneous forces between 1–5 N and tangential forces between 1 and 3 N , with an informal indication that subjects are likely capable of discriminating up to ~ 10 different constant-force levels within these ranges. Constant-force intensities are generally accepted as being primarily encoded in the firing rates and activation patterns of Type-I slowly-adapting receptors (e.g., Merkel disk receptors) [41,42,43,44], although many receptor subtypes are generally activated during naturalistic touch of an intact hand. Type-I and Type-II rapidly-adapting cutaneous mechanoreceptors (i.e., Meissner and Pacinian corpuscles) are generally assumed to be the primary encoders of vibratory intensities via their population activation patterns and firing rates . Human subjects have also been able to differentiate among at least 4 different amplitudes of vibratory tactile stimuli which were encoded with the amplitude (2.4–154 μm indentation) and frequency (10–200 Hz) of vibration .
Prior work has documented the discriminability of intensity for peripheral nerve stimulation using classic psychophysical methods (i.e., the just-noticeable difference) for cuff electrodes , transverse intrafascicular multichannel electrodes , flat interface nerve electrodes  and USEAs . By extrapolation of just-noticeable differences across the presumed range of perceivable stimulus intensities, these results suggest that at least 15, and possibly up to 46, different intensities could be felt by modulating stimulation frequencies between 1 and 300 Hz. However, it is unclear whether these estimates can be extrapolated to hundreds of USEA-evoked percepts. For example, multi-channel intraneural stimulation with transverse intrafascicular multichannel electrodes has been shown to lower the amount of stimulation needed to evoke detectable sensory percepts , and this sensory facilitation may alter the just-noticeable differences and expand the range of stimulation current. Multi-channel intraneural stimulation with transverse intrafascicular multichannel electrodes yields a linear summation of sensation locations, suggesting minimal multi-electrode interactions and limited current summation . However, current summation and non-linear responses have been documented for USEAs , and these are likely due to the higher electrode density and smaller inter-electrode distances that allow subthreshold currents from individual USEA electrodes to summate.
Here, we build on these prior studies by demonstrating discrimination among USEA-evoked percepts in blinded trials where subjects are presented with multiple possible stimulation conditions. These results highlight discrimination among four levels of intensity, eight locations, and ten location-intensity combinations for cutaneous percepts. We also highlight up to seven proprioceptive digit-position combinations, a unique finding given the relative scarcity of evoking proprioceptive percepts via other neural interfaces [16, 20, 23]. Furthermore, we demonstrate, for the first time, the ability to leverage the high electrode density of the USEA to evoke discriminable percepts by quality alone (i.e., distinct percept qualities with the same perceptive location) and to create linear or non-linear summations of percepts with interleaved or simultaneous multi-electrode stimulation. These results constitute an important step towards the development of sensorized bionic arms with a greater number of discriminable cutaneous and proprioceptive percepts.
Three transradial amputees participated in this study, referred to as S3, S4, and S5. Subject S3 was a 50-year-old male with a left-arm amputation that had occurred 21 years prior. Subject S4 was a 36-year-old male with bilateral amputations that had occurred 16 years prior. Subject S5 was a 43-year-old male with bilateral amputations that had occurred 24 years prior. Each subject underwent psychological and medical assessments prior to participating in the study. Subjects were provided with training materials prior to implantation of the electrodes to allow them to learn the concepts and methods of the experiments in advance and thus reduce post-implant training time. These included mirror-box or prosthesis-video training materials  as reported with previous subjects [13,14,15]. The subjects were monitored for medical risks both during and after the implant period, and subjects S4 and S5 were treated for implant-related infections that resolved without issue. The consenting process and experimental procedures were approved by the University of Utah Institutional Review Board, and the Department of the Navy Human Research Protection Program.
Two USEAs (Blackrock Microsystems, Salt Lake City, UT, USA) were implanted in each subject: one in the median nerve and one in the ulnar nerve. For each subject, the surgical implantation was completed in roughly one to two hours. The implant location for subject S3 was in the left forearm distal to the elbow, whereas the implants for subject S4 and S5 were placed midway along the left upper arm, proximal to the medial epicondyle and to many motor branch points, thereby providing access to muscle proprioceptive afferents from muscle spindles and Golgi tendon organs. USEAs consisted of 100 silicon microelectrodes (sputtered iridium oxide) spaced 400 μm apart in a 10 × 10 grid across a 4 × 4 mm square base. The electrodes varied from ~ 0.75 to 1.5 mm in length to allow cross-sectional access to fibers at different depths within the peripheral arm nerves . The stimulation surface area for each electrode tip is estimated to be 1573 µm2 . Separate looped platinum wires were also implanted as stimulation return leads and for use as recording reference and ground leads. These looped platinum wires were placed close to (within ~ 5 mm of) the USEAs at the time of implantation, and were generally sutured to the epineurium along with the USEA lead wires within a centimeter of each USEA . Electrical connection to each USEA electrode was available via an external printed circuit board that was coupled percutaneously to USEAs via a bundle of gold lead wires. Connection of the external circuit board to stimulation and recording hardware was made via a ZIF-Clip-96 connector cable (Tucker-Davis Technologies Inc., Alachua, FL, USA) for S3 and S4, or a 96-channel Gator connector cable (Ripple LLC, Salt Lake City, UT, USA) for S5.
The slanted nature of the USEAs enables cross-sectional nerve access to fibers at different depths, thereby increasing the possibility of activation of different axons or subsets of axons with each electrode . An effort was made during the implant surgery to implant USEAs into the nerves so that the electrodes were positioned squarely perpendicular to the length of the nerve, which maximizes the cross-sectional nerve coverage of the USEA electrodes. The two-dimensional distance between two electrodes on the cross-sectional projection plane is likely the most influential factor on their ability to activate different axons or subsets of axons (Fig. 1a). The stimulation amplitude on a given electrode influences which axons near the tip of the electrode are activated, whereas the stimulation frequency influences their firing rate. The stimulation amplitude may also influence firing rate when modulated at peri-threshold levels, for example, when only a subset of stimulation pulses in a pulse train result in generation of an action potential , or when increasing stimulation intensity actives new fibers.
Surgical and experimental procedures
Subjects were given prophylactic antibiotics the day before, the day of, and for several days following the implant surgery (100 mg minocycline, 7 days, twice per day). USEAs were implanted in each subject under general anesthesia, via similar methods to those described in past publications . For subject S5, intramuscular electromyographic recording electrodes (Ripple Neuro LLC, Salt Lake City, UT, USA) were also placed in the muscles of the forearm for recording purposes, as described in [11, 12]. The intramuscular electromyographic recording electrodes were not used in the experiments presented herein. After exposure of each nerve implant site, the epineurium was dissected away, and USEAs were inserted into the nerve using a pneumatic insertion tool (Blackrock Microsystems, Salt Lake City, UT, USA) . USEA lead wires and reference and ground wires were sutured to the epineurium, and a collagen wrap (AxoGen Inc., Alachua, FL, USA) was secured around the USEA, nerve, and reference and ground wires using vascular clips (Fig. 1b). For subject S5, the epineurium was sutured around the USEAs and reference and ground wires prior to placement of the collagen wrap. Dexamethasone (0.1 mg/kg) was delivered intravenously to the subjects during surgical closure as a potential means for decreasing the foreign body response [51, 52].
The site of percutaneous wire passage (Fig. 1c) was redressed roughly once per week using an antibiotic wound patch (Biopatch, Ethicon US LLC, Somerville, NJ, USA). The percutaneous connector boards were sutured to the skin in an attempt to stabilize the percutaneous wire passage, although this approach was abandoned for subjects S6 and S7 (not reported here). Subjects S4 and S5 both experienced infections at the USEA percutaneous wire passage site with subsequent full recoveries after USEA extraction and antibiotic treatment. Implants were removed after 4 weeks, 5 weeks, and 13 weeks, for S3, S4, and S5, respectively. The USEAs from subject S3 were removed along with the section of implanted neural tissue for histological analysis .
Experimental sessions were typically carried out 1–3 days per week, for 1–5 h each. Experimental sessions started 1–2 weeks after implant surgery and were performed throughout the remainder of implant durations (total implant durations of 4 weeks for S3, 5 weeks for S4, and 13 weeks for S5). In addition to the stimulation-evoked sensory percepts reported here, experimental sessions consisted of impedance testing, decoding of neuronal and myoelectric signals for prosthesis movement control, and closed-loop control of a prosthetic hand. Only the discrimination tasks for evoked sensory percepts are reported here.
Electrical stimulation was delivered using the IZ2-128 System (Tucker-Davis Technologies Inc., Alachua, FL, USA) for S3 and S4, or the Grapevine System (Ripple LLC, Salt Lake City, UT, USA) for S4 and S5. Stimulation was delivered as symmetric biphasic (cathodic-first) 200-µs square-wave pulses separated by a 100-µs interphase interval. Stimulation amplitudes and frequencies were kept below 120 µA and 500 Hz.
During discrimination trials for subjects S3 and S4, a single 200-ms train of stimulation was delivered at 200 Hz each time the subject or an experimenter pressed a button. For subject S5, three or four 500-ms trains of 100-Hz stimulation (unless noted otherwise, such as during intensity-encoding sessions) were delivered at a 50% duty cycle after the subject or the experimenters pressed a button. The 200-ms and 500-ms durations were selected as the minimal duration that the participants could still reliably perceive and distinguish the percepts; informally the participants felt their performance was not hindered by the duration of the stimulation trains, which is consistent with prior work showing that tactile mechanoreceptors are most active during onset of contact . Shorter train durations in turn minimized sensory adaptation, as described in , across extended use (i.e., approximately one hour of repeated stimulation on a subset of electrodes for sensory discrimination tasks). Similarly, 100-Hz stimulation was used for subject S5 to minimize sensory adaptation. All discrimination trials were performed at an amplitude greater than the detection threshold that was comfortable and reliably perceivable (generally 5–10 µA above detection threshold). The 100-Hz and 200-Hz stimulation frequencies were selected because they had been used previously .
All stimulation parameters were approved by the University of Utah IRB and have been used with USEAs in multiple subjects before without any considerable neural damage . A summary of stimulation parameters is shown in Table 1.
Percept identification and mapping
We mapped the location, size, quality, intensity and detection threshold of USEA-evoked percepts over time, as detailed previously [4, 54]. Detection thresholds were established first. For each electrode individually, stimulation current was increased in 1–10-µA steps until a sensation was reliably detected (i.e., the blinded subject could correctly identify when stimulation was provided by the experimenter with 100% accuracy). The subjects then used custom software to indicate the location, size, quality, and intensity of the USEA-evoked sensory percept on the image of a hand. Subjects selected percept qualities from a list (e.g., pressure, vibration, tingle, etc.) or created their own descriptors as necessary. For cutaneous percepts, participants marked the location and size of the percept on an image of the hand; representations of percept locations and sizes were created based on the subjects’ software markings as well as their verbal descriptions as appropriate. For proprioceptive percepts, the subjects identified a joint that had moved or was moving due to the stimulation, and then selected their own angles to describe the degree of flexion felt on the joint (where 0° is fully extended and 180° is fully flexed).
These complete USEA percept maps (for ~ 200 electrodes) provided a basis for selection of the electrodes used in the discrimination trials reported here. The electrodes chosen for a given discrimination task were typically selected from complete USEA percept maps gathered within a week prior. Electrodes were chosen which provided distinct percepts with the desired location and/or quality. Prior to discrimination trials, the detection thresholds of the individual electrodes were verified, and then exceeded (by 5–10 µA) to ensure the percepts were reliably detected. Adaptation of sensory percepts, as described in , and electrode impedance were not used as a criterion for selection. The subjects were told to report any changes in percept location, size, quality or intensity of the percepts that may occur throughout the discrimination trials; no changes were reported by the subjects during the trials.
Discrimination tasks were performed during different stimulation sessions. Discrimination tasks were unique to each subject; different subjects did not complete the same discrimination task due to limited time with the subjects and due to variations in the number and type of evoked percepts across participants and over time. A stimulation session typically included mapping the percept locations, qualities, and intensities associated with several USEA electrodes, and then down selecting to electrodes and stimulation frequencies that represented a subset of locations, qualities, intensities, or combinations for formal discrimination trials. No sensory discrimination tasks were attempted with more test conditions (e.g., location, quality, intensity, or combinations) than those reported herein.
Discrimination experiments were performed by delivering randomly-ordered stimulation trials in which the subject was required to classify the location, quality, and/or intensity of the evoked percept for each trial. Stimulation conditions varied across trials, including stimulation via different USEA electrodes or combinations of electrodes, and/or use of different stimulation frequencies. The number of electrodes selected for each discrimination study was based on the time remaining in a session and the desire to compare multiple trials of stimulation on each electrode in a blinded, randomized fashion. Formal discrimination trials were preceded by informal practice trials in which the subject experienced each different stimulation condition and formulated category labels for the percept associated with the condition. Once the subject felt comfortable identifying the location, quality, and/or intensity of the different stimulation conditions, formal blind trials commenced in which the subject was required to select one of his predetermined percept categories in response to each stimulation trial. The number of trials per condition was selected to have enough statistical power to detect significant performance on the overall task, not necessarily for each individual condition. The number of trials per condition was selected to be psychometrically realistic so that mental fatigue did not confound the subject’s performance within an experimental session. Cross-session comparisons were not pursued in these initial studies because they can introduce other confounds from differences in percepts evoked by electrode stimulation .
A summary of discrimination tasks and the number of USEA electrodes used can be found in Table 2.
For location discrimination trials, electrodes were preferentially down-selected to represent sensations on different gross anatomical hand regions, such as different digits and the palm. When available, electrodes that evoked sensations at the same location but with different qualities were used for quality discrimination trials.
Subject S3 discriminated among five stimulation conditions that evoked sensations at five different hand locations: (1) D4 tip, (2) D5 tip, (3) palm, (4) wrist, (5) combined perception at all four of these locations (Table 2). These percepts were evoked by individual stimulation of four ulnar-nerve-USEA electrodes and simultaneous stimulation of all four of these electrodes, respectively. Stimulation amplitudes for the four electrodes ranged from 14 to 30 μA. A total of 35 discrimination trials were performed by subject S3 for these five conditions.
Subject S3 also discriminated among four different stimulation conditions that evoked sensations at four different hand locations: (1) palm, (2) D5 tip, (3) both palm and D5 tip, (4) palm, D5 tip, and a merging sensation between the palm and D5 tip (Table 2). These percepts were evoked by: (1) individual stimulation of two different ulnar-nerve-USEA electrodes, (2) simultaneous stimulation of the two ulnar-nerve-USEA electrodes (i.e., no time shift between the stimulation pulses on each electrode), and (3) interleaved stimulation of the two ulnar-nerve-USEA electrodes (i.e., a 2.5-ms time shift between the stimulation pulses on each electrode). Stimulation amplitudes for the two electrodes were 23 μA and 20 μA. A total of 25 discrimination trials were performed by subject S3 for these four conditions.
Subject S4 also discriminated among eight different stimulation conditions that evoked sensations at eight different hand locations: (1) no sensations, (2) D5 and palm, (3) D5 side, (4) D4 tip, (5) D5, palm, D5 side, (6) D5, palm, D4 tip, (7) D5 side, D4 tip, (8) D5, palm, D5 side, D4 tip (Table 2). These percepts were evoked by: (1) no stimulation, (2) individual stimulation of each of three ulnar-nerve-USEA electrodes, (3) simultaneous stimulation using each combination of subsets of two of three electrodes, (4) simultaneous stimulation using all three electrodes. Stimulation amplitudes on the three electrodes ranged from 7 to 13 μA depending on the electrode. A total of 24 discrimination trials were performed by subject S4 for these eight conditions.
Subject S3 discriminated between two different stimulation conditions that evoked sensations at the same hand location but with two different qualities: (1) tingle, (2) vibration (Table 2). These percepts were evoked by individual stimulation of two ulnar-nerve-USEA electrodes. Stimulation amplitudes for the two electrodes were 11 μA and 12 μA. A total of 30 discrimination trials were performed by subject S3 for these two conditions.
Subject S5 discriminated among four different stimulation conditions that evoked sensations at the same hand location but with different self-reported intensities: (1) no pressure, (2) light pressure, (3) medium pressure, (4) heavy pressure (Table 2). These percepts were evoked by stimulating a single median-nerve-USEA electrode at: (1) 0 Hz (no stimulation), (2) 35 Hz, (3) 70 Hz, (4) 100 Hz. The stimulation amplitude used during trials was 25 μA. A total of 20 discrimination trials were performed by subject S5 for these two conditions.
Combined location and cutaneous intensity discrimination
Subject S5 discriminated among ten different stimulation conditions that evoked sensations at different hand locations with different self-reported intensities: (1) no sensation, (2) D3, light pressure, (3) D3, medium pressure, (4) D3, heavy pressure, (5) palm, light pressure, (6) palm, medium pressure, (7) palm, heavy pressure, (8) D2, light pressure, (9) D2, medium pressure, (10) D2, heavy pressure. These percepts were evoked by individual stimulation of three median-nerve-USEA electrodes with stimulation frequencies of 30 Hz, 70 Hz, or 100 Hz (Table 2). Sham stimulation was also used (i.e., no stimulation), making a total of ten classification categories (three intensities at each of three percept locations, plus sham). Stimulation amplitudes on the three electrodes ranged from 17 to 64 μA depending on the electrode. A total of 30 discrimination trials were performed by subject S5 for these two conditions.
Combined location and proprioceptive intensity discrimination
Subject S5 also discriminated among seven different stimulation conditions that evoked sensations at different hand locations with different self-reported proprioceptive intensities: (1) no sensation, (2) D2, 20° flex, (3) D2, 50° flex, (4) D2, 180° flex, (5) D3, 10° flex, (6) D3, 90° flex, (7) D3, 180° flex. These percepts were evoked by individual stimulation of two median-nerve-USEA electrodes. Stimulation frequencies for one median-nerve-USEA electrode were 100 Hz, 50 Hz, and 150 Hz. Stimulation frequencies for the other median-nerve-USEA electrode were 30 Hz, 80 Hz, and 150 Hz (Table 2). Sham stimulation was also used (i.e., no stimulation), making a total of seven classification categories (three proprioceptive intensities at each of two percept locations, plus sham). Stimulation amplitudes on the two electrodes were from 17 to 40 μA. A total of 40 discrimination trials were performed by subject S5 for these seven conditions.
Discrimination trial results reported here were not pooled across sessions or subjects. Data analysis for discrimination trials was performed using the binomial test, where the probability of guessing the correct classification on a given trial was determined as the inverse of the number of predetermined classification categories. Post-hoc analyses included removal of the sham “no stimulation” condition in order to isolate the discriminability of percepts at higher stimulus intensities. Hypothesis testing was performed with a critical value of α = 0.05. A Bonferroni adjustment was made to the critical value for any additional post-hoc tests by dividing the critical value by the number of post-hoc tests performed.
All subjects were able to discriminate percepts by location, quality, and intensity with performance significantly greater than chance. Additionally, subject S5 performed combined location/quality/intensity discrimination trials, including trial sets with cutaneous percepts and trial sets with proprioceptive percepts. Discrimination among percepts of different locations, qualities, and intensities will be important for future use of sensory feedback from multiple prosthesis-coupled sensors during closed-loop prosthesis control.
Subject S3 discriminated among five stimulation conditions that evoked sensation at five different hand locations. The subject discriminated among these stimulation conditions by classifying the percept evoked into one of the five predetermined classification categories in 35/35 successful trials (20% chance per trial, p < 0.0001, binomial test; Fig. 2a). Importantly, the four electrodes selected for these stimulation trials had tip positions as close as ~ 899 μm within the nerve, yet they each consistently evoked unique sensory percepts, suggesting selectivity in axon activation. Additionally, the combined stimulation of all four electrodes did not result in emergent sensory percepts (a percept with different quality or location from the four individual percepts), suggesting that current summation during simultaneous stimulation was limited.
To better study current summation during simultaneous stimulation of multiple electrodes in subject S3, we selected two ulnar-nerve-USEA electrodes with tips placed less than ~ 899 μm apart within the nerve (~ 805 μm cross-sectional projection separation assuming USEAs were implanted squarely perpendicular to the nerve) and delivered four stimulation conditions: (1 & 2) individual stimulation of two different ulnar-nerve-USEA electrodes, (3) simultaneous stimulation of the two ulnar-nerve-USEA electrodes (i.e., no time shift between the stimulation pulses on each electrode), and (4) interleaved stimulation of the two ulnar-nerve-USEA electrodes (i.e., a 2.5-ms time shift between the stimulation pulses on each electrode) (Fig. 2b). The individual stimulation via two different electrodes consistently produced sensations of D5-tip sting and lateral-palm tingle, respectively, whereas interleaved stimulation of these electrodes (2.5-ms time shift difference) consistently reproduced both of these percepts concurrently with no emergent sensations, and simultaneous stimulation (no time shift difference) consistently produced both of these percepts concurrently accompanied by an emergent ‘massage’ feeling bridging between them. The participant successfully identified among these four sensations in 20/24 trials (25% chance per trial, p < 0.0001, binomial test; Fig. 2b).
Subject S4 also performed location-discrimination trials, including discrimination among eight different cutaneous stimulation configurations (Fig. 2c). The participant successfully identified between these sensations in 11/24 trials (12.5% chance per trial, p < 0.0001, binomial test, Fig. 2c). Importantly, these trials also included a condition of “no stimulation,” to validate that percepts were indeed evoked by USEA stimulation in contrast to pseudethesia. Subject S4 successfully identified when stimulation was delivered compared with when no stimulation was delivered in 24/24 trials (50% chance per trial, p < 0.0001, binomial test). Furthermore, even when the “no stimulation” condition was removed in a post-hoc analysis, the participant still successfully discriminated among the evoked percepts in 8/21 trials (14.2% chance per trial, p < 0.01, binomial test).
Subject S4 also performed location-discrimination trials with both single-channel and multichannel stimulation. The participant successfully identified the location when single-channel stimulation was used in 4/9 trials (12.5% chance per trial, p < 0.05, binomial test), and when multichannel stimulation was used in 5/12 trials (12.5% chance per trial, p < 0.05, binomial test). We found no significant different between these two stimulation conditions (4/9 versus 5/12, p = 0.89, chi-squared test), although statistical power is lacking to rule out false negatives.
Subject S3 successfully discriminated between two evoked percepts with the same perceived somatotopic location, but with two distinct qualities, produced via stimulation of two different ulnar-nerve-USEA electrodes (Fig. 3). Prior to formal discrimination trials, the subject identified the percepts evoked by these two different electrodes as having identical intensities and locations near the D5 tip (“Right on, exact same space”), but differing qualities of vibration and tingle, respectively. In subsequent formal trials, the subject consistently discriminated between the percepts evoked by the two electrodes in 30/30 trials (50% chance per trial, p < 0.0001, binomial test).
Subject S5 successfully discriminated among four different cutaneous-percept intensities, encoded via stimulation with different frequencies on a single USEA electrode (Fig. 4). During informal practice trials, the subject designated four intensity levels as “high,” “medium,” “light,” or “nothing,” corresponding to stimulation at 100 Hz, 70 Hz, 35 Hz or no stimulation, respectively. During subsequent formal trials, the subject correctly classified these percept intensities in 13/20 trials (25% chance per trial, p < 0.0005, binomial test, Fig. 4). With the “no stimulation” condition removed in a post-hoc analysis, the participant’s performance was no longer statistically significant, although a trend toward statistical significance was observed (8/15 trials correct; 33% chance per trial, p = 0.08, binomial test).
Combined location and cutaneous intensity discrimination
Subject S5 performed combined location- and intensity-discrimination trials for cutaneous percepts, similar to what may be used as part of a multi-sensor closed-loop prosthesis (Fig. 5). Subject S5 successfully discriminated among ten different stimulation conditions in 15/30 trials (10% chance per trial, p < 0.0001, binomial test, Fig. 5). Furthermore, even when the “no stimulation” condition was removed in a post-hoc analysis, the participant still successfully discriminated among the evoked percepts in 12/27 trials (11.1% chance per trial, p < 0.0001, binomial test). In post-hoc analyses, we found that most of the subject’s success was attributed to accurate location discrimination; location was identified correctly in 26/30 trials (25% chance per trial, p < 0.0001, binomial test for location classification independent of intensity classification, using a corrected critical value of α = 0.005). In contrast, intensity discrimination was successful but seemed more challenging; intensity was identified correctly in 17/30 trials (25% chance per trial, p < 0.0005, binomial test for intensity classification independent of location classification, using a corrected critical value of α = 0.005).
Combined location and proprioceptive intensity discrimination
Subject S5 performed combined location- and intensity-discrimination trials for proprioceptive percepts, similar to what may be used as part of a multi-sensor closed-loop prosthesis (Fig. 6). Subject S5 successfully discriminated among seven different stimulation conditions in 21/40 trials (14.3% chance per trial, p < 0.0001, binomial test). Furthermore, even when the “no stimulation” condition was removed in a post-hoc analysis, the participant still successfully discriminated among the evoked percepts in 13/30 trials (16.6% chance per trial, p < 0.001, binomial test). The subject correctly identified which phantom digit moved in 32/40 trials (50% chance per trial, p < 0.0001, post-hoc binomial test for digit classification independent of joint-position classification, using a corrected critical value of α = 0.005). The subject identified the correct joint position in 22/40 trials (33% chance per trial, p < 0.005, binomial test for joint-position classification independent of joint classification, using a corrected critical value of α = 0.005).
Qualitative descriptions of sensory percepts
The subjects generally appreciated the cutaneous and proprioceptive sensations evoked by USEA stimulation, although a small percentage of USEA electrodes can evoke painful or uncomfortable sensations associated with nociceptive sensory fibers . After his first stimulation session, subject S3 stated, “My hand is starting to stimulate like it’s starting to wake up or something. It really feels good. […] It’s good to know that there’s something still there.” We did not formally quantify the naturalism of the evoked sensory percepts. However, informal remarks and comparisons to every-day sensory experiences suggest that most percepts were perceived as somewhat natural. For example, in response to the proprioceptive percept of D3 flexion delivered during proprioception discrimination trials, subject S5 stated that the sensation felt “exactly like movement of the middle finger.” Similarly, when asked to describe one of the sensory percepts evoked during cutaneous location-intensity discrimination trials, subject S5 stated, “It feels like touch. It feels like if I touched that door.”
We have demonstrated that USEA stimulation can be used to encode sensory percepts with different locations, qualities, and intensities that can be reliably discriminated with a performance greater than chance alone. Further, discrimination was possible for both cutaneous and proprioceptive percepts. Encoding of cutaneous sensory percepts with different locations and qualities was achieved by stimulation of different USEA electrodes or combinations of electrodes, presumably resulting in activation of different axons or subsets of axons within the nerve. Encoding of sensory percepts with different intensities was achieved by modulation of the stimulation frequency, presumably resulting in an increased firing rate in activated axons . We have also demonstrated that subjects can discriminate among multiple location-intensity combined percepts such as would be desired during closed-loop prosthesis control.
Importantly, we demonstrated the ability to selectively evoke percepts with the same location but different qualities. It has been shown that modulating stimulation frequency increases percept intensity but not location or quality. Increasing amplitude also increases intensity, but by recruiting additional sensory fibers, that may be associated with different qualities. We hypothesize that the percepts with overlapping projected fields but different qualities were evoked by activating two different sensory afferent subtypes. This result suggests that subjects may be able to discriminate among activation of different afferent subtypes that have overlapping projected fields. The ability to selectively evoke percepts with overlapping projected fields and different qualities may allow for fiber-level biomimetic sensory feedback .
Additionally, we show that subjects can discriminate between simultaneous and interleaved multi-electrode stimulation. The subject was able to reliably feel an emergent massage feeling during simultaneous multi-electrode stimulation but not with interleaved multi-electrode stimulation. One plausible explanation for the emergent massage feeling during simultaneous stimulation is that multiple additional axons may have been activated due to spatiotemporal current summation from the two electrodes . Future use of simultaneous and interleaved multielectrode stimulation may allow for improvements in the number and nature of restored percepts. This result also provides an important proof-of-concept for a method of interleaving stimulation via different USEA electrodes when current-summation effects are not desired, for example, during closed-loop prosthesis control with simultaneous USEA-evoked sensory feedback from multiple prosthesis sensors. Although we have shown that USEA electrodes as close as 800 μm within the nerve cross-section can evoke distinct sensory percepts, simultaneous stimulation via these electrodes often results in current summation and potentially undesired activation of additional axons that evoke additional sensation. Use of interleaved stimulation allows for simultaneous generation of the individual sensory percepts without current-summation effects. During closed-loop prosthesis control, interaction with the external environment may result in simultaneous activation of multiple prosthesis sensors, potentially generating simultaneous stimulation via multiple USEA electrodes. Algorithms may be developed and incorporated to interleave stimulation on different USEA electrodes to prevent current-summation effects. One tradeoff of interleaving stimulation is that a more frequent occurrence of stimulation artifact will likely be produced in USEA electrode recordings, possibly interrupting the ability to decode neural recordings for prosthesis control. In this case, it may be desirable to develop stimulation artifact blanking approaches or to implant separate recording electrodes in a distant location where stimulation artifact will be minimized (e.g., the residual limb muscles or a distant nerve location).
It is uncertain in some cases whether proprioceptive percepts were elicited by activating proprioceptive fibers directly or by generating secondary proprioceptive signaling after activating motor fibers. In the majority of cases, we did not observe visible muscle twitching in the residual limb during USEA stimulation; however, there is a possibility that single motor fibers were activated without producing a visible muscle twitch. However, proprioceptive percepts associated with movements of missing hand muscles (e.g., intrinsic hand muscles) do not suffer from this potential confound and hence are likely due to direct activation of proprioceptive fibers. Furthermore, subject S5 described both monotonic and nonmonotonic frequency-intensity encoding for D3 and D2 joint positions, respectively. These activations patterns are consistent with those that have been previously reported for muscle spindle fibers [56, 57].
Sensory feedback from the hand has been shown to be important for identifying when contact events between the hand and the environment occur and for identifying object properties such as curvature, texture, and weight. These complex properties are interpreted using sensory integration across various proprioceptive and cutaneous channels with many receptive fields. Cutaneous information, encoded via multiple different receptors (e.g., slowly-adapting I, slowly-adapting II, rapidly-adapting I, and rapidly-adapting II), provides information regarding contact locations, object texture, object slippage, and gross shape [41, 43, 58,59,60,61]. Proprioceptive channels provide information regarding hand conformation and position, which, in conjunction with cutaneous information, provides information regarding object shape, weight, and counterforce . Many of these object properties are challenging to deduce using visual feedback alone, particularly when feedback is needed rapidly during motor tasks  or when handling opaque objects. The goal of discrimination among a variety of sensory channels is ultimately to provide the brain with sufficient information to deduce useful information regarding interactions with the external environment.
Our gross encoding of three stimulus locations, each with three different intensities, may be sufficient to assist subjects in identifying gross object properties such as size and compliance . However, more complex properties such as curvature and skin indentation direction and force gradations will likely require encoding via sensory percepts of different submodalities (e.g., rapidly-adapting I and slowly-adapting I) that have nearby projected fields . Restored sensation via multiple axons with adjacent projected fields may be critical for naturalistic sensorimotor hand control because real-time neural encoding of object properties likely involves cortical comparison of spike timings from neurons with adjacent receptive fields . We anticipate that functional prosthesis control will improve with increasing number and variety of discriminable sensory feedback channels. Importantly, the data reported in this paper represents the most complex sensory discrimination tasks attempted with subjects S4 and S5; future studies should be designed to attempt more sophisticated discrimination tasks.
The ultimate goal of restored prosthesis sensation is not just to provide subjects with a useful tool, but also to provide subjects with a prosthesis that is perceived by subjects as a replacement hand. Although the results of this report do not begin to approximate the sophistication of an intact hand (hundreds of discriminable cutaneous locations, and ~ 50 discriminable force levels), this work constitutes an important step in demonstrating the capabilities of USEAs to restore a variety of discriminable sensory percepts, which may ultimately help guide the development of sensorized bionic arms. Specifically, we have demonstrated that different USEA-evoked percepts are discriminable from each other, including up to three gross-level hand regions such as different digits and the palm, each with three different intensities. These results are comparable to a recent study in which transfemoral amputees were able to discriminate among a combination of two or three cutaneous percepts and two or three emulated proprioceptive percepts (stimulation of efferent nerves to indirectly activate proprioceptive fibers) evoked by intraneural stimulation . Likewise, the results presented here are similar to those reported by another recent study in which transradial amputees discriminated among seven different hand postures evoked by epineural stimulation .
The intensity discrimination results presented here show the participant was capable of discriminating among 0 Hz, 35 Hz, 70 Hz and 100 Hz at a level greater than chance alone. However, when the 0-Hz condition was removed in a post-hoc analysis, the participant’s ability to discriminate among the three remaining intensity levels (low, medium and high) was almost but not quite statistically significant (p = 0.08). The ability to discriminate a 30-Hz difference at a 100-Hz reference with at least 75% accuracy requires a Weber fraction of 0.3 for changes in intraneural pulse frequency. This Weber fraction is consistent with those reported previously for intraneural stimulation via USEAs , as well as for those reported for epineural stimulation [16, 24]. Thus, we speculate that with additional data the trend observed (p = 0.08) would reveal significance, even with the “no stimulation” condition removed. In real-world activities of daily living, the ability to determine whether a stimulus is absent or present is among the most important discriminative capabilities. Removal of the “no stimulation” condition here is an artificial experimental constraint intended to isolate the discriminability of percepts at higher stimulus intensities.
It is also important to note that the discrimination tasks presented here were designed to be psychometrically ergonomic and to be analyzed at the aggregate level. As such, we did not have enough trials at each individual condition to eliminate the possibility of false negatives when looking for statistically significant performance on the individual conditions. Future studies should increase the number of trials at each condition by performing the task across multiple days after ensuring cross-session stability of the evoked percepts.
Although the results presented here do not recreate the performance of intact human hands, this level of discriminability has been shown to result in substantial functional improvements in fragile object manipulation and haptic perception [1, 4], and performance may improve with long-term use [25, 67]. Prior work has highlighted hundreds of sensory percepts from USEAs [13, 14, 54], but these studies did not test for false positives using sham conditions. In contrast, here we show that subjects can reliably discriminate sensory percepts from one another, and importantly, from sham conditions. However, infrequently but occasionally subjects were not able to identify the correct answer at all (e.g., Fig. 2c, 0% accuracy for electrode 28). Given that the subject consistently described the percept by a description different from what had been originally proposed, we speculate that the percept may have changed from when it was given its “correct” label during informal practice trials to when the participant was attempting to identify the “correct” label during formal discrimination trials.
Ongoing work should focus on discrimination among successively closer projected fields to identify minimum discriminable distances. Additionally, interleaved, multielectrode stimulation strategies may produce surround inhibition effects that could improve percept discrimination. Although USEAs offer the highest channel count of any peripheral nerve interface, 100 channels likely will not provide the incredibly fine level of resolution that would be required to completely restore sensory hand function. Development of a neural interface that may provide such resolution remains as a substantial challenge to the field.
One limitation of this report is the lack of control of the intensity and/or quality of sensory percepts during location-only discrimination trials. Specifically, subjects described the different sensory percepts by indicating both their location and their quality, raising the possibility that the discrimination may not have been performed based on location alone. Future studies regarding location discrimination should attempt to control for the quality and intensity of the percepts.
We have also demonstrated in this report that selective activation of distinct axons or subsets of axons is possible using USEA electrodes as close as ~ 800 μm within the nerve. Stimulation amplitudes were between 7 and 64 μA for the trials reported here, which apparently allowed for focal activation of a subset of axons within the local area of an electrode tip that was distinct from the subset of axons activated by electrodes ~ 800 μm away. Future testing should be performed using closer electrodes, such as neighboring electrodes that are ~ 400 μm apart, to see if selectivity is achievable. Additionally, we anticipate that selectivity will decrease primarily as a function of cross-sectional projection distance, suggesting that electrodes that are directly distal/proximal to each other are less likely to evoke selective sensory percepts due to the possibility that the same axon(s) will pass near each electrode tip as they travel longitudinally along the course of the nerve. More data from electrodes with a variety of different cross-sectional projection distances is needed to perform such an assessment. Future USEA designs may use a steeper slant to allow for improved selectivity along distal–proximal rows.
Informally, we observed adaptation of some sensory percepts during intensity discrimination trials in subject S5. We did not explicitly study the adaptation phenomenon extensively here. However, prior research has documented this phenomenon for neural stimulation , and adaptation of responses evoked by natural sensory stimuli is ubiquitous [68, 69]. Informally, we found that in some cases there seemed to be less nominal adaptation if the stimulation was delivered at an amplitude at least 150% of threshold, and if we allowed for ~ 30 s of rest between each trial. Despite this, we informally observed that the subject’s performance discriminating among intensities declined slightly as trials continued, and the subject tended to underestimate the percept intensity in later trials compared with earlier trials in a session. The adaptation of USEA-evoked sensory percepts should be studied and understood explicitly in future studies, particularly for longer-duration sensory prosthesis use. Intact subjects exhibit adaptation in response to tactile stimulation of the skin [70,71,72,73,74]. Past studies indicate that the rate of nominal habituation varies as a function of stimulus frequency and inversely as a function of stimulus strength for neural interface stimulation [23, 26], suggesting that algorithms that use either frequency or charge per pulse to encode stimulus intensity may have different consequences across time, even though the two parameters may be functionally interchangeable for a given time point . We hypothesize that use of suprathreshold stimulation intensities, or addition of interpulse variability into stimulation trains (in contrast to constant-frequency stimulation), to produce more biomimetic stimulation patterns [4, 21], may help reduce the effects of adaptation.
Although the sensory percepts restored via USEA stimulation are generally stable within a 2–3 h session, the projected field location, quality, and intensity associated with each electrode often varies across sessions [13, 54]. Due to this limitation, we did not attempt to repeat identical discrimination tasks in different sessions. This instability may be due to a number of factors, including micromechanical shifts of the USEA relative to nerve fibers, the developing foreign body response to implanted USEAs, or degradation or failure of USEA electrodes and/or wire bundles . A complete characterization of how USEA-evoked percepts and discriminability change throughout long-term implant durations was outside the scope of this study, and warrants further investigation. Furthermore, the subjects involved in this study had USEAs implanted for a total of 4, 5, and 13 weeks. Recent reports have now documented the long-term performance of USEAs implanted for over 70 weeks .
Ultimately, we foresee development of a closed-loop prosthesis system with multiple discriminable sensory percepts coupled to sensors that span a physical prosthetic hand for use in activities of daily living. We anticipate that discriminable sensory feedback via a prosthesis will enhance motor control, particularly in scenarios where visual feedback is limited or undesired. Also, we anticipate that discriminable, multi-sensor feedback with variable intensity and tunable quality will further enhance the level of embodiment of a prosthetic limb, helping amputees to feel as though their prosthesis is a replacement hand, in addition to being a useful tool. Sensory feedback during closed-loop control, and any associated limb embodiment, may also alleviate phantom pain and many of the psychological difficulties associated with losing a hand [3, 20, 23, 25].
We have shown that human amputees implanted with USEAs in their residual peripheral arm nerves can discriminate among a variety of restored hand sensations in blind trials, including: (a) percepts with different hand locations, (b) percepts with different qualities, and (c) percepts with different intensities. Additionally, we have demonstrated that one subject was able to discriminate among cutaneous or proprioceptive percepts with different combinations of location and intensity, such as may occur during functional prosthesis use with multiple graded sensors for feedback. Furthermore, we have presented a multielectrode stimulation strategy using interleaved stimulation, which may be useful for evoking multiple sensory percepts concurrently without the effects of current summation during closed-loop prosthesis control. The subjects enjoyed most of the sensory percepts and appreciated feeling controlled sensation from their amputated hand. Future work should include investigation of discriminability using multielectrode biomimetic stimulation patterns, as well exploration of the limit of discriminability resolution with USEAs. We hypothesize that increasing the number of sensory percepts that can be discriminated by location, quality, and intensity during closed-loop prosthesis control will further increase embodiment and motor performance for prosthesis users.
Availability of data and materials
All data needed to evaluate the conclusions are available in the paper or the supplementary materials. Data and materials requests should be sent to G.A.C. (email@example.com). Requestors may need to be approved by the human-subjects research committees (e.g., local institutional review board and Department of the Navy Human Resources Protection Program) to comply with Health Insurance Portability and Accountability Act requirements.
Utah slanted electrode array
Raspopovic S, Capogrosso M, Petrini FM, Bonizzato M, Rigosa J, Pino GD, et al. Restoring natural sensory feedback in real-time bidirectional hand prostheses. Sci Transl Med. 2014;6:222ra19-222ra19.
Marasco PD, Kim K, Colgate JE, Peshkin MA, Kuiken TA. Robotic touch shifts perception of embodiment to a prosthesis in targeted reinnervation amputees. Brain. 2011;134:747–58.
Page DM, George JA, Kluger DT, Duncan C, Wendelken S, Davis T, et al. Motor control and sensory feedback enhance prosthesis embodiment and reduce phantom pain after long-term hand amputation. Front Hum Neurosci [Internet]. 2018 [cited 2018 Dec 5];12. Available from: https://www.frontiersin.org/articles/10.3389/fnhum.2018.00352/full?&utm_source=Email_to_authors_&utm_medium=Email&utm_content=T1_11.5e1_author&utm_campaign=Email_publication&field=&journalName=Frontiers_in_Human_Neuroscience&id=348751.
George JA, Kluger DT, Davis TS, Wendelken SM, Okorokova EV, He Q, et al. Biomimetic sensory feedback through peripheral nerve stimulation improves dexterous use of a bionic hand. Sci Robot. 2019;4:eaax2352.
Engdahl SM, Christie BP, Kelly B, Davis A, Chestek CA, Gates DH. Surveying the interest of individuals with upper limb loss in novel prosthetic control techniques. J NeuroEngineering Rehabil [Internet]. 2015 [cited 2016 Mar 30];12. Available from: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4465617/
Biddiss E, Beaton D, Chau T. Consumer design priorities for upper limb prosthetics. Disabil Rehabil Assist Technol. 2007;2:346–57.
Atkins DJO, Heard DCYM, Donovan WH. Epidemiologic overview of individuals with upper-limb loss and their reported research priorities. J Prosthet. 1996;8:2–11.
Kyberd PJ, Hill W. Survey of upper limb prosthesis users in Sweden, the United Kingdom and Canada. Prosthet Orthot Int. 2011;35:234–41. https://doi.org/10.1177/0309364611409099.
Biddiss EA, Chau TT. Upper limb prosthesis use and abandonment: a survey of the last 25 years. Prosthet Orthot Int. 2007;31:236–57.
Engdahl SM, Chestek CA, Kelly B, Davis A, Gates DH. Factors associated with interest in novel interfaces for upper limb prosthesis control. PLoS ONE. 2017;12:e0182482.
Kluger DT, Joyner JS, Wendelken SM, Davis TS, George JA, Page DM, et al. Virtual reality provides an effective platform for functional evaluations of closed-loop neuromyoelectric control. IEEE Trans Neural Syst Rehabil Eng. 2019;27:876–86.
George JA, Davis TS, Brinton MR, Clark GA. Intuitive neuromyoelectric control of a dexterous bionic arm using a modified Kalman filter. J Neurosci Methods. 2019;330:108462.
Wendelken S, Page DM, Davis T, Wark HAC, Kluger DT, Duncan C, et al. Restoration of motor control and proprioceptive and cutaneous sensation in humans with prior upper-limb amputation via multiple Utah Slanted Electrode Arrays (USEAs) implanted in residual peripheral arm nerves. J NeuroEng Rehabil. 2017;14:121. https://doi.org/10.1186/s12984-017-0320-4.
Davis TS, Wark HAC, Hutchinson DT, Warren DJ, O’Neill K, Scheinblum T, et al. Restoring motor control and sensory feedback in people with upper extremity amputations using arrays of 96 microelectrodes implanted in the median and ulnar nerves. J Neural Eng. 2016;13:036001.
Clark GA, Wendelken S, Page DM, Davis T, Wark HA, Normann RA, et al. Using multiple high-count electrode arrays in human median and ulnar nerves to restore sensorimotor function after previous transradial amputation of the hand. Eng Med Biol Soc EMBC 2014 36th Annu Int Conf IEEE. IEEE; 2014. p. 1977–80.
Ackerley R, Backlund Wasling H, Ortiz-Catalan M, Brånemark R, Wessberg J. Case studies in neuroscience: sensations elicited and discrimination ability from nerve cuff stimulation in an amputee over time. J Neurophysiol. 2018;120:291–5.
Ortiz-Catalan M, Håkansson B, Brånemark R. An osseointegrated human-machine gateway for long-term sensory feedback and motor control of artificial limbs. Sci Transl Med. 2014;6:257re6-257re6.
D’Anna E, Petrini FM, Artoni F, Popovic I, Simanić I, Raspopovic S, et al. A somatotopic bidirectional hand prosthesis with transcutaneous electrical nerve stimulation based sensory feedback. Sci Rep. 2017;7:1–15.
Oddo CM, Raspopovic S, Artoni F, Mazzoni A, Spigler G, Petrini F, et al. Intraneural stimulation elicits discrimination of textural features by artificial fingertip in intact and amputee humans. eLife [Internet]. 2016 [cited 2019 Jan 10];5. Available from: https://elifesciences.org/articles/09148.
Petrini FM, Valle G, Strauss I, Granata G, Di Iorio R, D’Anna E, et al. Six-month assessment of a hand prosthesis with intraneural tactile feedback: hand prosthesis. Ann Neurol. 2019;85:137–54.
Valle G, Mazzoni A, Iberite F, D’Anna E, Strauss I, Granata G, et al. Biomimetic intraneural sensory feedback enhances sensation naturalness, tactile sensitivity, and manual dexterity in a bidirectional prosthesis. Neuron. 2018;100(37–45):e7.
Valle G, D’Anna E, Strauss I, Clemente F, Granata G, Di Iorio R, et al. Hand control with invasive feedback is not impaired by increased cognitive load. Front Bioeng Biotechnol [Internet]. Frontiers; 2020 [cited 2020 May 15];8. Available from: https://www.frontiersin.org/articles/10.3389/fbioe.2020.00287/full#F2.
Tan DW, Schiefer MA, Keith MW, Anderson JR, Tyler J, Tyler DJ. A neural interface provides long-term stable natural touch perception. Sci Transl Med. 2014;6:257ra138-257ra138.
Graczyk EL, Schiefer MA, Saal HP, Delhaye BP, Bensmaia SJ, Tyler DJ. The neural basis of perceived intensity in natural and artificial touch. Sci Transl Med. 2016;8:362ra142-362ra142.
Graczyk EL, Resnik L, Schiefer MA, Schmitt MS, Tyler DJ. Home use of a neural-connected sensory prosthesis provides the functional and psychosocial experience of having a hand again. Sci Rep. 2018;8:9866.
Graczyk EL, Delhaye BP, Schiefer MA, Bensmaia SJ, Tyler DJ. Sensory adaptation to electrical stimulation of the somatosensory nerves. J Neural Eng. 2018;15:046002.
Dhillon GS, Horch KW. Direct neural sensory feedback and control of a prosthetic arm. IEEE Trans Neural Syst Rehabil Eng. 2005;13:468–72.
Dhillon GS, Krüger TB, Sandhu JS, Horch KW. Effects of short-term training on sensory and motor function in severed nerves of long-term human amputees. J Neurophysiol. 2005;93:2625–33.
Horch K, Meek S, Taylor TG, Hutchinson DT. Object discrimination with an artificial hand using electrical stimulation of peripheral tactile and proprioceptive pathways with intrafascicular electrodes. IEEE Trans Neural Syst Rehabil Eng Publ IEEE Eng Med Biol Soc. 2011;19:483–9.
Dhillon GS, Lawrence SM, Hutchinson DT, Horch KW. Residual function in peripheral nerve stumps of amputees: implications for neural control of artificial limbs1. J Hand Surg. 2004;29:605–15.
Valle G, Petrini FM, Strauss I, Iberite F, D’Anna E, Granata G, et al. Comparison of linear frequency and amplitude modulation for intraneural sensory feedback in bidirectional hand prostheses. Sci Rep. 2018;8:16666.
Schiefer MA, Graczyk EL, Sidik SM, Tan DW, Tyler DJ. Artificial tactile and proprioceptive feedback improves performance and confidence on object identification tasks. PLoS ONE. 2018;13:e0207659.
D’Anna E, Valle G, Mazzoni A, Strauss I, Iberite F, Patton J, et al. A closed-loop hand prosthesis with simultaneous intraneural tactile and position feedback. Sci Robot. 2019;4:eaau8892.
Ortiz-Catalan M, Mastinu E, Bensmaia S. Chronic use of a sensitized bionic hand does not remap the sense of touch. medRxiv [Internet]. Cold Spring Harbor Laboratory Press; 2020 [cited 2020 May 8];2020.05.02.20089185. Available from: https://www.medrxiv.org/content/10.1101/2020.05.02.20089185v1.
Strauss I, Valle G, Artoni F, D’Anna E, Granata G, Di Iorio R, et al. Characterization of multi-channel intraneural stimulation in transradial amputees. Sci Rep. 2019;9:19258.
Segil JL, Cuberovic I, Graczyk EL, Weir RF, Tyler D. Combination of simultaneous artificial sensory percepts to identify prosthetic hand postures: a case study. Sci Rep. 2020;10:1–15.
Wheat HE, Goodwin AW, Browning AS. Tactile resolution: peripheral neural mechanisms underlying the human capacity to determine positions of objects contacting the fingerpad. J Neurosci. 1995;15:5582–95.
Johansson RS, Vallbo AB. Tactile sensibility in the human hand: relative and absolute densities of four types of mechanoreceptive units in glabrous skin. J Physiol. 1979;286:283–300.
Paré M, Smith AM, Rice FL. Distribution and terminal arborizations of cutaneous mechanoreceptors in the glabrous finger pads of the monkey. J Comp Neurol. 2002;445:347–59.
Wheat HE, Salo LM, Goodwin AW. Human ability to scale and discriminate forces typical of those occurring during grasp and manipulation. J Neurosci. 2004;24:3394–401.
Hollins M, Bensmaïa SJ. The coding of roughness. Can J Exp Psychol Rev Can Psychol Expérimentale. 2007;61:184–95.
Saal HP, Bensmaia SJ. Touch is a team effort: interplay of submodalities in cutaneous sensibility. Trends Neurosci. 2014;37:689–97.
Bensmaia S. Tactile intensity and population codes. Behav Brain Res. 2008;190:165–73.
Bensmaïa SJ, Craig JC, Yoshioka T, Johnson KO. SA1 and RA afferent responses to static and vibrating gratings. J Neurophysiol. 2006;95:1771–82.
Hollins M, Roy EA. Perceived intensity of vibrotactile stimuli: the role of mechanoreceptive channels. Somatosens Mot Res. 1996;13:273–86.
George JA, Brinton MR, Colgan PC, Colvin GK, Bensmaia SJ, Clark GA. Intensity discriminability of electrocutaneous and intraneural stimulation pulse frequency in intact individuals and amputees. 2020 42nd Annu Int Conf IEEE Eng Med Biol Soc EMBC. 2020. p. 3893–6.
Branner A, Stein RB, Normann RA. Selective stimulation of cat sciatic nerve using an array of varying-length microelectrodes. J Neurophysiol. 2001;85:1585–94.
Ramachandran VS, Rogers-Ramachandran D. Synaesthesia in phantom limbs induced with mirrors. Proc Biol Sci. 1996;263:377–86.
Rousche PJ, Normann RA. Chronic intracortical microstimulation (ICMS) of cat sensory cortex using the Utah Intracortical Electrode Array. IEEE Trans Rehabil Eng Publ IEEE Eng Med Biol Soc. 1999;7:56–68.
Rousche PJ, Normann RA. A method for pneumatically inserting an array of penetrating electrodes into cortical tissue. Ann Biomed Eng. 1992;20:413–22.
Spataro L, Dilgen J, Retterer S, Spence AJ, Isaacson M, Turner JN, et al. Dexamethasone treatment reduces astroglia responses to inserted neuroprosthetic devices in rat neocortex. Exp Neurol. 2005;194:289–300.
Zhong Y, Bellamkonda RV. Dexamethasone coated neural probes elicit attenuated inflammatory response and neuronal loss compared to uncoated neural probes. Brain Res. 2007;1148:15–27.
Christensen MB, Wark HAC, Hutchinson DT. A histological analysis of human median and ulnar nerves following implantation of Utah slanted electrode arrays. Biomaterials. 2016;77:235–42.
George JA, Page DM, Davis TS, Duncan CC, Hutchinson DT, Rieth L, et al. Long-term performance of Utah Slanted Electrode Arrays and intramuscular electromyographic leads implanted chronically in human arm nerves and muscles. J Neural Eng [Internet]. 2020 [cited 2020 Oct 23]; Available from: http://iopscience.iop.org/10.1088/1741-2552/abc025.
Saal HP, Delhaye BP, Rayhaun BC, Bensmaia SJ. Simulating tactile signals from the whole hand with millisecond precision. Proc Natl Acad Sci USA. 2017;114:E5693–702.
Yu Wei J, Simon J, Randić M, Burgess PR. Joint angle signaling by muscle spindle receptors. Brain Res. 1986;370:108–18.
Yu Wei J, Kripke BR, Burgess PR. Classification of muscle spindle receptors. Brain Res. 1986;370:119–26.
Johnson KO, Hsiao SS. Neural mechanisms of tactual form and texture perception. Annu Rev Neurosci. 1992;15:227–50.
Friedman RM, Khalsa PS, Greenquist KW, LaMotte RH. Neural coding of the location and direction of a moving object by a spatially distributed population of mechanoreceptors. J Neurosci. 2002;22:9556–66.
Macefield VG, Häger-Ross C, Johansson RS. Control of grip force during restraint of an object held between finger and thumb: responses of cutaneous afferents from the digits. Exp Brain Res. 1996;108:155–71.
Yoshioka T, Bensamaïa SJ, Craig JC, Hsiao SS. Texture perception through direct and indirect touch: an analysis of perceptual space for tactile textures in two modes of exploration. Somatosens Mot Res. 2007;24:53–70.
Yau JM, Kim SS, Thakur PH, Bensmaia SJ. Feeling form: the neural basis of haptic shape perception. J Neurophysiol. 2016;115:631–42.
Johansson RS, Flanagan JR. Tactile sensory control of object manipulation in human. In: The senses: a comprehensive reference. New York: Academic Press; 2007. p. 67–86.
Saal HP, Vijayakumar S, Johansson RS. Information about complex fingertip parameters in individual human tactile afferent neurons. J Neurosci. 2009;29:8022–31.
Gollisch T, Meister M. Rapid neural coding in the retina with relative spike latencies. Science. 2008;319:1108–11.
Petrini FM, Valle G, Bumbasirevic M, Barberi F, Bortolotti D, Cvancara P, et al. Enhancing functional abilities and cognitive integration of the lower limb prosthesis. Sci Transl Med. 2019;11:eaav8939.
Schofield JS, Shell CE, Beckler DT, Thumser ZC, Marasco PD. Long-term home-use of sensory-motor-integrated bidirectional bionic prosthetic arms promotes functional, perceptual, and cognitive changes. Front Neurosci [Internet]. Frontiers; 2020 [cited 2020 Mar 7];14. Available from: https://www.frontiersin.org/articles/10.3389/fnins.2020.00120/full.
Thompson RF, Spencer WA. Habituation: a model phenomenon for the study of neuronal substrates of behavior. Psychol Rev. 1966;73:16–43.
Rankin CH, Abrams T, Barry RJ, Bhatnagar S, Clayton DF, Colombo J, et al. Habituation revisited: an updated and revised description of the behavioral characteristics of habituation. Neurobiol Learn Mem. 2009;92:135–8.
Hollins M, Delemos KA, Goble AK. Vibrotactile adaptation on the face. Percept Psychophys. 1991;49:21–30.
Hollins M, Goble AK, Whitsel BL, Tommerdahl M. Time course and action spectrum of vibrotactile adaptation. Somatosens Mot Res. 1990;7:205–21.
Berglund U, Berglund B. Adaptation and Recovery in Vibrotactile Perception. Percept Mot Skills. 2016. https://doi.org/10.2466/pms.19184.108.40.2063.
Mei J, Tuckett RP, Poulos DA, Horch KW, Wei JY, Burgess PR. The neural signal for skin indentation depth. II. Steady indentations. J Neurosci. 1983;3:2652–9.
Burgess PR, Mei J, Tuckett RP, Horch KW, Ballinger CM, Poulos DA. The neural signal for skin indentation depth. I. Changing indentations. J Neurosci. 1983;3:1572–85.
Baker B, Caldwell R, Crosland D, Sharma R, Kluger D, George JA, et al. Improved long-term performance of Utah slanted arrays in clinical studies. Soc Neurosci [Internet]. 2018;271.03. Available from: https://www.sfn.org/-/media/SfN/Documents/NEW-SfN/Meetings/Neuroscience-2018/Abstracts/Neuroscience-2018-Abstracts/SFN18_Abstract-PDFs---Nano_11-02-18.pdf.
This paper constitutes a chapter of the doctoral dissertation of David M. Page, of the Department of Biomedical Engineering, University of Utah. The authors acknowledge the contributions of Richard A. Normann, Heather A. C. Wark, and Bradley Greger in prior studies related to this research. The authors further acknowledge Sliman J. Bensmaia and Hannes Saal for general consulting and input regarding the encoding of cutaneous sensation, and David J. Warren for assistance in final revision of the manuscript and for general contributions to the design of hardware for these experiments.
This work was sponsored by the Defense Advanced Research Projects Agency (DARPA) BTO Hand Proprioception and Touch Interfaces (HAPTIX) program under the auspices of Dr. Doug Weber through the Space and Naval Warfare Systems Center, Pacific Grant/Contract No. N66001-15-C-4017, and the DARPA MTO under the auspices of Dr. Jack Judy through the Space and Naval Warfare Systems Center, Pacific Grant/Contract No. N66001-12-C-4042. Additional funding was also provided by the National Institutes of Health (NIH NCATS Award No. 1ULTR001067). Trainee support for J.A.G. was provided by the National Science Foundation (NSF GRFP-1747505) and National Center for Advancing Translational Sciences of the National Institutes of Health (UL1TR002538 and TL1TR002540).
Ethics approval and consent to participate
All experiments were performed with informed consent and under protocols approved by the University of Utah Institutional Review Board and the Department of the Navy Human Resources Protection Program.
Consent for publication
Dr. Clark is an inventor on a US patent on the electrode arrays and methods for protecting recordings from Utah Electrode Arrays from noise contaminations when used for recording (US Patent Nos. 8,359,083, 8,639,312, and 8,855,737). Dr. Clark, Dr. Hutchinson, Dr. Page, and Dr. Kluger are inventors of an implant carrier device used during surgical implantation of USEAs (patent pending, International Application no. PCT/US2017/044427). Dr. Clark, Dr. Davis, Dr. Page, and Dr. Kluger are inventors of the concept of using implanted electrode arrays to block transmission of neural signals (patent pending, US Application No. 15/583,568).
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Page, D.M., George, J.A., Wendelken, S.M. et al. Discriminability of multiple cutaneous and proprioceptive hand percepts evoked by intraneural stimulation with Utah slanted electrode arrays in human amputees. J NeuroEngineering Rehabil 18, 12 (2021). https://doi.org/10.1186/s12984-021-00808-4
- Neural interface
- Brain computer interface
- Peripheral nerve stimulation
- Utah slanted electrode array
- Sensory feedback
- Neural prosthesis
- Bionic arm