On neuromechanical approaches for the study of biological and robotic grasp and manipulation
Journal of NeuroEngineering and Rehabilitation volume 14, Article number: 101 (2017)
Biological and robotic grasp and manipulation are undeniably similar at the level of mechanical task performance. However, their underlying fundamental biological vs. engineering mechanisms are, by definition, dramatically different and can even be antithetical. Even our approach to each is diametrically opposite: inductive science for the study of biological systems vs. engineering synthesis for the design and construction of robotic systems. The past 20 years have seen several conceptual advances in both fields and the quest to unify them. Chief among them is the reluctant recognition that their underlying fundamental mechanisms may actually share limited common ground, while exhibiting many fundamental differences. This recognition is particularly liberating because it allows us to resolve and move beyond multiple paradoxes and contradictions that arose from the initial reasonable assumption of a large common ground. Here, we begin by introducing the perspective of neuromechanics, which emphasizes that real-world behavior emerges from the intimate interactions among the physical structure of the system, the mechanical requirements of a task, the feasible neural control actions to produce it, and the ability of the neuromuscular system to adapt through interactions with the environment. This allows us to articulate a succinct overview of a few salient conceptual paradoxes and contradictions regarding under-determined vs. over-determined mechanics, under- vs. over-actuated control, prescribed vs. emergent function, learning vs. implementation vs. adaptation, prescriptive vs. descriptive synergies, and optimal vs. habitual performance. We conclude by presenting open questions and suggesting directions for future research. We hope this frank and open-minded assessment of the state-of-the-art will encourage and guide these communities to continue to interact and make progress in these important areas at the interface of neuromechanics, neuroscience, rehabilitation and robotics.
Grasp and manipulation have captivated the imagination and interest of thinkers of all stripes over the millennia; and with enough reverence to even attribute the intellectual evolution of humans to the capabilities of the hand [1–3]. Simply put, manipulation function is one of the key elements of our identity as a species (for an overview, see ). This is a natural response to the fact that much of our physical and cognitive ability and well-being is intimately tied to the use of our hands. Importantly, we have shaped our tools and environment to match its capabilities (straightforward examples include lever handles, frets in string instruments, and touch-screens). This co-evolution between hand-and-world reinforces the notion that our hands are truly amazing and robust manipulators, as well as rich sensory, perceptual and even social information.
It then comes as no surprise that engineers and physicians have long sought to replicate and restore this functionality in machines—both as appendages to robots and prostheses attached to humans with missing upper limbs . Robotic hands and prostheses have a long and illustrious history, with records of sophisticated articulated hands as early as Gottfried ‘Götz’ von Berlichingen’s iron hand in 1504 . Other efforts [7–11] were often fueled by the injuries of war [12–15] and the Industrial Revolution . The higher survival rate in soldiers who lose upper limbs [17, 18] and the continual emergence of artificial intelligence [19, 20] are but the latest impetus. Thus, the past 20 years have seen an explosion in designs, fueled by large scale governmental funding (e.g., DARPA’s Revolutionizing Prosthetics and HAPTIX projects, EU’s INPUT and SOFTPRO projects) and private efforts such as DeepMind. A new player in this space is the potentially revolutionary social network of high-quality amateur scientists as exemplified by the FABLAB movement . They are enabled by ubiquitously accessible and inexpensive 3D printing and additive manufacturing tools , collaborative design databases (www.eng.yale.edu/grablab/openhand/ and others), and communities with formal journals (www.liebertpub.com/overview/3d-printing-and-additive-manufacturing/621/ and www.journals.elsevier.com/additive-manufacturing/). Grassroots communities have also emerged that can, for example, compare and contrast the functionality of prosthetic hands whose price differs by three orders of magnitude (www.3dprint.com/2438/50-prosthetic-3d-printed-hand).
For all the progress that we have seen, however, (i) robotic platforms remain best at pre-sorted, pick-and-place assembly tasks ; and (ii) many prosthetic users still prefer simple designs like the revered whole- or split-hook designs originally developed centuries ago [24, 25].
Why have robotic and prosthetic hands not come of age? This short review provides a current attempt to tackle this long-standing question in response to the current technological boom in robotic and prosthetic limbs. Similar booms occurred in response to upper limb injuries  after the Napoleonic , First  and Second World Wars , and—with the advent of powerful inexpensive computers—in response to industrial and space exploration needs in the 1960’s, 1970’s and 1980’s [27–32]. We argue that a truly bio-inspired approach suffers, by definition, from both gaps in our understanding of the biology, and technical challenges in mimicking (what we understand of) biological sensors, motors and controllers. Although biomimicry is often not the ultimate goal in robotics in general, it is relevant for humanoids and prostheses. Thus, our approach is to clarify when and why a better understanding of the biology of grasp and manipulation would benefit robotic grasping and manipulation.
Similarly, why is our understanding of the nature, function and rehabilitation of biological arms and hands incomplete? Jacob Benignus Winsløw Jacques-Bénigne Winslow, (1669—1760) noted in his Exposition anatomique de la structure du corps humain (1732) that ‘The coordination of the muscles of the live hand will never be understood’ . Interestingly, he is still mostly correct. As commented in detail before , there has been much work devoted to inferring the anatomical, physiological, neural and cognitive processes that produce the upper limb function we so dearly appreciate and passionately work to restore following trauma or pathology. We argue, as Galileo Galilei did, that mathematics and engineering have much to contribute to the understanding of biological systems. Without such a ‘mathematical language’ we run the risk, as Galileo put it, of ‘wandering in vain through a dark labyrinth’ . Thus, this short review also attempts to point out important mathematical and engineering developments and advances that have helped our understanding of our hands.
This review first contrasts the fundamental differences between engineering and neuroscience approaches to biological robotic systems. Whereas the former applies engineering principles, the latter relies on scientific inference. We then discuss how the physics of the world provides a common ground between them because both types of systems have similar functional goals, and must abide by the same physical laws. We go on to evaluate how biological and robotic systems implement the necessary sensory and motor functions using the dramatically different anatomy, morphology and mechanisms available to each. This inevitably raises questions about differences in their sensorimotor control strategies. Whereas engineering system can be designed and manufactured to optimize well-defined functional features, biological systems evolve without such strict tautology. Biological systems likely evolve by implementing ecologically and temporally good-enough, sub-optimal or habitual control strategies in response to the current multi-dimensional functional constraints and goals in the presence of competition, variability, uncertainty, and noise. We conclude by exploring the notion that the functional versatility of biological systems that roboticists admire is, in fact, enabled by the very nonlinearities and complexities in anatomy, sensorimotor physiology, and neural function that engineering approaches often seek to avoid.
Deductive and inductive science for the study of biological systems vs. engineering synthesis for the construction of robotic systems
As we have discussed before , any understanding of a biological system is done by a difficult scientific process of logical inference 1. Scientific inquiry, in particular, is a combination of a deductive (top-down logic) approach that invokes laws of physics and inductive (bottom-up logic) reasoning that uses specific instances of observed behavior in the complete system (e.g., gait, flight, manipulation) to build conceptual, analytical or computational models (i.e., hypotheses) about how constitutive parts interact to produce the overall behavior. In contrast, the engineering perspective is to use proven physical laws (i.e., mechanisms) to synthesize and build complex systems, like robots. The multiple technological successes of this engineering approach naturally encourage us to identify such fundamental mechanisms in biological systems, and assemble models and hypotheses about how they interact in biological systems to explain vertebrate function and dysfunction—and apply them to revolutionize rehabilitation medicine and build better machines that are either bio-inspired or able to interact with humans (e.g., exoskeletons).
Thus, this engineering approach has been used by biomechanists, kinesiologists, clinicians, and computational- and neuro-scientists to build models to address questions such as What is the control strategy the nervous system uses to (i) move the arm to place the hand in a sequence of locations in space? Or (ii) reach to an object and grasp an object? Or (iii) use the fingers to use a hand held tool? Similarly, How do specific parts of the brain contribute to produce specific features of reach, grasp and manipulation? (for recent reviews see, e.g., [4, 37–41]).
For example, neuroscientists have characterized the cortical networks responsible for selection of hand postures, forces and dexterous manipulation [42, 43]. Specifically, invasive and noninvasive recordings from cortical regions in non-human and human primates, and non-invasive brain stimulation studies in humans have revealed the functional role of sensory, premotor, motor, and association areas in motor planning, sensorimotor adaptation, grip type selection, storing and retrieving sensorimotor memories of hand-object interactions, and controlling grasping and manipulation (for review see ).
However, inferring valid models of biological systems is not trivial. It remains reasonable to ask whether it is even possible for us to produce robust insights about the mechanisms underlying complex neuromuscular systems . Scientific inquiry requires that we trust current (imperfect) theories of the mechanisms behind the material properties, sensors, muscles, and neural processing in biological systems which, when interacting with physical laws in a particular functional regime (e.g., turbulent and laminar flow, continuum and rigid body mechanics, stable and unstable dynamical domains, information theory, etc.), give rise to the observed biological behavior. Unfortunately, the differences that invariably emerge between model predictions and experimental data can be attributed to a variety of sources, ranging from the validity of the scientific hypothesis being tested, the choice of each constitutive element, or even their numerical implementation [35, 45]. Even when conceptual, analytical or computational models are carefully assembled, the modeler must make arbitrary choices that often affect the predictions of the model in counterintuitive ways. Some examples of unavoidable choices are the types of models for joints (e.g., a hinge vs. articulating surfaces), muscles (e.g., simple low pass filters, Hill-type, populations of motor units), controllers (e.g., proportional-derivative, Bayesian, internal models, optimal control), and solution methods (e.g., forward, inverse) . These choices are driven, at best, by a comprehensive distillation of the vast literature, a focused research scope, or intentional sidestepping of unknown aspects of model elements and their interactions that cannot be easily or accurately measured experimentally—and thus, cannot be confidently included in the model. At worst, (over)simplifications are driven by biological/mathematical/computational convenience or expediency.
A salient example of applying scientific findings to robotic systems is the application of kinematic (postural) hand synergies to the design of the controller for a robotic hand, such as the Pisa/IIT SoftHand . This design is based on using the first principal component computed from a set of static hand postures recorded in human subjects while grasping imagined objects . Here, the observed covariation in joint angles of the digits was captured by the first principal components accounting for over 50% of kinematic data. This inspired the robotic design of the Pisa/IIT SoftHand where a single actuator drives the motion across multiple digits along that main joint-angle coordination pattern.
It is important to note that it is perhaps the compliance built into this robotic hand by design that allows a passive (i.e., uncontrolled) adaptation to the specifics of each grasp . Such counter-intuitive and often overlooked contributions of ‘passive’ structures to static and dynamic functional versatility falls within the realm of morphological computation—a longstanding concept that is being revisited as an important contributor to the versatility of biological systems, robots and prosthetics (e.g., [49–53]).
The status quo in traditional robotics is a prime example of the converse, i.e., engineering synthesis. That is, building robotic systems that are the embodiment and application of the closed-form mathematical, design, and control principles we have and understand well. To give an example discussed in detail below, many robots are designed to have rotational motors. This comes from the fact that the torque-control formulation for robotics is well developed .
However, the control of robotic systems can also depend heavily on a deductive approach. Namely, most control architectures include an idealized mathematical model of the system they are controlling (i.e., the so-called plant2) [55, 56]. It is common practice to, for example, use system identification techniques [57, 58] to use experimental data to infer a data-driven model, i.e. input/output transfer function of the plant ‘as built’ [59–61]. These models range from linear models through to nonlinear and probabilistic approximations to the robotic system’s dynamics [62–66]. This is especially necessary when using optimal control formulations which depend critically on an accurate model of the plant . These limitations are currently being addressed by real-time model predictive control strategies that continually update families of possible models of the plant (and their states), and operate only over a limited time horizon, e.g., .
Mechanics and neuromechanics as the common ground between biological and robotic systems
The fields of biological and robotic behavior are, fortunate in that principles of mechanics are at the root of both evolutionary biology and robotics. Darwinian evolution and Newtonian mechanics are unforgiving arbiters that continually shape what is possible and successful in the physical world. Thus, even though animals have had to evolve whereas robots have had to be designed and built, both had to successfully withstand and exploit the laws of mechanics . Therefore, studying biological systems in the context of the physical function of grasp and manipulation does have the possibility of providing insights into how the structure of the body, information processing in the nervous system, and their interactions give rise to complex behavior.
An appropriate name for this approach is Neuromechanics. To our knowledge, this term was first coined by Enoka in his 1988 book Neuromechanical Basis of Kinesiology . We use the term neuromechanics as describing the functional co-adaptations of the nervous, motor, sensory and musculoskeletal systems to produce effective and versatile mechanical behavior with a physical body in the physical world. In a field that mostly emphasizes the cognitive capabilities of the mammalian brain, it is easy to overlook that the nervous system and body co-evolved well before mammals appeared . Thus, there is much to be learned when studying neural function using physical behavior by the periphery (i.e., limbs) as a means to understand central (i.e., neural) function . But how can we move away from the difficulties in deductive inference mentioned in the prior section?
One promising approach is to use synthetic analysis to build neuromorphic neuromechanical systems that exploit physical reality as the common ground between biological and robotic systems. The neuromorphic approach reflects the sentiment expressed by Richard Feynman, ‘What I cannot build I do not understand. Know how to solve every problem that has been solved.’3 In our context, it can be taken to mean that, if we have over one hundred years of sensorimotor neuroscience since Sir Charles Sherrington , and if the principles we have deduced are sound, then we should be able to build components that embody those mechanisms in such a way that when assembled they behave like biological systems [72, 73]. One example of such a neuromorphic approach uses ultra-fast computer processors to simultaneously implement populations of autonomous, interconnected spiking neurons in real time that follow Hodgkin-Huxley rules of how action potentials in neurons are initiated and propagated . As mentioned in [72, 75], this general approach has also been successfully applied to understand mechanisms of memory, visual representation, and cognitive function. Note that neuromorphic is distinct from neuromimetic or neuroinspired. Biomimetic (neuromimetic) and bioinspired (neuroinspired) work seeks to copy or replicate the biological (neural) behavior by any engineering means—like prosthetic hands that have no muscles or tendons, or airplanes that fly without flapping wings. In contrast, neuromorphic approaches use engineering means to implement the biological mechanisms themselves.
As explained in , we have taken this approach one step further by combining neuromorphic and neuromechanical approaches we seek to implement the neural control of the body—effectively merging biology and robotics in the arena of physical function. We have coupled real-time neuromorphic implementations of stretch reflex circuitry in populations of spinal neurons, to electric motors controlled by real-time models of muscle function to apply forces to the tendons of actual human cadaveric fingers. This is the first neuromorphic neuromechanical system, to our knowledge, that has put our understanding of fundamental sensorimotor mechanisms in the spinal cord to the ultimate test of physical implementation. Importantly, the behavior emerges from the system as it is not prescribed beyond the nature and connectivity of its elements. An added advantage is that one can also ‘record’ from single or multiple neurons, motor units, afferent nerves, etc. to explore emergent behavior at truly multiple scales. So far, this approach has allowed us to begin to understand cardinal features of afferented muscles of human fingers to replicate fundamental features of healthy muscle tone, hypo and hypertonia .
While still an imperfect approximation, this neo-Sherringtonian approach helps us test arguments about which specific features of spiking neurons and their connectivity, spindle function, fusimotor drive, descending commands, finger anatomy and tendon/skin/joint tissue properties suffice to produce realistic healthy and pathologic behavior in afferented muscles acting on anatomical fingers. Moreover, this has the advantage of using physical behavior as the ground truth for the evaluation of functional performance.
A combined neuromorphic and neuromechanical approach, although grounded and developed for neuroscientific applications, could potentially inspire robotics research and design by revealing insights into how complex behaviors emerge from adaptation of neural controllers to mechanical properties of physical systems.
Fundamental differences between biological and robotic systems
From the perspective of biological vs. robotic closed-loop behavior, a striking difference is the superior ability of the nervous system to utilize and effectively integrate information acquired through an incredibly wide array of nonlinear, delayed, noisy, non-collocated and distributed sensors (for review, see ). Important advances have been made in our understanding of how multimodal sensory information is integrated to make possible the ability of humans to extrapolate sensory information based on the statistical properties of stimuli , as well as its vulnerability to sensory illusions .
Remarkably, the hand’s sensory system endows humans not only the ability to perform online sensing of the state of the system (e.g., contact onset and offset) [79, 80], but also to use sensory information acquired through past hand-object interactions to predict sensory consequences stemming from planned interactions [81, 82]. Even more impressive is the exquisite ability of vertebrates to perform ‘active sensing’ (e.g., whisking in rodents [83, 84]) and tactile exploration in humans of the shape, texture, features and mechanical properties of objects [85, 86]4. In active sensing, motor actions are explicitly driven to extract relevant sensory information . This has led some to express that the human hand is as much a sensory organ as a motor effector .
In robotics, sensory data are central to feedback control . The idea of extending the use of sensory data beyond feedback to also extract the properties of a system is called system identification  or ‘plant inversion’ [79, 90]. That is, characterizing the effects of command signals (i.e., the input-output characteristics of the plant) can be done when the process is inverted mathematically (i.e., find the output-input characteristics), analytically or experimentally. Hence the term ‘plant inversion.’ System identification has been an extensive field since the middle of the last century [57, 91], and continues to make progress as sensors and algorithms improve, and processing power increases [92–95].
An important challenge in tactile sensors is their problematic placement at the fingertips, where they are exposed to damage [96, 97]. A notable advance has been the biomimetic idea by Loeb and Johansson to develop the Biotac [98, 99], where the fingertip itself is a rugged and ribbed rubber balloon (much like a fingerpad) inflated with conductive fluid over the distal bone. Static and dynamic contacts with objects produce changes in hydrostatic pressure and electrical impedance in the fluid that produce a rich and time-varying multi-dimensional sensory signal. The commercial version of this system is now being incorporated into multiple robotic hands . It is even being deployed to create industrial standards for the perceptual aspects of touch such as smoothness, roughness, silkiness, richness, quality, etc. Solving the difficult signal processing challenges that this type of tactile sensor presents has the potential to imbue robotic hands with truly robust and useful synthetic touch. Solving the computational challenges of sensory fusion (let alone active sensing) in robotic and prosthetic systems is a critical frontier. There are even efforts at the interface of prosthetics and robotics to translate touch information from prosthetic hands into neurostimulation to restore the sense of touch (e.g., [101–103]).
Artificial feedback approaches, of course, extend beyond these examples of sensors located on the fingertips, and include artificial skins with embedded strain gauges (e.g., ) and vibrotactile feedback used in prosthetics delivering information about mechanical events (i.e., contact) to the residual limb (e.g., ).
Nevertheless, the necessity of sensory information for manipulation has been challenged by practical examples of sensor-less fully open-loop grasp [46, 48, 53, 106, 107], and pre-planned manipulation . It is therefore most likely that in biological systems—and by extension in robots—sensory information is most useful during learning  (see section on learning below).
Chief among these is our inability, so far, to match the power:weight ratio, mechanical efficiency, versatility, adaptability and self-repair properties of muscle. A pneumatic analog to muscle was first developed by McKibben in the 1950’s [109–111] and continues to be used and studied [112, 113], but the need for compressors/pressurized tanks, valves, cables, mufflers, etc. remains a challenge to its portability and versatility. Electric, hydraulic and pneumatic actuators are, of course, the mainstay of robotics. The last two decades have seen great progress in the technology to control  and power useful and portable exoskeletons and prostheses [115–117]. Moreover, battery life has improved by several orders of magnitude [118–120]. However, muscles remain unmatched in the continually surprising variety of mechanical functions they accomplish in locomotion and manipulation; serving as motors, brakes, springs, struts, etc. [121, 122].
From the architectural perspective, contractile proteins in muscle can only make muscles actively pull on their tendons, which attach to bones after crossing joints [123, 124]. Consequently limb function in vertebrates is tendon-driven, not torque-driven as in the mathematics and dominant practice of robotics.
A recent conceptual advancement in the study of sensorimotor control in vertebrates comes from embracing and emphasizing the fact that muscles act on the body via tendons . While this has been obvious since the very first anatomical studies of antiquity, most modern engineering, neuroscience, biomechanical, and mathematical analyses have tended to prefer the torque-driven abstraction. To be fair, the torque-driven phrasing of the problem is attractive, mathematically correct, and well developed from the conceptual, analytical and computational perspectives. In it, rotational motors at each hinge joint produce torque, angle, or angular velocity directly, which give rise to the kinematics and kinetics of the limbs and fingers they control. The actions of muscles in a simulated biological system are, thus, collapsed into net joint torques at each joint. Then, their analysis proceeds as with any other robotic system. But there are several arguments concluding that this abstraction can be misleading as it does not represent the actual mechanical problem of controlling tendons, which is the actual problem the nervous system confronts. Due to recent advances in the tendon-driven formulation of limb and finger function (e.g., [54, 125–129]), we are now better able to focus on the actual tendon-driven mechanical problem that confronts the nervous system. In fact, as argued in , many of the conceptual/mathematical problems associated with the analysis of the neuromuscular control of biological limbs can be clarified by using this perspective.
Due to the above-described limitations of scientific inference, it is not surprising that competing views exist on the model (i.e., hypothesis, strategy) that best explains the nervous system’s exquisite ability to control movement, locomotion and manipulation; as well as its uncanny ability to generalize and adapt learned motor behaviors. For example, the concepts of ‘internal models’ and ‘optimal control’ can capture significant features of motor behavior, but it has been challenging to associate these theoretical frameworks with specific anatomical structures or physiological mechanisms. It is only natural that some of these models have been inspired by the formalism and successes of robotics and control theory, which in turn have been influential in driving experimental approaches and theoretical frameworks (for review, see ).
However, even a cursory comparison between how robotic and human hands reach, grasp and manipulate objects reveals major differences between them. Some differences stem from ability of the neuromuscular system to implement versatile transitions, adjustments and adaptations of control strategies. One example is the ability of the hand to swiftly change control strategies when transitioning from finger motion to force application . Another example is humans’ ability to modulate finger force distribution shortly after contact and prior to onset of manipulation to account for trial-to-trial variability in finger placement [132–136]. Such problems are extremely challenging to replicate in a robotic system. Other differences emerge from the hand’s unique anatomical structure, which allows it to adapt to task demands including passively shaping itself to object geometry. These are differences that robotic designs can partially address (see ‘Under- vs. Over-actuated control’ section), but cannot fully match given the limitations of robotic systems in actively integrating sensory feedback with motor commands, or passively adapting to objects and the environment.
Advantages and limitations of control theoretic approaches to biological sensorimotor control
These fundamental differences motivate and justify a candid evaluation of the extent to which our conceptual approaches to robotics are appropriate for the study of sensorimotor control in biological systems. As mentioned above, the approach to biological sensorimotor control has, for historical and practical reasons, leveraged the formalism of robotics and control theory (e.g., [29, 54, 137, 138]). At the risk of oversimplifying a large field for the sake of succinctness, we can describe real-time feedback control as follows: sensors transduce physical signals to estimate the performance of the system, which the controller considers as it applies control laws to take the next actions to correct mistakes, reject perturbations, and meet the constraints of the task to achieve a goal. It stands to reason that the neuromuscular control of biological systems can perform all of these functions. Therefore, control-theoretic constructs likely apply (e.g., [139–143]). Such an approach is justified by the successes in identifying neural circuits that perform closed-loop feedback control such as homeostasis in physiological control systems , muscle stretch reflexes , and vestibulo–ocular reflexes for eye tracking in the presence of head rotation [146, 147].
Why is it that such a well-founded approach has failed to produce conclusive theories for sensorimotor control in humans for grasp and manipulation?5 One possibility is that sensorimotor control for grasp and manipulation is unlike other forms of motor control because its motor actions involve perception, as well as more complex sensorimotor transformation processes than, say, cyclical movements for locomotion. The importance of the interaction between perception and action has been convincingly argued by, for example, Prinz, Iberall and Arbib [148–151]. This is further exemplified by other work bridging this perception-action gap [152–157].
This conceptual divergence across biological and robotics problems can perhaps be explained by assessing some fundamental features of the robotics perspective, and their appropriateness for the study of sensorimotor control in biological systems. Earlier, we spoke of the control-theoretic framework that defines interactions among sensors, control laws and the goal of the task. A more formal presentation is that the control laws operate to change the ‘state’ of the system. The formal definition of the state of a system is the minimal set of variables to characterize its governing equations, or that can be used to describe its dynamical evolution [29, 55, 158]. Thus, control theory is based on actions that will effectively and appropriately change the state to reach a goal, track an external process or reject a perturbation on the basis of a user-defined optimization criterion (often called objective or cost function). In fact, the definition of ‘controllability’ is to be able to arbitrarily move a system from any state to any other state in finite time. Its counterpart is ‘observability,’ which is the formal quantification of the ability to arbitrarily extract the state of the system from measurements obtained by sensors [159, 160]. When designing a robotic system, its state variables are explicitly chosen by the user from the many potential options, such as joint angles, angular velocities, endpoint locations, velocities, etc. Implementing observability via methods of state estimation is a form of system identification that spans a wide set of techniques, and which is central to any control-theoretic approach applied to robotics and models of biological function [35, 158, 161].
The field of neuromuscular control has come to the realization that it is still an open question whether and how the nervous system adopts the concept of state, and even whether it optimizes an explicit or implicit cost function [54, 162, 163]. This realization has been slow and reluctant because abandoning the sound engineering formalism is both unappealing and unnecessarily extreme. Thankfully, the past several decades have seen, as described below, the development of equally well-founded alternatives or complements to the classical control theoretic perspective that mitigate the drawbacks of state estimation, cost functions and even control laws. Furthermore, there are many other techniques and approaches that have yet to be applied to biological problems .
Feasible rather than optimal function
Optimization is a computationally efficient means to use convex, preferably quadratic, cost functions to select a specific control action from among all feasible actions within a high-dimensional solution space. For example, if you have N muscles crossing a joint, optimization can be used to search an N-dimensional space to find a point in it (i.e., a combination of muscle activations) to produce a given net joint torque while minimizing, say, the sum of squares of activations.
Roboticists have always used optimization to control robots. Be it to tune gains in the P, PD or PID controllers to implement force, impedance and position control , plan paths (e.g., ), etc. In fact, the ubiquitous of state estimators (such as Kalman Filters) are in fact optimal solutions in the least-square sense . In addition, this emphasis on optimality is central to Optimal Control  in its various modern forms LQR, LQG, iLQR, iLQG (e.g., ). From its inception, however, which has led to other forms of control such as robust control, path integral control, model predictive control, etc. [67, 167–169].
Biomechanists and neuroscientists have, nevertheless, adopted the well-founded mathematical concept of optima to cast the problem of neuromuscular control as one of numerical optimization [139, 170, 171]. However, it is unlikely that the nervous system acts strictly like a computer running optimal control, gradient descent or policy gradient algorithms. Rather, optimization has and should be used as a metaphor, but one that should not be taken too literally when working with biological systems [162, 163].
We must recognize that, as with any metaphor, there are limits to its validity. It is important to explicitly acknowledge a bifurcation in the approaches we use to build robots vs. understand biological systems. For example, recent advances in control have begun to yield very impressive real-time performance in physical robots [68, 172–174]—but there is no need to insist that biological systems use those methodologies or algorithms.
Nevertheless, scientists studying biological systems must ask themselves how faithful they want to adhere to physiological realism and, on the basis of that decision, select appropriate problems and solution methods—while also avoiding the temptation to necessarily imbue biological systems with mathematical algorithms, or solutions with physiological meaning.
An approach we can call Feasibility Theory is an alternative to optimization. It tackles and solves the computationally expensive problem of explicitly defining and finding families of valid solutions (i.e., a ‘feasible muscle activation set’). In doing so, we can characterize the set of options open to the nervous system without having to advocate a particular (and debatable) cost function [54, 175, 176]. These families of feasible muscle activations have a well-defined, low-dimensional structure because they emerge, unavoidably and naturally, from the interactions among the known mechanical and physiological properties of the limb and the functional constraints of the task (which can be mechanical, metabolic, physiological, etc.). That is, if you have a limb with 9 muscles and you are producing a task with five constraints (e.g., the x, y, z magnitude of the force vector produced by the endpoint of the limb, and the stiffness of the endpoint in the x and y directions), then the solution space is a 4-dimensional (i.e., 4=9-5) subset of the 9-dimensional activation space [177, 178].
More generally, thinking of the problem of controlling muscles as one of exploring and exploiting solution spaces is perhaps biologically tenable. Biological systems could use sparse trial-and-error learning to find and explore feasible activation sets. That is, implementing any point within the low-dimensional feasible solution space will be adequate to perform the task. Memory and pattern matching could be used to exploit the ‘information’ collected from prior experience in the context of the current environment and task goals .
Probabilistic sensorimotor control
What information does the nervous system use to produce physical behavior? And how does it assemble, encode, store, access and use that information? A promising approach is a probabilistic one, where trial-and-error can be combined with memory to form probabilistic representations of actions in the physical world. Bayesian inference [179, 180] or stochastic control  are formal approaches to describe the emergence of probability density functions of the mapping from perception/intention to action in the presence of unavoidable uncertainty, noise, risk and variability in the real world. Moreover, there are probabilistic approaches that can be used with populations of spiking neurons to produce physical behavior in a cost-agnostic, emergent, model-free way [72, 73, 181, 182].
Probabilistic approaches to control have their origins in robotics, where noise, uncertainty about the state, properties of the plant, dynamics of the coupled robot-world system, etc. have always posed challenges. One can argue that such probabilistic models can be considered model-free or semi-model free because there is no explicit representation of the body or world, other than from the statistical representation of the results of trial-and-error experiments that inform the learning of a successful policy (i.e., control law or motor habit) that is valid in the neighborhood of some initial conditions to meet a specific goal [169, 183].
Along these same lines, it is also possible that the controller itself is ‘embedded’ in the structure of the hand. Thus, there would be no need to regulate the manipulation task, but rather that the mechanical architecture of the hand naturally leads to adequate and versatile grasping function. This is sometimes called embedded logic or underactuated control, as described below [46, 48, 53, 106, 107, 184].
Paradoxes and insights
Under-determined vs. Over-determined mechanics
One of the central tenets of motor control has been the concept that the control of biological systems is under-determined, meaning that they have ‘too many’ kinematic or muscular degrees of freedom. Therefore, the nervous system faces a problem of selecting and implementing a solution from among an infinite set of choices.
Such kinematic redundancy can be demonstrated by simple examples such as the possibility of using any one of multiple arm trajectories to hammer the same location in space , or one of multiple types of grasps to hold the object just as well . From the muscle control perspective, vertebrates have multiple tendons crossing each joint, then there are multiple individual muscle forces that can produce a given net joint torque . In contrast, roboticists have emphasized design architectures to reduce kinematic and actuation redundancy and typically build robots with as few kinematic degrees of freedom or tendons to be controllable.
This begs the question why the evolutionary process has tended to converged on such so-called under-determined mechanical systems for vertebrates. As reviewed in , thinking of biological systems as under-determined is paradoxical with respect to the evolutionary process and clinical reality. For example, why would organisms evolve, encode, grow, maintain, repair, and control unnecessarily many muscles when a simpler musculoskeletal system would suffice, and thus, have phenotypical and metabolic advantages? Why do people seek clinical treatment for measurable dysfunction even after injury to a few muscles, or mild neuropathology? Which muscle would you donate to improve your neural control?
Somehow, however, many muscles are a good thing. Given the evolutionary process, we probably have close to the right number of muscles to allow us to produce useful behavior in the real world6. One approach to explain the apparent paradox that we have ‘too many’ muscles in vertebrates is that every muscle expands our abilities and provides an additional degree of freedom for control. Behavior in the real world7 consists of satisfying multiple—at times competing—demands. Therefore, a mathematical argument can be made  that behavior in the real world, by virtue of needing to satisfy multiple demands or constraints, requires multiple muscles . And, by extension, that dysfunction of even a few muscles will make the limb less versatile .
Similarly, kinematic redundancy loses its relevance when we consider that limbs are actuated by muscles that pull on tendons. It is clear that, if multiple tendons cross each joint, then there is redundancy in the sense that multiple individual muscle forces at those tendons that can produce a given torque. However, the same is not true when we consider movement. The rotation of that single joint defines the lengths of all muscles that cross it [54, 176, 188]. While in principle muscles can go slack, muscles with tone will shorten appropriately. However, muscles that lengthen must do so by a prescribed amount. Thus, the relationship where a few joint angles and angular velocities for a given limb movement determine the lengths and velocities of all muscles is over-determined—the very opposite of redundant. That is, if any one muscle that needs to lengthen to accommodate the movement fails to do so (because, for example, it received the incorrect neural command or its stretch reflex fails to be appropriately modulated in time), the movement will be disrupted [54, 176, 188]. Therefore, while multiple limb kinematics may be equivalent from a task perspective (i.e., reaching a cup or throwing a ball), they are far from equivalent from the perspective of neurophysiological control, robustness to sensorimotor noise, or time-critical modulation of activation and reflexes .
Grasp vs. Manipulation
Another recent evolution in the biological side has been the explicit distinction between grasp and manipulation. Although these terms are often used interchangeably in the biological literature, there is a long tradition of creating clear taxonomies and descriptions of hand actions that clearly distinguish between the two [27, 29, 149, 189]. Specifically, grasp in general relates to the act of seizing an object by wrapping the fingers around it. Manipulation has a more general connotation of imparting change to an object or process. However, precision or dexterous manipulation is a more specific term reserved for cases where only the fingertips make contact with the object, not simply to grip the object, but to be able to act independently to produce in-hand manipulation.
Interestingly, most biological research has focused on grasp [27, 29, 48]. Largely because studying precision or dexterous manipulation has important practical difficulties with motion capture of individual finger motions, and measurement of individual fingertip forces. Similarly, in spite of the mathematics of dexterous manipulation being well developed , robotic hands and prostheses tend to focus on grasp because of the difficulties in designing, building, and controlling fingers and finger contacts independently.
There have been some important advances, however. For example, it is possible to begin to simulate contact forces that go beyond physics engines for gaming or animation . Similarly, some experimental methods have been developed to quantify dynamic dexterous manipulation, which has revealed novel aspects about the neuromechanical control of dexterous manipulation in development, adulthood, healthy aging and neurological conditions (for overviews see [42, 190–194]), as well as how the interaction between cognitive and biomechanical factors affect dexterous manipulation performance (e.g., [132, 133, 195]).
Under- vs. Over-actuated control
Similarly, it is reasonable to ask to what extent the nervous system is necessary for grasp (and perhaps even manipulation). It is an analogous question to what has also been recognized for passive dynamic walkers [196, 197]. While effective mechanical function can be found in many, primates (and humans) are the beneficiaries of highly specialized neuroanatomical coevolution of brain and hand (e.g., [2, 41, 198, 199]). Understanding the contributions of a neural controller, or specific neuroanatomical areas of the brain, to grasp and manipulate remains an active area of study. In fact, it is critical to consider moving away from a strictly somatotopic  and cortico-centric view of manipulation, especially in the cases of dynamic dexterous manipulation where time delays preclude active involvement .
After all, the current concept of cortical control is not the exclusive micromanagement of individual muscle activations, but rather includes the ‘binding’ of motor neurons into flexible, context-dependent functional groups [201–203], the utilization of primitive ‘synergies’ prepared by networks of spinal interneurons , adjustment of sensory feedback gains , and the formation/recall of motor memories , to name just a few. Synergies are discussed in more detail in subsequent sections.
Nevertheless, as in the case of passive dynamic walkers, robotics provide counterexamples to such micromanagement of muscle actions by the brain, or even the nervous system in general. A class of robotic hand designs is called under-actuated because few motors drive multiple degrees of freedom (this is in contrast with over-actuated hands that have enough to control every degree of freedom independently). Such hands can display multiple versatile grasp functions, without requiring a controller [53, 107] or even fingers . Such developments are alternatives that promise to develop multiple designs along the spectrum between under- and over-actuated robotic hands. This is especially useful in cases of brain-machine interfaces for hand prostheses, where only a few degrees of freedom of control can be extracted from the human pilot’s nervous system (e.g., ).
Learning vs. Implementation vs. Adaptation
Human sensorimotor learning has been extensively studied [80, 130]. One view posits that humans’ ability to perform skilled motor behaviors relies on learning both control and prediction through inverse and forward internal models (implicit, explicit, probabilistic or otherwise). Specifically, a given control strategy generates motor commands needed to create desired consequences (e.g., a given reach trajectory or grasping an object at specific locations), whereas prediction maps motor commands (i.e., efference copy) into expected sensory consequences (e.g., object contact or onset of acceleration at object lift off [209, 210]). The mechanisms proposed to account for updating of these internal models may or may not include errors that would occur when a mismatch between sensed and predicted sensory outcome occur, i.e., error-based learning (e.g., [211–213]) and use-dependent learning (e.g., [214–217]). However, most of what we know about human sensorimotor learning for reach has been derived from studies of reaching movements over distances of ± 10—14 cm, and their adaptations to force fields or visuomotor rotations. Relatively little is known about mechanisms underlying sensorimotor learning of grasping and manipulation.
We have known for decades that finger force control used in previous manipulation can influence how forces are coordinated on the current manipulation through the memory of an object’s physical properties [81, 82, 218]. More recently, it has been shown that humans may acquire and retain multiple internal representations of manipulation [219, 220]. Later studies provided further evidence supporting the concept of multiple sensorimotor mechanisms and how their different time scales may interfere with generalization or retrieval of previously learned manipulation —even when the object being manipulated is the same. A recent study has provided evidence for the co-existence of context-dependent and independent learning processes , which would operate similarly to those described for adaptation of reaching movements . The advantage of context-dependent representations of manipulation is that they can be recalled when the object has strong contextual cues (i.e., object geometry and perhaps other perceptual attributes). In contrast, context-independent representations are more sensitive to the practice schedule used to learn a given manipulation, but might be particularly advantageous when the upcoming context has no context cues. That is, in the absence of information to the contrary, it is preferable to repeat the most recent manipulation strategy even though it is not guaranteed to be the correct one.
When considering parallels between the above-described framework for learning of dexterous manipulation in humans with learning manipulation by robotics systems, it has been suggested that artificial controllers could take advantage of select features of the biological framework. Specifically, and as reviewed in , multiple parallel learning mechanisms could benefit robotic learning of manipulation tasks to afford to deal with structured and unstructured environments. At the same time, the detrimental effects or interference of neural representation built through learning in one manipulation context, and then transferring it to another context can be theoretically minimized or bypassed when designing an artificial controller. Some examples of successful robotic learning for grasp and manipulation show that this is possible [172, 173, 224, 225]. Of course, these theoretical considerations assume that building multiple representations of learned manipulations allows them to operate independently, something that—as described above—clearly also challenges biological controllers.
Another biologically inspired phenomenon that could be of value to robotic manipulators is finger force-to-position modulation. Briefly, it has been shown that humans are able to modulate manipulative forces in an anticipatory fashion, i.e., between contact and onset of manipulation, according to where the object is grasped [132, 133]. This phenomenon, which has been confirmed by several studies [134–136, 226], ensures attainment of the manipulation goal despite trial-to-trial variability in finger placement that may naturally occur while using the same or different number of fingers ( and , respectively). Finger force-to-position modulation is a phenomenon that is very useful for inferring its underlying neural control mechanisms. Specifically, for humans to be able to adjust finger forces as a function of variable position, a ‘high-level’ representation of the task (e.g., a given compensatory torque) is required, rather than learning a fixed finger force distribution. Additionally, such high-level representation has to drive how sensing of the relative position of the fingers is used to implement the appropriate finger force distribution by the time the learned manipulation is initiated. As finger force-to-position modulation affords biological systems to be very adaptive—a given manipulation can be performed without having to grasp an object exactly in the same way each time it is being manipulated—one can envision important robotics applications. These include controllers that are designed to build, through extensive training, the high-level representation of a task performed in many different ways. If such high-level representation could be built, stored, retrieved, and designed to interact with artificial sensing of finger positions, such a controller should theoretically be able to be adaptable to manipulators that differ in terms of number of joints or fingers. Such a controller could be shared by multiple representations learned through training of manipulation in structured and unstructured contexts.
Another important distinction to be made is that, as roboticists, we marvel at the learned capabilities of biological systems. However, we tend to forget how difficult it is for organisms to learn and maintain that level of performance. Recent work has begun to elucidate why learning to produce accurate, smooth and repeatable movements takes immense amounts of practice even in typically developing children , why so few of us can become elite musicians or athletes , and why rehabilitation requires very intensive practice . That is, controlling our bodies is not as easy as it appears. We are seeing the result of millennia of co-evolution and years of development, training and learning. Moreover, in the case of manipulation, we have co-evolved environments, objects and tools to match the capabilities of our hands. The design of airplane cockpits, left- and right-handed scissors, frets in string instruments, the key system in clarinets, and touch screens are but a few examples.
Thus, biological hands in particular have an unfair advantage over robotic hands and prosthetics. Engineers should explicitly begin to decide what functionality and control to embed in the mechanics of the system, what control algorithms to use for learning vs. standard performance vs. elite performance vs. adaptation. It is not unreasonable to propose that robotic hands, once built, should undergo a developmental learning process (a ‘robot kindergarten?’) to learn the specific control algorithms, motor habits, and statistically useful anticipatory strategies defined by their intended use or—in the case of prosthetics—the environment, job and preferences of their human pilot. Insisting on a one-size-fits-all, real-time control approach to robotic hands has been shown to be overly ambitious, and even unnecessary as demonstrated by the capabilities of the under-actuated hands mentioned above (e.g., [46, 107]), as well as grippers with no fingers at all . Some salient examples of such learning (and re-learning) come from [230–232].
Prescriptive vs. Descriptive synergies
What are the debates in the study of synergies in biological systems? A root cause of the debates is the nature of scientific inference based on experimental observations. The fact that experimental recordings detect dimensionality reduction is not surprising because sensorimotor control must, by definition, select motor actions from the low-dimensional subspace of feasible actions . Therefore, disambiguating prescriptive synergies of neural origin (those that are prescribed by the nervous system as a control strategy) from descriptive synergies (those that describe the expected dimensionality reduction) is difficult [48, 177]. Thus, the main question is not whether the nervous system inhabits a low-dimensional solution space to perform tasks, but rather how it does so [177, 233–235]. Moreover, although several tasks can share the same general features captured by such dimensionality reduction, it is perhaps the fine details particular to each task that maybe critical to their performance .
Biological ‘controllers’ co-evolved with mechanical systems whose operations are characterized by a very large number of elements—e.g., motor units, muscles, and joints—while relying on their spatiotemporal coordination and adaptability to task demands. The refinements afforded by such evolution can be appreciated when examining the efficacy of the neural control of several complex motor behaviors, including but not limited to speech production, locomotion, and manipulation. When examined in detail, researchers were surprised and intrigued to see that those functionally complex behaviors that involve the control of many variables (like the 20+ angles for the joints of all fingers) in reality evolve in a lower-dimensional space (i.e., can be well approximated by roughly 5 variables) . Such motor synergies have also been observed in the phase-locked coordination (or correlated action) of multiple muscles that produce complex behaviors [236–238]
The theoretical framework of synergies has been extensively used and tested to account for the nervous system’s ability to control multiple muscles and multi-joint movements (for reviews see [239–241]). Synergies would operate by constraining the spatial and temporal activation of multiple muscles. Therefore, the existence of consistent covariation patterns in electromyographic (EMG) activity or joint excursions, whose structure can be spatially and/or temporally modulated according to task requirements, would be compatible with the synergy framework. Synergies have also been used as a framework to understand pathological coordination of movement (for reviews see [242, 243]). However, longstanding issues remain regarding the extent to which synergies can be considered ‘fixed’ building blocks of movements, the extent to which they are modifiable as a function of task demands, adaptation and perceptual context, as well as their very role in facilitating sensorimotor learning in tasks that may benefit from, or be penalized by a synergy-like control structure  (for a review see ).
When considering the biomechanics of hand muscles, the existence of anatomical constraints would support synergistic actions of the fingers. These constraints can come from, for example, finger muscle-tendon complexes spanning several joints and passive linkages among tendons . Such synergistic actions have been described as subject-independent finger kinematic patterns for grasping [47, 245] (for review see ), as well as coupling of finger movement or forces among non-instructed fingers when humans are asked to move or exert force with one finger [246, 247] (for review see ). Early attempts to define the control of individuated finger forces in cortical neuron activity revealed a much more complex picture characterized by broadly distributed activity . More recent work in non-human primates, however, supports an organization of cortical activity that is compatible with the synergy framework . When searching for neural correlates of synergies in humans, a recent study revealed that the cortical representation of hand postures can be better accounted for by using a synergy-based network than somatotopic or muscle-based models , which is compatible with the view of cortical organization of finger movement being shaped by habitual use , and even goal equivalence in finger actions being implemented at a cortical level .
Many studies have attempted to identify synergies at different levels of biological systems and species, including primary motor cortex , spinal cord , motor units [254–256], motion [47, 257], and forces [258–260]. However, the functional role of synergies has been debated for decades, partly due to the fact that the operational definition of synergies can vary significantly depending on several factors, including the level of the system at which they are analyzed, the methods used to quantify them, and the tasks used to prove or negate their existence (as discussed in ; see also ). Among the conceptual frameworks that have been proposed, synergies would be instrumental in reducing the number of independent degrees of freedom that the nervous system has to control as originally proposed by Bernstein , or ensuring attainment of task goals by minimizing the variance that would be detrimental to performance [237, 262, 263]. An alternative interpretation of the role of synergies, however, points out the difficulty of interpreting synergies as the root cause of multi-muscle coordination or a byproduct of mechanical interactions between the biological system and the environment .
Robotics, in contrast, synthetically designs, assembles and operates engineered systems where synergies can be prescribed. Over the past two decades, roboticists have exploited the concept of (prescriptive) synergies to design robotic hands (for review see ). Examples of these designs include the Pisa/IIT SoftHand , whose design was based on the kinematic synergies extracted from grasping a set of imagined objects , as well as devices to constrain motion of human fingers for rehabilitation of sensorimotor function . Here, the underlying design motivation is to capture human-like kinematic features, i.e, simultaneous motion of all fingers, by using a significantly smaller number of actuators than joints. Preliminary clinical applications of this approach for prosthetic applications have shown that individuals with upper limb loss can quickly adopt such synergy-based design with minimal training . A major goal and challenge for robotic grasping and manipulation is the implementation of force control using kinematic synergies. The results of computational modeling suggest that the first few hand postural synergies may play an important role for attaining force closure . Nevertheless, it remains to be investigated the extent to which robotic motion-to-force transition can fully leverage a synergy-based motion-to-force coordination. Experimental evidence and theoretical frameworks developed by studies of human multi-finger synergies might potentially be used to inspire a hierarchical control of high- and low-level grasp variables (i.e., task goal and distribution of individual fingertip forces, respectively) , as well as ‘default’ vs. task-dependent modulation of fingertip force distributions . Nevertheless, a major challenge, both from neuroscientific and robotic perspective, is evaluating the role of sensory feedback elicited by object contact and force production on the coordination of multiple (human and robotic) fingers.
The literature on the biological and robotic approaches to grasp and manipulation is large, and has experienced exponential growth in the past two decades. The reinvigorated interest in this topic has come, as in past conflicts, from governments attending to wounded soldiers and civilians who survive traumatic loss of limbs (e.g., the DARPA program to Revolutionize Prosthetics), from the need to improve the quality of life of individuals with stroke, cerebral palsy and other neurological conditions that now have greater survival rates, and from recent advances in autonomous and humanoid robots for whom manipulation remains a litmus test for performance. A positive feature of the latest developments has been the greater and fruitful cross-fertilization between biology and robotics approaches. It is no longer an aberration to have engineers who are well versed in neuroscience working in robotics or neuroscience, or neuroscientists who are well versed in engineering working on scientific problems or robotics. This greater interaction across fields, however, has the added burden of needing to understand and keep current on two vast and rapidly growing fields—which has led to confusion of terms and principles, duplication of efforts, loss of nuance in translation, and lack of familiarity with fundamental concepts.
Thus, our goal here is to provide researchers working in these fields the briefest of overviews of advances (conceptual and material), pitfalls, and open questions. In particular, we aimed to provide specific examples to clarify when and why a better understanding of the biology of grasp and manipulation would benefit robotic grasping and manipulation. Namely, the evolutionary process has yielded organisms that can produce versatile function even when cherished engineering principles are not present and biological systems operate well in spite of having noise, delays, nonlinearities, etc. There are many lessons learned, described above, such as hierarchical and open-loop control, morphology that simplifies the control problem, the utility of having multiple muscles, etc. Conversely, engineering thinking has provided well-founded principles of mechanics, mathematics and control engineering to aid the scientific work aimed at understanding the abilities of human hand. Some salient points are:
Deductive vs. synthetic science
Engineering approaches to understand biology—and biology as an inspiration to engineering—have generated a rich repertoire of experimental and theoretical advances in both areas. However, it is important to be aware of fundamental differences and inherent limitations of scientific vs. synthetic approaches. It is the recognition of these differences that needs to guide work in each field and in their interactions. This will allow those interactions to be as fruitful as possible.
The mathematics of robotics has contributed greatly to our ability to study biological limbs and hands. Unfortunately, the joint-torque formulation—while valid and correct—can oversimplify the nature of the problem that confronts the nervous system. At its core, the control problem the nervous system faces is one of linear actuators (muscles) that can only actively pull on tendons. We have revisited the redundancy problem while also emphasizing that the control of forces is distinct from the control of movements. This has allowed us to clarify many aspects of biological function and dysfunction. For example, it is now clear that muscle redundancy to produce a set of net joint torques is not as great as once thought. This is because the set of feasible muscle activations has a very strong structure. Similarly, kinematic redundancy is greatly constrained because different movement are not entirely equivalent. From the perspective of muscle excursions and the regulation of stretch reflexes, each natural movement in fact represents an over-determined problem (the opposite of redundant), where muscle activations and reflex modulation must follow very specific spatiotemporal patterns. This all begins to explain why it is so difficult to learn to use our limbs and hands (i.e., it takes years of practice), why dysfunction arises even from minor neuromuscular damage, why rehabilitation is so difficult, and why limbs have evolved to have ‘so many’ muscles. Roboticists can use these lessons to revisit their design specifications, which often prefer torque motors or a sparse architecture where each joint is controlled by two dedicated tendons.
From motor towards sensorimotor
Sensory feedback plays critical roles in human grasp and manipulation for building internal representations that are considered critical for predicting sensory consequences of hand-object interactions; and for online sensing of those interactions. This dual nature of sensory feedback (e.g., exploration-exploitation learning-execution) is particularly challenging to capture in robotics. From the technical perspective, replicating human tactile function has proven difficult, although there have been recent advances not only in sensor hardware development; but also in the expansion of prostheses to explicitly add hand proprioception and touch interfaces (i.e., DARPA’s HAPTIX program). But equally important, the field has begun to recognize that the use and sensory function may change as the learning process evolves. Thus, as in biological systems, on-line monitoring and processing of sensory information is necessary at first, but can actually be counterproductive and slow down performance once learning has stabilized. Thus, hierarchical, distributed and state-dependent gating, processing and use of sensory information is yet to be well understood in human hands, and should be a goal of robotic systems.
Grasp is not manipulation
Grasp and dexterous manipulation, although often used interchangeably in neuroscience literature, are fundamentally different and challenge biological and robotic controllers in unique ways. In robotics, greater advances have been made in grasping than manipulation. Some important advances are being made to understand and implement the ability of fingertips to produce motion-to-force transitions, force-to-position modulation, and in-hand object re-orientation/re-configuration, mostly in simulation [267, 268]. The challenge is now how to design and build robotic hands with the mechanical, motor and sensory abilities to implement those behaviors. This is a very promising and necessary direction for research. On the biological front, the new approaches to understand dynamic dexterous manipulation with the fingertips allows the quantification of performance. But more importantly, those findings challenge the dominant cortico-centric view of manipulation, and highlight the importance of considering subcortical, spinal and neuromechanical contributors. This further motivates the exploration of hierarchical and distributed mechanisms that allow such versatile capabilities in the presence of delays, noise and uncertainty. Such evolution in our thinking promises to revolutionize our understanding of the mechanisms that enable healthy function, explain disability, and inform rehabilitation. Combining future developments along these parallel lines of work also promises important developments in the evolution of the design and control of robotic and prosthetic hands.
Neuromorphic vs. neuromimetic
Unlike neuromimetic approaches aimed at capturing aspects of neural function without biological structures or processes, neuromorphic approaches seek to replicate (to the extent possible) the biological components and mechanisms at a particular scale. This allows us to ask whether and how neuromechanical function can emerge without being defined a priori. This allows us to understand the extent to which the implementation of the structures and processes (i.e., spiking neurons, delayed transmissions, muscle nonlinearities) define and contribute to function, and the different presentations of dysfunction. Thus, neomorphism is proposed as a means to reconcile engineering and biology, as well as accelerate their cross-fertilization.
Prescriptive vs. descriptive synergies
Synergies have been defined and studied by neuroscientists as building blocks of complex movements based on observations made at different levels of the neuromuscular system. Although their fundamental characteristics and functional role remain to be established, the concept of synergies has inspired robotic and prosthetic hand design not only to simplify control, but also to capture human-like motion features— being particularly important for assistive technologies where there are few degrees of freedom for control and the prosthetics are underactuated. From the conceptual perspective, however, it is important that we recognize that the execution of a task will always exhibit dimensionality reduction in the control, kinetic and kinematic variables because they are, by definition, inhabiting the subspace of feasible actions that satisfy the constraints that define the task. Therefore, it is to be expected that (descriptive) synergies will be detected when studying function. Nevertheless, interesting, valid and open questions remain in our understanding of whether and how the healthy and damaged nervous system implements (prescriptive) synergies to inhabit those subspaces (i.e., the feasible activation manifold for a given task).
It is our hope and expectation that these recent conceptual clarifications, advances and newly-defined open problems will accelerate our understanding of healthy and pathologic hand function (and biological function in general), and will catalyze the creation of truly versatile and dexterous robotic hands and prostheses.
1 Quoted from : ‘Deductive reasoning (top-down logic) contrasts with inductive reasoning (bottom-up logic) in the following way: In deductive reasoning, a conclusion is reached reductively by applying general rules that hold over the entirety of a closed domain of discourse, narrowing the range under consideration until only the conclusion(s) is left.’. Conversely , ‘Inductive reasoning is reasoning in which the premises are viewed as supplying strong evidence for the truth of the conclusion. While the conclusion of a deductive argument is certain, the truth of the conclusion of an inductive argument may be probable, based upon the evidence given .’
2 A note on nomenclature. This does not mean a potted houseplant. This term comes from control engineering where the process to be controlled was usually an industrial or manufacturing plant.
3 This was found written on his blackboard at the time of his death in February 1988, https://archives.caltech.edu/pictures/1.10-29.jpg. It is thought he meant to suggest that one should only use mathematical concepts one has derived, and therefore proven, to oneself.
4 Other important forms of active learning are active vision and saccades in mammalian vision .
6 Note that this is not an argument for optimality of anatomical architecture, but only for sufficiency.
Nussbaum MC. Aristotle’s De Motu Animalium. Princeton: Princeton University Press; 1985.
Wilson FR. The Hand: How Its Use Shapes the Brain, Language, and Human Culture. New York: Vintage; 2010.
Bell C. The Hand: Its Mechanism and Vital Endowments, as Evincing Design. vol 4.London: Bell & Daldy; 1865.
Valero-Cuevas FJ. Why the hand?Adv Exp Med Biol. 2009; 629:553–7.
Cordella F, Ciancio AL, Sacchetti R, Davalli A, Cutti AG, Guglielmelli E, Zollo L. Literature review on needs of upper limb prosthesis users. Front Neurosci. 2016; 10:209.
Löffler L. Der Ersatz Für die Obere Extremität: die Entwicklung Von Den Ersten Zeugnissen Bis heute. Stuttgart: Ferdinand Enke Verlag; 1984.
Thurston AJ. Paré and prosthetics: the early history of artificial limbs. ANZ J Surg. 2007; 77(12):1114–9.
Norton K. A brief history of prosthetics. InMotion. 2007; 17(7):11–3.
Hillman M. 2 rehabilitation robotics from past to present–a historical perspective. In: Advances in Rehabilitation Robotics. New York: Springer: 2004. p. 25–44.
Schlesinger IG. Der mechanische aufbau der künstlichen glieder. In: Ersatzglieder und Arbeitshilfen. Springer: 1919. p. 321–661. ISBN: 978-3-662-32182-9, 978-3-662-33009-8. DOI:10.1007/978-3-662-33009-8_13.
Kluge CAF, Fritze HE. Arthroplastik Oder die Sämmtlichen, Bisher Bekannt Gewordenen Künstlichen Hände und Füsse, zum Ersatz Dieser Verloren Gegangenen Gliedmassen: Mit 26 in Stein gravirten Tafeln.Meyer; 1842. p. 128.
Panchasi R. Reconstructions: prosthetics and the rehabilitation of the male body in world war i france. Differ J Fem Cultural Stud. 1995; 7(3):109–41.
Serlin D, Ott K, Mihm S, (eds).Artificial Parts, Practical Lives: Modern Histories of Prosthetics. NYU Press; 2002. p. 359. ISBN 0814761976, 9780814761977.
McSorley K, (ed).War and the Body: Militarisation, Practice and Experience War, Politics and Experience. Routledge; 2013. p. 264. ISBN 1136173544, 9781136173547.
Ling GS, Rhee P, Ecklund JM. Surgical innovations arising from the iraq and afghanistan wars. Annu Rev Med. 2010; 61:457–68.
Riskin J. Eighteenth-century wetware. Bernadette Bensaude-Vincent and William R. Newmaneds, Eds. The Artificial and the Natural: an Evolving Polarity. Cambridge: Mass;2007;239–74.
Feinglass J, Pearce WH, Martin GJ, Gibbs J, Cowper D, Sorensen M, Henderson WG, Daley J, Khuri S. Postoperative and late survival outcomes after major amputation: findings from the department of veterans affairs national surgical quality improvement program. Surgery. 2001; 130(1):21–9.
Kristensen MT, Holm G, Kirketerp-Møller K, Krasheninnikoff M, Gebuhr P. Very low survival rates after non-traumatic lower limb amputation in a consecutive series: what to do?Interact Cardiovasc Thorac Surg. 2012; 14(5):543–7.
McCorduck P, Minsky M, Selfridge OG, Simon HA. History of artificial intelligence. In: IJCAI.Hong Kong: IJCAI Organization: 1977. p. 951–4.
Benko A, Lányi CS. History of artificial intelligence. In: Encyclopedia of Information Science and Technology, Second Edition. IGI Global: 2009. p. 1759–62.
Gershenfeld N. Fab: the Coming Revolution on Your Desktop–from Personal Computers to Personal Fabrication.New York: Basic Books; 2008.
Prince JD. 3d printing: an industrial revolution. J Electron Resour Med Librar. 2014; 11(1):39–45.
Honarpardaz M, Tarkian M, Ölvander J, Feng X. Finger design automation for industrial robot grippers: A review. Robot Auton Syst. 2017; 87:104–19. doi:10.1016/j.robot.2016.10.003.
Weir RF, Sensinger JW. Design of artificial arms and hands for prosthetic applications. 2003.
Childress DS. Historical aspects of powered limb prostheses. Clin Prosthet Orthot. 1985; 9(1):2–13.
Wellerson TL. A Manual for Occupational Therapists on the Rehabilitation of Upper Extremity Amputees.Dubuque: Kendall/Hunt Publishing Company; 1958.
Cutkosky MR. On grasp choice, grasp models, and the design of hands for manufacturing tasks. IEEE Trans Robot Autom. 1989; 5(3):269–79.
Colgate JE, Hogan N. Robust control of dynamically interacting systems. Int J Control. 1988; 48(1):65–88.
Murray RM, Li Z, Sastry SS. A Mathematical Introduction to Robotic Manipulation.Boca Raton: CRC Press; 1994.
Uchiyama M, Konno A, Uchiyama T, Kanda S. Development of a flexible dual-arm manipulator testbed for space robotics. In: Intelligent Robots and Systems’ 90.’Towards a New Frontier of Applications’, Proceedings. IROS’90. IEEE International Workshop On. New York: IEEE Corporate Headquarters: 1990. p. 375–81.
Aikenhead BA, Daniell RG, Davis FM. Canadarm and the space shuttle. J Vacuum Science & Technology A: Vacuum, Surfaces, and Films. 1983; 1(2):126–32.
Nguyen CC, Pooran FJ. Dynamic analysis of a 6 dof ckcm robot end-effector for dual-arm telerobot systems. Robot Auton Syst. 1989; 5(4):377–94.
Winslow JB. Exposition Anatomique de la Structure du Corps Humain.chez Guillaume Desprez... et Jean Desessartz; 1732.
Galilei G. Il Saggiatore (Roma, 1623). Italian translation by L. Sosio. Milano: Feltrinelli; 1979.
Valero-Cuevas FJ, Hoffmann H, Kurse MU, Kutch JJ, Theodorou EA. Computational models for neuromuscular function. Biomedical Engineering, IEEE Reviews in. 2009; 2:110–35.
Krakauer JW, Ghazanfar AA, Gomez-Marin A, MacIver MA, Poeppel D. Neuroscience needs behavior: correcting a reductionist bias. Neuron. 2017; 93(3):480–90.
van Duinen H, Gandevia SC. Constraints for control of the human hand. J Physiol. 2011; 589(23):5583–93.
Santello M. Getting a grasp of theories of sensorimotor control of the hand: Identification of underlying neural mechanisms. Motor Control. 2015; 19(2):149–53.
Jacobs S, Danielmeier C, Frey SH. Human anterior intraparietal and ventral premotor cortices support representations of grasping with the hand or a novel tool. J Cogn Neurosci. 2010; 22(11):2594–608.
Davare M, Kraskov A, Rothwell JC, Lemon RN. Interactions between areas of the cortical grasping network. Curr Opin Neurobio. 2011; 21(4):565–70.
Lemon RN. Descending pathways in motor control. Annu Rev Neurosci. 2008; 31:195–218.
Mosier K, Lau C, Wang Y, Venkadesan M, Valero-Cuevas FJ. Controlling instabilities in manipulation requires specific cortical-striatal-cerebellar networks. J Neurophysiol. 2011; 105(3):1295–305.
Ejaz N, Hamada M, Diedrichsen J. Hand use predicts the structure of representations in sensorimotor cortex. Nature Neurosci. 2015; 18(7):1034–40.
Jonas E, Kording KP. Could a neuroscientist understand a microprocessor?PLoS Comput Biol. 2017; 13(1):1005268.
Valero-Cuevas FJ, Anand VV, Saxena A, Lipson H. Beyond parameter estimation: extending biomechanical modeling by the explicit exploration of model topology. IEEE Trans Biomed Eng. 2007; 54:1951–64.
Catalano MG, Grioli G, Farnioli E, Serio A, Piazza C, Bicchi A. Adaptive synergies for the design and control of the pisa/iit softhand. nternational J Robot Res. 2014; 33(5):768–82.
Santello M, Flanders M, Soechting JF. Postural hand synergies for tool use. J Neurosci. 1998; 18(23):10105–15.
Brock O, Valero-Cuevas F. Transferring synergies from neuroscience to robotics: Comment on “hand synergies: Integration of robotics and neuroscience for understanding the control of biological and artificial hands” by m. santello et al. Phys Life Rev. 2016; 17:27–32.
Pfeifer R, Gómez G. Morphological computation–connecting brain, body, and environment. Creating Brain-like Intell. 2009;66–83.
Valero-Cuevas FJ, Yi JW, Brown D, McNamara RV, Paul C, Lipson H. The tendon network of the fingers performs anatomical computation at a macroscopic scale. IEEE Trans Biomed Eng. 2007; 54(6):1161–6.
Alexander RM. Animal mechanics. Seattle: University of Washington Press; 1968.
Mardula KL, Balasubramanian R, Allan CH. Implanted passive engineering mechanism improves hand function after tendon transfer surgery: a cadaver-based study. Hand. 2015; 10(1):116–22.
Odhner LU, Jentoft LP, Claffee MR, Corson N, Tenzer Y, Ma RR, Buehler M, Kohout R, Howe RD, Dollar AM. A compliant, underactuated hand for robust manipulation. Int J Robot Res. 2014; 33(5):736–52.
Valero-Cuevas FJ. Fundamentals of Neuromechanics. Biosystems and Biorobotics, vol 8.New York: Springer; 2015.
Ogata K. Modern Control Engineering, 3rd ed. Upper Saddle River: Prentice Hall; 1997. Katsuhiko Ogata. Includes bibliographical references (p. 983-986) and index.
Stengel RF. Optimal Control and Estimation. North Chelmsford: Courier Corporation; 2012.
Verhaegen M, Verdult V. Filtering and System Identification: a Least Squares Approach.New York: Cambridge University Press; 2007.
Ljung L. System Identification - Theory for the User.Prentice-Hall; 1999, p. 672. ISBN: 0136566952, 9780136566953.
Van der Helm FC, Schouten AC, de Vlugt E, Brouwn GG. Identification of intrinsic and reflexive components of human arm dynamics during postural control. J Neurosci Methods. 2002; 119(1):1–14.
Jalaleddini K, Tehrani ES, Kearney RE. A subspace approach to the structural decomposition and identification of ankle joint dynamic stiffness. IEEE Trans Biomed Eng. 2017; 64(6):1357–68.
Perreault EJ, Kirsch RF, Acosta AM. Multiple-input, multiple-output system identification for characterization of limb stiffness dynamics. Biol Cybern. 1999; 80(5):327–37.
Hollerbach JM, Lokhorst DM. Closed-loop kinematic calibration of the rsi 6-dof hand controller. IEEE Trans Robot Autom. 1995; 11(3):352–9.
Bobrow JE, McDonell BW. Modeling, identification, and control of a pneumatically actuated, force controllable robot. IEEE Trans Robot Autom. 1998; 14(5):732–42.
Johansson R, Robertsson A, Nilsson K, Verhaegen M. State-space system identification of robot manipulator dynamics. Mechatronics. 2000; 10(3):403–18.
Lewis FW, Jagannathan S, Yesildirak A. Neural network control of robot manipulators and non-linear systems.CRC Press; 1998, p. 468. ISBN: 978-0748405961.
Ortega R, Spong MW. Adaptive motion control of rigid robots: A tutorial. Automatica. 1989; 25(6):877–88.
Doyle JC. Guaranteed Margins for LQG Regulators. IEEE Trans Autom Control. 1978; AC-23(4):756–7.
Williams G, Drews P, Goldfain B, Rehg JM, Theodorou EA. Aggressive driving with model predictive path integral control. In: Robotics and Automation (ICRA), 2016 IEEE International Conference On. New York: IEEE Corporate Headquarters: 2016. p. 1433–40.
Enoka R. Neuromechanical basis of kinesiology: ERIC; 1998, p. 352. ISBN: 978-0873221795.
Lisberger S, Thach W, Kandel E, Schwartz J, Jessell T, Siegelbaum S, Hudspeth A. Principles of neural science. 2013.
Sherrington CS. Reflex inhibition as a factor in the co-ordination of movements and postures. Exp Physiol. 1913; 6(3):251–310.
Niu CM, Jalaleddini K, Sohn WJ, Rocamora J, Sanger TD, Valero-Cuevas FJ. Neuromorphic meets neuromechanics, part i: the methodology and implementation. J Neural Eng. 2017; 14(2):025001.
Jalaleddini K, Niu CM, Raja SC, Sohn WJ, Loeb GE, Sanger TD, Valero-Cuevas FJ. Neuromorphic meets neuromechanics, part ii: the role of fusimotor drive. J Neural Eng. 2017; 14(2):025002.
Hodgkin AL, Huxley AF. The dual effect of membrane potential on sodium conductance in the giant axon of loligo. J Physiol. 1952; 116(4):497.
Olshausen BA, Field DJ. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature. 1996; 381(6583):607.
Johansson RS, Flanagan JR. Coding and use of tactile signals from the fingertips in object manipulation tasks. Nature Reviews Neurosci. 2009; 10(5):345–59.
Ernst MO, Banks MS. Humans integrate visual and haptic information in a statistically optimal fashion. Nature. 2002; 415(6870):429–33.
Shibata D, Kappers AM, Santello M. Digit forces bias sensorimotor transformations underlying control of fingertip position. Front Human Neurosci. 2014; 8:564.
Wolpert DM, Ghahramani Z. Computational principles of movement neuroscience. Nature Neurosci. 2000; 3:1212–7.
Wolpert DM, Ghahramani Z, Flanagan JR. Perspectives and problems in motor learning. Trends Cogn Sci. 2001; 5(11):487–94.
Johansson R, Westling G. Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects. Exp Brain Res. 1984; 56(3):550–64.
Johansson RS, Westling G. Coordinated isometric muscle commands adequately and erroneously programmed for the weight during lifting task with precision grip. Exp Brain Res. 1988; 71:59–71.
Celikel T, Sakmann B. Sensory integration across space and in time for decision making in the somatosensory system of rodents. Proc Natl Acad Sci. 2007; 104(4):1395–400.
Solomon JH, Hartmann MJ. Biomechanics: robotic whiskers used to sense features. Nature. 2006; 443(7111):525–5.
Lederman SJ, Klatzky RL. Hand movements: A window into haptic object recognition. Cogn Psychol. 1987; 19(3):342–68.
Lederman SJ, Klatzky RL. Extracting object properties through haptic exploration. Acta psychologica. 1993; 84(1):29–40.
Eggermann E, Kremer Y, Crochet S, Petersen CC. Cholinergic signals in mouse barrel cortex during active whisker sensing. Cell reports. 2014; 9(5):1654–60.
Vallbo ÅB, Johansson RS, et al. Properties of cutaneous mechanoreceptors in the human hand related to touch sensation. Hum Neurobiol. 1984; 3(1):3–14.
Siciliano B, Sciavicco L, Villani L, Oriolo G. Robotics: Modelling, Planning and Control.New York: Springer; 2010.
Uhl T. The inverse identification problem and its technical application. Arch Appl Mech. 2007; 77(5):325–37.
Westwick DT, Kearney RE. Identification of Nonlinear Physiological Systems. vol 7.San Francisco: John Wiley & Sons; 2003.
Yang Y, Solis-Escalante T, Yao J, van der Helm FC, Dewald JP, Schouten AC. Nonlinear connectivity in the human stretch reflex assessed by cross-frequency phase coupling. Int J Neural Syst. 2016; 26(08):1650043.
Jalaleddini K, Kearney RE. Subspace identification of siso hammerstein systems: application to stretch reflex identification. IEEE Trans Biomed Eng. 2013; 60(10):2725–34.
de Vlugt E, Schouten AC, van der Helm FC. Closed-loop multivariable system identification for the characterization of the dynamic arm compliance using continuous force disturbances: a model study. J Neurosci Methods. 2003; 122(2):123–40.
Ludvig D, Perreault EJ. System identification of physiological systems using short data segments. IEEE Trans Biomed Eng. 2012; 59(12):3541–9.
Shamanna V, Das S, Çelik-Butler Z, Butler DP, Lawrence KL. Micromachined integrated pressure–thermal sensors on flexible substrates. J Micromech Microeng. 2006; 16(10):1984.
Lowe M, King A, Lovett E, Papakostas T. Flexible tactile sensor technology: bringing haptics to life. Sensor review. 2004; 24(1):33–6.
Loeb GE, Johansson R. Biomimetic tactile sensor. US Patent 7,658,119. 2010. University of Southern California, assignee.
Wettels N, Santos VJ, Johansson RS, Loeb GE. Biomimetic tactile sensor array. Adv Robot. 2008; 22(8):829–49.
Fishel J, Lin G, Loeb G. Biotac product manual v. 16. SynTouch LLC. Tech. Rep. 2013.
Horch K, Meek S, Taylor TG, Hutchinson DT. Object discrimination with an artificial hand using electrical stimulation of peripheral tactile and proprioceptive pathways with intrafascicular electrodes. IEEE Trans Neural Syst Rehabil Eng. 2011; 19(5):483–9.
Tabot GA, Dammann JF, Berg JA, Tenore FV, Boback JL, Vogelstein RJ, Bensmaia SJ. Restoring the sense of touch with a prosthetic hand through a brain interface. Proc Natl Acad Sc. 2013; 110(45):18279–84.
Raspopovic S, Capogrosso M, Petrini FM, Bonizzato M, Rigosa J, Di Pino G, Carpaneto J, Controzzi M, Boretius T, Fernandez E, Granata G, Oddo CM, Citi L, Ciancio AL, Cipriani C, Carrozza MC, Jensen W, Guglielmelli E, Stieglitz T, Rossini PM, Micera S. Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses. Sci Transl Med. 2014; 6(222):222–1922219. doi:10.1126/scitranslmed.3006820.
Kim J, Lee M, Shim HJ, Ghaffari R, Cho HR, Son D, Jung YH, Soh M, Choi C, Jung S, et al.Stretchable silicon nanoribbon electronics for skin prosthesis. Nature Commun. 2014; 5:5747.
Antfolk C, D’Alonzo M, Controzzi M, Lundborg G, Rosén B, Sebelius F, Cipriani C. Artificial redirection of sensation from prosthetic fingers to the phantom hand map on transradial amputees: vibrotactile versus mechanotactile sensory feedback. IEEE Trans Neural Syst Rehabil Eng. 2013; 21(1):112–20.
Valero-Cuevas FJ, Yi JW, Brown D, McNamara III RV, Paul C, Lipson H. The tendon network of the fingers performs anatomical computation at a macroscopic scale. IEEE Trans Biomed Eng. 2007; 54(6 Pt 2):1161–6.
Deimel R, Brock O. A novel type of compliant and underactuated robotic hand for dexterous grasping. Int J Robot Res. 2016; 35(1-3):161–85.
Imai Y, Namiki A, Hashimoto K, Ishikawa M. Dynamic active catching using a high-speed multifingered hand and a high-speed vision system. In: Robotics and Automation, 2004. Proceedings. ICRA’04. 2004 IEEE International Conference On. New York: IEEE Corporate Headquarters: 2004. p. 1849–54.
Schulte H. The characteristics of the mckibben artificial muscle. Appl External Power Prosthetics Orthot. 1961; 874:94–115.
Gavrilović M, Marić M. Positional servo-mechanism activated by artificial muscles. Med Biol Eng Comput. 1969; 7(1):77–82.
Chou CP, Hannaford B. Measurement and modeling of mckibben pneumatic artificial muscles. IEEE Trans Robot Autom. 1996; 12(1):90–102.
Kodama T, Okabe A, Kogiso K. Simultaneous estimation of contraction ratio and parameter of mckibben pneumatic artificial muscle model using log-normalized unscented kalman filter. In: Cyber-Physical Systems, Networks, and Applications (CPSNA), 2016 IEEE 4th International Conference On. New York: IEEE Corporate Headquarters: 2016. p. 44–8.
Gordon KE, Sawicki GS, Ferris DP. Mechanical performance of artificial pneumatic muscles to power an ankle–foot orthosis. J Biomech. 2006; 39(10):1832–41.
Jackson RW, Collins SH. An experimental comparison of the relative benefits of work and torque assistance in ankle exoskeletons. J Appl Physiol. 2015; 119(5):541–57.
Van Ham R, Sugar TG, Vanderborght B, Hollander KW, Lefeber D. Compliant actuator designs. IEEE Robotics & Automation Magazine. 2009; 16(3):81–94.
Pons J, Rodriguez H, Luyckx I, Reynaerts D, Ceres R, Brussel HV. High torque ultrasonic motors for hand prosthetics: current status and trends. Technol Health Care. 2002; 10(2):121–33.
Bogue R. Exoskeletons and robotic prosthetics: a review of recent developments. Ind Robot Int J. 2009; 36(5):421–7.
Rahman MA, Wang X, Wen C. A review of high energy density lithium–air battery technology. J Appl Electrochem. 2014; 44(1):5–22. doi:10.1007/s10800-013-0620-8.
Scrosati B, Garche J. Lithium batteries: Status, prospects and future. J Power Sources. 2010; 195(9):2419–30. doi:10.1016/j.jpowsour.2009.11.048.
Yoshino A. Development of the lithium-ion battery and recent technological trends In: Pistoia G, editor. Lithium-Ion Batteries. San Diego: Elsevier: 2014. p. 1–20.
Dickinson MH, Farley CT, Full RJ, Koehl M, Kram R, Lehman S. How animals move: an integrative view. Science. 2000; 288(5463):100–6.
Biewener AA. Locomotion as an emergent property of muscle contractile dynamics. J Exp Biol. 2016; 219(2):285–94.
Lieber RL. Skeletal Muscle Structure and Function: Implications for Rehabilitation and Sports Medicine.Williams & Wilkins; 1992. p. 303. ISBN: 978-0683050264.
Enoka RM. Neuromechanics of Human Movement.Human kinetics; 2008. p. 560. ISBN: 978-0736066792.
Martin P, Johnson E, Murphey T, Egerstedt M. Constructing and implementing motion programs for robotic marionettes. IEEE Trans Autom Control. 2011; 56(4):902–7.
Shinjiro S, Andrew K, Dinesh KP. Musculotendon simulation for hand animation. ACM Trans Graph. 2008; 27(3):1–8. 1360682.
Kaufman DM, Edmunds T, Pai DK. Fast frictional dynamics for rigid bodies. In: International Conference on Computer Graphics and Interactive Techniques. New York: ACM: 2005. p. 946–56.
Mao Y, Agrawal SK. Design of a cable-driven arm exoskeleton (carex) for neural rehabilitation. IEEE Trans Robot. 2012; 28(4):922–31.
Oh SR, Agrawal SK. Cable suspended planar robots with redundant cables: Controllers with positive tensions. IEEE Trans Robot. 2005; 21(3):457–65.
Wolpert DM, Diedrichsen J, Flanagan JR. Principles of sensorimotor learning. Nat Rev Neurosci. 2011; 12(12):739–51. doi:10.1038/nrn3112.
Venkadesan M, Valero-Cuevas FJ. Neural control of motion-to-force transitions with the fingertip. J Neurosci. 2008; 28:1366–73.
Fu Q, Zhang W, Santello M. Anticipatory planning and control of grasp positions and forces for dexterous two-digit manipulation. J Neurosci. 2010; 30(27):9117–26.
Fu Q, Hasan Z, Santello M. Transfer of learned manipulation following changes in degrees of freedom. J Neurosci. 2011; 31(38):13527–34.
Fu Q, Santello M. Coordination between digit forces and positions: interactions between anticipatory and feedback control. J Neurophysiol. 2014; 111(7):1519–28. doi:10.1152/jn.00754.2013.
Fu Q, Choi JY, Gordon AM, Jesunathadas M, Santello M. Learned manipulation at unconstrained contacts does not transfer across hands. PLoS ONE. 2014;9(9). doi:10.1371/journal.pone.0108222.
Marneweck M, Lee-miller T, Santello M, Gordon AM, Gordon AM. Digit Position and Forces Covary during Anticipatory Control of Whole-Hand Manipulation. Front Hum Neurosci. 2016; 10(September):1–10. doi:10.3389/fnhum.2016.00461.
Yamaguchi GT, Zajac FE. Restoring unassisted natural gait to paraplegics via functionalneuromuscular stimulation: a computer simulation study. IEEE Trans Biomed Eng. 1990; 37(9):886–902.
Shadmehr R, Mussa-Ivaldi S. Biological Learning and Control: How the Brain Builds Representations, Predicts Events, and Makes Decisions.Cambridge: Mit Press; 2012.
Todorov E, Jordan MI. Optimal feedback control as a theory of motor coordination. Nature Neurosci. 2002; 5(11):1226–35.
Scott SH. Optimal feedback control and the neural basis of volitional motor control. Nat Rev Neurosci. 2004; 5(7):532–46.
Loeb G, Brown I, Cheng E. A hierarchical foundation for models of sensorimotor control. Exp Brain Res. 1999; 126(1):1–18.
Loeb G, Levine W, He J. Understanding sensorimotor feedback through optimal control. In: Cold Spring Harbor Symposia on Quantitative Biology, vol 55. Cold Spring Harbor: Cold Spring Harbor Laboratory Press: 1990. p. 791–803.
Peterka R. Sensorimotor integration in human postural control. J neurophysiol. 2002; 88(3):1097–118.
Khoo MC. Physiological Control Systems. New York: IEEE Corporate Headquarters; 2000.
McIntyre J, Bizzi E. Servo hypotheses for the biological control of movement. J Motor Behav. 1993; 25(3):193–202.
Angelaki DE, Cullen KE. Vestibular system: the many facets of a multimodal sense. Annu Rev Neurosci. 2008; 31:125–50.
Ranjbaran M, Galiana HL. Hybrid model of the context dependent vestibulo-ocular reflex: implications for vergence-version interactions. Front Comput Neurosci. 2015; 9:6.
Iberall T, Arbib MA. Schemes for the control of hand. Vis action control grasping. 1990; 2:204.
MacKenzie CL, Iberall T. The Grasping Hand. vol 104. Amsterdam: Elsevier B.V. Registered Office; 1994.
Mechsner F, Kerzel D, Knoblich G, Prinz W. Perceptual basis of bimanual coordination. Nature. 2001; 414(6859):69–73.
Charpentier A. Analyse experimentale de quelgues elements de la sensation de poids. Arch Physiol Norm Pathol. 1891; 3:122–35.
Yue G, Cole KJ. Strength increases from the motor program: comparison of training with maximal voluntary and imagined muscle contractions. J Neurophysiol. 1992; 67(5):1114–23.
Gordon AM, Westling G, Cole KJ, Johansson RS. Memory representations underlying motor commands used during manipulation of common and novel objects. J Neurophysiol. 1993; 69(6):1789–96.
Murray DJ, Ellis RR, Bandomir CA, Ross HE. Charpentier (1891) on the size—weight illusion. Attention, Perception, & Psychophysics. 1999; 61(8):1681–5.
Flanagan JR, Beltzner MA. Independence of perceptual and sensorimotor predictions in the size–weight illusion. Nature Neurosci. 2000; 3(7):737–41.
Warren JP, Santello M, Tillery SIH. Effects of fusion between tactile and proprioceptive inputs on tactile perception. PloS ONE. 2011; 6(3):18073.
Crajé C, Santello M, Gordon AM. Effects of visual cues of object density on perception and anticipatory control of dexterous manipulation. PloS ONE. 2013; 8(10):76855.
Bryson AE. Applied Optimal Control: Optimization, Estimation and Control. Boca Raton: CRC Press; 1975.
Kalman R. On the general theory of control systems. IRE Trans Autom Control. 1959; 4(3):110–0.
Kalman RE. Mathematical description of linear dynamical systems. J Soc Ind Appl Math Seri A Control. 1963; 1(2):152–92.
Simon D. Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches.Hoboken: John Wiley & Sons, Inc.; 2006.
De Rugy A, Loeb GE, Carroll TJ. Muscle coordination is habitual rather than optimal. J Neurosci. 2012; 32(21):7384–391.
Loeb GE. Optimal isn’t good enough. Biol Cybern. 2012; 106(11-12):757–65.
Shiller Z, Dubowsky S. Robot path planning with obstacles, actuator, gripper, and payload constraints. Int J Robot Res. 1989; 8(6):3–18.
Strang G. Introduction to Linear Algebra. Wellesley: Wellesley-Cambridge Press; 2003.
Aschepkov LT, Dolgy DV, Kim T, Agarwal RP. Optimal Control. New York: Springer; 2016.
Safonov MG. Origins of robust control: Early history and future speculations. IFAC Proc Vol. 2012; 45(13):1–8.
Morari M, Garcia C, Lee J, Prett D. Model Predictive Control. Englewood Cliffs: Prentice Hall; 1993.
Theodorou E, Buchli J, Schaal S. A generalized path integral control approach to reinforcement learning. J Mach Learn Res. 2010; 11:3137–81.
Chao EY, An KN. Graphical interpretation of the solution to the redundant problem in biomechanics. J Biomech Eng. 1978; 100:159–67.
Crowninshield RD, Brand RA. A physiologically based criterion of muscle force prediction in locomotion. J Biomech. 1981; 14(11):793–801.
Righetti L, Kalakrishnan M, Pastor P, Binney J, Kelly J, Voorhies RC, Sukhatme GS, Schaal S. An autonomous manipulation system based on force control and optimization. Auton Robots. 2014; 36(1-2):11–30.
Cifuentes CG, Issac J, Wuthrich M, Schaal S, Bohg J. Probabilistic articulated real-time tracking for robot manipulation. IEEE Robot Autom Letters. 2017; 2(2):577–84.
Kumar V, Todorov E. Mujoco haptix: A virtual reality system for hand manipulation. In: Humanoid Robots (Humanoids), 2015 IEEE-RAS 15th International Conference On. New York: IEEE Corporate Headquarters: 2015. p. 657–63.
Valero-Cuevas FJ, Zajac FE, Burgar CG. Large index-fingertip forces are produced by subject-independent patterns of muscle excitation. J Biomech. 1998; 31(8):693–704.
Valero-Cuevas F, Cohn B, Yngvason H, Lawrence E. Exploring the high-dimensional structure of muscle redundancy via subject-specific and generic musculoskeletal models. J Biomech. 2015; 48(11):2887–96.
Kutch JJ, Valero-Cuevas FJ. Challenges and new approaches to proving the existence of muscle synergies of neural origin. PLoS Comput Biol. 2012; 8(5):1002434.
Inouye JM, Valero-Cuevas FJ. Muscle synergies heavily influence the neural control of arm endpoint stiffness and energy consumption. PLoS Comput Biol. 2016; 12(2):1004737.
Körding KP, Wolpert DM. Bayesian decision theory in sensorimotor control. Trends Cogn Sci. 2006; 10(7):319–26.
Peters MA, Ma WJ, Shams L. The size-weight illusion is not anti-bayesian after all: a unifying bayesian account. PeerJ. 2016; 4:2124.
Sanger TD. In: Hirose A, Ozawa S, Doya K, Ikeda K, Lee M, Liu D, (eds).Learning Visually Guided Risk-Aware Reaching on a Robot Controlled by a GPU Spiking Neural Network. Cham: Springer; 2016. p. 282–9. doi:10.1007/978-3-319-46687_31. http://dx.doi.org/10.1007/978-3-319-46687-3_31.
Dunning A, Ghoreyshi A, Bertucco M, Sanger TD. The tuning of human motor response to risk in a dynamic environment task. PloS ONE. 2015; 10(4):0125461.
Theodorou E, Todorov E, Valero-Cuevas FJ. Neuromuscular stochastic optimal control of a tendon driven index finger model. In: American Control Conference (ACC), 2011. New York: IEEE Corporate Headquarters: 2011. p. 348–55.
Rieffel J, Valero-Cuevas F, Lipson H. Morphological Communication: Exploiting Coupled Dynamics in a Complex Mechanical Structure to Achieve Locomotion. J Royal Soc Interf. 2009. In Press.
Bernstein NA. The Co-ordination and Regulation of Movement. Oxford: Pergamon Press; 1967.
Miller AT, Allen PK. Graspit! a versatile simulator for robotic grasping. IEEE Robot Autom Mag. 2004; 11(4):110–22.
Kutch JJ, Valero-Cuevas FJ. Muscle redundancy does not imply robustness to muscle dysfunction. J Biomech. 2011; 44(7):1264–70.
Hagen DA, Valero-Cuevas FJ. Similar movements are associated with drastically different muscle contraction velocities. J Biomech. 2017; 59:90–100.
Brand P, Hollister A. Clinical Mechanics of the Hand, St. Louis: Mosby-Year Book. Amsterdam: Elsevier B.V. Registered Office; 1993.
Valero-Cuevas FJ, Smaby N, Venkadesan M, Peterson M, Wright T. The strength-dexterity test as a measure of dynamic pinch performance. J Biomech. 2003; 36:265–70.
Lawrence EL, Fassola I, Werner I, Leclercq C, Valero-Cuevas FJ. Quantification of dexterity as the dynamical regulation of instabilities: comparisons across gender, age, and disease. Front Neurol. 2014;5.
Ko N-h, Laine CM, Fisher BE, Valero-Cuevas FJ. Force variability during dexterous manipulation in individuals with mild to moderate parkinson’s disease. Front Aging Neurosci. 2015; 7:151.
Lawrence EL, Dayanidhi S, Fassola I, Requejo P, Leclercq C, Winstein CJ, Valero-Cuevas FJ. Outcome measures for hand function naturally reveal three latent domains in older adults: strength, coordinated upper extremity function, and sensorimotor processing. Front Aging Neurosci. 2015; 7:108.
Pavlova E, Hedberg Å, Ponten E, Gantelius S, Valero-Cuevas FJ, Forssberg H. Activity in the brain network for dynamic manipulation of unstable objects is robust to acute tactile nerve block: an fmri study. Brain Res. 2015; 1620:98–106.
Fu Q, Santello M. Retention and interference of learned dexterous manipulation: interaction between multiple sensorimotor processes. J Neurophysiol. 2015; 113(1):144–55. doi:10.1152/jn.00348.2014.
McGeer T, et al.Passive dynamic walking. I J Robotic Res. 1990; 9(2):62–82.
Collins S, Ruina A, Tedrake R, Wisse M. Efficient bipedal robots based on passive-dynamic walkers. Science. 2005; 307(5712):1082–5.
Schieber MH, Santello M. Hand function: peripheral and central constraints on performance. J Appl Physiol. 2004; 96:2293–300.
Schieber MH. Constraints on somatotopic organization in the primary motor cortex. J Neurophysiol. 2001; 86(5):2125–43.
Sanes JN, Schieber MH. Orderly somatotopy in primary motor cortex: does it exist?Neuroimage. 2001; 13:968–74.
Nazarpour K, Barnard A, Jackson A. Flexible cortical control of task-specific muscle synergies. J Neurosci Off J Soc Neurosci. 2012; 32(36):12349–60. doi:10.1523/JNEUROSCI.5481-11.2012. Accessed 3 Sept 2015
Farmer SF. Rhythmicity, synchronization and binding in human and primate motor systems. J Physiol. 1998; 509(1):3.
de Vries IEJ, Daffertshofer A, Stegeman DF, Boonstra TW. Functional connectivity in the neuromuscular system underlying bimanual coordination. J Neurophysiol. 2016; 116(6):2576–85. doi:10.1152/jn.00460.2016. Accessed 13 Dec 2016
Rathelot JA, Strick PL. Subdivisions of primary motor cortex based on cortico-motoneuronal cells. Proc Natl Acad Sci. 2009; 106(3):918–23. doi:10.1073/pnas.0808362106. Accessed 12 May 2015
Shadmehr R, Krakauer JW. A computational neuroanatomy for motor control. Experimental brain research. Experimentelle Hirnforschung. Experimentation cerebrale. 2008; 185(3):359–81. doi:10.1007/s00221-008-1280--5. Accessed 28 Feb 2017
Nozaki D, Yokoi A, Kimura T, Hirashima M, de Xivry J-JO. Tagging motor memories with transcranial direct current stimulation allows later artificially-controlled retrieval. Elife. 2016; 5:15378. Accessed 28 Feb 2017.
Brown E, Rodenberg N, Amend J, Mozeika A, Steltz E, Zakin MR, Lipson H, Jaeger HM. Universal robotic gripper based on the jamming of granular material. Proc Natl Acad Sci. 2010; 107(44):18809–14.
Aflalo T, Kellis S, Klaes C, Lee B, Shi Y, Pejsa K, Shanfield K, Hayes-Jackson S, Aisen M, Heck C, et al. Decoding motor imagery from the posterior parietal cortex of a tetraplegic human. Science. 2015; 348(6237):906–10.
Flanagan JR, Vetter P, Johansson RS, Wolpert DM. Prediction precedes control in motor learning. Current Biol. 2003; 13(2):146–50.
Haruno M, Wolpert DM, Kawato M. MOSAIC Model for Sensorimotor Learning and Control. Neural Comput. 2001; 13:2201–0.
Kording KP, Tenenbaum JB, Shadmehr R. The dynamics of memory as a consequence of optimal adaptation to a changing body. Nature Neurosci. 2007; 10(6):779–86. doi:10.1038/nn1901.
Krakauer JW, Ghez C, Ghilardi MF. Adaptation to visuomotor transformations: consolidation, interference, and forgetting. J Neurosci. 2005; 25(2):473–8. doi:10.1523/JNEUROSCI.4218--04.2005.
Thoroughman KA, Shadmehr R. Learning of action through adaptive combination of motor primitives. Nature. 2000; 407(6805):742–7. doi:10.1038/35037588.
Classen J, Liepert J, Wise SP, Hallett M, Cohen LG. Rapid plasticity of human cortical movement representation induced by practice. J Neurophysiol. 1998; 79:1117–23.
Diedrichsen J, White O, Newman D, Lally N. Use-dependent and error-based learning of motor behaviors. J Neurosci. 2010; 30(15):5159–66. doi:10.1523/JNEUROSCI.5406--09.2010.
Verstynen T, Sabes PN. How each movement changes the next: an experimental and theoretical study of fast adaptive priors in reaching. J Neurosci. 2011; 31(27):10050–9. doi:10.1523/JNEUROSCI.6525--10.2011.
Huang VS, Haith AM, Mazzoni P, Krakauer JW. Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models. Neuron. 2011; 70(4):787–801. doi:10.1016/j.neuron.2011.04.012.
Johansson RS, Cole KJ. Sensory-motor coordination during grasping and manipulative actions. Curr Opin Neurobiol. 1992; 2(6):815–23.
Quaney BM, Rotella DL, Peterson C, Cole KJ. Sensorimotor memory for fingertip forces: evidence for a task-independent motor memory. J Neurosci. 2003; 23(5):1981–6.
Quaney BM, Nudo RJ, Cole KJ. Can internal models of objects be utilized for different prehension tasks?J Neurophysiol. 2005; 93(4):2021–7. doi:10.1152/jn.00599.2004.
Ingram JN, Howard IS, Flanagan JR, Wolpert DM. Multiple grasp-specific representations of tool dynamics mediate skillful manipulation. Current Biol. 2010; 20(7):618–23.
Lee JY, Schweighofer N. Dual adaptation supports a parallel architecture of motor memory. J Neurosci. 2009; 29(33):10396–404. doi:10.1523/JNEUROSCI.1294--09.2009.
Fu Q, Santello M (in press). Sensorimotor learning of dexterous manipulation In: Watanabe T, Harada K, Tada M, editors. Human Inspired Dexterity in Robotic Manipulation. Amsterdam: Elsevier B.V. Registered Office.
Kemp CC, Edsinger A, Torres-Jara E. Challenges for robot manipulation in human environments [grand challenges of robotics]. IEEE Robot Autom Mag. 2007; 14(1):20–9.
Saxena A, Driemeyer J, Kearns J, Ng AY. Robotic grasping of novel objects. In: Adv Neural Inf Process Syst. La Jolla: Neural Information Processing Systems Foundation: 2007. p. 1209–16.
Mojtahedi K, Fu Q, Santello M. Extraction of Time and Frequency Features From Grip Force Rates During Dexterous Manipulation. IEEE Trans Biomed Eng. 2015; 62(5):1363–75. doi:10.1109/TBME.2015.2388592.
Adolph KE, Cole WG, Komati M, Garciaguirre JS, Badaly D, Lingeman JM, Chan GL, Sotsky RB. How do you learn to walk? thousands of steps and dozens of falls per day. Psychological Sci. 2012; 23(11):1387–94.
Gladwell M. Outliers: The Story of Success. UK: Hachette; 2008.
Lohse KR, Lang CE, Boyd LA. Is more better? using metadata to explore dose–response relationships in stroke rehabilitation. Stroke. 2014; 45(7):2053–8.
Bongard J, Zykov V, Lipson H. Resilient machines through continuous self-modeling. Science. 2006; 314(5802):1118–21.
Kalakrishnan M, Buchli J, Pastor P, Mistry M, Schaal S. Learning, planning, and control for quadruped locomotion over challenging terrain. Int J Robot Res. 2011; 30(2):236–58.
Bristow DA, Tharayil M, Alleyne AG. A survey of iterative learning control. IEEE Control Syst. 2006; 26(3):96–114.
Valero-Cuevas FJ, Venkadesan M, Todorov E. Structured variability of muscle activations supports the minimal intervention principle of motor control. J Neurophysiol. 2009; 102:59–68.
Rácz K, Valero-Cuevas F. Spatio-temporal analysis reveals active control of both task-relevant and task-irrelevant variables. Front Comput Neurosci. 2013; 7:155.
Tresch MC, Jarc A. The case for and against muscle synergies. Curr Opin Neurobiol. 2009; 19(6):601–7.
Giszter SF, McIntyre J, Bizzi E. Kinematic strategies and sensorimotor transformations in the wiping movements of frogs. J Neurophysiol. 1989; 62(3):750–67.
Scholz JP, Schöner G. The uncontrolled manifold concept: identifying control variables for a functional task. Exp Brain Res. 1999; 126(3):289–306.
Giszter S, Patil V, Hart C. Primitives, premotor drives, and pattern generation: a combined computational and neuroethological perspective. Prog Brain Res. 2007; 165:323–46.
Ting LH, McKay JL. Neuromechanics of muscle synergies for posture and movement. Curr Opin Neurobiol. 2007; 17(6):622–8. doi:10.1016/j.conb.2008.01.002.
Bizzi E, Cheung VCK, D’Avella A, Saltiel P, Tresch MC. Combining modules for movement. Brain Res Rev. 2008; 57(1):125–33. doi:10.1016/j.brainresrev.2007.08.004.
Lacquaniti F, Ivanenko YP, D’Avella A, Zelik KE, Zago M. Evolutionary and developmental modules. Front Comput Neurosci. 2013; 7(May):61. doi:10.3389/fncom.2013.00061.
Cheung VCK, Turolla A, Agostini M, Silvoni S, Bennis C, Kasi P, Paganoni S, Bonato P, Bizzi E. Muscle synergy patterns as physiological markers of motor cortical damage. Proc Natl Acad Sci. 2012; 109(36):14652–6. doi:10.1073/pnas.1212056109. pnas.1212056109.
Santello M, Lang CE. Are movement disorders and sensorimotor injuries pathologic synergies? when normal multi-joint movement synergies become pathologic. Front Hum Neurosci. 2015; 8:1050.
Santello M, Baud-Bovy G, Jörntell H. Neural bases of hand synergies. Front Hum Neurosci. 2013; 7(April):23. doi:10.3389/fncom.2013.00023.
Santello M, Flanders M, Soechting JF. Patterns of hand motion during grasping and the influence of sensory guidance. J Neurosci. 2002; 22(4):1426–35.
Reilly KT, Hammond GR. Independence of force production by digits of the human hand. Neurosci Letters. 2000; 290(1):53–6. doi:10.1016/S0304--3940(00)01328--8.
Zatsiorsky VM, Li ZM, Latash ML. Enslaving effects in multi-finger force production. Exp Brain Res. 2000; 131(2):187–95. doi:10.1007/s002219900261.
Schieber MH, Hibbard LS. How somatotopic is the motor cortex hand area?Science. 1993; 261:489–92.
Overduin SA, D’Avella A, Carmena JM, Bizzi E. Microstimulation Activates a Handful of Muscle Synergies. Neuron. 2012; 76(6):1071–77. doi:10.1016/j.neuron.2012.10.018.
Leo A, Handjaras G, Bianchi M, Marino H, Gabiccini M, Guidi A, Scilingo EP, Pietrini P, Bicchi A, Santello M, Ricciardi E. A synergy-based hand control is encoded in human motor cortical areas. eLife. 2016; 5:13420. doi:10.7554/eLife.13420.
Ejaz N, Hamada M, Diedrichsen J. Hand use predicts the structure of representations in sensorimotor cortex. Nature Neurosci. 2015; 103(June). doi:10.1038/nn.4038.
Babikian S, Kanso E, Kutch JJ. Cortical activity predicts good variation in human motor output. Exp Brain Res. 2017; 235(4):1–9.
Giszter SF, Hart CB. Motor primitives and synergies in spinal cord and after injury - the current state of play. Ann N Y Acad Sci. 2013:114–26. doi:10.1111/nyas.12065.Motor.
Winges SA, Santello M. Common input to motor units of digit flexors during multi-digit grasping. J Neurophysiol. 2004; 92(6):3210–20. doi:10.1152/jn.00516.2004.
Santello M, Fuglevand AJ. Role of across-muscle motor unit synchrony for the coordination of forces. Exp Brain Res. 2004; 159(4):501–8. doi:10.1007/s00221--004-1975--1.
Winges Sa, Kornatz KW, Santello M. Common input to motor units of intrinsic and extrinsic hand muscles during two-digit object hold. J Neurophysiol. 2008; 99(3):1119–26. doi:10.1152/jn.01059.2007.
Flanders M, Soechting JF. Kinematics of typing: parallel control of the two hands. J Neurophysiol. 1992; 67(5):1264–74.
Santello M, Soechting JF. Force synergies for multifingered grasping. Exp Brain Res. 2000; 133(4):457–67. doi:10.1007/s002210000420.
Rearick MP, Casares A, Santello M. Task-dependent modulation of multi-digit force coordination patterns. J Neurophysiol. 2003; 89(3):1317–26. doi:10.1152/jn.00581.2002.
Zatsiorsky V, Gao F, Latash M. Prehension synergies: effects of object geometry and prescribed torques. Exp Brain Res. 2003; 148(1):77–87.
Santello M, Bianchi M, Gabiccini M, Ricciardi E, Salvietti G, Prattichizzo D, Ernst M, Moscatelli A, Jörntell H, Kappers AM, Kyriakopoulos K, Albu-Schäffer A, Castellini C, Bicchi A. Hand synergies: Integration of robotics and neuroscience for understanding the control of biological and artificial hands. Phys Life Rev. 2016; 17:1–23. doi:10.1016/j.plrev.2016.02.001.
Scholz JP, Kang N, Patterson D, Latash ML. Uncontrolled manifold analysis of single trials during multi-finger force production by persons with and without down syndrome. Exp Brain Res. 2003; 153(1):45–58.
Kang N, Shinohara M, Zatsiorsky VM, Latash ML. Learning multi-finger synergies: an uncontrolled manifold analysis. Exp Brain Res. 2004; 157(3):336–50. doi:10.1007/s00221--004-1850--0.
Xiloyannis M, Cappello L, Khanh DB, Yen SC, Masia L. Modelling and design of a synergy-based actuator for a tendon-driven soft robotic glove. In: Biomedical Robotics and Biomechatronics (BioRob), 2016 6th IEEE International Conference On. New York: IEEE Corporate Headquarters: 2016. p. 1213–19.
Zhao K, Breighner R, Theuer A, Godfrey SB, Bianchi M, Catalano M, Grioli G, Santello M, Bicchi A, Andrews K. Application of a novel robotic hand as a myoelectric prosthetic prototype: proof of concept in a single patient. Lyon: International Society for Prosthetics and Orthotics World Congress; 2015, p. 571.
Bicchi A, Gabiccini M, Santello M. Modelling natural and artificial hands with synergies. Philos Trans Royal Soc Lond B Biol Sci. 2011; 366(1581):3153–61.
Kumar V, Tassa Y, Erez T, Todorov E. Real-time behaviour synthesis for dynamic hand-manipulation. In: Robotics and Automation (ICRA), 2014 IEEE International Conference On. New York: IEEE Corporate Headquarters: 2014. p. 6808–15.
Fu Q, Ushani A, Jentoft L, Howe RD, Santella M. Human reach-to-grasp compensation with object pose uncertainty. In: Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE. New York: IEEE Corporate Headquarters: 2013. p. 6893–6.
Wikipedia contributors. DeductiveReasoning. Wikipedia, The Free Encyclopedia. 2017. http://en.wikipedia.org/wiki/Deductive_reasoning. Accessed 19 Aug 2017.
Wikipedia contributors. InductiveReasoning. Wikipedia, The Free Encyclopedia. 2017. https://en.wikipedia.org/wiki/Inductive_reasoning. Accessed 19 Aug 2017.
Copi I. Essentials of Logic.Abingdon: Taylor & Francis; 2016.
Olshausen BA. 20 years of learning about vision: Questions answered, questions unanswered, and questions not yet asked. In: 20 Years of Computational Neuroscience. New York: Springer: 2013. p. 243–70.
Grillner S. Biological pattern generation: the cellular and computational logic of networks in motion. Neuron. 2006; 52(5):751–66.
Suver M, Dickinson M. Sensory integration by descending interneurons in the flying fruit fly. Integr Comp Biol. 2016; 56(S1):216.
Harris-Warrick RM. General principles of rhythmogenesis in central pattern networks. Prog Brain Res. 2010; 187:213.
Ewart J. Neuroethology–An Introduction to the Neurophysiological Fundamentals of Behaviour. New York: Springer; 1980.
We thank Dr. Qiushi Fu, Dr. Christopher Laine, Dr. Kian Jalaleddini, Suraj Chakravarthi Raja, Ali Marjaninejad and Melisa Osborne for their help with critical reading of this manuscript.
Research reported in this publication was supported by the National Institute of Arthritis and Musculoskeletal and Skin Diseases of the National Institutes of Health (NIH) under award numbers AR050520 and AR052345, and CDMRP MR150091 from the Department of Defense (DoD) to FV-C, and Eunice Kennedy Shriver National Institute Of Child Health and Human Development of the NIH under award number HD081938, National Science Foundation (NSF) under award number BCS-1455866, and the Grainger Foundation to MS. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH, DoD or NSF.
Availability of data and materials
Not applicable in this review article.
Ethics approval and consent to participate
Not applicable in this review article.
Consent for publication
The authors consent.
FV-C holds US Patent No. 6,537,075 on some of the technology reviewed in this article that is commercialized by Neuromuscular Dynamics, LLC. MS has no financial or personal relationships with other people or organizations that could inappropriately influence this work.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Valero-Cuevas, F.J., Santello, M. On neuromechanical approaches for the study of biological and robotic grasp and manipulation. J NeuroEngineering Rehabil 14, 101 (2017). https://doi.org/10.1186/s12984-017-0305-3
- Neuromuscular control