Design and technical construction of a tactile display for sensory feedback in a hand prosthesis system

Background  

The users of today's commercial prosthetic hands are not given any conscious sensory feedback. To overcome this deficiency in prosthetic hands we have recently proposed a sensory feedback system utilising a "tactile display" on the remaining amputation residual limb acting as man-machine interface. Our system uses the recorded pressure in a hand prosthesis and feeds back this pressure onto the forearm skin. Here we describe the design and technical solution of the sensory feedback system aimed at hand prostheses for trans-radial/humeral amputees. Critical parameters for the sensory feedback system were investigated.     

Vibrotactile Sensory Substitution Elicits Feeling of Ownership of an Alien Hand

Tactile feedback plays a key role in the attribution of a limb to the self and in the motor control of grasping and manipulation. However, due to technological limits, current prosthetic hands do not provide amputees with cutaneous touch feedback. Recent findings showed that amputees can be tricked into experiencing an alien rubber hand as part of their own body, by applying synchronous touches to the stump which is out of view, and to the rubber hand in full view. It was suggested that similar effects could be achieved by using a prosthesis with touch sensors that provides synchronous cutaneous feedback through an array of tactile stimulators on the stump. Such a prosthesis holds the potential to be easily incorporated within one’s body scheme, because it would reproduce the perceptual illusion in everyday usage. We propose to use sensory substitution – specifically vibrotactile – to address this issue, as current haptic technology is still too bulky and inefficient. In this basic study we addressed the fundamental question of whether visuo-tactile modality mismatch promotes self-attribution of a limb, and to what extent compared to a modality-matched paradigm, on normally-limbed subjects. We manipulated visuo-tactile stimulations, comprising combinations of modality matched, modality mismatched, synchronous and asynchronous stimulations, in a set of experiments fashioned after the Rubber Hand Illusion. Modality mismatched stimulation was provided using a keypad-controlled vibrotactile display. Results from three independent measures of embodiment (questionnaires, pointing tests and skin conductance responses) indicate that vibrotactile sensory substitution can be used to induce self-attribution of a rubber hand when synchronous but modality-conflicting visuo-tactile stimulation is delivered to the biological finger pads and to the equivalent rubber hand phalanges.     

Surface EMG pattern recognition for real-time control of a wrist exoskeleton

Background  

Surface electromyography (sEMG) signals have been used in numerous studies for the classification of hand gestures and movements and successfully implemented in the position control of different prosthetic hands for amputees. sEMG could also potentially be used for controlling wearable devices which could assist persons with reduced muscle mass, such as those suffering from sarcopenia. While using sEMG for position control, estimation of the intended torque of the user could also provide sufficient information for an effective force control of the hand prosthesis or assistive device. This paper presents the use of pattern recognition to estimate the torque applied by a human wrist and its real-time implementation to control a novel two degree of freedom wrist exoskeleton prototype (WEP), which was specifically developed for this work.     

Modelling natural and artificial hands with synergies

We report on recent work in modelling the process of grasping and active touch by natural and artificial hands. Starting from observations made in human hands about the correlation of degrees of freedom in patterns of more frequent use (postural synergies), we consider the implications of a geometrical model accounting for such data, which is applicable to the pre-grasping phase occurring when shaping the hand before actual contact with the grasped object. To extend applicability of the synergy model to study force distribution in the actual grasp, we introduce a modified model including the mechanical compliance of the hand's musculotendinous system. Numerical results obtained by this model indicate that the same principal synergies observed from pre-grasp postural data are also fundamental in achieving proper grasp force distribution. To illustrate the concept of synergies in the dual domain of haptic sensing, we provide a review of models of how the complexity and heterogeneity of sensory information from touch can be harnessed in simplified, tractable abstractions. These abstractions are amenable to fast processing to enable quick reflexes as well as elaboration of high-level percepts. Applications of the synergy model to the design and control of artificial hands and tactile sensors are illustrated.     

Surface EMG in advanced hand prosthetics

One of the major problems when dealing with highly dexterous, active hand prostheses is their control by the patient wearing them. With the advances in mechatronics, building prosthetic hands with multiple active degrees of freedom is realisable, but actively controlling the position and especially the exerted force of each finger cannot yet be done naturally. This paper deals with advanced robotic hand control via surface electromyography. Building upon recent results, we show that machine learning, together with a simple downsampling algorithm, can be effectively used to control on-line, in real time, finger position as well as finger force of a highly dexterous robotic hand. The system determines the type of grasp a human subject is willing to use, and the required amount of force involved, with a high degree of accuracy. This represents a remarkable improvement with respect to the state-of-the-art of feed-forward control of dexterous mechanical hands, and opens up a scenario in which amputees will be able to control hand prostheses in a much finer way than it has so far been possible. This work is partially supported by the project NEURObotics, FP6-IST-001917.     

Molecular diversity--the toolbox for synthetic gene switches and networks

The rapid development of synthetic biology is a paradigm of how the molecular diversity of naturally occurring gene control components can be used to design synthetic control devices and gene networks that provide precisely programmed transgene expression dynamics in space and time. Here we offer an overview on recent advances in the modular design of trigger-inducible mammalian expression devices that are either responsive by exogenous stimuli such as chemicals and physical cues or controlled by endogenous metabolites driving prosthetic circuits to treat metabolic disorders in a self-sufficient manner. Compatible genetic switches can also be assembled to synthetic gene networks that show highly complex expression dynamics such as temporally resolved band-detect functions or oscillating transgene expression profiles. The ongoing metagenomic discovery and characterization of the unexplored sequence space is constantly increasing the molecular diversity in fundamental control components that fuels the further development of synthetic biology.     

A methodology for studying the effects of various types of prosthetic feet on the biomechanics of trans-femoral amputee gait.

This paper reports on a methodology developed for studying the effects of various types of prosthetic feet on the gait of trans-femoral amputees. It is shown that an analysis in three planes of motion of not only the prosthetic, but also the sound limb provides important information on the performance of prosthetic feet. Two male trans-femoral amputees were tested with four different prosthetic feet; the Springlite II, Carbon Copy III, Seattle LightFoot and the Multiflex foot. A detailed analysis of the results of one amputee and a summary of the most important results of a second subject is presented. The tests were carried out at normal (1.16 m s(-1)) and fast (1.56 m s(-1)) walking speeds. Three dimensional gait analysis was carried out to derive the time curves of the joint angles, intersegmental moments and power at the ankle, knee and hip joints at both the prosthetic and sound sides. A higher first peak of the ground reaction force at the sound side with the Seattle LightFoot compared to that with the Springlite II, may be the result of the lower late stance dorsiflexion angle with the former. Compared to the other two feet, the Carbon Copy III and the Springlite II showed higher prosthetic dorsiflexing moments and positive power at late stance, which could assist in the push-off. The 3D intersegmental loads at the ankle and knee can be used as a guide for design and for compilation of standards for testing of lower limb prostheses incorporating flexible feet.     

Altered kinetic strategy for the control of swing limb elevation over obstacles in unilateral below-knee amputee gait.

Our goal was to document the kinetic strategies for obstacle avoidance in below-knee amputees. Kinematic data were collected as unilateral below-knee traumatic amputees stepped over obstacles of various heights in the walking path. Inverse dynamics were employed to calculate power profiles and work during the limb-elevation and limb-lowering phases. Limb elevation was achieved by employing a different strategy of intra-limb interaction for elevation of the prosthetic limb than for the sound limb, which was similar to that seen in healthy adult non-amputees. As obstacle height increased, prosthetic side knee flexion was increased by modulating the work done at the hip, and not the knee, as seen on the sound side. Although the strength of the muscles about the residual knee was preserved, the range of motion of that knee had previously been found to be somewhat limited. Perhaps more importantly, potential instability of the interface between the stump and the prosthetic socket, and associated discomfort at the stump could explain the altered limb-elevation strategy. Interestingly, the limb-lowering strategy seen in the sound limb and in non-amputees already features modulation of rotational and translational work at the hip, so an alternate strategy was not required. Thus, following a major insult to the sensory and neuromuscular system, the CNS is able to update the internal model of the locomotor apparatus as the individual uses the new limb in a variety of movements, and modify control strategies as appropriate.     

Bio-inspired grasp control in a robotic hand with massive sensorial input

The capability of grasping and lifting an object in a suitable, stable and controlled way is an outstanding feature for a robot, and thus far, one of the major problems to be solved in robotics. No robotic tools able to perform an advanced control of the grasp as, for instance, the human hand does, have been demonstrated to date. Due to its capital importance in science and in many applications, namely from biomedics to manufacturing, the issue has been matter of deep scientific investigations in both the field of neurophysiology and robotics. While the former is contributing with a profound understanding of the dynamics of real-time control of the slippage and grasp force in the human hand, the latter tries more and more to reproduce, or take inspiration by, the nature’s approach, by means of hardware and software technology. On this regard, one of the major constraints robotics has to overcome is the real-time processing of a large amounts of data generated by the tactile sensors while grasping, which poses serious problems to the available computational power. In this paper a bio-inspired approach to tactile data processing has been followed in order to design and test a hardware–software robotic architecture that works on the parallel processing of a large amount of tactile sensing signals. The working principle of the architecture bases on the cellular nonlinear/neural network (CNN) paradigm, while using both hand shape and spatial–temporal features obtained from an array of microfabricated force sensors, in order to control the sensory-motor coordination of the robotic system. Prototypical grasping tasks were selected to measure the system performances applied to a computer-interfaced robotic hand. Successful grasps of several objects, completely unknown to the robot, e.g. soft and deformable objects like plastic bottles, soft balls, and Japanese tofu, have been demonstrated.     

Fine detection of grasp force and posture by amputees via surface electromyography

The state-of-the-art feed-forward control of active hand prostheses is rather poor. Even dexterous, multi-fingered commercial prostheses are controlled via surface electromyography (EMG) in a way that enforces a few fixed grasping postures, or a very basic estimate of force. Control is not natural, meaning that the amputee must learn to associate, e.g., wrist flexion and hand closing. Nevertheless, recent literature indicates that much more information can be gathered from plain, old surface EMG. To check this issue, we have performed an experiment in which three amputees train a Support Vector Machine (SVM) using five commercially available EMG electrodes while asked to perform various grasping postures and forces with their phantom limbs. In agreement with recent neurological studies on cortical plasticity, we show that amputees operated decades ago can still produce distinct and stable signals for each posture and force. The SVM classifies the posture up to a precision of 95% and approximates the force with an error of as little as 7% of the signal range, sample-by-sample at 25 Hz. These values are in line with results previously obtained by healthy subjects while feed-forward controlling a dexterous mechanical hand. We then conclude that our subjects could finely feed-forward control a dexterous prosthesis in both force and position, using standard EMG in a natural way, that is, using the phantom limb.     

Controlling propulsive forces in gait initiation in transfemoral amputees

During prosthetic gait initiation, transfemoral (TF) amputees control the spatial and temporal parameters that modulate the propulsive forces, the positions of the center of pressure (CoP), and the center of mass (CoM). Whether their sound leg or the prosthetic leg is leading, the TF amputees reach the same end velocity. We wondered how the CoM velocity build up is influenced by the differences in propulsive components in the legs and how the trajectory of the CoP differs from the CoP trajectory in able bodied (AB) subjects. Seven TF subjects and eight AB subjects were tested on a force plate and on an 8 m long walkway. On the force plate, they initiated gait two times with their sound leg and two times with their prosthetic leg. Force measurement data were used to calculate the CoM velocity curves in horizontal and vertical directions. Gait initiated on the walkway was used to determine the leg preference. We hypothesized that because of the differences in propulsive components, the motions of the CoP and the CoM have to be different, as ankle muscles are used to help generate horizontal ground reaction force components. Also, due to the absence of an active ankle function in the prosthetic leg, the vertical CoM velocity during gait initiation may be different when leading with the prosthetic leg compared to when leading with the sound leg. The data showed that whether the TF subjects initiated a gait with their prosthetic leg or with their sound leg, their horizontal end velocity was equal. The subjects compensated the loss of propulsive force under the prosthesis with the sound leg, both when the prosthetic leg was leading and when the sound leg was leading. In the vertical CoM velocity, a tendency for differences between the two conditions was found. When initiating gait with the sound leg, the downward vertical CoM velocity at the end of the gait initiation was higher compared to when leading with the prosthetic leg. Our subjects used a gait initiation strategy that depended mainly on the active ankle function of the sound leg; therefore, they changed the relative durations of the gait initiation anticipatory postural adjustment phase and the step execution phase. Both legs were controlled in one single system of gait propulsion. The shape of the CoP trajectories, the applied forces, and the CoM velocity curves are described in this paper.     

Estimation of the forces generated by the thigh muscles for transtibial amputee gait

The forces generated by the muscles with origin on the human femur play a major role in transtibial amputee gait, as they are the most effective of the means that the body can use for propulsion. By estimating the forces generated by the thigh muscles of transtibial amputees, and comparing them to the forces generated by the thigh muscles of normal subjects, it is possible to better estimate the energy output needed from prosthetic devices. The purpose of this paper is to obtain the forces generated by the thigh muscles of transtibial amputees and compare these with forces obtained from the same muscles in the case of normal subjects. Two transtibial amputees and four normal subjects similar in size to the amputees were investigated. Level ground walking was chosen as the movement to be studied, since it is a common activity that most amputees engage in. Inverse dynamics and a muscle recruitment algorithm (developed by AnyBody Technology^®) were used for generating the muscle activation patterns and for computing the muscle forces. The muscle forces were estimated as two sums: one for all posterior muscles and one for the anterior muscles, based on the position of the muscles of the thigh relative to the frontal plane of the human body. The results showed that a significantly higher force is generated by the posterior muscles of the amputees during walking, leading to a general increase of the metabolic cost necessary for one step.     

Dynamic updating of distributed neural representations using forward models

In this paper, we present a continuous attractor network model that we hypothesize will give some suggestion of the mechanisms underlying several neural processes such as velocity tuning to visual stimulus, sensory discrimination, sensorimotor transformations, motor control, motor imagery, and imitation. All of these processes share the fundamental characteristic of having to deal with the dynamic integration of motor and sensory variables in order to achieve accurate sensory prediction and/or discrimination. Such principles have already been described in the literature by other high-level modeling studies (Decety and Sommerville in Trends Cogn Sci 7:527–533, 2003; Oztop et al. in Neural Netw 19(3):254–271, 2006; Wolpert et al. in Philos Trans R Soc 358:593–602, 2003). With respect to these studies, our work is more concerned with biologically plausible neural dynamics at a population level. Indeed, we show that a relatively simple extension of the classical neural field models can endow these networks with additional dynamic properties for updating their internal representation using external commands. Moreover, an analysis of the interactions between our model and external inputs also shows interesting properties, which we argue are relevant for a better understanding of the neural processes of the brain.     

Analysing the content of the European Ocean Biogeographic Information System (EurOBIS): available data, limitations, prospects and a look at the future

The European Ocean Biogeographic Information System—EurOBIS—is an integrated data system developed by the Flanders Marine Institute (VLIZ) for the EU Network of Excellence “Marine Biodiversity and Ecosystem Functioning” (MarBEF) in 2004. Its principle aims are to centralise the largely scattered biogeographical data on marine species collected by European institutions and to make these quality-controlled data freely available and easily accessible. It is in essence a distributed system in which individual datasets go through a series of quality control procedures before they are integrated into one large consolidated database. EurOBIS is freely available online at , where marine biogeographical data—with a focus on taxonomy, temporal and spatial distribution—can be consulted and downloaded for analyses. Over the last 6 years, EurOBIS has collected 228 datasets contributed by more than 75 institutes, representing over 13.6 million distribution records of which almost 12.5 million records are species level identifications. It is now the largest online searchable public source of European marine biological data, holding biogeographical information on 26,801 species and 9,221 genera. EurOBIS acts as the European node of OBIS, the Ocean Biogeographic Information System of the Census of Marine Life (CoML). EurOBIS shares its data with OBIS, which in its turn shares its content with the Global Biodiversity Information Facility (GBIF). This article describes the status of the European Ocean Biogeographic Information System, identifies data gaps, possible applications, uses and limitations. It also formulates a strategy for the growth and improvement of the system and wants to appeal for more contributions.     

A position paper in support of hand transplantation in the blind

Blind upper extremity amputees have historically been excluded from consideration for hand allotransplantation. Although no formal position statement regarding their exclusion has been published to date, functional, rehabilitative, and ethical concerns related to blind amputee candidacy for hand transplantation may be inferred. The authors provide a summary of these reservations and a counterargument to their assumptions, drawing on outcomes measures reported for hand transplantations completed to date. The authors therefore provide a rationale for the inclusion of blind amputees in hand transplantation protocols in the future.     

Toward the Restoration of Hand Use to a Paralyzed Monkey: Brain-Controlled Functional Electrical Stimulation of Forearm Muscles

Loss of hand use is considered by many spinal cord injury survivors to be the most devastating consequence of their injury. Functional electrical stimulation (FES) of forearm and hand muscles has been used to provide basic, voluntary hand grasp to hundreds of human patients. Current approaches typically grade pre-programmed patterns of muscle activation using simple control signals, such as those derived from residual movement or muscle activity. However, the use of such fixed stimulation patterns limits hand function to the few tasks programmed into the controller. In contrast, we are developing a system that uses neural signals recorded from a multi-electrode array implanted in the motor cortex; this system has the potential to provide independent control of multiple muscles over a broad range of functional tasks. Two monkeys were able to use this cortically controlled FES system to control the contraction of four forearm muscles despite temporary limb paralysis. The amount of wrist force the monkeys were able to produce in a one-dimensional force tracking task was significantly increased. Furthermore, the monkeys were able to control the magnitude and time course of the force with sufficient accuracy to track visually displayed force targets at speeds reduced by only one-third to one-half of normal. Although these results were achieved by controlling only four muscles, there is no fundamental reason why the same methods could not be scaled up to control a larger number of muscles. We believe these results provide an important proof of concept that brain-controlled FES prostheses could ultimately be of great benefit to paralyzed patients with injuries in the mid-cervical spinal cord.     

Asymmetric cell division in the morphogenesis of <Emphasis Type="Italic">Drosophila melanogaster</Emphasis> macrochaetae

Asymmetric cell division (ACD) is the basic process which creates diversity in the cells of multi-cellular organisms. As a result of asymmetric cell division, daughter cells acquire the ability to differentiate and specialize in a given direction, which is different from that of their parent cells and from each other. This type of division is observed in a wide range of living organisms from bacteria to vertebrates. It has been shown that the molecular-genetic control mechanism of ACD is evolutionally conservative. The proteins involved in the process of ACD in different kinds of animals have a high degree of homology. Sensory organs—bristles (macrochaetae)—of Drosophila are widely used as a model system for studying the genetic control mechanisms of asymmetric division. Bristles located in an orderly manner on the head and body of the fly play the role of mechanoreceptors. Each of them consists of four specialized cells—offspring of the only sensory organ precursor cell (SOP), which differentiates from the wing imaginal disc at the larval stage of the late third age. The basic differentiation and further specialization of the daughter cells of SOP is an asymmetric division process.     

Conceptual Method of Temperature Sensation in Bionic Hand by Extraordinary Perceptual Phenomenon

Lack of temperature sensation of myoelectric prosthetic hand limits the daily activities of amputees.To this end,a non-invasive temperature sensation method is proposed to train amputees to sense temperature with psychophysical sensory substitution.In this study,22 healthy participants took part besides 5 amputee participants.The duration time of the study was 31 days with five test steps according to the Leitner technique.An adjustable temperature mug and a Peltier were used to change the temperature of the water/phantom digits to induce temperature to participants.Also,to isolate the surround-ings and show colors,a Virtual Reality(VR)glass was employed.The statistical results conducted are based on the response of participants with questionnaire method.Using Chi-square tests,it is concluded that participants answer the experiment significantly correctly using the Leitner technique(P value＜0.05).Also,by applying the"Repeated Measures ANOVA",it is noticed that the time of numbness felt by participants had significant(P value＜0.001)difference.Participants could remember lowest and highest temperatures significantly better than other temperatures(P value＜0.001);furthermore,the well-trained amputee participant practically using the prosthesis with 72.58％could identify object's temperature with only once time experimenting the color temperature.     

Stance phase control of above-knee prostheses: knee control versus SACH foot design

The mobility of above-knee amputees (A/K) is limited, in part, due to the performance of A/K prostheses during the stance phase. Currently stance phase control of most conventional A/K prostheses can only be achieved through leg alignment and choice of the SACH (Solid Ankle Cushioned Heel) foot. This paper examines the role of the knee controller in relation to a SACH foot during the stance phase of level walking. The three-dimensional gait mechanics were measured under two stance phase conditions. In the first set of trials, the amputee used a prosthesis with a conventional knee controller that allowed the amputee to maintain the knee joint in full extension during the stance phase. In the second set of trials, the prosthetic knee, during stance, echoed the modified kinematics of the amputee's sound (intact) knee that had been recorded during the previous sound stance phase. Analysis and interpretation of the data indicate the following: (1) SACH foot design can strongly influence the walking mechanics independent of the knee controller; (2) knee controller design and SACH foot design are mutually interdependent; and (3) normal kinematics imposed on the prosthetic knee does not necessarily produce normal hip kinematics (e.g. reduce the abnormal rise in the prosthetic side hip trajectory). Future research is necessary to explore and exploit the interdependency of prosthetic knee control and foot design.