Three-dimensional kinematic analysis of influence of hand orientation and joint limits on the control of arm postures and movements

The problems related to kinematic redundancy in both task and joint space were investigated for arm prehension movements in this paper. After a detailed analysis of kinematic redundancy of the arm, it is shown that the redundancy problem is ill posed only for the control of hand orientation. An experiment was then designed to investigate the influence of hand orientation on the control of arm movements. Since movements must be made within the limits of the joints, the influence of these limits was also analyzed quantitatively. The results of the experiment confirm that the increase of movement time because of the change of object orientation is due to the lengthening of the deceleration phase disproportionately to the rest of the movement. The variation of hand path due to the change of object orientation was observed as being surprisingly small for some subjects as opposed to the large range of object orientation, implying that hand path and hand orientation could be controlled separately, thus simplifying the computational problem of inverse kinematics. Moreover, the observations from the present experiment strongly suggest that a functional segmentation of the proximal and distal joints exists and that the control of wrist motion is dissociated from the rest of joint motions. The contribution of each joint in the control of arm movements could be determined through the principle of minimum energy and minimum discomfort under the constraints of the joint limits. A simplified inverse kinematics model was tested. It shows that these hypotheses can be easily implemented in a geometric algorithm and be used to predict arm prehension postures reasonably well under the constraints of joint limits. Received: 6 August 1998 / Accepted in revised form: 16 December 1998     

Learning the dynamics of reaching movements results in the modification of arm impedance and long-latency perturbation responses

 Some characteristics of arm movements that humans exhibit during learning the dynamics of reaching are consistent with a theoretical framework where training results in motor commands that are gradually modified to predict and compensate for novel forces that may act on the hand. As a first approximation, the motor control system behaves as an adapting controller that learns an internal model of the dynamics of the task. It approximates inverse dynamics and predicts motor commands that are appropriate for a desired limb trajectory. However, we had previously noted that subtle motion characteristics observed during changes in task dynamics challenged this simple model and raised the possibility that adaptation also involved sensory–motor feedback pathways. These pathways reacted to sensory feedback during the course of the movement. Here we hypothesize that adaptation to dynamics might also involve a modification of how the CNS responds to sensory feedback. We tested this through experiments that quantified how the motor system's response to errors during voluntary movements changed as it adapted to dynamics of a force field. We describe a nonlinear approach that approximates the impedance of the arm, i.e., force response as a function of arm displacement trajectory. We observe that after adaptation, the impedance function changes in a way that closely matches and counters the effect of the force field. This is particularly prominent in the long-latency (>100 ms) component of response to perturbations. Therefore, it appears that practice not only modifies the internal model with which the brain generates motor commands that initiate a movement, but also the internal model with which sensory feedback is integrated with the ongoing descending commands in order to respond to error during the movement. Received: 10 January 2001 / Accepted in revised form: 30 May 2001     

Formation and control of optimal trajectory in human multijoint arm movement

In this paper, we study trajectory planning and control in voluntary, human arm movements. When a hand is moved to a target, the central nervous system must select one specific trajectory among an infinite number of possible trajectories that lead to the target position. First, we discuss what criterion is adopted for trajectory determination. Several researchers measured the hand trajectories of skilled movements and found common invariant features. For example, when moving the hand between a pair of targets, subjects tended to generate roughly straight hand paths with bell-shaped speed profiles. On the basis of these observations and dynamic optimization theory, we propose a mathematical model which accounts for formation of hand trajectories. This model is formulated by defining an objective function, a measure of performance for any possible movement: square of the rate of change of torque integrated over the entire movement. That is, the objective function CT is defined as follows: (formula; see text) We overcome this difficult by developing an iterative scheme, with which the optimal trajectory and the associated motor command are simultaneously computed. To evaluate our model, human hand trajectories were experimentally measured under various behavioral situations. These results supported the idea that the human hand trajectory is planned and controlled in accordance with the minimum torque-change criterion.     

A behavior-based inverse kinematics algorithm to predict arm prehension postures for computer-aided ergonomic evaluation.

In this paper, the computational problem of inverse kinematics of arm prehension movements was investigated. How motions of each joint involved in arm movements can be used to control the end-effector (hand) position and orientation was first examined. It is shown that the inverse kinematics problem due to the kinematic redundancy in joint space is ill-posed only at the control of hand orientation but not at the control of hand position. Based upon this analysis, a previously proposed inverse kinematics algorithm (Wang et Verriest, 1998a) to predict arm reach postures was extended to a seven-DOF arm model to predict arm prehension postures using a separate control of hand position and orientation. The algorithm can be either in rule-based form or by optimization through appropriate choice of weight coefficients. Compared to the algebraic inverse kinematics algorithm, the proposed algorithm can handle the non-linearity of joint limits in a straightforward way. In addition, no matrix inverse calculation is needed, thus avoiding the stability and convergence problems often occurring near a singularity of the Jacobian. Since an end-effector motion-oriented method is used to describe joint movements, observed behaviors of arm movements can be easily implemented in the algorithm. The proposed algorithm provides a general frame for arm postural control and can be used as an efficient postural manipulation tool for computer-aided ergonomic evaluation.     

On the possibility of linear modelling the human arm neuromuscular apparatus

It has been widely claimed that linear models of the neuromuscular apparatus give very inaccurate approximations of human arm reaching movements. The present paper examines this claim by quantifying the contributions of the various non-linear effects of muscle force generation on the accuracy of linear approximation. We performed computer simulations of a model of a two-joint arm with six monarticular and biarticular muscles. The global actions of individual muscles resulted in a linear dependence of the joint torques on the joint angles and angular velocities, despite the great non-linearity of the muscle properties. The effect of time delay in force generation is much more important for model accuracy than all the non-linear effects, while ignoring this time delay in linear approximation results in large errors. Thus, the viscosity coefficients are rather underestimated and some of them can even be paradoxically estimated to be negative. Similarly, our computation showed that ignoring the time delay resulted in large errors in the estimation of the hand equilibrium trajectory. This could explain why experimentally estimated hand equilibrium trajectories may be complex, even during a simple reaching movement. The hand equilibrium trajectory estimated by a linear model becomes simple when the time delay is taken into account, and it is close to that actually used in the non-linear model. The results therefore provide a theoretical basis for estimating the hand equilibrium trajectory during arm reaching movements and hence for estimating the time course of the motor control signals associated with this trajectory, as set out in the equilibrium point hypothesis. Received: 17 February 1999 / Accepted in revised form: 22 October 1999     

Development of an Anthropomorphic Robotic Arm and Hand for Interactive Humanoids

Humanoid robots are designed and built to mimic human form and movement.Ultimately,they are meant to resemble the size and physical abilities of a human in order to function in human-oriented environments and to work autonomously but to pose no physical threat to humans.Here,a humanoid robot that resembles a human in appearance and movement is built using powerful actuators paired with gear trains,joint mechanisms,and motor drivers that are all encased in a package no larger than that of the human physique.In this paper,we propose the construction of a humanoid-applicable anthropomorphic 7-DoF arm complete with an 8-DoF hand.The novel mechanical design of this humanoid arm makes it sufficiently compact to be compatible with currently available narrating-model humanoids,and to be sufficiently powerful and flexible to be functional; the number of degrees of freedom endowed in this robotic arm is sufficient for executing a wide range of tasks,including dexterous hand movements.The developed humanoid arm and hand are capable of sensing and interpreting incoming external force using the motor in each joint current without conventional torque sensors.The humanoid arm adopts an algorithm to avoid obstacles and the dexterous hand is capable of grasping objects.The developed robotic arm is suitable for use in an interactive humanoid robot.     

Kinematic invariants during cyclical arm movements

It has been observed that the motion of the arm end-point (the hand, fingertip or the tip of a pen) is characterized by a number of regularities (kinematic invariants). Trajectory is usually straight, and the velocity profile has a bell shape during point-to-point movements. During drawing movements, a two-thirds power law predicts the dependence of the end-point velocity on the trajectory curvature. Although various principles of movement organization have been discussed as possible origins of these kinematic invariants, the nature of these movement trajectory characteristics remains an open question. A kinematic model of cyclical arm movements derived in the present study analytically demonstrates that all three kinematic invariants can be predicted from a two-joint approximation of the kinematic structure of the arm and from sinusoidal joint motions. With this approach, explicit expressions for two kinematic invariants, the two-thirds power law during drawing movements and the velocity profile during point-to-point movements are obtained as functions of arm segment lengths and joint motion parameters. Additionally, less recognized kinematic invariants are also derived from the model. The obtained analytical expressions are further validated with experimental data. The high accuracy of the predictions confirms practical utility of the model, showing that the model is relevant to human performance over a wide range of movements. The results create a basis for the consolidation of various existing interpretations of kinematic invariants. In particular, optimal control is discussed as a plausible source of invariant characteristics of joint motions and movement trajectories.     

Robot-based methodology for a kinematic and kinetic analysis of unconstrained,but reproducible upper extremity movement

Although arm movements play an important role in everyday life, there is still a lack of procedures for the analysis of upper extremity movement. The main problems for standardizing the procedure are the variety of arm movements and the difficult assessment of external hand forces. The first problem requires the predefinition of motions, and the second one is the prerequisite for calculation of net joint forces and torques arising during motion. A new methodology for measuring external forces during prespecified, reproducible upper extremity movement has been introduced and validated. A robot-arm has been used to define the motion and 6 degrees of freedom (DoF) force sensor has been attached to it for acquiring the external loads acting on the arm. Additionally, force feedback has been used to help keeping external loads constant. Intra-individual reproducibility of joint angles was estimated by using correlation coefficients to compare a goal-directed movement with robot-guided task. Inter-individual reproducibility has been evaluated by using the mean standard deviation of joint angles for both types of movement. The results showed that both inter- and intra-individual reproducibility have significantly improved by using the robot. Also, the effectiveness of using force feedback for keeping a constant external load has been shown. This makes it possible to estimate net joint forces and torques which are important biomechanical information in motion analysis.     

A method for measuring endpoint stiffness during multi-joint arm movements

Current methods for measuring stiffness during human arm movements are either limited to one-joint motions, or lead to systematic errors. The technique presented here enables a simple, accurate and unbiased measurement of endpoint stiffness during multi-joint movements. Using a computer-controlled mechanical interface, the hand is displaced relative to a prediction of the undisturbed trajectory. Stiffness is then computed as the ratio of restoring force to displacement amplitude. Because of the accuracy of the prediction (< 1 cm error after 200 ms) and the quality of the implementation, the movement is not disrupted by the perturbation. This technique requires only 13 as many trials to identify stiffness as the method of Gomi and Kawato (1997, Biological Cybernetics 76, 163-171) and may, therefore, be used to investigate the evolution of stiffness during motor adaptation.     

Stabilisation of walking by intrinsic muscle properties revealed in a three-dimensional muscle-driven simulation

A fundamental question in movement science is how humans perform stable movements in the presence of disturbances such as contact with objects. It remains unclear how the nervous system, with delayed responses to disturbances, maintains the stability of complex movements. We hypothesised that intrinsic muscle properties (i.e. the force–length–velocity properties of muscle fibres and tendon elasticity) may help stabilise human walking by responding instantaneously to a disturbance and providing forces that help maintain the movement trajectory. To investigate this issue, we generated a 3D muscle-driven simulation of walking and analysed the changes in the simulation's motion when a disturbance was applied to models with and without intrinsic muscle properties. Removing the intrinsic properties reduced the stability; this was true when the disturbing force was applied at a variety of times and in different directions. Thus, intrinsic muscle properties play a unique role in stabilising walking, complementing the delayed response of the central nervous system.     

Virtual trajectory and stiffness ellipse during multijoint arm movement predicted by neural inverse models

We predict the virtual trajectories and stiffness ellipses during multijoint arm movements by computer simulations. A two-link manipulator with four single-joint muscles and two double-joint muscles is used as a model of the human arm. Physical parameters of the model are derived from several experimental data. Among them, special emphasis is put on low values of the dynamic hand stiffness recently measured during single joint and multijoint movements. The feedback-error-learning scheme to acquire the inverse dynamics model and the inverse statics model is utilized for this prediction. The virtual trajectories are much more complex than the actual trajectories. This indicates that planning the virtual trajectory is as difficult as solving the inverse dynamics problem for medium and fast movements, and simply falsifies the advocated computational advantage of the virtual trajectory control hypothesis. Thus, we conclude that learning inverse models is essential even in the virtual trajectory control framework. Finally, we propose a new computational model to learn the complicated shape of the virtual trajectories by integrating the virtual trajectory control and the feedback-error-learning scheme.     

Computational model of motor learning and perceptual change

Motor learning in the context of arm reaching movements has been frequently investigated using the paradigm of force-field learning. It has been recently shown that changes to somatosensory perception are likewise associated with motor learning. Changes in perceptual function may be the reason that when the perturbation is removed following motor learning, the hand trajectory does not return to a straight line path even after several dozen trials. To explain the computational mechanisms that produce these characteristics, we propose a motor control and learning scheme using a simplified two-link system in the horizontal plane: We represent learning as the adjustment of desired joint-angular trajectories so as to achieve the reference trajectory of the hand. The convergence of the actual hand movement to the reference trajectory is proved by using a Lyapunov-like lemma, and the result is confirmed using computer simulations. The model assumes that changes in the desired hand trajectory influence the perception of hand position and this in turn affects movement control. Our computer simulations support the idea that perceptual change may come as a result of adjustments to movement planning with motor learning.     

Trajectory formation based on physiological characteristics of skeletal muscles

Human arm trajectories in natural unrestricted reaching movements were studied. They have particular properties such that a hand path is a rather simple straight or curved line, and a tangential velocity profile of hand is bell-shaped. Also these properties are invariant, independent of movement duration and hand-held load. In this study, trajectory formation is investigated on the basis of physiological characteristics of skeletal muscles, and a criterion prescribed by a derivative of isometric muscle torque is proposed. Subsequently, optimal trajectories are formulated under various conditions of movement to account for a planning strategy of human arm trajectories. In addition to such a theoretical approach, human arm trajectories are experimentally observed by a measuring system which provides a visual sensor and a target tracking device, enabling totally unrestricted movements. Then, optimal trajectories are quantitatively evaluated in comparison with experimental data in which essential properties of human arm trajectories are demonstrated. These results support the idea that human arm trajectories are planned in order to minimize the proposed criterion which is determined from physiological aspects. Finally, the physiological advantages of human arm trajectories are discussed with regard to the analysis of observed and optimal trajectories. Received: 2 December 1997 / Accepted in revised form: 20 March 1998     

An artificial muscle actuator for biomimetic underwater propulsors

In this paper, we introduce the analytical framework of the modeling dynamic characteristics of a soft artificial muscle actuator for aquatic propulsor applications. The artificial muscle used for this underwater application is an ionic polymer-metal composite (IPMC) which can generate bending motion in aquatic environments. The inputs of the model are the voltages applied to multiple IPMCs, and the output can be either the shape of the actuators or the thrust force generated from the interaction between dynamic actuator motions and surrounding water. In order to determine the relationship between the input voltages and the bending moments, the simplified RC model is used, and the mechanical beam theory is used for the bending motion of IPMC actuators. Also, the hydrodynamic forces exerted on an actuator as it moves relative to the surrounding medium or water are added to the equations of motion to study the effect of actuator bending on the thrust force generation. The proposed method can be used for modeling the general bending type artificial muscle actuator in a single or segmented form operating in the water. The segmented design has more flexibility in controlling the shape of the actuator when compared with the single form, especially in generating undulatory waves. Considering an inherent nature of large deformations in the IPMC actuator, a large deflection beam model has been developed and integrated with the electrical RC model and hydrodynamic forces to develop the state space model of the actuator system. The model was validated against existing experimental data.     

Mechanisms underlying the generation of averaged modified trajectories

In this work we have studied what mechanisms might possibly underlie arm trajectory modification when reaching toward visual targets. The double-step target displacement paradigm was used with inter-stimulus intervals (ISIs) in the range of 10-300 ms. For short ISIs, a high percentage of the movements were found to be initially directed in between the first and second target locations (averaged trajectories). The initial direction of motion was found to depend on the target configuration, and on : the time difference between the presentation of the second stimulus and movement onset. To account for the kinematic features of the averaged trajectories two modification schemes were compared: the superposition scheme and the abort-replan scheme. According to the superposition scheme, the modified trajectories result from the vectorial addition of two elemental motions: one for moving between the initial hand position and an intermediate location, and a second one for moving between that intermediate location and the final target. According to the abort-replan scheme, the initial plan for moving toward the intermediate location is aborted and smoothly replaced by a new plan for moving from the hand position at the time the trajectory is modified to the final target location. In both tested schemes we hypothesized that due to the quick displacement of the stimulus, the internally specified intermediate goal might be influenced by both stimuli and may be different from the location of the first stimulus. It was found that the statistically most successful model in accounting for the measured data is based on the superposition scheme. It is suggested that superposition of simple independent elemental motions might be a general principle for the generation of modified motions, which allows for efficient, parallel planning. For increasing values of the inferred locations of the intermediate targets were found to gradually shift from the first toward the second target locations along a path that curved toward the initial hand position. These inferred locations show a strong resemblance to the intermediate locations of saccades generated in a similar double-step paradigm. These similarities in the specification of target locations used in the generation of eye and hand movements may serve to simplify visuomotor integration. Received: 22 June 1994 / Accepted in revised form: 15 September 1994     

Limb Dominance Results from Asymmetries in Predictive and Impedance Control Mechanisms

Handedness is a pronounced feature of human motor behavior, yet the underlying neural mechanisms remain unclear. We hypothesize that motor lateralization results from asymmetries in predictive control of task dynamics and in control of limb impedance. To test this hypothesis, we present an experiment with two different force field environments, a field with a predictable magnitude that varies with the square of velocity, and a field with a less predictable magnitude that varies linearly with velocity. These fields were designed to be compatible with controllers that are specialized in predicting limb and task dynamics, and modulating position and velocity dependent impedance, respectively. Because the velocity square field does not change the form of the equations of motion for the reaching arm, we reasoned that a forward dynamic-type controller should perform well in this field, while control of linear damping and stiffness terms should be less effective. In contrast, the unpredictable linear field should be most compatible with impedance control, but incompatible with predictive dynamics control. We measured steady state final position accuracy and 3 trajectory features during exposure to these fields: Mean squared jerk, Straightness, and Movement time. Our results confirmed that each arm made straighter, smoother, and quicker movements in its compatible field. Both arms showed similar final position accuracies, which were achieved using more extensive corrective sub-movements when either arm performed in its incompatible field. Finally, each arm showed limited adaptation to its incompatible field. Analysis of the dependence of trajectory errors on field magnitude suggested that dominant arm adaptation occurred by prediction of the mean field, thus exploiting predictive mechanisms for adaptation to the unpredictable field. Overall, our results support the hypothesis that motor lateralization reflects asymmetries in specific motor control mechanisms associated with predictive control of limb and task dynamics, and modulation of limb impedance.     

Dynamic primitives of motor behavior

We present in outline a theory of sensorimotor control based on dynamic primitives, which we define as attractors. To account for the broad class of human interactive behaviors??especially tool use??we propose three distinct primitives: submovements, oscillations, and mechanical impedances, the latter necessary for interaction with objects. Owing to the fundamental features of the neuromuscular system??most notably, its slow response??we argue that encoding in terms of parameterized primitives may be an essential simplification required for learning, performance, and retention of complex skills. Primitives may simultaneously and sequentially be combined to produce observable forces and motions. This may be achieved by defining a virtual trajectory composed of submovements and/or oscillations interacting with impedances. Identifying primitives requires care: in principle, overlapping submovements would be sufficient to compose all observed movements but biological evidence shows that oscillations are a distinct primitive. Conversely, we suggest that kinematic synergies, frequently discussed as primitives of complex actions, may be an emergent consequence of neuromuscular impedance. To illustrate how these dynamic primitives may account for complex actions, we brieflyreviewthree typesof interactivebehaviors: constrained motion, impact tasks, and manipulation of dynamic objects.     

Where the eye looks, the hand follows; limb-dependent magnetic misreaching in optic ataxia

The posterior parietal cortex (PPC) is thought to play an important role in the sensorimotor transformations associated with reaching movements. In humans, damage to the PPC, particularly bilateral lesions, leads to impairments of visually guided reaching movements (optic ataxia). Recent accounts of optic ataxia based upon electrophysiological recordings in monkeys have proposed that this disorder arises because of a breakdown in the tuning fields of parietal neurons responsible for integrating spatially congruent retinal, eye, and hand position signals to produce coordinated eye and hand movements . We present neurological evidence that forces a reconceptualization of this view. We report a detailed case study of a patient with a limb-dependent form of optic ataxia who can accurately reach with either hand to objects that he can foveate (thereby demonstrating coordinated eye-hand movements) but who cannot effectively decouple reach direction from gaze direction for movements executed using his right arm. The demonstration that our patient's misreaching is confined to movements executed using his right limb, and only for movements that are directed to nonfoveal targets, rules out explanations based upon simple perceptual or motor deficits but indicates an impairment in the ability to dissociate the eye and limb visuomotor systems when appropriate.     

Octopuses use a human-like strategy to control precise point-to-point arm movements

One of the key problems in motor control is mastering or reducing the number of degrees of freedom (DOFs) through coordination. This problem is especially prominent with hyper-redundant limbs such as the extremely flexible arm of the octopus. Several strategies for simplifying these control problems have been suggested for human point-to-point arm movements. Despite the evolutionary gap and morphological differences, humans and octopuses evolved similar strategies when fetching food to the mouth. To achieve this precise point-to-point-task, octopus arms generate a quasi-articulated structure based on three dynamic joints. A rotational movement around these joints brings the object to the mouth . Here, we describe a peripheral neural mechanism-two waves of muscle activation propagate toward each other, and their collision point sets the medial-joint location. This is a remarkably simple mechanism for adjusting the length of the segments according to where the object is grasped. Furthermore, similar to certain human arm movements, kinematic invariants were observed at the joint level rather than at the end-effector level, suggesting intrinsic control coordination. The evolutionary convergence to similar geometrical and kinematic features suggests that a kinematically constrained articulated limb controlled at the level of joint space is the optimal solution for precise point-to-point movements.