Development of an Anthropomorphic Robotic Arm and Hand for Interactive Humanoids

Humanoid robots are designed and built to mimic human form and movement.Ultimately,they are meant to resemble the size and physical abilities of a human in order to function in human-oriented environments and to work autonomously but to pose no physical threat to humans.Here,a humanoid robot that resembles a human in appearance and movement is built using powerful actuators paired with gear trains,joint mechanisms,and motor drivers that are all encased in a package no larger than that of the human physique.In this paper,we propose the construction of a humanoid-applicable anthropomorphic 7-DoF arm complete with an 8-DoF hand.The novel mechanical design of this humanoid arm makes it sufficiently compact to be compatible with currently available narrating-model humanoids,and to be sufficiently powerful and flexible to be functional; the number of degrees of freedom endowed in this robotic arm is sufficient for executing a wide range of tasks,including dexterous hand movements.The developed humanoid arm and hand are capable of sensing and interpreting incoming external force using the motor in each joint current without conventional torque sensors.The humanoid arm adopts an algorithm to avoid obstacles and the dexterous hand is capable of grasping objects.The developed robotic arm is suitable for use in an interactive humanoid robot.     

An interference effect of observed biological movement on action

It has been proposed that actions are intrinsically linked to perception and that imagining, observing, preparing, or in any way representing an action excites the motor programs used to execute that same action. There is neurophysiological evidence that certain brain regions involved in executing actions are activated by the mere observation of action (the so-called "mirror system;" ). However, it is unknown whether this mirror system causes interference between observed and simultaneously executed movements. In this study we test the hypothesis that, because of the overlap between action observation and execution, observed actions should interfere with incongruous executed actions. Subjects made arm movements while observing either a robot or another human making the same or qualitatively different arm movements. Variance in the executed movement was measured as an index of interference to the movement. The results demonstrate that observing another human making incongruent movements has a significant interference effect on executed movements. However, we found no evidence that this interference effect occurred when subjects observed a robotic arm making incongruent movements. These results suggest that the simultaneous activation of the overlapping neural networks that process movement observation and execution infers a measurable cost to motor control.     

Motor Contagion during Human-Human and Human-Robot Interaction

Motor resonance mechanisms are known to affect humans'' ability to interact with others, yielding the kind of “mutual understanding” that is the basis of social interaction. However, it remains unclear how the partner''s action features combine or compete to promote or prevent motor resonance during interaction. To clarify this point, the present study tested whether and how the nature of the visual stimulus and the properties of the observed actions influence observer''s motor response, being motor contagion one of the behavioral manifestations of motor resonance. Participants observed a humanoid robot and a human agent move their hands into a pre-specified final position or put an object into a container at various velocities. Their movements, both in the object- and non-object- directed conditions, were characterized by either a smooth/curvilinear or a jerky/segmented trajectory. These trajectories were covered with biological or non-biological kinematics (the latter only by the humanoid robot). After action observation, participants were requested to either reach the indicated final position or to transport a similar object into another container. Results showed that motor contagion appeared for both the interactive partner except when the humanoid robot violated the biological laws of motion. These findings suggest that the observer may transiently match his/her own motor repertoire to that of the observed agent. This matching might mediate the activation of motor resonance, and modulate the spontaneity and the pleasantness of the interaction, whatever the nature of the communication partner.     

Anthropomorphic Design of the Human-Like Walking Robot

In this paper, we present a new concept of the mechanical design of a humanoid robot. The goal is to build a humanoid robot utilizing a new structure which is more suitable for human-like walking with the characteristics of the knee stretch, heel-contact, and toe-off. Inspired by human skeleton, we made an anthropomorphic pelvis for the humanoid robot. In comparison with conventional humanoid robots, with such the anthropomorphic pelvis, our robot is capable of adjusting the center of gravity of the upper body by the motion of pelvic tilt, thus reducing the required torque at the ankle joint and the velocity variations in human-like walking. With more precise analysis of the foot mechanism, the fixed-length inverted pendulum can be used to describe the dynamics of biped walking, thus preventing redundant works and power consumption in length variable inverted pendulum system. As the result of the new structure we propose, a humanoid robot is able to walk with human-like gait.     

Human-like Manipulation Planning for Articulated Manipulator

A new method based on human-likeness assessment and optimization concept to solve the problem of human-like manipulation planning for articulated robot is proposed in this paper.This method intrinsically formulates the problem as a constrained optimization problem in robot configuration space.The robot configuration space is divided into different subregions by human likeness assessment.A widely used strategy,Rapid Upper Limb Assessment (RULA) in applied ergonomics,is adopted here to evaluate the human likeness of robot configuration.A task compatibility measurement of the robot velocity transmission ratio along a specified direction is used as the target function for the optimization problem.Simple illustrative examples of this method applied to a two Degree of Freedom (DOF) planar robot that resembles the upper limb of a human are presented.Further applications to a humanoid industrial robot SDA10D are also presented.The reasonable planning results for these applications assert the effectiveness of our method.     

Seeing Minds in Others – Can Agents with Robotic Appearance Have Human-Like Preferences?

Ascribing mental states to non-human agents has been shown to increase their likeability and lead to better joint-task performance in human-robot interaction (HRI). However, it is currently unclear what physical features non-human agents need to possess in order to trigger mind attribution and whether different aspects of having a mind (e.g., feeling pain, being able to move) need different levels of human-likeness before they are readily ascribed to non-human agents. The current study addresses this issue by modeling how increasing the degree of human-like appearance (on a spectrum from mechanistic to humanoid to human) changes the likelihood by which mind is attributed towards non-human agents. We also test whether different internal states (e.g., being hungry, being alive) need different degrees of humanness before they are ascribed to non-human agents. The results suggest that the relationship between physical appearance and the degree to which mind is attributed to non-human agents is best described as a two-linear model with no change in mind attribution on the spectrum from mechanistic to humanoid robot, but a significant increase in mind attribution as soon as human features are included in the image. There seems to be a qualitative difference in the perception of mindful versus mindless agents given that increasing human-like appearance alone does not increase mind attribution until a certain threshold is reached, that is: agents need to be classified as having a mind first before the addition of more human-like features significantly increases the degree to which mind is attributed to that agent.     

Rhythm Patterns Interaction - Synchronization Behavior for Human-Robot Joint Action

Interactive behavior among humans is governed by the dynamics of movement synchronization in a variety of repetitive tasks. This requires the interaction partners to perform for example rhythmic limb swinging or even goal-directed arm movements. Inspired by that essential feature of human interaction, we present a novel concept and design methodology to synthesize goal-directed synchronization behavior for robotic agents in repetitive joint action tasks. The agents’ tasks are described by closed movement trajectories and interpreted as limit cycles, for which instantaneous phase variables are derived based on oscillator theory. Events segmenting the trajectories into multiple primitives are introduced as anchoring points for enhanced synchronization modes. Utilizing both continuous phases and discrete events in a unifying view, we design a continuous dynamical process synchronizing the derived modes. Inverse to the derivation of phases, we also address the generation of goal-directed movements from the behavioral dynamics. The developed concept is implemented to an anthropomorphic robot. For evaluation of the concept an experiment is designed and conducted in which the robot performs a prototypical pick-and-place task jointly with human partners. The effectiveness of the designed behavior is successfully evidenced by objective measures of phase and event synchronization. Feedback gathered from the participants of our exploratory study suggests a subjectively pleasant sense of interaction created by the interactive behavior. The results highlight potential applications of the synchronization concept both in motor coordination among robotic agents and in enhanced social interaction between humanoid agents and humans.     

The Temporal Structure of Vertical Arm Movements

The present study investigates how the CNS deals with the omnipresent force of gravity during arm motor planning. Previous studies have reported direction-dependent kinematic differences in the vertical plane; notably, acceleration duration was greater during a downward than an upward arm movement. Although the analysis of acceleration and deceleration phases has permitted to explore the integration of gravity force, further investigation is necessary to conclude whether feedforward or feedback control processes are at the origin of this incorporation. We considered that a more detailed analysis of the temporal features of vertical arm movements could provide additional information about gravity force integration into the motor planning. Eight subjects performed single joint vertical arm movements (45° rotation around the shoulder joint) in two opposite directions (upwards and downwards) and at three different speeds (slow, natural and fast). We calculated different parameters of hand acceleration profiles: movement duration (MD), duration to peak acceleration (D PA), duration from peak acceleration to peak velocity (D PA-PV), duration from peak velocity to peak deceleration (D PV-PD), duration from peak deceleration to the movement end (D PD-End), acceleration duration (AD), deceleration duration (DD), peak acceleration (PA), peak velocity (PV), and peak deceleration (PD). While movement durations and amplitudes were similar for upward and downward movements, the temporal structure of acceleration profiles differed between the two directions. More specifically, subjects performed upward movements faster than downward movements; these direction-dependent asymmetries appeared early in the movement (i.e., before PA) and lasted until the moment of PD. Additionally, PA and PV were greater for upward than downward movements. Movement speed also changed the temporal structure of acceleration profiles. The effect of speed and direction on the form of acceleration profiles is consistent with the premise that the CNS optimises motor commands with respect to both gravitational and inertial constraints.     

Movement Coordination or Movement Interference: Visual Tracking and Spontaneous Coordination Modulate Rhythmic Movement Interference

When an actor performs a rhythmic limb movement while observing a spatially incongruent movement he or she exhibits increased movement orthogonal to the instructed motion. Known as rhythmic movement interference, this phenomenon has been interpreted as a motor contagion effect, whereby observing the incongruent movement interferes with the intended movement and results in a motor production error. Here we test the hypothesis that rhythmic movement interference is an emergent property of rhythmic coordination. Participants performed rhythmic limb movements at a self-selected tempo while observing a computer stimulus moving in a congruent or incongruent manner. The degree to which participants visually tracked the stimulus was manipulated to influence whether participants became spontaneously entrained to the stimulus or not. Consistent with the rhythmic coordination hypothesis, participants only exhibited the rhythmic movement interference effect when they became spontaneously entrained to the incongruent stimulus.     

Humanoid robot Lola: Design and walking control

In this paper we present the humanoid robot LOLA, its mechatronic hardware design, simulation and real-time walking control. The goal of the LOLA-project is to build a machine capable of stable, autonomous, fast and human-like walking. LOLA is characterized by a redundant kinematic configuration with 7-DoF legs, an extremely lightweight design, joint actuators with brushless motors and an electronics architecture using decentralized joint control. Special emphasis was put on an improved mass distribution of the legs to achieve good dynamic performance. Trajectory generation and control aim at faster, more flexible and robust walking. Center of mass trajectories are calculated in real-time from footstep locations using quadratic programming and spline collocation methods. Stabilizing control uses hybrid position/force control in task space with an inner joint position control loop. Inertial stabilization is achieved by modifying the contact force trajectories.     

Analysis of an optimal control model of multi-joint arm movements

 In this paper, we propose a model of biological motor control for generation of goal-directed multi-joint arm movements, and study the formation of muscle control inputs and invariant kinematic features of movements. The model has a hierarchical structure that can determine the control inputs for a set of redundant muscles without any inverse computation. Calculation of motor commands is divided into two stages, each of which performs a transformation of motor commands from one coordinate system to another. At the first level, a central controller in the brain accepts instructions from higher centers, which represent the motor goal in the Cartesian space. The controller computes joint equilibrium trajectories and excitation signals according to a minimum effort criterion. At the second level, a neural network in the spinal cord translates the excitation signals and equilibrium trajectories into control commands to three pairs of antagonist muscles which are redundant for a two-joint arm. No inverse computation is required in the determination of individual muscle commands. The minimum effort controller can produce arm movements whose dynamic and kinematic features are similar to those of voluntary arm movements. For fast movements, the hand approaches a target position along a near-straight path with a smooth bell-shaped velocity. The equilibrium trajectories in X and Y show an ‘N’ shape, but the end-point equilibrium path zigzags around the hand path. Joint movements are not always smooth. Joint reversal is found in movements in some directions. The excitation signals have a triphasic (or biphasic) pulse pattern, which leads to stereotyped triphasic (or biphasic) bursts in muscle control inputs, and a dynamically modulated joint stiffness. There is a fixed sequence of muscle activation from proximal muscles to distal muscles. The order is preserved in all movements. For slow movements, it is shown that a constant joint stiffness is necessary to produce a smooth movement with a bell-shaped velocity. Scaled movements can be reproduced by varying the constraints on the maximal level of excitation signals according to the speed of movement. When the inertial parameters of the arm are altered, movement trajectories can be kept invariant by adjusting the pulse height values, showing the ability to adapt to load changes. These results agree with a wide range of experimental observations on human voluntary movements. Received: 4 December 1995 / Accepted in revised form: 17 September 1996     

Interlimb interactions during cyclic in-phase and antiphase movements of arms and legs and their dependence on afferent influences

Coordinated arm and leg movements imply neural interactions between the rhythmic generators of the upper and lower extremities. In ten healthy subjects in the lying position, activity of the muscles of the upper and lower extremities was recorded during separate and joint cyclic movements of the arms and legs with different phase relationships between the movements of the limbs and under various conditions of the motor task. Antiphase active arm movements were characterized by higher muscle activity than during the inphase mode. The muscle activity during passive arm movements imposed by the experimentalist was significantly lower than muscle activity during passive arm movements imposed by the other arm. When loading one arm, the muscle activity in the other, passively moving, arm increased independently from the synergy of arm movements. During a motor task implementing joint antiphase movements of both upper and lower extremities, compared to a motor task implementing their joint in-phase movements, we observed a significant increase in activity in the biceps brahii muscle, the tibialis anterior muscle, and the biceps femoris muscle. Loading of arms in these motor tasks has been accompanied by increased activity in some leg muscles. An increase in the frequency of rhythmic movements resulted in a significant growth of the muscle activity of the arms and legs during their cooperative movements with a greater rate of rise in the flexor muscle activity of the arms and legs during joint antiphase movements. Thus, both the spatial organization of movements and the type of afferent influences are significant factors of interlimb interactions, which, in turn, determine the type of neural interconnections that are involved in movement regulation.     

Learning robotic eye–arm–hand coordination from human demonstration: a coupled dynamical systems approach

We investigate the role of obstacle avoidance in visually guided reaching and grasping movements. We report on a human study in which subjects performed prehensile motion with obstacle avoidance where the position of the obstacle was systematically varied across trials. These experiments suggest that reaching with obstacle avoidance is organized in a sequential manner, where the obstacle acts as an intermediary target. Furthermore, we demonstrate that the notion of workspace travelled by the hand is embedded explicitly in a forward planning scheme, which is actively involved in detecting obstacles on the way when performing reaching. We find that the gaze proactively coordinates the pattern of eye–arm motion during obstacle avoidance. This study provides also a quantitative assessment of the coupling between the eye–arm–hand motion. We show that the coupling follows regular phase dependencies and is unaltered during obstacle avoidance. These observations provide a basis for the design of a computational model. Our controller extends the coupled dynamical systems framework and provides fast and synchronous control of the eyes, the arm and the hand within a single and compact framework, mimicking similar control system found in humans. We validate our model for visuomotor control of a humanoid robot.     

Role of motor cortex in coordinating multi-joint movements: is it time for a new paradigm?

Reaching movements to spatial targets require motor patterns at the shoulder to be coordinated carefully with those at the elbow to smoothly move the hand through space. While the motor cortex is involved in this volitional task, considerable debate remains about how this cortical region participates in planning and controlling movement. This article reviews two opposing interpretations of motor cortical function during multi-joint movements. On the one hand, studies performed predominantly on single-joint movement generally support the notion that motor cortical activity is intimately involved in generating motor patterns at a given joint. In contrast, studies on reaching demonstrate correlations between motor cortical activity and features of movement related to the hand, suggesting that the motor cortex may be involved in more global features of the task. Although this latter paradigm involves a multi-joint motor task in which neural activity is correlated with features of movement related to the hand, this neural activity is also correlated to other movement variables. Therefore it is difficult to assess if and how the motor cortex contributes to the coordination of motor patterns at different joints. In particular, present paradigms cannot assess whether motor cortical activity contributes to the control of one joint or multiple joints during whole-arm tasks. The final point discussed in this article is the development of a new experimental device (KINARM) that can both monitor and manipulate the mechanics of the shoulder and elbow independently during multi-joint motor tasks. It is hoped that this new device will provide a new approach for examining how the motor cortex is involved in motor coordination.     

Changes in limb dynamics during the practice of rapid arm movements

In our study we examined Bernstein's hypothesis that practice alters the motor coordination among the muscular and passive joint moments. In particular, we conducted dynamical analyses of a human multisegmental movement during the practice of a task involving the upper extremity. Seven male human volunteers performed maximal-speed, unrestrained vertical arm movements whose upward and downward trajectories between two target endpoints required the hand to round a barrier, resulting in complex shoulder, elbow, and wrist joint movements. These movements were recorded by high-speed ciné film, and myopotentials from selected upper-extremity muscles were recorded. The arm was modeled as interconnected rigid bodies, so that dynamical interactions among the upper arm, forearm, and hand could be calculated. With practice, subjects achieved significantly shorter movement times. As movement times decreased, all joint-moment components (except gravity) increased, and the moment-time and EMG profiles were changed significantly. Particularly during reversals in movement direction, the changes in moment-time and EMG profiles were consistent with Bernstein's hypothesis relating practice effects and intralimb coordination: with practice, motor coordination was altered so that individuals employed reactive phenomena in such a way as to use muscular moments to counterbalance passive-interactive moments created by segment movements.     

Three-dimensional model to predict muscle forces and their relation to motor variances in reaching arm movements

A three-dimensional (3-D) arm movement model is presented to simulate kinematic properties and muscle forces in reaching arm movements. Healthy subjects performed reaching movements repetitively either with or without a load in the hand. Joint coordinates were measured. Muscle moment arms, 3-D angular acceleration, and moment of inertias of arm segments were calculated to determine 3-D joint torques. Variances of hand position, arm configuration, and muscle activities were calculated. Ratios of movement variances observed in the two conditions (load versus without load) showed no differences for hand position and arm configuration variances. Virtual muscle force variances for all muscles except deltoid posterior and EMG variances for four muscles increased significantly by moving with the load. The greatly increased variances in muscle activity did not imply equally high increments in kinematic variances. We conclude that enhanced muscle cooperation through synergies helps to stabilize movement at the kinematic level when a load is added.     

Robot-Assisted Arm Assessments in Spinal Cord Injured Patients: A Consideration of Concept Study

Robotic assistance is increasingly used in neurological rehabilitation for enhanced training. Furthermore, therapy robots have the potential for accurate assessment of motor function in order to diagnose the patient status, to measure therapy progress or to feedback the movement performance to the patient and therapist in real time. We investigated whether a set of robot-based assessments that encompasses kinematic, kinetic and timing metrics is applicable, safe, reliable and comparable to clinical metrics for measurement of arm motor function. Twenty-four healthy subjects and five patients after spinal cord injury underwent robot-based assessments using the exoskeleton robot ARMin. Five different tasks were performed with aid of a visual display. Ten kinematic, kinetic and timing assessment parameters were extracted on joint- and end-effector level (active and passive range of motion, cubic reaching volume, movement time, distance-path ratio, precision, smoothness, reaction time, joint torques and joint stiffness). For cubic volume, joint torques and the range of motion for most joints, good inter- and intra-rater reliability were found whereas precision, movement time, distance-path ratio and smoothness showed weak to moderate reliability. A comparison with clinical scores revealed good correlations between robot-based joint torques and the Manual Muscle Test. Reaction time and distance-path ratio showed good correlation with the “Graded and Redefined Assessment of Strength, Sensibility and Prehension” (GRASSP) and the Van Lieshout Test (VLT) for movements towards a predefined position in the center of the frontal plane. In conclusion, the therapy robot ARMin provides a comprehensive set of assessments that are applicable and safe. The first results with spinal cord injured patients and healthy subjects suggest that the measurements are widely reliable and comparable to clinical scales for arm motor function. The methods applied and results can serve as a basis for the future development of end-effector and exoskeleton-based robotic assessments.     

Representation of movements and muscles within the primate precentral motor cortex: historical and current perspectives

A major problem with the study of the control of movement and posture is to determine how specific brain areas contribute to the selection of those particular muscle patterns that underlie a coordinated movement. With this problem in mind, a selective review is presented of mapping studies of the primate motor cortex, whose results bear on the question of how the spatial organization of cortical efferent cells might contribute to the production of organized muscle synergies. More recent findings are also summarized, which appear to resolve previous controversies on the question of whether movements or muscles are the primary units of motor cortex organization. These same findings suggest also a form of spatial organization within the primate precentral gyrus that would allow spatially simple afferent inputs to evoke the muscle synergies that are necessary for a variety of simple movements of the arm and hand.     

Arm-plane representation of shoulder compensation during pointing movements in patients with stroke

Improvements in functional motor activities are often accompanied by motor compensations to overcome persistent motor impairment in the upper limb. Kinematic analysis is used to objectively quantify movement patterns including common motor compensations such as excessive trunk displacement during reaching. However, a common motor compensation to assist reaching, shoulder abduction, is not adequately characterized by current motion analysis approaches. We apply the arm-plane representation that accounts for the co-variation between movements of the whole arm, and investigate its ability to identify and quantify compensatory arm movements in stroke subjects when making forward arm reaches. This method has not been previously applied to the analysis of motion deficits. Sixteen adults with right post-stroke hemiparesis and eight healthy age-matched controls reached in three target directions (14 trials/target; sampling rate: 100 Hz). Arm-plane movement was validated against endpoint, joint, and trunk kinematics and compared between groups. In stroke subjects, arm-plane measures were correlated with arm impairment (Fugl-Meyer Assessment) and ability (Box and Blocks) scores and were more sensitive than clinical measures to detect mild motor impairment. Arm-plane motion analysis provides new information about motor compensations involving the co-variation of shoulder and elbow movements that may help to understand the underlying motor deficits in patients with stroke.     

Robot-based methodology for a kinematic and kinetic analysis of unconstrained,but reproducible upper extremity movement

Although arm movements play an important role in everyday life, there is still a lack of procedures for the analysis of upper extremity movement. The main problems for standardizing the procedure are the variety of arm movements and the difficult assessment of external hand forces. The first problem requires the predefinition of motions, and the second one is the prerequisite for calculation of net joint forces and torques arising during motion. A new methodology for measuring external forces during prespecified, reproducible upper extremity movement has been introduced and validated. A robot-arm has been used to define the motion and 6 degrees of freedom (DoF) force sensor has been attached to it for acquiring the external loads acting on the arm. Additionally, force feedback has been used to help keeping external loads constant. Intra-individual reproducibility of joint angles was estimated by using correlation coefficients to compare a goal-directed movement with robot-guided task. Inter-individual reproducibility has been evaluated by using the mean standard deviation of joint angles for both types of movement. The results showed that both inter- and intra-individual reproducibility have significantly improved by using the robot. Also, the effectiveness of using force feedback for keeping a constant external load has been shown. This makes it possible to estimate net joint forces and torques which are important biomechanical information in motion analysis.