Generalization of Dexterous Manipulation Is Sensitive to the Frame of Reference in Which It Is Learned

128870-Thumbnail Image.png
Description

Studies have shown that internal representations of manipulations of objects with asymmetric mass distributions that are generated within a specific orientation are not generalizable to novel orientations, i.e., subjects fail to prevent object roll on their first grasp-lift attempt of

Studies have shown that internal representations of manipulations of objects with asymmetric mass distributions that are generated within a specific orientation are not generalizable to novel orientations, i.e., subjects fail to prevent object roll on their first grasp-lift attempt of the object following 180° object rotation. This suggests that representations of these manipulations are specific to the reference frame in which they are formed. However, it is unknown whether that reference frame is specific to the hand, the body, or both, because rotating the object 180° modifies the relation between object and body as well as object and hand. An alternative, untested explanation for the above failure to generalize learned manipulations is that any rotation will disrupt grasp performance, regardless if the reference frame in which the manipulation was learned is maintained or modified. We examined the effect of rotations that (1) maintain and (2) modify relations between object and body, and object and hand, on the generalizability of learned two-digit manipulation of an object with an asymmetric mass distribution. Following rotations that maintained the relation between object and body and object and hand (e.g., rotating the object and subject 180°), subjects continued to use appropriate digit placement and load force distributions, thus generating sufficient compensatory moments to minimize object roll. In contrast, following rotations that modified the relation between (1) object and hand (e.g. rotating the hand around to the opposite object side), (2) object and body (e.g. rotating subject and hand 180°), or (3) both (e.g. rotating the subject 180°), subjects used the same, yet inappropriate digit placement and load force distribution, as those used prior to the rotation. Consequently, the compensatory moments were insufficient to prevent large object rolls. These findings suggest that representations of learned manipulation of objects with asymmetric mass distributions are specific to the body- and hand-reference frames in which they were learned.

Date Created
2015-09-16
Agent

Effects of Visual Cues of Object Density on Perception and Anticipatory Control of Dexterous Manipulation

128891-Thumbnail Image.png
Description

Anticipatory force planning during grasping is based on visual cues about the object’s physical properties and sensorimotor memories of previous actions with grasped objects. Vision can be used to estimate object mass based on the object size to identify and

Anticipatory force planning during grasping is based on visual cues about the object’s physical properties and sensorimotor memories of previous actions with grasped objects. Vision can be used to estimate object mass based on the object size to identify and recall sensorimotor memories of previously manipulated objects. It is not known whether subjects can use density cues to identify the object’s center of mass (CM) and create compensatory moments in an anticipatory fashion during initial object lifts to prevent tilt. We asked subjects (n = 8) to estimate CM location of visually symmetric objects of uniform densities (plastic or brass, symmetric CM) and non-uniform densities (mixture of plastic and brass, asymmetric CM). We then asked whether subjects can use density cues to scale fingertip forces when lifting the visually symmetric objects of uniform and non-uniform densities. Subjects were able to accurately estimate an object’s center of mass based on visual density cues. When the mass distribution was uniform, subjects could scale their fingertip forces in an anticipatory fashion based on the estimation. However, despite their ability to explicitly estimate CM location when object density was non-uniform, subjects were unable to scale their fingertip forces to create a compensatory moment and prevent tilt on initial lifts. Hefting object parts in the hand before the experiment did not affect this ability. This suggests a dichotomy between the ability to accurately identify the object’s CM location for objects with non-uniform density cues and the ability to utilize this information to correctly scale their fingertip forces. These results are discussed in the context of possible neural mechanisms underlying sensorimotor integration linking visual cues and anticipatory control of grasping.

Date Created
2013-10-16
Agent

Effects of Fusion Between Tactile and Proprioceptive Inputs on Tactile Perception

128895-Thumbnail Image.png
Description

Tactile perception is typically considered the result of cortical interpretation of afferent signals from a network of mechanical sensors underneath the skin. Yet, tactile illusion studies suggest that tactile perception can be elicited without afferent signals from mechanoceptors. Therefore, the

Tactile perception is typically considered the result of cortical interpretation of afferent signals from a network of mechanical sensors underneath the skin. Yet, tactile illusion studies suggest that tactile perception can be elicited without afferent signals from mechanoceptors. Therefore, the extent that tactile perception arises from isomorphic mapping of tactile afferents onto the somatosensory cortex remains controversial. We tested whether isomorphic mapping of tactile afferent fibers onto the cortex leads directly to tactile perception by examining whether it is independent from proprioceptive input by evaluating the impact of different hand postures on the perception of a tactile illusion across fingertips. Using the Cutaneous Rabbit Effect, a well studied illusion evoking the perception that a stimulus occurs at a location where none has been delivered, we found that hand posture has a significant effect on the perception of the illusion across the fingertips. This finding emphasizes that tactile perception arises from integration of perceived mechanical and proprioceptive input and not purely from tactile interaction with the external environment.

Date Created
2011-03-25
Agent

Effects of Carpal Tunnel Syndrome on Dexterous Manipulation Are Grip Type-Dependent

128897-Thumbnail Image.png
Description

Carpal tunnel syndrome (CTS) impairs sensation of a subset of digits. Although the effects of CTS on manipulation performed with CTS-affected digits have been studied using precision grip tasks, the extent to which CTS affects multi-digit force coordination has only

Carpal tunnel syndrome (CTS) impairs sensation of a subset of digits. Although the effects of CTS on manipulation performed with CTS-affected digits have been studied using precision grip tasks, the extent to which CTS affects multi-digit force coordination has only recently been studied. Whole-hand manipulation studies have shown that CTS patients retain the ability to modulate multi-digit forces to object mass, mass distribution, and texture. However, CTS results in sensorimotor deficits relative to healthy controls, including significantly larger grip force and lower ability to balance the torques generated by the digits. Here we investigated the effects of CTS on multi-digit force modulation to object weight when manipulating an object with a variable number of fingers. We hypothesized that CTS patients would be able to modulate digit forces to object weight. However, as different grip types involve the exclusive use of CTS-affected digits (‘uniform’ grips) or a combination of CTS-affected and non-affected digits (‘mixed’ grips), we addressed the question of whether ‘mixed’ grips would reduce or worsen CTS-induced force coordination deficits. The former scenario would be due to adding digits with intact tactile feedback, whereas the latter scenario might occur due to a potentially greater challenge for the central nervous system of integrating ‘noisy’ and intact tactile feedback. CTS patients learned multi-digit force modulation to object weight regardless of grip type. Although controls exerted the same total grip force across all grip types, patients exerted significantly larger grip force than controls but only for manipulations with four and five digits. Importantly, this effect was due to CTS patients’ inability to change the finger force distribution when adding the ring and little fingers. These findings suggest that CTS primarily challenges sensorimotor integration processes for dexterous manipulation underlying the coordination of CTS-affected and non-affected digits.

Date Created
2013-01-10
Agent

Effects of Carpal Tunnel Syndrome on Adaptation of Multi-Digit Forces to Object Weight for Whole-Hand Manipulation

128898-Thumbnail Image.png
Description

The delicate tuning of digit forces to object properties can be disrupted by a number of neurological and musculoskeletal diseases. One such condition is Carpal Tunnel Syndrome (CTS), a compression neuropathy of the median nerve that causes sensory and motor

The delicate tuning of digit forces to object properties can be disrupted by a number of neurological and musculoskeletal diseases. One such condition is Carpal Tunnel Syndrome (CTS), a compression neuropathy of the median nerve that causes sensory and motor deficits in a subset of digits in the hand. Whereas the effects of CTS on median nerve physiology are well understood, the extent to which it affects whole-hand manipulation remains to be addressed. CTS affects only the lateral three and a half digits, which raises the question of how the central nervous system integrates sensory feedback from affected and unaffected digits to plan and execute whole-hand object manipulation. We addressed this question by asking CTS patients and healthy controls to grasp, lift, and hold a grip device (445, 545, or 745 g) for several consecutive trials. We found that CTS patients were able to successfully adapt grip force to object weight. However, multi-digit force coordination in patients was characterized by lower discrimination of force modulation to lighter object weights, higher across-trial digit force variability, the consistent use of excessively large digit forces across consecutive trials, and a lower ability to minimize net moments on the object. Importantly, the mechanical requirement of attaining equilibrium of forces and torques caused CTS patients to exert excessive forces at both CTS-affected digits and digits with intact sensorimotor capabilities. These findings suggest that CTS-induced deficits in tactile sensitivity interfere with the formation of accurate sensorimotor memories of previous manipulations. Consequently, CTS patients use compensatory strategies to maximize grasp stability at the expense of exerting consistently larger multi-digit forces than controls. These behavioral deficits might be particularly detrimental for tasks that require fine regulation of fingertip forces for manipulating light or fragile objects.

Date Created
2011-11-16
Agent

Effects of Carpal Tunnel Syndrome on Adaptation of Multi-Digit Forces to Object Mass Distribution for Whole-Hand Manipulation

129056-Thumbnail Image.png
Description

Background: Carpal tunnel syndrome (CTS) is a compression neuropathy of the median nerve that results in sensorimotor deficits in the hand. Until recently, the effects of CTS on hand function have been studied using mostly two-digit grip tasks. The purpose of

Background: Carpal tunnel syndrome (CTS) is a compression neuropathy of the median nerve that results in sensorimotor deficits in the hand. Until recently, the effects of CTS on hand function have been studied using mostly two-digit grip tasks. The purpose of this study was to investigate the coordination of multi-digit forces as a function of object center of mass (CM) during whole-hand grasping.

Methods: Fourteen CTS patients and age- and gender-matched controls were instructed to grasp, lift, hold, and release a grip device with five digits for seven consecutive lifts while maintaining its vertical orientation. The object CM was changed by adding a mass at different locations at the base of the object. We measured forces and torques exerted by each digit and object kinematics and analyzed modulation of these variables to object CM at object lift onset and during object hold. Our task requires a modulation of digit forces at and after object lift onset to generate a compensatory moment to counteract the external moment caused by the added mass and to minimize object tilt.

Results: We found that CTS patients learned to generate a compensatory moment and minimized object roll to the same extent as controls. However, controls fully exploited the available degrees of freedom (DoF) in coordinating their multi-digit forces to generate a compensatory moment, i.e., digit normal forces, tangential forces, and the net center of pressure on the finger side of the device at object lift onset and during object hold. In contrast, patients modulated only one of these DoFs (the net center of pressure) to object CM by modulating individual normal forces at object lift onset. During object hold, however, CTS patients were able to modulate digit tangential force distribution to object CM.

Conclusions: Our findings suggest that, although CTS did not affect patients’ ability to perform our manipulation task, it interfered with the modulation of specific grasp control variables. This phenomenon might be indicative of a lower degree of flexibility of the sensorimotor system in CTS to adapt to grasp task conditions.

Date Created
2012-11-21
Agent

Learning joint actions in human-human interactions

Description
Understanding human-human interactions during the performance of joint motor tasks is critical for developing rehabilitation robots that could aid therapists in providing effective treatments for motor problems. However, there is a lack of understanding of strategies (cooperative or competitive) adopted

Understanding human-human interactions during the performance of joint motor tasks is critical for developing rehabilitation robots that could aid therapists in providing effective treatments for motor problems. However, there is a lack of understanding of strategies (cooperative or competitive) adopted by humans when interacting with other individuals. Previous studies have investigated the cues (auditory, visual and haptic) that support these interactions but understanding how these unconscious interactions happen even without those cues is yet to be explained. To address this issue, in this study, a paradigm that tests the parallel efforts of pairs of individuals (dyads) to complete a jointly performed virtual reaching task, without any auditory or visual information exchange was employed. Motion was tracked with a NDI OptoTrak 3D motion tracking system that captured each subject’s movement kinematics, through which we could measure the level of synchronization between two subjects in space and time. For the spatial analyses, the movement amplitudes and direction errors at peak velocities and at endpoints were analyzed. Significant differences in the movement amplitudes were found for subjects in 4 out of 6 dyads which were expected due to the lack of feedback between the subjects. Interestingly, subjects in this study also planned their movements in different directions in order to counteract the visuomotor rotation offered in the test blocks, which suggests the difference in strategies for the subjects in each dyad. Also, the level of de-adaptation in the control blocks in which no visuomotor rotation was offered to the subjects was measured. To further validate the results obtained through spatial analyses, a temporal analyses was done in which the movement times for the two subjects were compared. With the help of these results, numerous interaction scenarios that are possible in the human joint actions in without feedback were analyzed.
Date Created
2016
Agent

Haptic discrimination of object size using vibratory sensory substitution

154617-Thumbnail Image.png
Description
Humans constantly rely on a complex interaction of a variety of sensory modalities in order to complete even the simplest of daily tasks. For reaching and grasping to interact with objects, the visual, tactile, and proprioceptive senses provide the majority

Humans constantly rely on a complex interaction of a variety of sensory modalities in order to complete even the simplest of daily tasks. For reaching and grasping to interact with objects, the visual, tactile, and proprioceptive senses provide the majority of the information used. While vision is often relied on for many tasks, most people are able to accomplish common daily rituals without constant visual attention, instead relying mainly on tactile and proprioceptive cues. However, amputees using prosthetic arms do not have access to these cues, making tasks impossible without vision. Even tasks with vision can be incredibly difficult as prosthesis users are unable to modify grip force using touch, and thus tend to grip objects excessively hard to make sure they don’t slip.

Methods such as vibratory sensory substitution have shown promise for providing prosthesis users with a sense of contact and have proved helpful in completing motor tasks. In this thesis, two experiments were conducted to determine whether vibratory cues could be useful in discriminating between sizes. In the first experiment, subjects were asked to grasp a series of hidden virtual blocks of varying sizes with vibrations on the fingertips as indication of contact and compare the size of consecutive boxes. Vibratory haptic feedback significantly increased the accuracy of size discrimination over objects with only visual indication of contact, though accuracy was not as great as for typical grasping tasks with physical blocks. In the second, subjects were asked to adjust their virtual finger position around a series of virtual boxes with vibratory feedback on the fingertips using either finger movement or EMG. It was found that EMG control allowed for significantly less accuracy in size discrimination, implying that, while proprioceptive feedback alone is not enough to determine size, direct kinesthetic information about finger position is still needed.
Date Created
2016
Agent

Neural correlates of learning in brain machine interface controlled tasks

154148-Thumbnail Image.png
Description
Brain-machine interfaces (BMIs) were first imagined as a technology that would allow subjects to have direct communication with prosthetics and external devices (e.g. control over a computer cursor or robotic arm movement). Operation of these devices was not automatic, and

Brain-machine interfaces (BMIs) were first imagined as a technology that would allow subjects to have direct communication with prosthetics and external devices (e.g. control over a computer cursor or robotic arm movement). Operation of these devices was not automatic, and subjects needed calibration and training in order to master this control. In short, learning became a key component in controlling these systems. As a result, BMIs have become ideal tools to probe and explore brain activity, since they allow the isolation of neural inputs and systematic altering of the relationships between the neural signals and output. I have used BMIs to explore the process of brain adaptability in a motor-like task. To this end, I trained non-human primates to control a 3D cursor and adapt to two different perturbations: a visuomotor rotation, uniform across the neural ensemble, and a decorrelation task, which non-uniformly altered the relationship between the activity of particular neurons in an ensemble and movement output. I measured individual and population level changes in the neural ensemble as subjects honed their skills over the span of several days. I found some similarities in the adaptation process elicited by these two tasks. On one hand, individual neurons displayed tuning changes across the entire ensemble after task adaptation: most neurons displayed transient changes in their preferred directions, and most neuron pairs showed changes in their cross-correlations during the learning process. On the other hand, I also measured population level adaptation in the neural ensemble: the underlying neural manifolds that control these neural signals also had dynamic changes during adaptation. I have found that the neural circuits seem to apply an exploratory strategy when adapting to new tasks. Our results suggest that information and trajectories in the neural space increase after initially introducing the perturbations, and before the subject settles into workable solutions. These results provide new insights into both the underlying population level processes in motor learning, and the changes in neural coding which are necessary for subjects to learn to control neuroprosthetics. Understanding of these mechanisms can help us create better control algorithms, and design training paradigms that will take advantage of these processes.
Date Created
2015
Agent

Smart glove: an assistive device to enhance recovery of hand function during motor rehabilitation

153929-Thumbnail Image.png
Description
Stroke accounts for high rates of mortality and disability in the United States. It levies great economic burden on the affected subjects, their family and the society at large. Motor impairments after stroke mainly manifest themselves as hemiplegia or hemiparesis

Stroke accounts for high rates of mortality and disability in the United States. It levies great economic burden on the affected subjects, their family and the society at large. Motor impairments after stroke mainly manifest themselves as hemiplegia or hemiparesis in the upper and lower limbs. Motor recovery is highly variable but can be enhanced through motor rehabilitation with sufficient movement repetition and intensity. Cost effective assistive devices that can augment therapy by increasing movement repetition both at home and in the clinic may facilitate recovery. This thesis aims to develop a Smart Glove that can enhance motor recovery by providing feedback to both the therapist and the patient on the number of hand movements (wrist and finger extensions) performed during therapy. The design implements resistive flex sensors for detecting the extensions and processes the information using the Lightblue bean microcontroller mounted on the wrist. Communication between the processing unit and display module is wireless and executes Bluetooth 4.0 communication protocol. The capacity for the glove to measure and record hand movements was tested on three stroke and one traumatic brain injured patient while performing a box and blocks test. During testing many design flaws were noted and several were adapted during testing to improve the function of the glove. Results of the testing showed that the glove could detect wrist and finger extensions but that the sensitivity had to be calibrated for each patient. It also allowed both the therapist and patient to know whether the patient was actually performing the task in the manner requested by the therapist. Further work will reveal whether this feedback can enhance recovery of hand function in neurologically impaired patients.
Date Created
2015
Agent