The adaptation and use of a haptic robot in a 3T fMRI is described.
Functional magnetic resonance imaging (fMRI) provides excellent functional brain imaging via the BOLD signal 1 with advantages including non-ionizing radiation, millimeter spatial accuracy of anatomical and functional data 2, and nearly real-time analyses 3. Haptic robots provide precise measurement and control of position and force of a cursor in a reasonably confined space. Here we combine these two technologies to allow precision experiments involving motor control with haptic/tactile environment interaction such as reaching or grasping. The basic idea is to attach an 8 foot end effecter supported in the center to the robot 4 allowing the subject to use the robot, but shielding it and keeping it out of the most extreme part of the magnetic field from the fMRI machine (Figure 1).
The Phantom Premium 3.0, 6DoF, high-force robot (SensAble Technologies, Inc.) is an excellent choice for providing force-feedback in virtual reality experiments 5, 6, but it is inherently non-MR safe, introduces significant noise to the sensitive fMRI equipment, and its electric motors may be affected by the fMRI’s strongly varying magnetic field. We have constructed a table and shielding system that allows the robot to be safely introduced into the fMRI environment and limits both the degradation of the fMRI signal by the electrically noisy motors and the degradation of the electric motor performance by the strongly varying magnetic field of the fMRI. With the shield, the signal to noise ratio (SNR: mean signal/noise standard deviation) of the fMRI goes from a baseline of ˜380 to ˜330, and ˜250 without the shielding. The remaining noise appears to be uncorrelated and does not add artifacts to the fMRI of a test sphere (Figure 2). The long, stiff handle allows placement of the robot out of range of the most strongly varying parts of the magnetic field so there is no significant effect of the fMRI on the robot. The effect of the handle on the robot’s kinematics is minimal since it is lightweight (˜2.6 lbs) but extremely stiff 3/4″ graphite and well balanced on the 3DoF joint in the middle. The end result is an fMRI compatible, haptic system with about 1 cubic foot of working space, and, when combined with virtual reality, it allows for a new set of experiments to be performed in the fMRI environment including naturalistic reaching, passive displacement of the limb and haptic perception, adaptation learning in varying force fields, or texture identification 5, 6.
1. Outside the scanner room
2. Moving into the scanner room with two people, A and B
3. In the control room
4. The subject
5. Break down the setup with two people A and B
6. Representative results:
Ideally, the haptic robot and fMRI should not affect each other. We can tell online if the robot is being affected by the fMRI. Generally, if the robot’s parallel cable is not properly shielded and filtered, then the readout of the motors will oscillate rapidly. This can be fixed by double checking the aluminum shielding on the cable, that the ferrous core is properly placed on the parallel cable near the robot, and that the only filter to the robot is the custom filter on the scanner room side of the pass through. Detecting errors in the fMRI is really only possible after the data have been reduced and analyzed, but an anatomical scan should be taken early in the study and checked for zipper effects or other artifacts indicative of correlated noise (e.g. spike noise) 7. Frequently, such noise comes from metal on metal contact and can be cleaned up by tightening all the screws on the robot table, especially the hand adjustment screws on the side of the table. From our tests the baseline fMRI signal to noise ratio (SNR) is ˜380 and with the robot fully shielded in the room that drops to a still reasonable ˜330. If the shield is not in place on the robot, then the SNR drop further to ˜250, and noise effects become very significant.
As shown in 4, the 3 degree of freedom joint in the center of the handle has little effect on the dynamics of the robot/hand interaction except to shift it away from the robot. The joint in the center of the handle acts like a fulcrum and reverses the apparent motion in two of the directions (left-right and up-down) but not the third (forward-back). Since the Phantom and the hand are at opposite ends of the lever like handle with its fulcrum in the middle, gains are applied in software in each of the three Euclidean directions: negative gains in the two directions controlled by the swivel joint and a positive gain in the direction of the slider joint. The net effect of the handle and swivel reproduces the full 3 degrees of freedom of the Phantom robot, just 9′ away.
Figure 1 The apparatus used to mount the haptic robot for use in the fMRI environment. Top shows the haptic robot mounted in the case prior to enclosure (top, left) and the gimbal/slider joint at the midpoint of the handle (top, right). Bottom, left shows a subject in the scanner manipulating the handle. Bottom, right is a cartoon of the shielding and end effecter.
Figure 2 Results of the BIRN test for the fully shielded robot with movement. The three images with crosses show sections of the spherical head model, and the bottom right shows a three dimensional view. The small dots are bubbles in the static head model and are always present. The lack of large stripes or zippers indicates that the noise from the robot is uncorrelated.
The fMRI compatible robot opens up new possibilities for experiments in the neuroscience of motor control. The most critical step in the setup is the shielding of the robot to prevent artifacts in the fMRI, which we do in two steps. First, the robot itself is about 9′ away from the bore with a long, lightweight, handle supported in its middle with a 3 degree of freedom joint . Second, the robot is encased in a 1/16"-1/4" aluminum box with a plastic conical (13" base diameter, 6" top diameter x 42" long) waveguide with aluminum foil shielding that was calculated to block ˜100dB of noise in the fMRI relevant frequency band, >100 MHz. In the future, copper shielding could be used to replace the aluminum foil on the cone, but it currently performs satisfactorily as is at a substantial cost and weight saving. Also, to further expand the scope of the equipment, we plan to incorporate simultaneous EEG/fMRI with the current system.
The main safety concern associated with the experimental set-up is the potential for ferromagnetic objects to be pulled with great force into the bore of the fMRI magnet. To minimize this risk, all ancillary equipment, such as the shield and rolling table, are constructed from non-magnetic materials. As the haptic robot itself contains ferromagnetic materials, special care must be exercised with respect to its positioning. The robot is secured to the rolling table and the entire assembly is tethered to the wall prior to rolling the assembly into the magnet room. The length of the tether is designed so that the robot cannot move past the end of the patient table. Finally, to ensure safe operation, experimental personnel must take special care to follow the detailed protocol described elsewhere in this document.
One of the most important features of the fMRI is that it uses non-ionizing radiation and is thus safer than more invasive competing technologies, like PET, without the loss of localization of activity seen in passive technologies like EEG or MEG. The drawback to fMRI that we overcome with the haptic robot adaptation is to make equipment compatible with the high magnetic field and noise sensitivity of the fMRI while maintaining its functionality. Previous attempts to study human motor behavior have relied on either compressed air 8 or water 9 devices that have poor response times making them inappropriate for realistic interaction with the environment or drives located external to the scanner room with limited degrees of freedom. The solution here, similar to a previous study that used an unshielded lower-force model robot, in a 1.5 T fMRI 4, keeping the equipment in the room and shielding, gives the full range of motion of air compressors, but with the fast, millisecond latencies of electric drives.
With the equipment up and running, we are now looking to reexamine classic motor control experiments like pointing with penalty 5 or sequence learning 10 as well as develop new experiments involving fully immersive virtual reality with the robot providing haptic interaction. The relative ease of use of the current protocol will open up the fMRI to real time, interactive movement experiments.
The authors have nothing to disclose.
We would like to thank Kun Lu and Ronald Kurz for technical assistance. This work was supported by ONR MURI Award No.:N00014-10-1-0072, NSF grant #SBE-0542013 to the Temporal Dynamics of Learning Center, an NSF Science of Learning Center, and NIH grant #2 R01 NS036449-11.