We propose a novel automatic fiducial frame detection and registration method for device-to-image registration in MRI-guided prostate interventions. The proposed method does not require any manual selection of markers, and can be applied to a variety of fiducial frames, which consist of multiple cylindrical MR-visible markers placed in different orientations. The key idea is that automatic extraction of linear features using a line filter is more robust than that of bright spots by thresholding; by applying a line set registration algorithm to the detected markers, the frame can be registered to the MRI. The method was capable of registering the fiducial frame to the MRI with an accuracy of 1.00 +/- 0.73 mm and 1.41 +/- 1.06 degrees in a phantom study, and was sufficiently robust to detect the fiducial frame in 98% of images acquired in clinical cases despite the existence of anatomical structures in the field of view.
To overcome the problems of limited needle insertion accuracy and human error in the use of a conventional needle guide template in magnetic resonance imaging (MRI)-guided prostate intervention, we developed a motorized MRI-compatible needle guide template that resembles a transrectal ultrasound-guided prostate template. The motorized template allows automated, gapless needle guidance in a 3T MRI scanner with minimal changes in the current clinical procedure. To evaluate the impact of the motorized template on MRI, signal-to-noise ratio and distortion were measured under various system configurations. A maximum of 44% signal-to-noise ratio decrease was found when the ultrasonic motors were running, and a maximum of 0.4% image distortion was observed due to the presence of the motorized template. To measure needle insertion accuracy, we performed four sets of five random target needle insertions mimicking four biopsy procedures, which resulted in an average in-plane targeting error of 0.94 mm with a standard deviation of 0.34 mm. The evaluation studies indicated that the presence and operation of the motorized template in the MRI bore create insignificant image degradation, and provide submillimeter targeting accuracy. The automated needle guide that is directly controlled by navigation software eliminates human error so that the safety of the procedure can be improved.
Intra-operative medical imaging enables incorporation of human experience and intelligence in a controlled, closed-loop fashion. Magnetic resonance imaging (MRI) is an ideal modality for surgical guidance of diagnostic and therapeutic procedures, with its ability to perform high resolution, real-time, high soft tissue contrast imaging without ionizing radiation. However, for most current image-guided approaches only static pre-operative images are accessible for guidance, which are unable to provide updated information during a surgical procedure. The high magnetic field, electrical interference, and limited access of closed-bore MRI render great challenges to developing robotic systems that can perform inside a diagnostic high-field MRI while obtaining interactively updated MR images. To overcome these limitations, we are developing a piezoelectrically actuated robotic assistant for actuated percutaneous prostate interventions under real-time MRI guidance. Utilizing a modular design, the system enables coherent and straight forward workflow for various percutaneous interventions, including prostate biopsy sampling and brachytherapy seed placement, using various needle driver configurations. The unified workflow compromises: 1) system hardware and software initialization, 2) fiducial frame registration, 3) target selection and motion planning, 4) moving to the target and performing the intervention (e.g. taking a biopsy sample) under live imaging, and 5) visualization and verification. Phantom experiments of prostate biopsy and brachytherapy were executed under MRI-guidance to evaluate the feasibility of the workflow. The robot successfully performed fully actuated biopsy sampling and delivery of simulated brachytherapy seeds under live MR imaging, as well as precise delivery of a prostate brachytherapy seed distribution with an RMS accuracy of 0.98mm.
This paper undertakes the modular design and development of a minimally invasive surgical manipulator for MRI-guided transperineal prostate interventions. Severe constraints for the MRI-compatibility to hold the minimum artifact on the image quality and dimensions restraint of the bore scanner shadow the design procedure. Regarding the constructive design, the manipulator kinematics has been optimized and the effective analytical needle workspace is developed and followed by proposing the workflow for the manual needle insertion. A study of the finite element analysis is established and utilized to improve the mechanism weaknesses under some inevitable external forces to ensure the minimum structure deformation. The procedure for attaching a sterile plastic drape on the robot manipulator is discussed. The introduced robotic manipulator herein is aimed for the clinically prostate biopsy and brachytherapy applications.
BACKGROUND: Magnetic resonance imaging (MRI)-guided prostate interventions have been introduced to enhance the cancer detection. For accurate needle positioning, in-bore-operated robotic systems have been developed and optimal use of the confined in-bore space become a critical engineering challenge.
METHODS: As preliminary evaluation of our prostate intervention robot, we conducted a workspace design analysis, using a new evaluation method that we developed for in-bore-operated robots for transperineal prostate interventions, and an MRI compatibility study.
RESULTS: The workspace analysis resulted in the effective workspace (VW ) of 0.32, which is greater than that of our early prototype, despite the current robot being ca. 50% larger than the early prototype in sectional space. The MRI compatibility study resulted in < 15% signal:noise ratio (SNR) reduction.
CONCLUSIONS: The new workspace evaluation method quantifies the workspace utilization of the in-bore-operated robots for MRI-guided transperineal prostate interventions, providing a useful tool for evaluation and new robot design. The robot creates insignificant electromagnetic noise during typical prostate imaging sequences.
The purpose of this study is to evaluate perfusion indices and pharmacokinetic parameters in solitary pulmonary nodules (SPNs). Thirty patients of 34 enrolled with SPNs (15-30 mm) were evaluated in this study. T1 and T2-weighted structural images and 2D turbo FLASH perfusion images were acquired with shallow free breathing. B-spline nonrigid image registration and optimization by χ² test against pharmacokinetic model curve were performed on dynamic contrast-enhanced MRI. This allowed voxel-by-voxel calculation of k(ep) , the rate constant for tracer transport to and from plasma and the extravascular extracellular space. Mean transit time, time-to-peak, initial slope, and maximum enhancement (E(max) ) were calculated from time-intensity curves fitted to a gamma variate function. After blinded data analysis, correlation with tissue histology from surgical resection or biopsy samples was performed. Histologic evaluation revealed 25 malignant and five benign SPNs. All benign SPNs had k(ep) < 1.0 min⁻¹. Nineteen of 25 (76%) malignant SPNs showed k(ep) > 1.0 min⁻¹. Sensitivity to diagnose malignant SPNs at a cutoff of k(ep) = 1.0 min⁻¹ was 76%, specificity was 100%, positive predictive value was 100%, negative predictive value was 45%, and accuracy was 80%. Of all indices studied, k(ep) was the most significant in differentiating malignant from benign SPNs.
PURPOSE: To develop and evaluate image registration methodology for automated re-identification of tumor-suspicious foci from preprocedural MR exams during MR-guided transperineal prostate core biopsy.
MATERIALS AND METHODS: A hierarchical approach for automated registration between planning and intra-procedural T2-weighted prostate MRI was developed and evaluated on the images acquired during 10 consecutive MR-guided biopsies. Registration accuracy was quantified at image-based landmarks and by evaluating spatial overlap for the manually segmented prostate and sub-structures. Registration reliability was evaluated by simulating initial mis-registration and analyzing the convergence behavior. Registration precision was characterized at the planned biopsy targets.
RESULTS: The total computation time was compatible with a clinical setting, being at most 2 min. Deformable registration led to a significant improvement in spatial overlap of the prostate and peripheral zone contours compared with both rigid and affine registration. Average in-slice landmark registration error was 1.3 ± 0.5 mm. Experiments simulating initial mis-registration resulted in an estimated average capture range of 6 mm and an average in-slice registration precision of ±0.3 mm.
CONCLUSION: Our registration approach requires minimum user interaction and is compatible with the time constraints of our interventional clinical workflow. The initial evaluation shows acceptable accuracy, reliability and consistency of the method.
MRI-guided prostate biopsy in conventional closed-bore scanners requires transferring the patient outside the bore during needle insertion due to the constrained in-bore space, causing a safety hazard and limiting image feedback. To address this issue, we present our custom-made in-bore setup and software to support MRI-guided transperineal prostate biopsy in a wide-bore 3 T MRI scanner. The setup consists of a specially designed tabletop and a needle-guiding template with a Z-frame that gives a physician access to the perineum of the patient at the imaging position and allows the physician to perform MRI-guided transperineal biopsy without moving the patient out of the scanner. The software and Z-frame allow registration of the template, target planning and biopsy guidance. Initially, we performed phantom experiments to assess the accuracy of template registration and needle placement in a controlled environment. Subsequently, we embarked on our clinical trial (N = 10). The phantom experiments showed that the translational errors of the template registration along the right-left (RP) and anterior-posterior (AP) axes were 1.1 ± 0.8 and 1.4 ± 1.1 mm, respectively, while the rotational errors around the RL, AP and superior-inferior axes were (0.8 ± 1.0)°, (1.7 ± 1.6)° and (0.0 ± 0.0)°, respectively. The 2D root-mean-square (RMS) needle-placement error was 3 mm. The clinical biopsy procedures were safely carried out in all ten clinical cases with a needle-placement error of 5.4 mm (2D RMS). In conclusion, transperineal prostate biopsy in a wide-bore 3T scanner is feasible using our custom-made tabletop setup and software, which supports manual needle placement without moving the patient out of the magnet.
BACKGROUND: OpenIGTLink is a new, open, simple and extensible network communication protocol for image-guided therapy (IGT). The protocol provides a standardized mechanism to connect hardware and software by the transfer of coordinate transforms, images, and status messages. MeVisLab is a framework for the development of image processing algorithms and visualization and interaction methods, with a focus on medical imaging.
METHODS: The paper describes the integration of the OpenIGTLink network protocol for IGT with the medical prototyping platform MeVisLab. The integration of OpenIGTLink into MeVisLab has been realized by developing a software module using the C++ programming language.
RESULTS: The integration was evaluated with tracker clients that are available online. Furthermore, the integration was used to connect MeVisLab to Slicer and a NDI tracking system over the network. The latency time during navigation with a real instrument was measured to show that the integration can be used clinically.
CONCLUSIONS: Researchers using MeVisLab can interface their software to hardware devices that already support the OpenIGTLink protocol, such as the NDI Aurora magnetic tracking system. In addition, the OpenIGTLink module can also be used to communicate directly with Slicer, a free, open source software package for visualization and image analysis.
PURPOSE: To evaluate the targeting accuracy of a small profile MRI-compatible pneumatic robot for needle placement that can angulate a needle insertion path into a large accessible target volume.
METHODS: We extended our MRI-compatible pneumatic robot for needle placement to utilize its four degrees-of-freedom (4-DOF) mechanism with two parallel triangular structures and support transperineal prostate biopsies in a closed-bore magnetic resonance imaging (MRI) scanner. The robot is designed to guide a needle toward a lesion so that a radiologist can manually insert it in the bore. The robot is integrated with navigation software that allows an operator to plan angulated needle insertion by selecting a target and an entry point. The targeting error was evaluated while the angle between the needle insertion path and the static magnetic field was between -5.7° and 5.7° horizontally and between -5.7° and 4.3° vertically in the MRI scanner after sterilizing and draping the device.
RESULTS: The robot positioned the needle for angulated insertion as specified on the navigation software with overall targeting error of 0.8 ± 0.5mm along the horizontal axis and 0.8 ± 0.8mm along the vertical axis. The two-dimensional root-mean-square targeting error on the axial slices as containing the targets was 1.4mm.
CONCLUSIONS: Our preclinical evaluation demonstrated that the MRI-compatible pneumatic robot for needle placement with the capability to angulate the needle insertion path provides targeting accuracy feasible for clinical MRI-guided prostate interventions. The clinical feasibility has to be established in a clinical study.
PURPOSE: Magnetic Resonance Imaging (MRI) combined with robotic assistance has the potential to improve on clinical outcomes of biopsy and local treatment of prostate cancer.
METHODS: We report the workspace optimization and phantom evaluation of a five Degree of Freedom (DOF) parallel pneumatically actuated modular robot for MRI-guided prostate biopsy. To shorten procedure time and consequently increase patient comfort and system accuracy, a prototype of a MRI-compatible master-slave needle driver module using piezo motors was also added to the base robot.
RESULTS: Variable size workspace was achieved using appropriate link length, compared with the previous design. The 5-DOF targeting accuracy demonstrated an average error of 2.5 mm (STD = 1.37 mm) in a realistic phantom inside a 3T magnet with a bevel-tip 18G needle. The average position tracking error of the master-slave needle driver was always below 0.1 mm.
CONCLUSION: Phantom experiments showed sufficient accuracy for manual prostate biopsy. Also, the implementation of teleoperated needle insertion was feasible and accurate. These two together suggest the feasibility of accurate fully actuated needle placement into prostate while keeping the clinician supervision over the task.
PURPOSE: To investigates the impact of nonrigid motion correction on pixel-wise pharmacokinetic analysis of free-breathing DCE-MRI in patients with solitary pulmonary nodules (SPNs). Misalignment of focal lesions due to respiratory motion in free-breathing dynamic contrast-enhanced MRI (DCE-MRI) precludes obtaining reliable time-intensity curves, which are crucial for pharmacokinetic analysis for tissue characterization.
MATERIALS AND METHODS: Single-slice 2D DCE-MRI was obtained in 15 patients. Misalignments of SPNs were corrected using nonrigid B-spline image registration. Pixel-wise pharmacokinetic parameters K(trans) , v(e) , and k(ep) were estimated from both original and motion-corrected DCE-MRI by fitting the two-compartment pharmacokinetic model to the time-intensity curve obtained in each pixel. The "goodness-of-fit" was tested with χ(2) -test in pixel-by-pixel basis to evaluate the reliability of the parameters. The percentages of reliable pixels within the SPNs were compared between the original and motion-corrected DCE-MRI. In addition, the parameters obtained from benign and malignant SPNs were compared.
RESULTS: The percentage of reliable pixels in the motion-corrected DCE-MRI was significantly larger than the original DCE-MRI (P = 4 × 10(-7) ). Both K(trans) and k(ep) derived from the motion-corrected DCE-MRI showed significant differences between benign and malignant SPNs (P = 0.024, 0.015).
CONCLUSION: The study demonstrated the impact of nonrigid motion correction technique on pixel-wise pharmacokinetic analysis of free-breathing DCE-MRI in SPNs.
A software system to provide intuitive navigation for MRI-guided robotic transperineal prostate therapy is presented. In the system, the robot control unit, the MRI scanner, and the open-source navigation software are connected together via Ethernet to exchange commands, coordinates, and images using an open network communication protocol, OpenIGTLink. The system has six states called "workphases" that provide the necessary synchronization of all components during each stage of the clinical workflow, and the user interface guides the operator linearly through these workphases. On top of this framework, the software provides the following features for needle guidance: interactive target planning; 3D image visualization with current needle position; treatment monitoring through real-time MR images of needle trajectories in the prostate. These features are supported by calibration of robot and image coordinates by fiducial-based registration. Performance tests show that the registration error of the system was 2.6mm within the prostate volume. Registered real-time 2D images were displayed 1.97 s after the image location is specified.
OBJECT: In these days, patients and doctors in operation room are surrounded by many medical devices as resulting from recent advancement of medical technology. However, these cutting-edge medical devices are working independently and not collaborating with each other, even though the collaborations between these devices such as navigation systems and medical imaging devices are becoming very important for accomplishing complex surgical tasks (such as a tumor removal procedure while checking the tumor location in neurosurgery). On the other hand, several surgical robots have been commercialized, and are becoming common. However, these surgical robots are not open for collaborations with external medical devices in these days. A cutting-edge "intelligent surgical robot" will be possible in collaborating with surgical robots, various kinds of sensors, navigation system and so on. On the other hand, most of the academic software developments for surgical robots are "home-made" in their research institutions and not open to the public. Therefore, open source control software for surgical robots can be beneficial in this field. From these perspectives, we developed Open Core Control software for surgical robots to overcome these challenges.
MATERIALS AND METHODS: In general, control softwares have hardware dependencies based on actuators, sensors and various kinds of internal devices. Therefore, these control softwares cannot be used on different types of robots without modifications. However, the structure of the Open Core Control software can be reused for various types of robots by abstracting hardware dependent parts. In addition, network connectivity is crucial for collaboration between advanced medical devices. The OpenIGTLink is adopted in Interface class which plays a role to communicate with external medical devices. At the same time, it is essential to maintain the stable operation within the asynchronous data transactions through network. In the Open Core Control software, several techniques for this purpose were introduced. Virtual fixture is well known technique as a "force guide" for supporting operators to perform precise manipulation by using a master-slave robot. The virtual fixture for precise and safety surgery was implemented on the system to demonstrate an idea of high-level collaboration between a surgical robot and a navigation system. The extension of virtual fixture is not a part of the Open Core Control system, however, the function such as virtual fixture cannot be realized without a tight collaboration between cutting-edge medical devices. By using the virtual fixture, operators can pre-define an accessible area on the navigation system, and the area information can be transferred to the robot. In this manner, the surgical console generates the reflection force when the operator tries to get out from the pre-defined accessible area during surgery.
RESULTS: The Open Core Control software was implemented on a surgical master-slave robot and stable operation was observed in a motion test. The tip of the surgical robot was displayed on a navigation system by connecting the surgical robot with a 3D position sensor through the OpenIGTLink. The accessible area was pre-defined before the operation, and the virtual fixture was displayed as a "force guide" on the surgical console. In addition, the system showed stable performance in a duration test with network disturbance.
CONCLUSION: In this paper, a design of the Open Core Control software for surgical robots and the implementation of virtual fixture were described. The Open Core Control software was implemented on a surgical robot system and showed stable performance in high-level collaboration works. The Open Core Control software is developed to be a widely used platform of surgical robots. Safety issues are essential for control software of these complex medical devices. It is important to follow the global specifications such as a FDA requirement "General Principles of Software Validation" or IEC62304. For following these regulations, it is important to develop a self-test environment. Therefore, a test environment is now under development to test various interference in operation room such as a noise of electric knife by considering safety and test environment regulations such as ISO13849 and IEC60508. The Open Core Control software is currently being developed software in open-source manner and available on the Internet. A communization of software interface is becoming a major trend in this field. Based on this perspective, the Open Core Control software can be expected to bring contributions in this field.
Magnetic Resonance Imaging (MRI) guided robotic interventions have been introduced in order to advance prostate cancer detection and treatment. To overcome problems of such robotic interventions, we have been developing a pneumatically actuated MRI-compatible modular robotic system for MRI-guided transperineal prostate intervention and its interventional procedure. For system evaluation, a series of experiments have been conducted and this paper reports a needle insertion experiment using prostate phantom and patient mockup trials. The needle insertion experiment resulted in noticeable consistent error in one direction, which we will investigate further. Nonetheless, patient mockup experiences suggest that the modular robotic system and its interventional procedure are well integrated and implemented in clinical environment.
RATIONALE AND OBJECTIVES: The authors present their initial experience using a 3-T whole-body scanner equipped with a 128-channel coil applied to lung motion assessment. Recent improvements in fast magnetic resonance imaging (MRI) technology have enabled several trials of free-breathing three-dimensional (3D) imaging of the lung. A large number of image frames necessarily increases the difficulty of image analysis and therefore warrants automatic image processing. However, the intensity homogeneities of images of prior dynamic 3D lung MRI studies have been insufficient to use such methods. In this study, initial data were obtained at 3 T with a 128-channel coil that demonstrate the feasibility of acquiring multiple sets of 3D pulmonary scans during free breathing and that have sufficient quality to be amenable to automatic segmentation.
MATERIALS AND METHODS: Dynamic 3D images of the lungs of two volunteers were acquired with acquisition times of 0.62 to 0.76 frames/s and an image matrix of 128 x 128, with 24 to 30 slice encodings. The volunteers were instructed to take shallow and deep breaths during the scans. The variation of lung volume was measured from the segmented images.
RESULTS: Dynamic 3D images were successfully acquired for both respiratory conditions for each subject. The images showed whole-lung motion, including lifting of the chest wall and the displacement of the diaphragm, with sufficient contrast to distinguish these structures from adjacent tissues. The average time to complete segmentation for one 3D image was 4.8 seconds. The tidal volume measured was consistent with known tidal volumes for healthy subjects performing deep-breathing maneuvers. The temporal resolution was insufficient to measure tidal volumes for shallow breathing.
CONCLUSION: This initial experience with a 3-T whole-body scanner and a 128-channel coil showed that the scanner and imaging protocol provided dynamic 3D images with spatial and temporal resolution sufficient to delineate the diaphragmatic domes and chest wall during active breathing. In addition, the intensity homogeneities and signal-to-noise ratio were adequate to perform automatic segmentation.
PURPOSE: To apply an intensity-based nonrigid registration algorithm to MRI-guided prostate brachytherapy clinical data and to assess its accuracy.
MATERIALS AND METHODS: A nonrigid registration of preoperative MRI to intraoperative MRI images was carried out in 16 cases using a Basis-Spline algorithm in a retrospective manner. The registration was assessed qualitatively by experts' visual inspection and quantitatively by measuring the Dice similarity coefficient (DSC) for total gland (TG), central gland (CG), and peripheral zone (PZ), the mutual information (MI) metric, and the fiducial registration error (FRE) between corresponding anatomical landmarks for both the nonrigid and a rigid registration method.
RESULTS: All 16 cases were successfully registered in less than 5 min. After the nonrigid registration, DSC values for TG, CG, PZ were 0.91, 0.89, 0.79, respectively, the MI metric was -0.19 +/- 0.07 and FRE presented a value of 2.3 +/- 1.8 mm. All the metrics were significantly better than in the case of rigid registration, as determined by one-sided t-tests.
CONCLUSION: The intensity-based nonrigid registration method using clinical data was demonstrated to be feasible and showed statistically improved metrics when compare to only rigid registration. The method is a valuable tool to integrate pre- and intraoperative images for brachytherapy.
BACKGROUND: With increasing research on system integration for image-guided therapy (IGT), there has been a strong demand for standardized communication among devices and software to share data such as target positions, images and device status.
METHOD: We propose a new, open, simple and extensible network communication protocol for IGT, named OpenIGTLink, to transfer transform, image and status messages. We conducted performance tests and use-case evaluations in five clinical and engineering scenarios.
RESULTS: The protocol was able to transfer position data with submillisecond latency up to 1024 fps and images with latency of <10 ms at 32 fps. The use-case tests demonstrated that the protocol is feasible for integrating devices and software.
CONCLUSION: The protocol proved capable of handling data required in the IGT setting with sufficient time resolution and latency. The protocol not only improves the interoperability of devices and software but also promotes transitions of research prototypes to clinical applications.
BACKGROUND: In magnetic resonance (MR) image-guided microwave thermocoagulation of liver tumors, the choice of the optimal puncture route is an important and time-consuming process. To assist this process, we have developed a motorized MR-compatible manipulator.
METHODS: The manipulator consists of a passive end effecter with 2 degrees-of-freedom (DOF) rotation and active base stages with 3 ultrasonic motors. It automatically chases the preset target point with synergetic remote-center-of-motion (RCM) control. A mechanical torque limiter and an electrical shutdown switch were added for patient safety.
RESULTS: The manipulator was used for this procedure in 15 cases and successfully utilized to treat liver tumors in various locations. Thoracoscopic assistance was combined with the manipulator in 6 cases. No complications were experienced.
CONCLUSIONS: The manipulator was found to be very effective for assisting MR-guided microwave coagulation of liver tumors.
For real-time 3D visualization of respiratory organ motion for MRI-guided therapy, a new adaptive 4D MR imaging method based on navigator echo and multiple gating windows was developed. This method was designed to acquire a time series of volumetric 3D images of a cyclically moving organ, enabling therapy to be guided by synchronizing the 4D image with the actual organ motion in real time. The proposed method was implemented in an open-configuration 0.5T clinical MR scanner. To evaluate the feasibility and determine optimal imaging conditions, studies were conducted with a phantom, volunteers, and a patient. In the phantom study the root mean square (RMS) position error in the 4D image of the cyclically moving phantom was 1.9 mm and the imaging time was approximately 10 min when the 4D image had six frames. In the patient study, 4D images were successfully acquired under clinical conditions and a liver tumor was discriminated in the series of frames. The image quality was affected by the relations among the encoding direction, the slice orientation, and the direction of motion of the target organ. In conclusion, this study has shown that the proposed method is feasible and capable of providing a real-time dynamic 3D atlas for surgical navigation with sufficient accuracy and image quality.