Connolly L, Deguet A, Leonard S, Tokuda J, Ungi T, Krieger A, et al. Bridging 3D Slicer and ROS2 for Image-Guided Robotic Interventions. Sensors (Basel). 2022;22 (14). Abstract
Developing image-guided robotic systems requires access to flexible, open-source software. For image guidance, the open-source medical imaging platform 3D Slicer is one of the most adopted tools that can be used for research and prototyping. Similarly, for robotics, the open-source middleware suite robot operating system (ROS) is the standard development framework. In the past, there have been several "ad hoc" attempts made to bridge both tools; however, they are all reliant on middleware and custom interfaces. Additionally, none of these attempts have been successful in bridging access to the full suite of tools provided by ROS or 3D Slicer. Therefore, in this paper, we present the SlicerROS2 module, which was designed for the direct use of ROS2 packages and libraries within 3D Slicer. The module was developed to enable real-time visualization of robots, accommodate different robot configurations, and facilitate data transfer in both directions (between ROS and Slicer). We demonstrate the system on multiple robots with different configurations, evaluate the system performance and discuss an image-guided robotic intervention that can be prototyped with this module. This module can serve as a starting point for clinical system development that reduces the need for custom interfaces and time-intensive platform setup.
Schmidt EJ, Olson G, Tokuda J, Alipour A, Watkins RD, Meyer EM, et al. Intracardiac MR imaging (ICMRI) guiding-sheath with amplified expandable-tip imaging and MR-tracking for navigation and arrythmia ablation monitoring: Swine testing at 1.5 and 3T. Magn Reson Med. 2022;87 (6) :2885-2900. Abstract
PURPOSE: Develop a deflectable intracardiac MR imaging (ICMRI) guiding-sheath to accelerate imaging during MR-guided electrophysiological (EP) interventions for radiofrequency (500 kHz) ablation (RFA) of arrythmia. Requirements include imaging at three to five times surface-coil SNR in cardiac chambers, vascular insertion, steerable-active-navigation into cardiac chambers, operation with ablation catheters, and safe levels of MR-induced heating. METHODS: ICMRI's 6 mm outer-diameter (OD) metallic-braided shaft had a 2.6 mm OD internal lumen for ablation-catheter insertion. Miniature-Baluns (MBaluns) on ICMRI's 1 m shaft reduced body-coil-induced heating. Distal section was a folded "star"-shaped imaging-coil mounted on an expandable frame, with an integrated miniature low-noise-amplifier overcoming cable losses. A handle-activated movable-shaft expanded imaging-coil to 35 mm OD for imaging within cardiac-chambers. Four MR-tracking micro-coils enabled navigation and motion-compensation, assuming a tetrahedron-shape when expanded. A second handle-lever enabled distal-tip deflection. ICMRI with a protruding deflectable EP catheter were used for MR-tracked navigation and RFA using a dedicated 3D-slicer user-interface. ICMRI was tested at 3T and 1.5T in swine to evaluate (a) heating, (b) cardiac-chamber access, (c) imaging field-of-view and SNR, and (d) intraprocedural RFA lesion monitoring. RESULTS: The 3T and 1.5T imaging SNR demonstrated >400% SNR boost over a 4 × 4 × 4 cm3 FOV in the heart, relative to body and spine arrays. ICMRI with MBaluns met ASTM/IEC heating limits during navigation. Tip-deflection allowed navigating ICMRI and EP catheter into atria and ventricles. Acute-lesion long-inversion-time-T1-weighted 3D-imaging (TWILITE) ablation-monitoring using ICMRI required 5:30 min, half the time needed with surface arrays alone. CONCLUSION: ICMRI assisted EP-catheter navigation to difficult targets and accelerated RFA monitoring.
Gunderman AL, Schmidt EJ, Morcos M, Tokuda J, Seethamraju RT, Halperin HR, et al. MR-Tracked Deflectable Stylet for Gynecologic Brachytherapy. IEEE ASME Trans Mechatron. 2022;27 (1) :407-417. Abstract
Brachytherapy is a radiation based treatment that is implemented by precisely placing focused radiation sources into tumors. In advanced interstitial cervical cancer bracytherapy treatment, this is performed by placing a metallic rod ("stylet") inside a hollow cylindrical tube ("catheter") and advancing the pair to the desired target. The stylet is removed once the target is reached, followed by the insertion of radiation sources into the catheter. However, manually advancing an initially straight stylet into the tumor with millimeter spatial accuracy has been a long-standing challenge, which requires multiple insertions and retractions, due to the unforeseen stylet deflection caused by the stiff muscle tissue that is traversed. In this paper, we develop a novel tendon-actuated deflectable stylet equipped with MR active-tracking coils that may enhance brachytherapy treatment outcomes by allowing accurate stylet trajectory control. Herein we present the design concept and fabrication method, followed by the kinematic and mechanics models of the deflectable stylet. The hardware and theoretical models are extensively validated via benchtop and MRI-guided characterization. At insertion depths of 60 mm, benchtop phantom targeting tests provided a targeting error of 1. 23 ± 0. 47 mm, and porcine tissue targeting tests provided a targeting error of 1. 65 ± 0. 64 mm, after only a single insertion. MR-guided experiments indicate that the stylet can be safely and accurately located within the MRI environment.
Lo W-C, Bittencourt LK, Panda A, Jiang Y, Tokuda J, Seethamraju R, et al. Multicenter Repeatability and Reproducibility of MR Fingerprinting in Phantoms and in Prostatic Tissue. Magn Reson Med. 2022;88 (4) :1818-1827. Abstract
PURPOSE: To evaluate multicenter repeatability and reproducibility of T1 and T2 maps generated using MR fingerprinting (MRF) in the International Society for Magnetic Resonance in Medicine/National Institute of Standards and Technology MRI system phantom and in prostatic tissues. METHODS: MRF experiments were performed on 5 different 3 Tesla MRI scanners at 3 different institutions: University Hospitals Cleveland Medical Center (Cleveland, OH), Brigham and Women's Hospital (Boston, MA) in the United States, and Diagnosticos da America (Rio de Janeiro, RJ) in Brazil. Raw MRF data were reconstructed using a Gadgetron-based MRF online reconstruction pipeline to yield quantitative T1 and T2 maps. The repeatability of T1 and T2 values over 6 measurements in the International Society for Magnetic Resonance in Medicine/National Institute of Standards and Technology MRI system phantom was assessed to demonstrate intrascanner variation. The reproducibility between the 4 clinical scanners was assessed to demonstrate interscanner variation. The same-day test-retest normal prostate mean T1 and T2 values from peripheral zone and transitional zone were also compared using the intraclass correlation coefficient and Bland-Altman analysis. RESULTS: The intrascanner variation of values measured using MRF was less than 2% for T1 and 4.7% for T2 for relaxation values, within the range of 307.7 to 2360 ms for T1 and 19.1 to 248.5 ms for T2 . Interscanner measurements showed that the T1 variation was less than 4.9%, and T2 variation was less than 8.1% between multicenter scanners. Both T1 and T2 values in in vivo prostatic tissue demonstrated high test-retest reliability (intraclass correlation coefficient > 0.92) and strong linear correlation (R2  > 0.840). CONCLUSION: Prostate MRF measurements of T1 and T2 are repeatable and reproducible between MRI scanners at different centers on different continents for the above measurement ranges.
Giganti F, Cole AP, Fennessy FM, Clinton T, Moreira PLDF, Bernardes MC, et al. Promoting the use of the PI-QUAL score for prostate MRI quality: results from the ESOR Nicholas Gourtsoyiannis teaching fellowship. Eur Radiol. 2022;Abstract
OBJECTIVES: The Prostate Imaging Quality (PI-QUAL) score is a new metric to evaluate the diagnostic quality of multiparametric magnetic resonance imaging (MRI) of the prostate. This study assesses the impact of an intervention, namely a prostate MRI quality training lecture, on the participant's ability to apply PI-QUAL. METHODS: Sixteen participants (radiologists, urologists, physicists, and computer scientists) of varying experience in reviewing diagnostic prostate MRI all assessed the image quality of ten examinations from different vendors and machines. Then, they attended a dedicated lecture followed by a hands-on workshop on MRI quality assessment using the PI-QUAL score. Five scans assessed by the participants were evaluated in the workshop using the PI-QUAL score for teaching purposes. After the course, the same participants evaluated the image quality of a new set of ten scans applying the PI-QUAL score. Results were assessed using receiver operating characteristic analysis. The reference standard was the PI-QUAL score assessed by one of the developers of PI-QUAL. RESULTS: There was a significant improvement in average area under the curve for the evaluation of image quality from baseline (0.59 [95 % confidence intervals: 0.50-0.66]) to post-teaching (0.96 [0.92-0.98]), an improvement of 0.37 [0.21-0.41] (p < 0.001). CONCLUSIONS: A teaching course (dedicated lecture + hands-on workshop) on PI-QUAL significantly improved the application of this scoring system to assess the quality of prostate MRI examinations. KEY POINTS: • A significant improvement in the application of PI-QUAL for the assessment of prostate MR image quality was observed after an educational intervention. • Appropriate training on image quality can be delivered to those involved in the acquisition and interpretation of prostate MRI. • Further investigation will be needed to understand the impact on improving the acquisition of high-quality diagnostic prostate MR examinations.
Meyer A, Mehrtash A, Rak M, Bashkanov O, Langbein B, Ziaei A, et al. Domain adaptation for segmentation of critical structures for prostate cancer therapy. Sci Rep. 2021;11 (1) :11480. Abstract
Preoperative assessment of the proximity of critical structures to the tumors is crucial in avoiding unnecessary damage during prostate cancer treatment. A patient-specific 3D anatomical model of those structures, namely the neurovascular bundles (NVB) and the external urethral sphincters (EUS), can enable physicians to perform such assessments intuitively. As a crucial step to generate a patient-specific anatomical model from preoperative MRI in a clinical routine, we propose a multi-class automatic segmentation based on an anisotropic convolutional network. Our specific challenge is to train the network model on a unique source dataset only available at a single clinical site and deploy it to another target site without sharing the original images or labels. As network models trained on data from a single source suffer from quality loss due to the domain shift, we propose a semi-supervised domain adaptation (DA) method to refine the model's performance in the target domain. Our DA method combines transfer learning and uncertainty guided self-learning based on deep ensembles. Experiments on the segmentation of the prostate, NVB, and EUS, show significant performance gain with the combination of those techniques compared to pure TL and the combination of TL with simple self-learning ([Formula: see text] for all structures using a Wilcoxon's signed-rank test). Results on a different task and data (Pancreas CT segmentation) demonstrate our method's generic application capabilities. Our method has the advantage that it does not require any further data from the source domain, unlike the majority of recent domain adaptation strategies. This makes our method suitable for clinical applications, where the sharing of patient data is restricted.
Robertson FC, Sha RM, Amich JM, Essayed WI, Lal A, Lee BH, et al. Frameless neuronavigation with computer vision and real-time tracking for bedside external ventricular drain placement: a cadaveric study. J Neurosurg. 2021;:1-10. Abstract
OBJECTIVE: A major obstacle to improving bedside neurosurgical procedure safety and accuracy with image guidance technologies is the lack of a rapidly deployable, real-time registration and tracking system for a moving patient. This deficiency explains the persistence of freehand placement of external ventricular drains, which has an inherent risk of inaccurate positioning, multiple passes, tract hemorrhage, and injury to adjacent brain parenchyma. Here, the authors introduce and validate a novel image registration and real-time tracking system for frameless stereotactic neuronavigation and catheter placement in the nonimmobilized patient. METHODS: Computer vision technology was used to develop an algorithm that performed near-continuous, automatic, and marker-less image registration. The program fuses a subject's preprocedure CT scans to live 3D camera images (Snap-Surface), and patient movement is incorporated by artificial intelligence-driven recalibration (Real-Track). The surface registration error (SRE) and target registration error (TRE) were calculated for 5 cadaveric heads that underwent serial movements (fast and slow velocity roll, pitch, and yaw motions) and several test conditions, such as surgical draping with limited anatomical exposure and differential subject lighting. Six catheters were placed in each cadaveric head (30 total placements) with a simulated sterile technique. Postprocedure CT scans allowed comparison of planned and actual catheter positions for user error calculation. RESULTS: Registration was successful for all 5 cadaveric specimens, with an overall mean (± standard deviation) SRE of 0.429 ± 0.108 mm for the catheter placements. Accuracy of TRE was maintained under 1.2 mm throughout specimen movements of low and high velocities of roll, pitch, and yaw, with the slowest recalibration time of 0.23 seconds. There were no statistically significant differences in SRE when the specimens were draped or fully undraped (p = 0.336). Performing registration in a bright versus a dimly lit environment had no statistically significant effect on SRE (p = 0.742 and 0.859, respectively). For the catheter placements, mean TRE was 0.862 ± 0.322 mm and mean user error (difference between target and actual catheter tip) was 1.674 ± 1.195 mm. CONCLUSIONS: This computer vision-based registration system provided real-time tracking of cadaveric heads with a recalibration time of less than one-quarter of a second with submillimetric accuracy and enabled catheter placements with millimetric accuracy. Using this approach to guide bedside ventriculostomy could reduce complications, improve safety, and be extrapolated to other frameless stereotactic applications in awake, nonimmobilized patients.
Moreira P, Grimble J, Iftimia N, Bay CP, Tuncali K, Park J, et al. In vivo evaluation of angulated needle-guide template for MRI-guided transperineal prostate biopsy. Med Phys. 2021;Abstract
PURPOSE: Magnetic resonance imaging (MRI)-guided transperineal prostate biopsy has been practiced since the early 2000s. The technique often suffers from targeting error due to deviation of the needle as a result of physical interaction between the needle and inhomogeneous tissues. Existing needle guide devices, such as a grid template, do not allow choosing an alternative insertion path to mitigate the deviation because of their limited degree-of-freedom (DoF). This study evaluates how an angulated needle insertion path can reduce needle deviation and improve needle placement accuracy. METHODS: We extended a robotic needle-guidance device (Smart Template) for in-bore MRI-guided transperineal prostate biopsy. The new Smart Template has a 4-DoF needle-guiding mechanism allowing a translational range of motion of 65 and 58 mm along the vertical and horizontal axis, and a needle rotational motion around the vertical and horizontal axis and a vertical rotational range of , respectively. We defined a path planning strategy, which chooses between straight and angulated insertion paths depending on the anatomical structures on the potential insertion path. We performed (a) a set of experiments to evaluate the device positioning accuracy outside the MR-bore, and (b) an in vivo experiment to evaluate the improvement of targeting accuracy combining straight and angulated insertions in animal models (swine, ). RESULTS: We analyzed 46 in vivo insertions using either straight or angulated insertions paths. The experiment showed that the proposed strategy of selecting straight or angulated insertions based on the subject's anatomy outperformed the conventional approach of just straight insertions in terms of targeting accuracy (2.4 mm [1.3-3.7] vs 3.9 mm [2.4-5.0] {Median ); p = 0.041 after the bias correction). CONCLUSION: The in vivo experiment successfully demonstrated that an angulated needle insertion path could improve needle placement accuracy with a path planning strategy that takes account of the subject-specific anatomical structures.
Moreira P, Tuncali K, Tempany CM, Tokuda J. The Impact of Placement Errors on the Tumor Coverage in MRI-Guided Focal Cryoablation of Prostate Cancer. Acad Radiol. 2020;Abstract
RATIONALE AND OBJECTIVES: There have been multiple investigations defining and reporting the effectiveness of focal cryoablation as a treatment option for organ-confined prostate cancer. However, the impact of cryo-needle/probe placement accuracy within the tumor and gland has not been extensively studied. We analyzed how variations in the placement of the cryo-needles, specifically errors leading to incomplete ablation, may affect prostate cancer's resulting cryoablation. MATERIALS AND METHODS: We performed a study based on isothermal models using Monte Carlo simulations to analyze the impact of needle placement errors on tumor coverage and the probability of positive ablation margin. We modeled the placement error as a Gaussian noise on the cryo-needle position. The analysis used retrospective MRI data of 15 patients with biopsy-proven, unifocal, and MRI visible prostate cancer to calculate the impact of placement error on the volume of the tumor encompassed by the -40°C and -20°C isotherms using one to four cryo-needles. RESULTS: When the standard deviation of the placement error reached 3 mm, the tumor coverage was still above 97% with the -20°C isotherm, and above 81% with the -40°C isotherm using two cryo-needles or more. The probability of positive margin was significantly lower considering the -20°C isotherm (0.04 for three needles) than using the -40°C isotherm (0.66 for three needles). CONCLUSION: The results indicated that accurate cryo-needle placement is essential for the success of focal cryoablation of prostate cancer. The analysis shows that an admissible targeting error depends on the lethal temperature considered and the number of cryo-needles used.
Wang S, Frisbie J, Keepers Z, Bolten Z, Hevaganinge A, Boctor E, et al. The Use of Three-dimensional Visualization Techniques for Prostate Procedures: A Systematic Review. Eur Urol Focus. 2020;Abstract
CONTEXT: As an emerging technique, three-dimensional (3D) visualization has become more popular and can facilitate education, training, surgical planning, and intraoperative guidance for prostate cancer surgery. OBJECTIVE: In this review, we aim to present the impact of 3D printing, virtual reality (VR), and augmented reality (AR) techniques for prostate cancer procedures, specifically prostate biopsy and radical prostatectomy (RP). EVIDENCE ACQUISITION: A systematic review was performed by two investigators according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) criteria. EVIDENCE SYNTHESIS: A total of 541 papers were identified in PubMed, Scopus, and Embase. Of these, 53 studies were identified for detailed review and 25 were qualified. Two more studies were identified from the references; thus, 27 studies were finally included in this systematic review. Nine papers reported on the use of 3D reconstructed models, mainly in education/training and intraoperative guidance; nine reported on VR, focusing on simulation training model and intraoperative guidance; and nine reported on AR technique with its best indication for surgical guidance in robotic RP. CONCLUSIONS: Three-dimensional visualization techniques have gradually been introduced and developed in prostate procedures, and demonstrate potential utility not only for education/training, but also for surgical planning and intraoperative guidance. Prospective studies are needed to demonstrate clinical utility and validation of these technologies. PATIENT SUMMARY: Despite low-quality evidence, promising signals were identified to demonstrate that three-dimensional visualization could help facilitate prostate procedures, in terms of education/training, surgical planning, and intraoperative guidance. It is still in a very early stage, and more studies need to be conducted to justify its widespread use.
Yamada A, Tokuda J, Naka S, Murakami K, Tani T, Morikawa S. Magnetic resonance and ultrasound image-guided navigation system using a needle manipulator. Med Phys. 2020;47 (3) :850-858. Abstract
PURPOSE: Image guidance is crucial for percutaneous tumor ablations, enabling accurate needle-like applicator placement into target tumors while avoiding tissues that are sensitive to injury and/or correcting needle deflection. Although ultrasound (US) is widely used for image guidance, magnetic resonance (MR) is preferable due to its superior soft tissue contrast. The objective of this study was to develop and evaluate an MR and US multi-modal image-guided navigation system with a needle manipulator to enable US-guided applicator placement during MR imaging (MRI)-guided percutaneous tumor ablation. METHODS: The MRI-compatible needle manipulator with US probe was installed adjacent to a 3 Tesla MRI scanner patient table. Coordinate systems for the MR image, patient table, manipulator, and US probe were all registered using an optical tracking sensor. The patient was initially scanned in the MRI scanner bore for planning and then moved outside the bore for treatment. Needle insertion was guided by real-time US imaging fused with the reformatted static MR image to enhance soft tissue contrast. Feasibility, targeting accuracy, and MR compatibility of the system were evaluated using a bovine liver and agar phantoms. RESULTS: Targeting error for 50 needle insertions was 1.6 ± 0.6 mm (mean ± standard deviation). The experiment confirmed that fused MR and US images provided real-time needle localization against static MR images with soft tissue contrast. CONCLUSIONS: The proposed MR and US multi-modal image-guided navigation system using a needle manipulator enabled accurate needle insertion by taking advantage of static MR and real-time US images simultaneously. Real-time visualization helped determine needle depth, tissue monitoring surrounding the needle path, target organ shifts, and needle deviation from the path.
Herz C, MacNeil K, Behringer PA, Tokuda J, Mehrtash A, Mousavi P, et al. Open Source Platform for Transperineal In-Bore MRI-Guided Targeted Prostate Biopsy. IEEE Trans Biomed Eng. 2020;67 (2) :565-576. Abstract
OBJECTIVE: Accurate biopsy sampling of the suspected lesions is critical for the diagnosis and clinical management of prostate cancer. Transperineal in-bore MRI-guided prostate biopsy (tpMRgBx) is a targeted biopsy technique that was shown to be safe, efficient, and accurate. Our goal was to develop an open source software platform to support evaluation, refinement, and translation of this biopsy approach. METHODS: We developed SliceTracker, a 3D Slicer extension to support tpMRgBx. We followed modular design of the implementation to enable customization of the interface and interchange of image segmentation and registration components to assess their effect on the processing time, precision, and accuracy of the biopsy needle placement. The platform and supporting documentation were developed to enable the use of software by an operator with minimal technical training to facilitate translation. Retrospective evaluation studied registration accuracy, effect of the prostate segmentation approach, and re-identification time of biopsy targets. Prospective evaluation focused on the total procedure time and biopsy targeting error (BTE). RESULTS: Evaluation utilized data from 73 retrospective and ten prospective tpMRgBx cases. Mean landmark registration error for retrospective evaluation was 1.88 ± 2.63 mm, and was not sensitive to the approach used for prostate gland segmentation. Prospectively, we observed target re-identification time of 4.60 ± 2.40 min and BTE of 2.40 ± 0.98 mm. CONCLUSION: SliceTracker is modular and extensible open source platform for supporting image processing aspects of the tpMRgBx procedure. It has been successfully utilized to support clinical research procedures at our site.
Shono N, Ninni B, King F, Kato T, Tokuda J, Fujimoto T, et al. Simulated accuracy assessment of small footprint body-mounted probe alignment device for MRI-guided cryotherapy of abdominal lesions. Med Phys. 2020;47 (6) :2337-2349. Abstract
PURPOSE: Magnetic resonance imaging (MRI)-guided percutaneous cryotherapy of abdominal lesions, an established procedure, uses MRI to guide and monitor the cryoablation of lesions. Methods to precisely guide cryotherapy probes with a minimum amount of trial-and-error are yet to be established. To aid physicians in attaining precise probe alignment without trial-and-error, a body-mounted motorized cryotherapy-probe alignment device (BMCPAD) with motion compensation was clinically tested in this study. The study also compared the contribution of body motion and organ motion compensation to the guidance accuracy of a body-mounted probe alignment device. METHODS: The accuracy of guidance using the BMCPAD was prospectively measured during MRI-guided percutaneous cryotherapies before insertion of the probes. Clinical parameters including patient age, types of anesthesia, depths of the target, and organ sites of target were collected. By using MR images of the target organs and fiducial markers embedded in the BMCPAD, we retrospectively simulated the guidance accuracy with body motion compensation, organ motion compensation, and no compensation. The collected data were analyzed to test the impact of motion compensation on the guidance accuracy. RESULTS: Thirty-seven physical guidance of probes were prospectively recorded for sixteen completed cases. The accuracy of physical guidance using the BMCPAD was 13.4 ± 11.1 mm. The simulated accuracy of guidance with body motion compensation, organ motion compensation, and no compensation was 2.4 ± 2.9 mm, 2.2 ± 1.6 mm, and 3.5 ± 2.9 mm, respectively. Data analysis revealed that the body motion compensation and organ motion compensation individually impacted the improvement in the accuracy of simulated guidance. Moreover, the difference in the accuracy of guidance either by body motion compensation or organ motion compensation was not statistically significant. The major clinical parameters impacting the accuracy of guidance were the body and organ motions. Patient age, types of anesthesia, depths of the target, and organ sites of target did not influence the accuracy of guidance using BMCPAD. The magnitude of body surface movement and organ movement exhibited mutual statistical correlation. CONCLUSIONS: The BMCPAD demonstrated guidance accuracy comparable to that of previously reported devices for CT-guided procedures. The analysis using simulated motion compensation revealed that body motion compensation and organ motion compensation individually impact the improvement in the accuracy of device-guided cryotherapy probe alignment. Considering the correlation between body and organ movements, we also determined that body motion compensation using the ring fiducial markers in the BMCPAD can be solely used to address both body and organ motions in MRI-guided cryotherapy.
Tokuda J, Wang Q, Tuncali K, Seethamraju RT, Tempany CM, Schmidt EJ. Temperature-Sensitive Frozen-Tissue Imaging for Cryoablation Monitoring Using STIR-UTE MRI. Invest Radiol. 2020;55 (5) :310-317. Abstract
PURPOSE: The aim of this study was to develop a method to delineate the lethally frozen-tissue region (temperature less than -40°C) arising from interventional cryoablation procedures using a short tau inversion-recovery ultrashort echo-time (STIR-UTE) magnetic resonance (MR) imaging sequence. This method could serve as an intraprocedural validation of the completion of tumor ablation, reducing the number of local recurrences after cryoablation procedures. MATERIALS AND METHODS: The method relies on the short T1 and T2* relaxation times of frozen soft tissue. Pointwise Encoding Time with Radial Acquisition, a 3-dimensional UTE sequence with TE = 70 microseconds, was optimized with STIR to null tissues with a T1 of approximately 271 milliseconds, the threshold T1. Because the T1 relaxation time of frozen tissue in the temperature range of -40°C < temperature < -8°C is shorter than the threshold T1 at the 3-tesla magnetic field, tissues in this range should appear hyperintense. The sequence was evaluated in ex vivo frozen tissue, where image intensity and actual tissue temperatures, measured by thermocouples, were correlated. Thereafter, the sequence was evaluated clinically in 12 MR-guided prostate cancer cryoablations, where MR-compatible cryoprobes were used to destroy cancerous tissue and preserve surrounding normal tissue. RESULTS: The ex vivo experiment using a bovine muscle demonstrated that STIR-UTE images showed regions approximately between -40°C and -8°C as hyperintense, with tissues at lower and higher temperatures appearing dark, making it possible to identify the region likely to be above the lethal temperature inside the frozen tissue. In the clinical cases, the STIR-UTE images showed a dark volume centered on the cryoprobe shaft, Vinner, where the temperature is likely below -40°C, surrounded by a doughnut-shaped hyperintense volume, where the temperature is likely between -40°C and -8°C. The hyperintense region was itself surrounded by a dark volume, where the temperature is likely above -8°C, permitting calculation of Vouter. The STIR-UTE frozen-tissue volumes, Vinner and Vouter, appeared significantly smaller than signal voids on turbo spin echo images (P < 1.0 × 10), which are currently used to quantify the frozen-tissue volume ("the iceball"). The ratios of the Vinner and Vouter volumes to the iceball were 0.92 ± 0.08 and 0.29 ± 0.07, respectively. In a single postablation follow-up case, a strong correlation was seen between Vinner and the necrotic volume. CONCLUSIONS: Short tau inversion-recovery ultrashort echo-time MR imaging successfully delineated the area approximately between -40°C and -8°C isotherms in the frozen tissue, demonstrating its potential to monitor the lethal ablation volume during MR-guided cryoablation.
Taylor AJ, Slutzky T, Feuerman L, Ren H, Tokuda J, Nilsson K, et al. MR-Conditional SMA-Based Origami Joint. IEEE ASME Trans Mechatron. 2019;24 (2) :883-888. Abstract
Foldable origami structures have been implemented into robotics as a way of compacting joints and circuitry into smaller structures. This technique is especially useful in minimally invasive surgical instruments, where the goal is to create slimline devices that can be inserted through small incisions. Origami also has the potential to cut costs by reducing the amount of material required for assembly. Origami devices are especially suitable for MRI-guided procedures, where instruments must be nonmagnetic because origami is more suitable for flexible, non-metallic materials. MR conditional surgical instruments enable intraoperative MRI procedures that provide superior imaging capabilities to physicians to allow for safer procedures. This work presents an MR conditional joint developed using origami techniques that reduces costs by eliminating assembly of various components and has potential applications in endoscopy. The joint is a compliant rolling-contact element that employs curved-folding origami techniques. A chain of these joints can be constructed from a single sheet of material, eliminating assembly of numerous materials to produce a final product, which is specifically advantageous for constructing low-cost, disposable surgical devices. The prototype contains a degree of bending of ±9 degrees per joint, a response time of less than 4 seconds and an actuation force of 0.5 N using a 1.25 A current. The MRI results showed a minimal artifact of less than 1 mm measured from the boundary of the joint chain and a SNR reduction of less than 10%.
Patel NA, Li G, Shang W, Wartenberg M, Heffter T, Burdette EC, et al. System Integration and Preliminary Clinical Evaluation of a Robotic System for MRI-Guided Transperineal Prostate Biopsy. J Med Robot Res. 2019;4 (2). Abstract
This paper presents the development, preclinical evaluation, and preliminary clinical study of a robotic system for targeted transperineal prostate biopsy under direct interventional magnetic resonance imaging (MRI) guidance. The clinically integrated robotic system is developed based on a modular design approach, comprised of surgical navigation application, robot control software, MRI robot controller hardware, and robotic needle placement manipulator. The system provides enabling technologies for MRI-guided procedures. It can be easily transported and setup for supporting the clinical workflow of interventional procedures, and the system is readily extensible and reconfigurable to other clinical applications. Preclinical evaluation of the system is performed with phantom studies in a 3 Tesla MRI scanner, rehearsing the proposed clinical workflow, and demonstrating an in-plane targeting error of 1.5mm. The robotic system has been approved by the institutional review board (IRB) for clinical trials. A preliminary clinical study is conducted with the patient consent, demonstrating the targeting errors at two biopsy target sites to be 4.0 and 3.7, which is sufficient to target a clinically significant tumor foci. First-in-human trials to evaluate the system's effectiveness and accuracy for MR image-guide prostate biopsy are underway.
Wartenberg M, Schornak J, Gandomi K, Carvalho P, Nycz C, Patel N, et al. Closed-Loop Active Compensation for Needle Deflection and Target Shift During Cooperatively Controlled Robotic Needle Insertion. Ann Biomed Eng. 2018;46 (10) :1582-1594. Abstract
Intra-operative imaging is sometimes available to assist needle biopsy, but typical open-loop insertion does not account for unmodeled needle deflection or target shift. Closed-loop image-guided compensation for deviation from an initial straight-line trajectory through rotational control of an asymmetric tip can reduce targeting error. Incorporating robotic closed-loop control often reduces physician interaction with the patient, but by pairing closed-loop trajectory compensation with hands-on cooperatively controlled insertion, a physician's control of the procedure can be maintained while incorporating benefits of robotic accuracy. A series of needle insertions were performed with a typical 18G needle using closed-loop active compensation under both fully autonomous and user-directed cooperative control. We demonstrated equivalent improvement in accuracy while maintaining physician-in-the-loop control with no statistically significant difference (p > 0.05) in the targeting accuracy between any pair of autonomous or individual cooperative sets, with average targeting accuracy of 3.56 mm. With cooperatively controlled insertions and target shift between 1 and 10 mm introduced upon needle contact, the system was able to effectively compensate up to the point where error approached a maximum curvature governed by bending mechanics. These results show closed-loop active compensation can enhance targeting accuracy, and that the improvement can be maintained under user directed cooperative insertion.
Moreira P, Patel N, Wartenberg M, Li G, Tuncali K, Heffter T, et al. Evaluation of robot-assisted MRI-guided prostate biopsy: needle path analysis during clinical trials. Phys Med Biol. 2018;63 (20) :20NT02. Abstract
While the interaction between a needle and the surrounding tissue is known to cause a significant targeting error in prostate biopsy leading to false-negative results, few studies have demonstrated how it impacts in the actual procedure. We performed a pilot study on robot-assisted MRI-guided prostate biopsy with an emphasis on the in-depth analysis of the needle-tissue interaction in vivo. The data were acquired during in-bore transperineal prostate biopsies in patients using a 4 degrees-of-freedom (DoF) MRI-compatible robot. The anatomical structures in the pelvic area and the needle path were reconstructed from MR images, and quantitatively analyzed. We analyzed each structure individually and also proposed a mathematical model to investigate the influence of those structures in the targeting error using the mixed-model regression. The median targeting error in 188 insertions (27 patients) was 6.3 mm. Both the individual anatomical structure analysis and the mixed-model analysis showed that the deviation resulted from the contact between the needle and the skin as the main source of error. On contrary, needle bending inside the tissue (expressed as needle curvature) did not vary among insertions with targeting errors above and below the average. The analysis indicated that insertions crossing the bulbospongiosus presented a targeting error lower than the average. The mixed-model analysis demonstrated that the distance between the needle guide and the patient skin, the deviation at the entry point, and the path length inside the pelvic diaphragm had a statistically significant contribution to the targeting error (p  <  0.05). Our results indicate that the errors associated with the elastic contact between the needle and the skin were more prominent than the needle bending along the insertion. Our findings will help to improve the preoperative planning of transperineal prostate biopsies.
Tokuda J, Chauvin L, Ninni B, Kato T, King F, Tuncali K, et al. Motion compensation for MRI-compatible patient-mounted needle guide device: estimation of targeting accuracy in MRI-guided kidney cryoablations. Phys Med Biol. 2018;63 (8) :085010. Abstract
Patient-mounted needle guide devices for percutaneous ablation are vulnerable to patient motion. The objective of this study is to develop and evaluate a software system for an MRI-compatible patient-mounted needle guide device that can adaptively compensate for displacement of the device due to patient motion using a novel image-based automatic device-to-image registration technique. We have developed a software system for an MRI-compatible patient-mounted needle guide device for percutaneous ablation. It features fully-automated image-based device-to-image registration to track the device position, and a device controller to adjust the needle trajectory to compensate for the displacement of the device. We performed: (a) a phantom study using a clinical MR scanner to evaluate registration performance; (b) simulations using intraoperative time-series MR data acquired in 20 clinical cases of MRI-guided renal cryoablations to assess its impact on motion compensation; and (c) a pilot clinical study in three patients to test its feasibility during the clinical procedure. FRE, TRE, and success rate of device-to-image registration were [Formula: see text] mm, [Formula: see text] mm, and 98.3% for the phantom images. The simulation study showed that the motion compensation reduced the targeting error for needle placement from 8.2 mm to 5.4 mm (p  <  0.0005) in patients under general anesthesia (GA), and from 14.4 mm to 10.0 mm ([Formula: see text]) in patients under monitored anesthesia care (MAC). The pilot study showed that the software registered the device successfully in a clinical setting. Our simulation study demonstrated that the software system could significantly improve targeting accuracy in patients treated under both MAC and GA. Intraprocedural image-based device-to-image registration was feasible.
Hovet S, Ren H, Xu S, Wood B, Tokuda J, Tse ZTH. MRI-powered biomedical devices. Minim Invasive Ther Allied Technol. 2018;27 (4) :191-202. Abstract
Magnetic resonance imaging (MRI) is beneficial for imaging-guided procedures because it provides higher resolution images and better soft tissue contrast than computed tomography (CT), ultrasound, and X-ray. MRI can be used to streamline diagnostics and treatment because it does not require patients to be repositioned between scans of different areas of the body. It is even possible to use MRI to visualize, power, and control medical devices inside the human body to access remote locations and perform minimally invasive procedures. Therefore, MR conditional medical devices have the potential to improve a wide variety of medical procedures; this potential is explored in terms of practical considerations pertaining to clinical applications and the MRI environment. Recent advancements in this field are introduced with a review of clinically relevant research in the areas of interventional tools, endovascular microbots, and closed-loop controlled MRI robots. Challenges related to technology and clinical feasibility are discussed, including MRI based propulsion and control, navigation of medical devices through the human body, clinical adoptability, and regulatory issues. The development of MRI-powered medical devices is an emerging field, but the potential clinical impact of these devices is promising.