论文标题
在机器人手术中整合人工智能和增强现实：使用手术教育方案的初步DVRK研究
Integrating Artificial Intelligence and Augmented Reality in Robotic Surgery: An Initial dVRK Study Using a Surgical Education Scenario
论文作者
论文摘要
由于其临床优势，机器人辅助手术越来越受欢迎。同时，机器人手术中的人工智能和增强现实正在迅速发展，并受到了很多关注。但是，当前的方法尚未讨论机器人手术中AI和AR的相干整合。在本文中，我们通过无缝合并人工智能模块并增强现实可视化来开发一种新型系统，从而自动为机器人手术教育生成外科手术指南。具体来说，我们首先利用强化倾向来从专家演示中学习，然后生成3D指导轨迹，从而提供手术程序的先前上下文信息。再加上其他信息，例如文本提示，然后在DVRK的立体声视图中覆盖了3D轨迹，用户可以感知3D指导并学习该过程。通过对手术教育任务PEG转移的初步实验来评估拟议的系统，该实验证明了它是下一代机器人辅助手术教育解决方案的可行性和潜力。
Robot-assisted surgery has become progressively more and more popular due to its clinical advantages. In the meanwhile, the artificial intelligence and augmented reality in robotic surgery are developing rapidly and receive lots of attention. However, current methods have not discussed the coherent integration of AI and AR in robotic surgery. In this paper, we develop a novel system by seamlessly merging artificial intelligence module and augmented reality visualization to automatically generate the surgical guidance for robotic surgery education. Specifically, we first leverage reinforcement leaning to learn from expert demonstration and then generate 3D guidance trajectory, providing prior context information of the surgical procedure. Along with other information such as text hint, the 3D trajectory is then overlaid in the stereo view of dVRK, where the user can perceive the 3D guidance and learn the procedure. The proposed system is evaluated through a preliminary experiment on surgical education task peg-transfer, which proves its feasibility and potential as the next generation of robot-assisted surgery education solution.
