| Construction and application of augmented reality 3D image navigation platform for laparoscopic liver surgery |
| Received:October 16, 2022 Revised:November 18, 2022 Click here to download the full text |
| Citation of this paper:U Yang,CHENG Jian-wen,WANG Peng-xiang,ZHOU Kai-qian,SUN Yun-fan,WU Yi-rong,LI Nan-zhe,DUAN Xiao-ming,CHEN Yong-jian,FAN Jia,ZHOU Jian,YANG Xin-rong.Construction and application of augmented reality 3D image navigation platform for laparoscopic liver surgery[J].Chinese Journal of Clinical Medicine,2023,30(1):97-103 |
| Hits: 1424 |
| Download times: 507 |
| Author Name | Affiliation | E-mail | | U Yang | Department of Liver Surgery, Liver Cancer Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China | | | CHENG Jian-wen | Department of Liver Surgery, Liver Cancer Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China | | | WANG Peng-xiang | Department of Liver Surgery, Liver Cancer Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China | | | ZHOU Kai-qian | Department of Liver Surgery, Liver Cancer Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China | | | SUN Yun-fan | Department of Liver Surgery, Liver Cancer Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China | | | WU Yi-rong | Qingdao Hisense Medical Equipment Co. Ltd, Qingdao 266104, Shandong, China 3. Shanghai Shunjiu Electronic Technology Co. Ltd, Shanghai 201208, China | | | LI Nan-zhe | Qingdao Hisense Medical Equipment Co. Ltd, Qingdao 266104, Shandong, China 3. Shanghai Shunjiu Electronic Technology Co. Ltd, Shanghai 201208, China | | | DUAN Xiao-ming | Qingdao Hisense Medical Equipment Co. Ltd, Qingdao 266104, Shandong, China 3. Shanghai Shunjiu Electronic Technology Co. Ltd, Shanghai 201208, China | | | CHEN Yong-jian | Qingdao Hisense Medical Equipment Co. Ltd, Qingdao 266104, Shandong, China 3. Shanghai Shunjiu Electronic Technology Co. Ltd, Shanghai 201208, China | | | FAN Jia | Department of Liver Surgery, Liver Cancer Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China | | | ZHOU Jian | Department of Liver Surgery, Liver Cancer Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China | | | YANG Xin-rong | Department of Liver Surgery, Liver Cancer Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China | yang.xinrong@zs-hospital.sh.cn |
|
| Abstract:Objective To realize the real-time navigation scheme of augmented reality 3D image in laparoscopic liver surgery, build the prototype of the platform and evaluate its running effect. Methods The 3D image real-time navigation software of laparoscopic liver surgery augmented reality is composed of the automatic algorithm of 3D reconstruction of CT images, the acquisition algorithm of 2D plane projection contour point set of 3D model, the recognition and acquisition algorithm of liver contour point set of laparoscopic surgery visual field based on artificial intelligence, “one to many” matching algorithm, coordinate system conversion algorithm and video real-time rendering enhancement fusion algorithm. Cooperate with the optical positioning system hardware and binocular optical information acquisition hardware to build the prototype of the navigation platform; carry out the platform test run in the laboratory simulation model and large animals, introduce the registration error parameters, evaluate the operation effect and optimize the adjustment. Results The navigation software of laparoscopic liver surgery is basically realized: 3D model reconstruction (CT image automatic segmentation and heterochromatic mask processing), the establishment of operating room observation coordinate system, laparoscopic viewing angle coordinate system and 3D reconstruction model coordinate system and the information conversion among them, real-time registration and navigation between 3D reconstruction model and structure seen in operation video, and prototype construction of navigation platform. The registration error of the trial run in the laboratory simulation model is (4.1±0.4) mm, and the registration error of the two trial runs in large animals is 4.6 mm and 5.8 mm respectively. Conclusions Through the design, development, construction and use of the prototype of the augmented reality 3D image real-time navigation platform for laparoscopic liver surgery, the accuracy of navigation registration has basically met the clinical needs. After further optimization and adjustment in the future, it is expected to be widely used in laparoscopic liver surgery. |
| keywords:laparoscope surgical navigation augmented reality real time registration hepatectomy |
| HTML View Full Text View/Add Comment Download reader |
|
|
|