Abstract:
Objective To realize the real-time navigation scheme of augmented reality 3D image in laparoscopic liver surgery, build the prototype of the platform and evaluate its running effect.
Methods The 3D image real-time navigation software of laparoscopic liver surgery augmented reality is composed of the automatic algorithm of 3D reconstruction of CT images, the acquisition algorithm of 2D plane projection contour point set of 3D model, the recognition and acquisition algorithm of liver contour point set of laparoscopic surgery visual field based on artificial intelligence, "one to many" matching algorithm, coordinate system conversion algorithm and video real-time rendering enhancement fusion algorithm. Cooperate with the optical positioning system hardware and binocular optical information acquisition hardware to build the prototype of the navigation platform; carry out the platform test run in the laboratory simulation model and large animals, introduce the registration error parameters, evaluate the operation effect and optimize the adjustment.
Results The navigation software of laparoscopic liver surgery is basically realized: 3D model reconstruction (CT image automatic segmentation and heterochromatic mask processing), the establishment of operating room observation coordinate system, laparoscopic viewing angle coordinate system and 3D reconstruction model coordinate system and the information conversion among them, real-time registration and navigation between 3D reconstruction model and structure seen in operation video, and prototype construction of navigation platform. The registration error of the trial run in the laboratory simulation model is (4.1±0.4) mm, and the registration error of the two trial runs in large animals is 4.6 mm and 5.8 mm respectively.
Conclusions Through the design, development, construction and use of the prototype of the augmented reality 3D image real-time navigation platform for laparoscopic liver surgery, the accuracy of navigation registration has basically met the clinical needs. After further optimization and adjustment in the future, it is expected to be widely used in laparoscopic liver surgery.