0 88

Cited 0 times in

Surgical Scene Segmentation Using Semantic Image Synthesis with a Virtual Surgery Environment

 Jihun Yoon  ;  SeulGi Hong  ;  Seungbum Hong  ;  Jiwon Lee  ;  Soyeon Shin  ;  Bokyung Park  ;  Nakjun Sung  ;  Hayeong Yu  ;  Sungjae Kim  ;  SungHyun Park  ;  Woo Jin Hyung  ;  Min-Kook Choi 
 Lecture Notes in Computer Science, Vol.13437 LNCS : 551-561, 2022-09 
Journal Title
Lecture Notes in Computer Science
Issue Date
Surgical instrument localization ; Class imbalance ; Domain randomization ; Synthetic data ; Semantic image snythesis
The previous image synthesis research for surgical vision had limited results for real-world applications with simple simulators, including only a few organs and surgical tools and outdated segmentation models to evaluate the quality of the image. Furthermore, none of the research released complete datasets to the public enabling the open research. Therefore, we release a new dataset to encourage further study and provide novel methods with extensive experiments for surgical scene segmentation using semantic image synthesis with a more complex virtual surgery environment. First, we created three cross-validation sets of real image data considering demographic and clinical information from 40 cases of real surgical videos of gastrectomy with the da Vinci Surgical System (dVSS). Second, we created a virtual surgery environment in the Unity engine with five organs from real patient CT data and 22 the da Vinci surgical instruments from actual measurements. Third, We converted this environment photo-realistically with representative semantic image synthesis models, SEAN and SPADE. Lastly, we evaluated it with various state-of-the-art instance and semantic segmentation models. We succeeded in highly improving our segmentation models with the help of synthetic training data. More methods, statistics, and visualizations on https://sisvse.github.io/.
Full Text
Appears in Collections:
1. College of Medicine (의과대학) > Dept. of Surgery (외과학교실) > 1. Journal Papers
Yonsei Authors
Hyung, Woo Jin(형우진) ORCID logo https://orcid.org/0000-0002-8593-9214
사서에게 알리기


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.