Cited 0 times in
Visual Modalities Based Multimodal Fusion for Surgical Phase Recognition
DC Field | Value | Language |
---|---|---|
dc.contributor.author | 형우진 | - |
dc.contributor.author | 박성현 | - |
dc.date.accessioned | 2023-04-07T01:18:31Z | - |
dc.date.available | 2023-04-07T01:18:31Z | - |
dc.date.issued | 2022-10 | - |
dc.identifier.issn | 0302-9743 | - |
dc.identifier.uri | https://ir.ymlib.yonsei.ac.kr/handle/22282913/193875 | - |
dc.description.abstract | We propose visual modalities-based multimodal fusion for surgical phase recognition to overcome the limitation of the diversity of information such as the presence of tools. Through the proposed methods, we extracted a visual kinematics-based index related to the usage of tools such as movement and the relation between tools in surgery. In addition, we improved recognition performance using the effective fusion method which is fusing CNN-based visual feature and visual kinematics-based index. The visual kinematics-based index is helpful for understanding the surgical procedure as the information related to the interaction between tools. Furthermore, these indices can be extracted in any environment unlike kinematics in robotic surgery. The proposed methodology was applied to two multimodal datasets to verify that it can help to improve recognition performance in clinical environments. | - |
dc.description.statementOfResponsibility | restriction | - |
dc.language | English | - |
dc.publisher | Springer | - |
dc.relation.isPartOf | Lecture Notes in Computer Science | - |
dc.rights | CC BY-NC-ND 2.0 KR | - |
dc.title | Visual Modalities Based Multimodal Fusion for Surgical Phase Recognition | - |
dc.type | Article | - |
dc.contributor.college | College of Medicine (의과대학) | - |
dc.contributor.department | Dept. of Surgery (외과학교실) | - |
dc.contributor.googleauthor | Bogyu Park | - |
dc.contributor.googleauthor | Hyeongyu Chi | - |
dc.contributor.googleauthor | Bokyung Park | - |
dc.contributor.googleauthor | Jiwon Lee | - |
dc.contributor.googleauthor | Sunghyun Park | - |
dc.contributor.googleauthor | Woo Jin Hyung | - |
dc.contributor.googleauthor | Min-Kook Choi | - |
dc.identifier.doi | 10.1007/978-3-031-18814-5_2 | - |
dc.contributor.localId | A04382 | - |
dc.relation.journalcode | J02160 | - |
dc.identifier.url | https://link.springer.com/chapter/10.1007/978-3-031-18814-5_2 | - |
dc.subject.keyword | Surgical workflow | - |
dc.subject.keyword | Surgical phase recognition | - |
dc.subject.keyword | Multimodal learning | - |
dc.subject.keyword | Visual kinematics-based index | - |
dc.contributor.alternativeName | Hyung, Woo Jin | - |
dc.contributor.affiliatedAuthor | 형우진 | - |
dc.citation.volume | 13594 LNCS | - |
dc.citation.startPage | 11 | - |
dc.citation.endPage | 23 | - |
dc.identifier.bibliographicCitation | Lecture Notes in Computer Science, Vol.13594 LNCS : 11-23, 2022-10 | - |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.