Swin Transformer based Siamese Network for Thermal and Optical Image Registration
作者：
Elsaeidy, Mohamed;Yagmur, Ismail Can;Ates, Hasan Fehmi;Gunturk, Bahadir Kursat
通讯作者：
Elsaeidy, M
作者机构：
Istanbul Medipol Univ, Dept Comp Engn, Istanbul, Turkiye.
Ozyegin Univ, Dept Comp Sci, Istanbul, Turkiye.
通讯机构：
Istanbul Medipol Univ, Dept Comp Engn, Istanbul, Turkiye.
语种：
英文
关键词：
Multi-modal image registration,Transformer network,Keypoint
期刊：
2023 31ST SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU
ISSN：
2165-0608
年：
2023
会议名称：
31st IEEE Conference on Signal Processing and Communications Applications (SIU)
会议时间：
JUL 05-08, 2023
会议地点：
Istanbul Tech Univ, Ayazaga Campus, Istanbul, TURKEY
摘要：
The process of multi-modal image registration is fundamental in remote sensing and visual navigation applications. However, existing image registration methods that are designed for single modality images do not provide satisfactory results when applied to multi-modal image registration. In this research, our objective is to achieve highly accurate alignment of both infrared and optical (visible range) images. To accomplish this goal, we explore the effectiveness of the Swin Transformer encoder and cosine loss in enhancing the keypoint-based image registration process. Simulation results show the improvement achieved in multi-modal registration by using a transformer base...
