| 82 | 0 | 16 |
| Downloads | Citas | Reads |
Image matching is recognized as a core technology in missile scene matching guidance, enabling high-precision positioning and trajectory correction through the association of multimodal features or regional information. To address the engineering requirements of multimodal image matching technology in missile matching guidance system, critical challenges in missile matching guidance are systematically categorized, and key technologies affecting the precision guidance performance of aircraft scene matching are focused. The development status of multimodal image matching technology is summarized from both traditional and intelligent approaches. The traditional methods are classified into two types of classical technology paths, namely region-based and feature-based. And the exploratory applications of neural network-assisted matching methods and end-to-end matching methods in intelligent methods are summarized. Finally, it is envisioned that the theoretical evolution of multimodal image matching technology, and its engineering applications in missile matching guidance are discussed, aiming to provide valuable references for academic research and engineering practice in this field.
[1]滕锡超，叶熠彬，刘学聪.多模态多视角景象匹配及精确制导应用[J].国防科技，2023,44(5):26-34.
[2]胡仕友，赵英海.导弹武器智能精确制导技术发展分析[J].战术导弹技术，2017(2):1-6.
[3]邹汝平，陈士超，陈韵，等.一种图像寻的空地导弹的制导控制方法[J].战术导弹技术，2021(1):93-98+114.
[4]赵春晖，周昳慧，林钊，等.无人机景象匹配视觉导航技术综述[J].中国科学：信息科学，2019,49(5):507-519.
[5]朱柏，叶沅鑫.多模态遥感图像配准方法研究综述[J].中国图象图形学报，2024,29(8):2137-2161.
[6]刘丽君，胡仕友，曹星慧.基于Q-Shift双树复小波的SAR图像相干斑噪声抑制[J].战术导弹技术，2014(4):82-86+110.
[7]Zitova B,Flusser J. Image registration methods:A survey[J]. Image and Vision Computing,2003,21(11):977-1000.
[8]Gao H,Hu C. A new approach of template matching and localization based on the guidance of feature points[C].2018 IEEE International Conference on Information and Automation(ICIA),Wuyishan,China,2018.
[9]Ye Y,Shan J,Bruzzone L,et al. Robust registration of multimodal remote sensing images based on structural similarity[J]. IEEE Transactions on Geoscience and Remote Sensing,2017,55(5):2941-2958.
[10]Ye Y,Shan J,Hao S,et al. A local phase based invariant feature for remote sensing image matching[J]. ISPRS Journal of Photogrammetry and Remote Sensing,2018,142:205-221.
[11]Wells III W M,Viola P,Atsumi H,et al. Multi-modal volume registration by maximization of mutual information[J]. Medical Image Analysis, 1996, 1(1):35-51.
[12]Viola P,Wells III W M. Alignment by maximization of mutual information[J]. International Journal of Computer Vision,1997,24(2):137-154.
[13]Arar M, Ginger Y, Danon D, et al. Unsupervised multi-modal image registration via geometry preserving image-to-image translation[C]. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR),Seattle,WA,USA,2020.
[14]Kim Y S,Lee J H,Ra J B. Multi-sensor image registration based on intensity and edge orientation information[J]. Pattern Recognition, 2008, 41(11):3356-3365.
[15]Ma W,Wu Y,Liu S,et al. Remote sensing image registration based on phase congruency feature detection and spatial constraint matching[J]. IEEE Access,2018,6:77554-77567.
[16]Yol A,Delabarre B,Dame A,et al. Vision-based absolute localization for unmanned aerial vehicles[C].2014 IEEE/RSJ International Conference on Intelligent Robots and Systems,Chicago,IL,USA,2014.
[17]Patel B. Visual localization for UAVs in outdoor GPS-denied environments[D]. Toronto:University of Toronto,2019.
[18]Sotiras A,Davatzikos C,Paragios N. Deformable medical image registration:A survey[J]. IEEE Transactions on Medical Imaging,2013,32(7):1153-1190.
[19]Le Moigne J,Campbell W J,Cromp R F. An automated parallel image registration technique based on the correlation of wavelet features[J]. IEEE Transactions on Geoscience and Remote Sensing,2002,40(8):1849-1864.
[20]Ye Y, Bruzzone L, Shan J, et al. Fast and robust matching for multimodal remote sensing image registration[J]. IEEE Transactions on Geoscience and Remote Sensing,2019,57(11):9059-9070.
[21]韩松来，王钰婕，王星，等.多尺度PCA-HOG遥感异源图像匹配算法[J].国防科技大学学报，2022,44(1):146-155.
[22]Jiang X Y,Ma J Y,Xiao G B,et al. A review of multimodal image matching:Methods and applications[J].Information Fusion,2021,73:22-71.
[23]Ma J, Jiang X, Fan A, et al. Image matching from handcrafted to deep features:A survey[J]. International Journal of Computer Vision,2021,129(1):23-79.
[24]Lindeberg T. Scale invariant feature transform[J]. Scholarpedia,2012,7:10491.
[25]Bay H,Ess A,Tuytelaars T,et al. Speeded-up robust features(SURF)[J]. Computer Vision and Image Understanding,2008,110(3):346-359.
[26]Rublee E,Rabaud V,Konolige K,et al. ORB:An efficient alternative to SIFT or SURF[C]. 2011 International Conference on Computer Vision,Barcelona,Spain,2011.
[27]Li J,Hu Q,Ai M. RIFT:Multi-modal image matching based on radiation-variation insensitive feature transform[J]. IEEE Transactions on Image Processing,2019,29:3296-3310.
[28]Xiang Y M, Wang F, You H J. OS-SIFT:A robust SIFT-like algorithm for high-resolution optical-to-SAR image registration in suburban areas[J]. IEEE Transactions on Geoscience and Remote Sensing, 2018, 56(6):3078-3090.
[29]Tang C,Tian G Y,Chen X,et al. Infrared and visible images registration with adaptable local-global feature integration for rail inspection[J]. Infrared Physics&Technology,2017,87:31-39.
[30]Han J,Pauwels E J,De Zeeuw P. Visible and infrared image registration in man-made environments employing hybrid visual features[J]. Pattern Recognition Letters,2013,34(1):42-51.
[31]Chen Y,Zhang X,Zhang Y,et al. Visible and infrared image registration based on region features and edginess[J]. Machine Vision and Applications, 2018, 29(1):113-123.
[32]Jiang D,Shi Y,Chen X,et al. Fast and robust multimodal image registration using a local derivative pattern[J]. Medical Physics,2017,44(2):497-509.
[33]Wu F,Wang B,Yi X,et al. Visible and infrared image registration based on visual salient features[J]. Journal of Electronic Imaging,2015,24(5):1-11.
[34]Ye Y,Shan J,Bruzzone L,et al. Robust registration of multimodal remote sensing images based on structural similarity[J]. IEEE Transactions on Geoscience and Remote Sensing,2017,55(5):2941-2958.
[35]Shechtman E,Irani M. Matching local self-similarities across images and videos[C]. 2007 IEEE Conference on Computer Vision and Pattern Recognition,Minneapolis,MN,USA,2007.
[36]李晴，赵欣，曲广洲，等.基于加权Hausdorff距离矩阵测度的SAR图像与光学图像匹配研究[J].战术导弹技术，2012(4):89-95.
[37]杨鸿睿，朱启举，曹培贤，等.一种用于景象匹配导航的新型图像配准算法[J].工程科学学报，2025,47(3):496-503.
[38]Huang L,Li Z,Zhang R. SAR and optical images registration using shape context[C]. 2010 IEEE International Geoscience and Remote Sensing Symposium,Honolulu,HI,USA,2010.
[39]Xu C, Sui H, Li H, et al. An automatic optical and SAR image registration method with iterative level set segmentation and SIFT[J]. International Journal of Remote Sensing,2015,36(15):3997-4017.
[40]Xiong B L,Li W C,Zhao L J,et al. Registration for SAR and optical images based on straight line features and mutual information[C]. 2016 IEEE International Geoscience and Remote Sensing Symposium(IGARSS),Beijing,China,2016.
[41]李培，姜刚，马千里，等.结合张量与互信息的混合模型多模态图像配准方法[J].测绘学报，2021,50(7):916-929.
[42]Deng C,Yuan X,Deng L,et al. Detecting matching blunders of multi-source remote sensing images via graph theory[J]. Sensors,2020,20(13):3712.
[43]Luo X B, Tian Y L, Wan X, et al. Deep learning based cross-view image matching for UAV geo-localization[C]. 2022 International Conference on Service Robotics(ICoSR),Chengdu,China,2022.
[44]Cheng X,Zhang L,Zheng Y. Deep similarity learning for multimodal medical images[J]. Computer Methods in Biomechanics and Biomedical Engineering:Imaging&Visualization,2018,6(3):248-252.
[45]Haskins G, Kruecker J, Kruger U, et al. Learning deep similarity metric for 3D MR–TRUS image registration[J]. International Journal of Computer Assisted radiology and Surgery,2019,14:417-425.
[46]Blendowski M, Heinrich M P. Combining MRF-based deformable registration and deep binary 3D-CNN descriptors for large lung motion estimation in COPD patients[J]. International Journal of Computer Assisted Radiology and Surgery,2019,14:43-52.
[47]Yang Z Q, Dan T T, Yang Y. Multi-temporal remote sensing image registration using deep convolutional features[J]. IEEE Access,2018,6:38544-38555.
[48]Ye F M,Su Y F,Xiao H,et al. Remote sensing image registration using convolutional neural network features[J]. IEEE Geoscience and Remote Sensing Letters,2018,15(2):232-236.
[49]Ma W P, Zhang J, Wu Y, et al. A novel two-step registration method for remote sensing images based on deep and local features[J]. IEEE Transactions on Geoscience and Remote Sensing,2019,57(7):4834-4843.
[50]南轲，齐华，叶沅鑫.深度卷积特征表达的多模态遥感影像模板匹配方法[J].测绘学报，2019,48(6):727-736.
[51]Wang T Y,Zheng Z D,Yan C G,et al. Each part matters:Local patterns facilitate cross-view geo-localization[J]. IEEE Transactions on Circuits and Systems for Video Technology,2021,32(2):867-879.
[52]Zhuang J,Dai M,Chen X,et al. A faster and more effective cross-view matching method of UAV and satellite images for UAV geolocalization[J]. Remote Sensing,2021,13(19):3979.
[53]Lin J L,Zheng Z D,Zhong Z,et al. Joint representation learning and keypoint detection for cross-view geolocalization[J]. IEEE Transactions on Image Processing,2022,31:3780-3792.
[54]Dosovitskiy A. An image is worth 16x16 words:Transformers for image recognition at scale[J/OL]. 2020-10-22. https：//arxiv. org/abs/2010. 11929.
[55]Zhu S J,Shah M,Chen C. TransGeo:Transformer is all you need for cross-view image geo-localization[C].2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR),New Orleans,LA,USA,2022.
[56]Jiang W, Trulls E, Hosang J, et al. COTR:Correspondence transformer for matching across images[C].2021 IEEE/CVF International Conference on Computer Vision(ICCV),Montreal,QC,Canada,2021.
[57]Chen H K, Luo Z X, Zhang J H, et al. Learning to match features with seeded graph matching network[C].2021 IEEE/CVF International Conference on Computer Vision(ICCV),Montreal,QC,Canada,2021.
[58]Shi Y,Cai J,Shavit Y,et al. ClusterGNN:Clusterbased coarse-to-fine graph neural network for efficient feature matching[C]. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR),New Orleans,LA,USA,2022.
[59]Sun J M,Shen Z H,Wang Y A,et al. LoFTR:Detector-free local feature matching with transformers[C].2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR), Nashville, TN, USA,2021.
[60]Chen H K, Luo Z X, Zhou L, et al. ASpanFormer:Detector-free image matching with adaptive span transformer[C]. 17th European Conference on Computer Vision(ECCV),Tel Aviv,Israel,2022.
[61]Sarlin P E, DeTone D, Malisiewicz T, et al. SuperGlue:Learning feature matching with graph neural networks[C]. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR),Seattle,WA,USA,2020.
[62]Li Z Y,Zhang H T,Huang Y H. A rotation-invariant optical and SAR image registration algorithm based on deep and Gaussian features[J]. Remote Sensing,2021,13(13):2628.
[63]Johnson J E,Sundaresan S,Daylan T,et al. RotNet:Fast and scalable estimation of stellar rotation periods using convolutional neural networks[J/OL]. 2020-12-02.https：//arxiv. org/abs/2012. 01985.
[64]Pielawski N, Wetzer E，Öfverstedt J, et al. CoMIR:Contrastive multimodal image representation for registration[J]. Advances in Neural Information Processing Systems,2020,33:18433-18444.
[65]Goodfellow I J,Pouget-Abadie J,Mirza M,et al. Generative adversarial nets[J]. Advances in Neural Information Processing Systems,2014,27:2672-2680.
[66]Isola P, Zhu J, Zhou T H, et al. Image-to-image translation with conditional adversarial networks[C].2017 IEEE Conference on Computer Vision and Pattern Recognition(CVPR),Honolulu,HI,USA,2017.
[67]Zhu J,Park T,Isola P,et al. Unpaired image-to-image translation using cycle-consistent adversarial networks[C]. 2017 IEEE International Conference on Computer Vision(ICCV),Venice,Italy,2017.
[68]Tian X,Shao J,Ouyang D,et al. UAV-satellite view synthesis for cross-view geo-localization[J]. IEEE Transactions on Circuits and Systems for Video Technology,2021,32(7):4804-4815.
[69]Ma D C,Li S P,Su J,et al. Visible-to-infrared image translation for matching tasks[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2024,17:18199-18213.
[70]郝帅，吴瑛琦，马旭，等.基于CycleGAN-SIFT的可见光和红外图像匹配[J].光学精密工程，2022,30(5):602-614.
[71]Haskins G,Kruger U,Yan P K. Deep learning in medical image registration:A survey[J]. Machine Vision and Applications,2020,31(1):8.
[72]Zhang J. Inverse-consistent deep networks for unsupervised deformable image registration[J/OL]. 2018-09-10. https：//arxiv. org/abs/1809. 03443.
[73]Yi K M,Trulls E,Lepetit V,et al. Lift:Learned invariant feature transform[C]. 14th European Conference on Computer Vision(ECCV),Amsterdam,Netherlands,2016.
[74]Luo Z X,Shen T W,Zhou L,et al. ContextDesc:Local descriptor augmentation with cross-modality context[C]. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR). Long Beach, CA,USA,2019.
[75]毛远宏，贺占庄，马钟，等.采用类内迁移学习的红外/可见光异源图像匹配[J].西安交通大学学报，2020,54(1):49-55.
[76]Ono Y,Trulls E,Fua P,et al. LF-Net:Learning local features from images[C]. 32nd Conference on Neural Information Processing Systems(NeurIPS 2018),Montréal,Canada,2018.
[77]Moreshet A,Keller Y. Attention-based multimodal image matching[J]. Computer Vision and Image Understanding,2024,241:103949.
[78]Ye Y X,Yang C,Gong G Q,et al. Robust optical and SAR image matching using attention-enhanced structural features[J]. IEEE Transactions on Geoscience and Remote Sensing,2024,62:1-12.
[79]Yao Y X,Zhang Y J,Wan Y,et al. Multi-modal remote sensing image matching considering co-occurrence filter[J]. IEEE Transactions on Image Processing,2022,31:2584-2597.
Basic Information:
DOI：10.16358/j.issn.1009-1300.20240203
China Classification Code:TJ765.3
Citation Information:
[1]Liu Xinyu,Li Shaopeng,Xian Yong ,et al.A review of multimodal image matching technology for missile matching guidance[J].Tactical Missile Technology,2026,No.235(01):142-155.DOI:10.16358/j.issn.1009-1300.20240203.
Fund Information:
国家自然科学基金(62103432)