FmCFA: a feature matching method for critical feature attention in multimodal images
FmCFA: a feature matching method for critical feature attention in multimodal images
About this item
Full title
Author / Creator
Liao, Yun , Wu, Xuning , Liu, Junhui , Liu, Peiyu , Pan, Zhixuan and Duan, Qing
Publisher
London: Nature Publishing Group UK
Journal title
Language
English
Formats
Publication information
Publisher
London: Nature Publishing Group UK
Subjects
More information
Scope and Contents
Contents
Multimodal image feature matching is a critical technique in computer vision. However, many current methods rely on extensive attention interactions, which can lead to the inclusion of irrelevant information from non-critical regions, introducing noise and consuming unnecessary computational resources. In contrast, focusing attention on the most relevant regions (information-rich areas) can significantly improve the subsequent matching phase. To address this, we propose a feature matching method called FmCFA, which emphasizes critical feature attention interactions for multimodal images. We introduce a novel Critical Feature Attention (CFA) mechanism that prioritizes attention interactions on the key regions of the multimodal images. This strategy enhances focus on important features while minimizing attention to non-essential ones, thereby improving matching efficiency and accuracy, and reducing computational cost. Additionally, we introduce the CFa-block, built upon CF-Attention, to facilitate coarse matching. The CFa-block strengthens the information exchange between key features across different modalities. Extensive experiments demonstrate that FmCFA achieves exceptional performance across multiple multimodal image datasets. The code is publicly available at:
https://github.com/LiaoYun0x0/FmCFA
....
Alternative Titles
Full title
FmCFA: a feature matching method for critical feature attention in multimodal images
Authors, Artists and Contributors
Author / Creator
Identifiers
Primary Identifiers
Record Identifier
TN_cdi_doaj_primary_oai_doaj_org_article_5b19abcaaa9247ee84f0aab6e8c7e309
Permalink
https://devfeature-collection.sl.nsw.gov.au/record/TN_cdi_doaj_primary_oai_doaj_org_article_5b19abcaaa9247ee84f0aab6e8c7e309
Other Identifiers
ISSN
2045-2322
E-ISSN
2045-2322
DOI
10.1038/s41598-025-90955-8