作者：
Lisi WeiLibo ZhaoXiaoli ZhangCollege of Computer Science and Technology
Jilin University China College of Artificial Intelligence and Big Data Hulunbuir University China and Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University China College of Computer Science and Technology
Jilin University China and Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University China
Due to the limitations of imaging sensors, obtaining a medical image that simultaneously captures both functional metabolic data and structural tissue details remains a significant challenge in clinical diagnosis. To ...
详细信息
Due to the limitations of imaging sensors, obtaining a medical image that simultaneously captures both functional metabolic data and structural tissue details remains a significant challenge in clinical diagnosis. To address this, Multimodal Medical Image Fusion (MMIF) has emerged as an effective technique for integrating complementary information from multimodal source images, such as CT, PET, and SPECT, which is critical for providing a comprehensive understanding of both anatomical and functional aspects of the human body. One of the key challenges in MMIF is how to exchange and aggregate this multimodal information. This paper rethinks MMIF by addressing the harmony of modality gaps and proposes a novel Modality-Aware Interaction Network (MAINet), which leverages cross-modal feature interaction and progressively fuses multiple features in graph space. Specifically, we introduce two key modules: the Cascade Modality Interaction (CMI) module and the Dual-Graph Learning (DGL) module. The CMI module, integrated within a multi-scale encoder with triple branches, facilitates complementary multimodal feature learning and provides beneficial feedback to enhance discriminative feature learning across modalities. In the decoding process, the DGL module aggregates hierarchical features in two distinct graph spaces, enabling global feature interactions. Moreover, the DGL module incorporates a bottom-up guidance mechanism, where deeper semantic features guide the learning of shallower detail features, thus improving the fusion process by enhancing both scale diversity and modality awareness for visual fidelity results. Experimental results on medical image datasets demonstrate the superiority of the proposed method over existing fusion approaches in both subjective and objective evaluations. We also validated the performance of the proposed method in applications such as infrared-visible image fusion and medical image segmentation.
Smart agriculture which integrates the agriculture with Internet of Things (IoT) has attracted attention since it contributes to increase the productivity and quality of crops, reduce energy consumption and facilitate...
详细信息
Smart agriculture which integrates the agriculture with Internet of Things (IoT) has attracted attention since it contributes to increase the productivity and quality of crops, reduce energy consumption and facilitate the farmers. Wireless sensor networks (WSNs) and unmanned aerial vehicles (UAVs) are two most commonly deployed devices that are used for enabling the smart agriculture. In this paper, we design a collaborative WSN-UAV system, wherein different clusters of sensor nodes form different sensor-based virtual antenna arrays (SVAAs) to transmit the collected data towards different receiver UAVs via adopting collaborative beamforming (CB), then the receiver UAVs will take the collected data back to the ground control station (GCS). We formulate a transmission rate and battery energy bi-objective optimization problem (TRBEBOP) to simultaneously maximize the total transmission rate of the sensor-based CB clusters and the total remaining battery energy of the selected sensor nodes, by selecting appropriate sensor nodes in each cluster that can form a predominant SVAA, determining suitable receiver UAVs and optimizing the excitation current weights of the selected sensor nodes. To handle the formulated TRBEBOP that is demonstrated to be non-convex and NP-hard, an enhanced non-dominated sorting genetic algorithm II (ENSGA-II) with several specific designs is presented. Simulation results validate the effectiveness of the proposed ENSGA-II for solving the formulated TRBEBOP. Moreover, compared with other benchmark algorithms, the superiority of the proposed ENSGA-II is demonstrated. In addition, the impacts of several fortuitous circumstances on the system are estimated, and the results illustrate the robustness of the proposed scheme. Finally, the discussion about several mechanisms to deal with the interference induced by the sidelobe levels and the impact of UAV movement on receiving rate are provided.
暂无评论