检索结果-内蒙古大学图书馆

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Haijian Liang Weicheng Xie Xilin He Siyang Song Linlin Shen School of Computer Science & Software Engineering Computer Vision Institue Shenzhen University Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University School of Computing and Mathematical Sciences University of Leicester National Engineering Laboratory for Big Data System Computing Technology Shenzhen University

Multimodal Sentiment Analysis is a burgeoning research area, leveraging various modalities to predict the sentiment score. Nevertheless, previous studies have disregarded the impact of noise interference on specific modal sentiments during video recording, thereby compromising the accuracy of sentiment prediction. In this paper, we propose the Guided Circular Decomposition and Cross-Modal Recombination (GCD-CMR) model, which aims to eliminate contaminated sentiment features in a fine-grained way. To achieve this, we utilize tailored global information specific to each modality to guide the circular decomposing process in the GCD module, to produce a set of sentiment prototypes. Subsequently, in the CMR module, we align cross-modal sentiment prototypes and remove the contaminated prototypes for recombination. Experimental results on two publicly available datasets demonstrate that our model surpasses state-of-the-art models, confirming the effectiveness of our proposed method. We release the code at: https://***/nianhua20/GCD-CMR.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Learning a Coordinated Network for Detail-Refinement Multiexposure Image Fusion

引用

IEEE Transactions on Circuits and Systems for Video Technology 2023年第2期33卷 713-727页

作者： Li, Jiawei Liu, Jinyuan Zhou, Shihua Zhang, Qiang Kasabov, Nikola K. Ministry of Education School of Software Engineering Dalian University Key Laboratory of Advanced Design and Intelligent Computing Dalian116622 China Dalian University of Technology School of Software Technology Dalian116024 China Auckland University of Technology Knowledge Engineering and Discovery Research Institute Auckland1010 New Zealand Ulster University Intelligent Systems Research Center LondonderryBT52 1SA United Kingdom

Nowadays, deep learning has made rapid progress in the field of multi-exposure image fusion. However, it is still challenging to extract available features while retaining texture details and color. To address this difficult issue, in this paper, we propose a coordinated learning network for detail-refinement in an end-to-end manner. Firstly, we obtain shallow feature maps from extreme over/under-exposed source images by a collaborative extraction module. Secondly, smooth attention weight maps are generated under the guidance of a self-attention module, which can draw a global connection to correlate patches in different locations. With the cooperation of the two aforementioned used modules, our proposed network can obtain a coarse fused image. Moreover, by assisting with an edge revision module, edge details of fused results are refined and noise is suppressed effectively. We conduct subjective qualitative and objective quantitative comparisons between the proposed method and twelve state-of-the-art methods on two available public datasets, respectively. The results show that our fused images significantly outperform others in visual effects and evaluation metrics. In addition, we also perform ablation experiments to verify the function and effectiveness of each module in our proposed method. The source code can be achieved at https://***/lok-18/LCNDR. © 1991-2012 IEEE.

关键词： Extraction

来源：评论

学校读者我要写书评

暂无评论

High-performance optimization of SM4-GCM based on FPGA

High-performance optimization of SM4-GCM based on FPGA

引用

2021 International Conference on advanced computing and Endogenous Security, ICACES 2021

作者： Lv, Shun Sen Li, Bin Chen, Xiaojie Zhou, Qinglei School of Information Engineering Zhengzhou University Zhengzhou China State Key Laboratory of Mathmatical Engineering and Advanced Computing Zhengzhou China

ISBN: (纸本)9781665424493

SM4-GCM is an encryption algorithm with authentication function. The algorithm achieves the purpose of data security and information integrity. The SM4-GCM algorithm, implemented using traditional software methods, has low throughput and high resource consumption. In order to further improve the algorithm performance, this paper uses FPGA to optimize the SM4-GCM algorithm to achieve full-pipeline parallel acceleration. Firstly, the SM4 module is optimized using pipelining techniques. Then, the GHASH module is optimized using the Karatsuba algorithm and fast reduction. Finally, a loosely coupled architecture is used to connect various modules with asynchronous FIFOs, which improves the resource utilization and throughput of the FPGA circuit. The experimental results show that the throughput of the optimized SM4-GCM algorithm reaches 28.8 Gbps. It is better than other schemes, has a higher throughput, and meets the actual application requirements. © 2022 IEEE.

关键词： Pipelines

来源：评论

学校读者我要写书评

暂无评论

Siamese Learning with Joint Alignment and Regression for Weakly-Supervised Video Paragraph Grounding

arXiv

引用

arXiv 2024年

作者： Tan, Chaolei Lai, Jianhuang Zheng, Wei-Shi Hu, Jian-Fang School of Computer Science and Engineering Sun Yat-sen University China Guangdong Province Key Laboratory of Information Security Technology China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education China

Video Paragraph Grounding (VPG) is an emerging task in video-language understanding, which aims at localizing multiple sentences with semantic relations and temporal order from an untrimmed video. However, existing VPG approaches are heavily reliant on a considerable number of temporal labels that are laborious and time-consuming to acquire. In this work, we introduce and explore Weakly-Supervised Video Paragraph Grounding (WSVPG) to eliminate the need of temporal annotations. Different from previous weakly-supervised grounding frameworks based on multiple instance learning or reconstruction learning for two-stage candidate ranking, we propose a novel siamese learning framework that jointly learns the cross-modal feature alignment and temporal coordinate regression without timestamp labels to achieve concise one-stage localization for WSVPG. Specifically, we devise a Siamese Grounding TRansformer (SiamGTR) consisting of two weight-sharing branches for learning complementary supervision. An Augmentation Branch is utilized for directly regressing the temporal boundaries of a complete paragraph within a pseudo video, and an Inference Branch is designed to capture the order-guided feature correspondence for localizing multiple sentences in a normal video. We demonstrate by extensive experiments that our paradigm has superior practicability and flexibility to achieve efficient weakly-supervised or semi-supervised learning, outperforming state-of-the-art methods trained with the same or stronger supervision. © 2024, CC BY.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Shields for Digital Images: A Watermarking Method with KAN Block and Simulation-Enhanced Noise Pool to Resist Screen-Camera Attacks

引用

IEEE Transactions on Circuits and Systems for Video Technology 2025年

作者： Guo, Daidou Qin, Chuan Luo, Xiangyang Feng, Guorui Zhang, Xinpeng University of Shanghai for Science and Technology School of Optical-Electrical and Computer Engineering Shanghai200093 China State Key Laboratory of Mathematical Engineering and Advanced Computing Zhengzhou450000 China Henan Key Laboratory of Cyberspace Situation Awareness Zhengzhou450001 China Shanghai University School of Communication and Information Engineering Shanghai200444 China

To address the issues of privacy leakage and copyright infringement in screen-camera scenarios, we propose a robust image watermarking method, which incorporates kolmogorov-arnold network (KAN) blocks and a simulation-enhanced noise pool to resist screen-camera noise attacks. Specifically, we first modify the traditional convolutional blocks for processing high-dimensional features in the U-Net-based encoder to KAN blocks. This operation enhances the ability of encoder to model nonlinear relationships between complex features, while preserving global structure of the original image and minimizing the damage to local details caused by watermark embedding, thereby improving visual quality of the watermarked image. Additionally, to enhance the robustness of the proposed method against complex screen-camera noise attacks, a simulation-enhanced noise pool containing mathematical models and a deep noise simulation network, called NSim-Net, is designed. Especially, in NSim-Net, adversarial training between the simulator based on the improved U-Net and the discriminator based on PatchGAN effectively improves the ability to simulate complex noise. Experimental results demonstrate that, compared to typical screen-camera resilient watermarking methods, the watermarked image generated by the proposed method achieves a maximum peak signal-to-noise ratio (PSNR) improvement of 4.78 dB. Furthermore, based on our simulation-enhanced noise pool, the watermark extraction accuracy of the proposed method exceeds 98% under various screen-camera noise attacks. © 1991-2012 IEEE.

关键词： Image enhancement

来源：评论

学校读者我要写书评

暂无评论

Expert with Outlier Exposure for Continual Learning of New Diseases

Expert with Outlier Exposure for Continual Learning of New D...

引用

2022 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2022

作者： Xu, Zhengjing Chen, Kanghao Zheng, Wei-Shi Tan, Zhijun Yang, Xiaobo Wang, Ruixuan Sun Yat-sen University School of Computer Science and Engineering Guangzhou China Key Laboratory of Machine Intelligence and Advanced Computing MOE China State Key Laboratory of Dampness Syndrome of Chinese Medicine Guangzhou China Peng Cheng Laboratory Department of Network Intelligence Shenzhen China

ISBN: (纸本)9781665468190

Current intelligent diagnosis systems struggle to continually learn to diagnose more and more diseases due to catastrophic forgetting of old knowledge when learning new knowledge. Although storing small old data for subsequent continual learning can effectively help alleviate the forgetting issue, the heavy data imbalance between old classes and to-be-learned new classes in classifier training often causes biased prediction towards the new classes just learned by the updated classifier. In this study, an outlier detection technique is novelly applied to train an additional expert classifier for new classes to help alleviate the class imbalance issue and discriminate the learned new classes from old classes during inference (instead of the training phase). Specially, the stored small data of old classes are considered as outliers during training the expert classifier, such that the output probability distributions from the expert classifier are expected to be obviously different between test data of the old classes and those of the new classes. Such difference between old classes and new classes can be used to fine-tune the original output from the updated classifier which is responsible for prediction of all learned (old and new) classes. During inference, a novel ensemble strategy is proposed to combine the predictions from the updated classifier, the expert classifier, and the previously learned old classifier. The proposed learning and inference framework can be easily combined with existing continual learning strategies. Empirical evaluations on three medical image datasets and one natural image dataset show that the proposed framework can effectively improve continual learning performance. © 2022 IEEE.

关键词： Forecasting

来源：评论

学校读者我要写书评

暂无评论

Salient Foreground-Aware Network for Person Search 16th

Salient Foreground-Aware Network for Person Search

引用

16th Chinese Conference on Biometric Recognition, CCBR 2022

作者： Chen, Hongxu Zhang, Quan Lai, Jianhuang The School of Computer Science and Engineering Sun Yat-Sen University Guangzhou510006 China The Guangdong Key Laboratory of Information Security Technology Guangzhou510006 China The Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education China Guangzhou510006 China

ISBN: (纸本)9783031202322

Person search aims to simultaneously localize and identify a query person from realistic and uncropped images, which consists of person detection and re-identification. In existing methods, the extracted features come from the low-quality proposals generated by the structure like Region Proposal Network (RPN), and convolution is used to learn local features in the process of extracting features while the receptive field cannot grasp the global structural information. We propose an end-to-end network embedded with our Salient Foreground-Aware Module (SFAM). Self-attention mechanism in SFAM allows for better capture of global information. Our network incorporates our embedding method for person detection and person re-identification, which can effectively optimize the process of extracting features and improve feature expression capabilities. We merge the above modules into our Salient Foreground-Aware Network (SFAN). Extensive experiments have shown that our SFAN significantly improves the performance of end-to-end models with acceptable time-consuming and achieves state-of-the-art results. © 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Embeddings

来源：评论

学校读者我要写书评

暂无评论

A Novel Feature Selection Strategy Based on Salp Swarm Algorithm for Plant Disease Detection

引用

Plant Phenomics 2023年第2期5卷 209-225页

作者： Xiaojun Xie Fei Xia Yufeng Wu Shouyang Liu Ke Yan Huanliang Xu Zhiwei Ji College of Artificial Intelligence Nanjing Agricultural UniversityNanjingJiangsu 210095China Center for Data Science and Intelligent Computing Nanjing Agricultural UniversityNanjingJiangsu 210095China State Key Laboratory for Crop Genetics and Germplasm Enhancement Bioinformatics CenterAcademy for Advanced Interdisciplinary StudiesNanjing Agricultural UniversityNanjingJiangsu 210095China Academy for Advanced Interdisciplinary Studies Nanjing Agricultural UniversityNanjingJiangsu 210095China Department of the Built Environment College of Design and EngineeringNational University of Singapore4 Architecture DriveSingapore 117566Singapore

Deep learning has been widely used for plant disease recognition in smart agriculture and has proven to be a powerful tool for image classification and pattern ***,it has limited interpretability for deep *** the transfer of expert knowledge,handcrafted features provide a new way for personalized diagnosis of plant ***,irrelevant and redundant features lead to high *** this study,we proposed a swarm intelligence algorithm for feature selection[salp swarm algorithm for feature selection(SSAFS)]in image-based plant disease *** is employed to determine the ideal combination of handcrafted features to maximize classification success while minimizing the number of *** verify the effectiveness of the developed SSAFS algorithm,we conducted experimental studies using SSAFS and 5 metaheuristic *** evaluation metrics were used to evaluate and analyze the performance of these methods on 4 datasets from the UCI machine learning repository and 6 plant phenomics datasets from *** results and statistical analyses validated the outstanding performance of SSAFS compared to existing state-of-the-art algorithms,confirming the superiority of SSAFS in exploring the feature space and identifying the most valuable features for diseased plant image *** computational tool will allow us to explore an optimal combination of handcrafted features to improve plant disease recognition accuracy and processing time.

关键词： Plant image redundant

来源：评论

学校读者我要写书评

暂无评论

Ultradurable,freeze-resistant,and healable MXene-based ionic gels for multi-functional electronic skin

引用

Nano Research 2022年第5期15卷 4421-4430页

作者： Yao Lu Xinyu Qu Siying Wang Ye Zhao Yanfang Ren Wenli Zhao Qian Wang Chencheng Sun Wenjun Wang Xiaochen Dong Key Laboratory of Flexible Electronics(KLOFE)&Institute of Advanced Materials(IAM) School of Physical and Mathematical SciencesNanjing Tech University(NanjingTech)30 South Puzhu RoadNanjing 211816China School of Physical Science and Information Technology Liaocheng UniversityLiaocheng 252059China School of Electronic and Information Engineering Changshu Institute of TechnologyChangshu 215500China

Hydrogel is a potential matrix material of electronic-skins(E-skins)because of its excellent ductility,tunability,and ***,hydrogel-based E-Skins will inevitably lose their sensing performance in practical applications for water loss,physical damage,and ambient *** remains a challenge to manufacture highly durable gel-based ***,an E-Skin is fabricated by introducing ionic liquids(ILs)into MXene-composited binary polymer *** obtained ionic gel shows excellent mechanical properties,strong adhesion,and superior tolerance to harsh *** E-skin exhibits high sensitivity to both strain and pressure in a wide range of deformations,which enables a monitoring function for various human motions and physiological ***,the E-skin shows consistent electrical response after being stored in the open air for 30 days and can be quickly healed by irradiation with 808 nm near-infrared light,originating from the photo-thermal effect induced self-healing *** is noteworthy that the E-skin also reveals a highly sensitive perception of temperature and near-infrared light,displaying the promising potential applications in the multifunctional flexible sensor.

关键词： E-skins MXene environment resistance photothermal effect flexible sensor

来源：评论

学校读者我要写书评

暂无评论

GLCF: A Global-Local Multimodal Coherence Analysis Framework for Talking Face Generation Detection

arXiv

引用

arXiv 2024年

作者： Chen, Xiaocan Yin, Qilin Liu, Jiarui Lu, Wei Luo, Xiangyang Zhou, Jiantao School of Computer Science and Engineering MoE Key Laboratory of Information Technology Guangdong Province Key Laboratory of Information Security Technology Sun Yat-sen University Guangzhou510006 China Alibaba Group Hangzhou China State Key Laboratory of Mathematical Engineering and Advanced Computing Zhengzhou450002 China State Key Laboratory of Internet of Things for Smart City Department of Computer and Information Science Faculty of Science and Technology University of Macau 999078 China

Talking face generation (TFG) allows for producing lifelike talking videos of any character using only facial images and accompanying text. Abuse of this technology could pose significant risks to society, creating the urgent need for research into corresponding detection methods. However, research in this field has been hindered by the lack of public datasets. In this paper, we construct the first large-scale multi-scenario talking face dataset (MSTF), which contains 22 audio and video forgery techniques, filling the gap of datasets in this field. The dataset covers 11 generation scenarios and more than 20 semantic scenarios, closer to the practical application scenario of TFG. Besides, we also propose a TFG detection framework, which leverages the analysis of both global and local coherence in the multimodal content of TFG videos. Therefore, a region-focused smoothness detection module (RSFDM) and a discrepancy capture-time frame aggregation module (DCTAM) are introduced to evaluate the global temporal coherence of TFG videos, aggregating multi-grained spatial information. Additionally, a visual-audio fusion module (V-AFM) is designed to evaluate audiovisual coherence within a localized temporal perspective. Comprehensive experiments demonstrate the reasonableness and challenges of our datasets, while also indicating the superiority of our proposed method compared to the state-of-the-art deepfake detection approaches. © 2024, CC BY-NC-ND.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：