检索结果-内蒙古大学图书馆

arXiv 2023年

作者： Sun, Hanqing Pang, Yanwei Cao, Jiale Xie, Jin Li, Xuelong Changchun Institute of Optics Fine Mechanics and Physics Chinese Academy of Sciences Changchun China Tianjin Key Laboratory of Brain-Inspired Intelligence Technology School of Electrical and Information Engineering Tianjin University Tianjin China School of Big Data and Software Engineering Chongqing University Chongqing China Northwestern Polytechnical University Xi’an China

Transformers have shown promising progress in various visual object detection tasks, including monocular 2D/3D detection and surround-view 3D detection. More importantly, the attention mechanism in the Transformer model and the 3D information extraction in binocular stereo are both similarity-based. However, directly applying existing Transformer-based detectors to binocular stereo 3D object detection leads to slow convergence and significant precision drops. We argue that a key cause of that defect is that existing Transformers ignore the binocular-stereo-specific image correspondence information. In this paper, we explore the model design of Transformers in binocular 3D object detection, focusing particularly on extracting and encoding task-specific image correspondence information. To achieve this goal, we present TS3D, a Transformer-based Stereo-aware 3D object detector. In the TS3D, a Disparity-Aware Positional Encoding (DAPE) module is proposed to embed the image correspondence information into stereo features. The correspondence is encoded as normalized sub-pixel-level disparity and is used in conjunction with sinusoidal 2D positional encoding to provide the 3D location information of the scene. To enrich multi-scale stereo features, we propose a Stereo Preserving Feature Pyramid Network (SPFPN). The SPFPN is designed to preserve the correspondence information while fusing intra-scale and aggregating cross-scale stereo features. Our proposed TS3D achieves a 41.29% Moderate Car detection average precision on the KITTI test set and takes 88 ms to detect objects from each binocular image pair. It is competitive with advanced counterparts in terms of both precision and inference speed. © 2023, CC BY-NC-SA.

关键词： Encoding (symbols)

来源：评论

学校读者我要写书评

暂无评论

Exploring A CAM - Based Approach for Weakly Supervised Fire Detection Task

Exploring A CAM - Based Approach for Weakly Supervised Fire ...

引用

IEEE International Conference on e-Business engineering (ICEBE)

作者： Lvlong Lai Jian Chen Huichou Huang Qingyao Wu School of Software Engineering South China University of Technology Guangzhou China Key Laboratory of Big Data and Intelligent Robot Ministry of Education City University of Hong Kong Hong Kong China Pazhou Lab Guangzhou China

ISBN: (纸本)9781665444194

Most existing works in fire detection literature use available detectors like Faster RCNN, SSD, YOLO, etc. to localize the fire in images. These approaches work well but require object-level annotation for training, which is created manually and is very expensive. In this paper, we explore the weakly supervised fire detection task (WSFD) in which only the image-level annotation is given. We propose an approach based on class activation map (CAM). The CAM-based approach firstly trains a deep neural network as the classifier for identifying fire and non-fire images. For a fire image in the inference stage, it uses the classifier to create a CAM and then further generates the bounding boxes according to the CAM. To evaluate the effectiveness of our approach, we collect and construct a benchmark dataset named WS-FireNet and conduct comprehensive experiments on it. The experiment results show that in a way the performance of our approach is satisfactory.

关键词： Training Deep learning Annotations IEEE Sections Conferences Neural networks Detectors

来源：评论

学校读者我要写书评

暂无评论

Cooperative Sensing Via Matrix Factorization of the Partially Received Sample Covariance Matrix

Cooperative Sensing Via Matrix Factorization of the Partiall...

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Rui Zhou Wenqiang Pu Licheng Zhao Ming-Yi You Qingjiang Shi Sergios Theodoridis Shenzhen Research Institute of Big Data The Chinese University of Hong Kong Shenzhen China National Key Laboratory of Electromagnetic Space Security Jiaxing China School of Software Engineering Tongji University Shanghai China Department of Electronics Systems Aalborg University Denmark Department of Informatics and Telecommunications National and Kapodistrian University of Athens Greece

A fundamental problem in cognitive radio is spectrum sensing, which detects the presence of the primary users in a licensed spectrum. To boost the detection performance and robustness, the multiantenna detector has been investigated and various related methods have been developed, e.g., the energy detector, the eigenvalue arithmetic-to-geometric mean detector, and the generalized likelihood ratio test detector. Cooperative sensing, which makes use of multiple receivers distributed in different locations, has the advantage of being able to make full use of the distributed antennas and enjoy a high spatial diversity gain. However, the successful employment of cooperative sensing depends on the reliable information exchange among the cooperating receivers over a long range, which may be impractical for real-world scenarios. In this paper, we consider the scenario where each receiving node can only broadcast its received raw data in a short-range communication fashion. We propose a novel cooperative sensing scheme by allowing each node to send to the fusion center only local correlation coefficients, computed within a neighborhood. A detection algorithm, based on matrix factorization of the partially received sample covariance matrix, i.e., with missing entries, is proposed. The performance of our proposed cooperative scheme is verified via numerical experiments.

关键词：

来源：评论

学校读者我要写书评

暂无评论

How Deep is Love in LLMs’ Hearts? Exploring Semantic Size in Human-like Cognition

arXiv

引用

arXiv 2025年

作者： Yao, Yao Yang, Yifei Ma, Xinbei Yang, Dongjie Zhang, Zhuosheng Li, Zuchao Zhao, Hai Department of Computer Science and Engineering Shanghai Jiao Tong University Shanghai China Shanghai Key Laboratory of Trusted Data Circulation and Governance in Web3 Shanghai China Key Laboratory of Shanghai Education Commission for Intelligent Interaction and Cognitive Engineering Shanghai Jiao Tong University Shanghai China School of Electronic Information and Electrical Engineering Shanghai Jiao Tong University Shanghai China National Engineering Research Center for Multimedia Software School of Computer Science Wuhan University Wuhan University Wuhan430072 China

How human cognitive abilities are formed has long captivated researchers. However, a significant challenge lies in developing meaningful methods to measure these complex processes. With the advent of large language models (LLMs), which now rival human capabilities in various domains, we are presented with a unique testbed to investigate human cognition through a new lens. Among the many facets of cognition, one particularly crucial aspect is the concept of semantic size—the perceived magnitude of both abstract and concrete words or concepts. This study seeks to investigate whether LLMs exhibit similar tendencies in understanding semantic size, thereby providing insights into the underlying mechanisms of human cognition. We begin by exploring metaphorical reasoning, comparing how LLMs and humans associate abstract words with concrete objects of varying sizes. Next, we examine LLMs’ internal representations to evaluate their alignment with human cognitive processes. Our findings reveal that multi-modal training is crucial for LLMs to achieve more human-like understanding, suggesting that real-world, multi-modal experiences are similarly vital for human cognitive development. Lastly, we examine whether LLMs are influenced by attention-grabbing headlines with larger semantic sizes in a real-world web shopping scenario. The results show that multi-modal LLMs are more emotionally engaged in decision-making, but this also introduces potential biases, such as the risk of manipulation through clickbait headlines. Ultimately, this study offers a novel perspective on how LLMs interpret and internalize language, from the smallest concrete objects to the most profound abstract concepts like ‘love’. The insights gained not only improve our understanding of LLMs but also provide new avenues for exploring the cognitive abilities that define human intelligence. Our code and dataset is publicly available at https://***/Zoeyyao27/LLM-Semantic-Size-Understanding. © 2025, CC BY.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Dts-Adapstnet: An Adaptive Spatiotemporal Neural Networks for Traffic Prediction with Mulit-Graph Fusion

SSRN

引用

SSRN 2023年

作者： Zhang, Jing Shi, Wenlong Ye, Xiucai Tsai, Peiwei School of Computer Science and Mathematics Fujian Provincial Key Laboratory of Big Data Mining and Applications Fujian University of Technology Fuzhou China Department of Computer Science University of Tsukuba Tsukuba Japan Department of Computer Science and Software Engineering Swinburne University of Technology Hawthorn Australia

Traffic prediction is of vital importance in intelligent transportation systems. It can realize efficient route planning, avoid traffic congestion and reduce travel time, etc. However, it is difficult to make accurate road traffic prediction, due to the complex spatiotemporal dependencies of the traffic network. The construction and learning of spatial dependencies play a pivotal role in road traffic prediction, laying the foundation for accurate traffic prediction. Regrettably, most of the existing methods for capturing spatial dependencies only consider a single spatial relationship, ignoring other potential temporal and spatial correlations in the traffic network. Moreover, the end-to-end training methods are difficult to control the training direction during graph learning. Additionally, the result of traffic forecasting lacks of fusing multiple traffic data information. All of these have adverse effects on road traffic prediction. In other to capture the spatiotemporal dependencies of the traffic network accurately, a novel traffic prediction framework, Adaptive Spatio-Temporal Graph Neural Network based on Multi-graph Fusion (DTS-adapSTNet), is proposed. First of all, in order to better extract the hidden spatial dependencies, a method of fusing multiple factors is designed, which includs the distance relationship, transfer relationship and same-road segment relationship of traffic data, etc. Secondly, an adaptive learning method is proposed, which can control the learning direction of parameters better by the adaptive matrix generation module and traffic prediction module. Thirdly, an improved loss function is designed for training processes and a multi-matrix fusion module is designed to perform weighted fusion of the learned matrices, updating the spatial adjacency matrix continuously, which fuses as much traffic information as possible for more accurate traffic prediction. Finally, based on the experiments by two large real-world datasets, the DTS-adapSTNe

关键词： Travel time

来源：评论

学校读者我要写书评

暂无评论

Distilled Transformers with Locally Enhanced Global Representations for Face Forgery Detection

arXiv

引用

arXiv 2024年

作者： Zhang, Yaning Li, Qiufu Yu, Zitong Shen, Linlin Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Guangdong Shenzhen518060 China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Guangdong Shenzhen518060 China Shenzhen Institute of Artificial Intelligence and Robotics for Society Guangdong Shenzhen518129 China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Guangdong Shenzhen518060 China School of Computing and Information Technology Great Bay University Guangdong Dongguan523000 China

Face forgery detection (FFD) is devoted to detecting the authenticity of face images. Although current CNN-based works achieve outstanding performance in FFD, they are susceptible to capturing local forgery patterns generated by various manipulation methods. Though transformer-based detectors exhibit improvements in modeling global dependencies, they are not good at exploring local forgery artifacts. Hybrid transformer-based networks are designed to capture local and global manipulated traces, but they tend to suffer from the attention collapse issue as the transformer block goes deeper. Besides, soft labels are rarely available. In this paper, we propose a distilled transformer network (DTN) to capture both rich local and global forgery traces and learn general and common representations for different forgery faces. Specifically, we design a mixture of expert (MoE) module to mine various robust forgery embeddings. Moreover, a locally-enhanced vision transformer (LEVT) module is proposed to learn locally-enhanced global representations. We design a lightweight multi-attention scaling (MAS) module to avoid attention collapse, which can be plugged and played in any transformer-based models with only a slight increase in computational costs. In addition, we propose a deepfake self-distillation (DSD) scheme to provide the model with abundant soft label information. Extensive experiments show that the proposed method surpasses the state of the arts on five deepfake datasets. Copyright © 2024, The Authors. All rights reserved.

关键词： Face recognition

来源：评论

学校读者我要写书评

暂无评论

Dual-View Pyramid Pooling in Deep Neural Networks for Improved Medical Image Classification and Confidence Calibration

arXiv

引用

arXiv 2024年

作者： Zhang, Xiaoqing Nie, Qiushi Xiao, Zunjie Zhao, Jilu Wu, Xiao Guo, Pengxin Li, Runzhi Liu, Jin Wei, Yanjie Pan, Yi Center for High Performance Computing Shenzhen Key Laboratory of Intelligent Bioinformatics Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Shenzhen518055 China Department of Computer Science and Engineering Southern University of Science and Technology Shenzhen518055 China Department of Statistics and Actuarial Science The University of Hong Kong 999077 Hong Kong Cooperative Innovation Center of Internet Healthcare Zhengzhou University Zhengzhou450001 China Hunan Provincial Key Lab on Bioinformatics School of Computer Science and Engineering Central South University Changsha410083 China Xinjiang Engineering Research Center of Big Data and Intelligent Software School of software Xinjiang University Wulumuqi830046 China Faculty of Computer Science and Control Engineering Shenzhen University of Advanced Technology Shenzhen China

Spatial pooling (SP) and cross-channel pooling (CCP) operators have been applied to aggregate spatial features and pixel-wise features from feature maps in deep neural networks (DNNs), respectively. Their main goal is to reduce computation and memory overhead without visibly weakening the performance of DNNs. However, SP often faces the problem of losing the subtle feature representations, while CCP has a high possibility of ignoring salient feature representations, which may lead to both miscalibration of confidence issues and suboptimal medical classification results. To address these problems, we propose a novel dual-view framework, the first to systematically investigate the relative roles of SP and CCP by analyzing the difference between spatial features and pixel-wise features. Based on this framework, we propose a new pooling method, termed dual-view pyramid pooling (DVPP), to aggregate multi-scale dual-view features. DVPP aims to boost both medical image classification and confidence calibration performance by fully leveraging the merits of SP and CCP operators from a dual-axis perspective. Additionally, we discuss how to fulfill DVPP with five parameter-free implementations. Extensive experiments on six 2D/3D medical image classification tasks show that our DVPP surpasses state-of-the-art pooling methods in terms of medical image classification results and confidence calibration across different DNNs. © 2024, CC BY.

关键词： Deep neural networks

来源：评论

学校读者我要写书评

暂无评论

MFCLIP: Multi-modal Fine-grained CLIP for Generalizable Diffusion Face Forgery Detection

arXiv

引用

arXiv 2024年

作者： Zhang, Yaning Wang, Tianyi Yu, Zitong Gao, Zan Shen, Linlin Chen, Shengyong Jinan250353 China Nanyang Technological University 50 Nanyang Ave Block N 4 639798 Singapore School of Computing and Information Technology Great Bay University Dongguan523000 China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen518060 China Jinan250014 China The Key Laboratory of Computer Vision and System Ministry of Education Tianjin University of Technology Tianjin300384 China Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen China Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen518129 China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen518060 China

The rapid development of photo-realistic face generation methods has raised significant concerns in society and academia, highlighting the urgent need for robust and generalizable face forgery detection (FFD) techniques. Although existing approaches mainly capture face forgery patterns using image modality, other modalities like fine-grained noises and texts are not fully explored, which limits the generalization capability of the model. In addition, most FFD methods tend to identify facial images generated by GAN, but struggle to detect unseen diffusion-synthesized ones. To address the limitations, we aim to leverage the cutting-edge foundation model, contrastive language-image pre-training (CLIP), to achieve generalizable diffusion face forgery detection (DFFD). In this paper, we propose a novel multi-modal fine-grained CLIP (MFCLIP) model, which mines comprehensive and fine-grained forgery traces across image-noise modalities via language-guided face forgery representation learning, to facilitate the advancement of DFFD. Specifically, we devise a fine-grained language encoder (FLE) that extracts fine global language features from hierarchical text prompts. We design a multi-modal vision encoder (MVE) to capture global image forgery embeddings as well as fine-grained noise forgery patterns extracted from the richest patch, and integrate them to mine general visual forgery traces. Moreover, we build an innovative plug-and-play sample pair attention (SPA) method to emphasize relevant negative pairs and suppress irrelevant ones, allowing cross-modality sample pairs to conduct more flexible alignment. Extensive experiments and visualizations show that our model outperforms the state of the arts on different settings like cross-generator, cross-forgery, and cross-dataset evaluations. Copyright © 2024, The Authors. All rights reserved.

关键词： Alignment

来源：评论

学校读者我要写书评

暂无评论

Model-enhanced vector index 23

Model-enhanced vector index

引用

Proceedings of the 37th International Conference on Neural Information Processing Systems

作者： Hailin Zhang Yujing Wang Qi Chen Ruiheng Chang Ting Zhang Ziming Miao Yingyan Hou Yang Ding Xupeng Miao Haonan Wang Bochen Pang Yuefeng Zhan Hao Sun Weiwei Deng Qi Zhang Fan Yang Xing Xie Mao Yang Bin Cui School of Computer Science & Key Lab of High Confidence Software Technologies Peking University and Microsoft Microsoft Microsoft and Aerospace Information Research Institute & Key Laboratory of Target Cognition and Application Technology Chinese Academy of Sciences Microsoft and Institute of Information Engineering Chinese Academy of Sciences Carnegie Mellon University National University of Singapore School of Computer Science & Key Lab of High Confidence Software Technologies Peking University and National Engineering Laboratory for Big Data Analysis and Applications Peking University

Embedding-based retrieval methods construct vector indices to search for document representations that are most similar to the query representations. They are widely used in document retrieval due to low latency and decent recall performance. Recent research indicates that deep retrieval solutions offer better model quality, but are hindered by unacceptable serving latency and the inability to support document updates. In this paper, we aim to enhance the vector index with end-to-end deep generative models, leveraging the differentiable advantages of deep retrieval models while maintaining desirable serving efficiency. We propose Model-enhanced Vector Index (MEVI), a differentiable model-enhanced index empowered by a twin-tower representation model. MEVI leverages a Residual Quantization (RQ) codebook to bridge the sequence-to-sequence deep retrieval and embedding-based models. To substantially reduce the inference time, instead of decoding the unique document ids in long sequential steps, we first generate some semantic virtual cluster ids of candidate documents in a small number of steps, and then leverage the well-adapted embedding vectors to further perform a fine-grained search for the relevant documents in the candidate virtual clusters. We empirically show that our model achieves better performance on the commonly used academic benchmarks MSMARCO Passage and Natural Questions, with comparable serving latency to dense retrieval solutions.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Study on an Adaptive Clamping Device for Passive Safety Delivery of Vascular Intervention robot

Study on an Adaptive Clamping Device for Passive Safety Deli...

引用

IEEE International Conference on Mechatronics and Automation

作者： Sheng Cao Shuxiang Guo Jian Guo Jian Wang Chunying Li Huiyin Xu Bin Wang Mingchao Ding Aerospace Center Hospital & the Key Laboratory of Convergence Medical Engineering System and Healthcare Technology School of Life Science & Ministry of Industry and Information Technology Beijing Institute of Technology Beijing China Shenzhen Institute of Advanced Biomedical Robot Company Limited Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China National Engineering Laboratory of Computer Technology for Big Data Systems Shenzhen University Shenzhen China

ISBN: (数字)9798350388077

ISBN: (纸本)9798350388084

In practical clinical applications, vascular intervention surgical robots have developed sophisticated human-machine interaction systems, enabling assistance to physicians in performing remote surgeries and providing intelligent visual feedback. However, regarding surgical safety, current research predominantly focuses on force feedback and robot control logic, with clamping mechanisms targeting the locking of catheters and guide wires. Excessive clamping force may lead to surface damage to intervention instruments, while insufficient force delivery may result from slippery surfaces. Therefore, addressing these issues, this study proposed a passive, compliant safety strategy for an adaptive clamping device based on a vascular intervention surgical robot platform. This device can accommodate different diameter catheters and maintain a constant delivery force during the intervention process. Finally, through experimentation, the effectiveness, safety, and stability of the device were demonstrated.

关键词： Visualization Medical robotics Force Wires robot control Surgery Safety

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：