检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Tian, Weiwei Huang, Xinyu Hou, Junlin Ren, Caiyue Jiang, Longquan Zhao, Rui-Wei Jin, Gang Zhang, Yuejie Geng, Daoying Academy for Engineering and Technology Fudan University Shanghai200433 China School of Computer Science Shanghai Key Laboratory of Intelligent Information Processing Fudan University Shanghai200433 China Shanghai Collaborative Innovation Center of Intelligent Visual Computing China Shanghai200433 China Department of Computer Science and Engineering The Hong Kong University of Science and Technology China

Owing to a large amount of multi-modal data in modern medical systems, such as medical images and reports, Medical Vision-Language Pre-training (Med-VLP) has demonstrated incredible achievements in coarse-grained downstream tasks (i.e., medical classification, retrieval, and visual question answering). However, the problem of transferring knowledge learned from Med-VLP to fine-grained multi-organ segmentation tasks has barely been investigated. Multi-organ segmentation is challenging mainly due to the lack of large-scale fully annotated datasets and the wide variation in the shape and size of the same organ between individuals with different diseases. In this paper, we propose a novel pre-training & fine-tuning framework for Multi-Organ Segmentation by harnessing Medical repOrt Supervision (MOSMOS). Specifically, we first introduce global contrastive learning to maximally align the medical image-report pairs in the pre-training stage. To remedy the granularity discrepancy, we further leverage multi-label recognition to implicitly learn the semantic correspondence between image pixels and organ tags. More importantly, our pre-trained models can be transferred to any segmentation model by introducing the pixel-tag attention maps. Different network settings, i.e., 2D U-Net and 3D UNETR, are utilized to validate the generalization. We have extensively evaluated our approach using different diseases and modalities on BTCV, AMOS, MMWHS, and BRATS datasets. Experimental results in various settings demonstrate the effectiveness of our framework. This framework can serve as the foundation to facilitate future research on automatic annotation tasks under the supervision of medical reports. Copyright © 2024, The Authors. All rights reserved.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Interpretable multi-view attention network for drug-drug interaction prediction

Interpretable multi-view attention network for drug-drug int...

引用

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Xuan Lin Qi Wen Sijie Yang Zu-Guo Yu Yahui Long Xiangxiang Zeng College of Computer Science Xiangtan University China Key Laboratory of Intelligent Computing and Information Processing of Ministry of Education Xiangtan University China Singapore Immunology Network (SIgN) Agency for Science Technology and Research(A*STAR) Singapore College of Information Science and Engineering Hunan University China

Drug-drug interaction (DDI) plays an increasingly crucial role in drug discovery. Predicting potential DDI is also essential for clinical research. Given the high cost and risk of wet-lab experiments, in-silico DDI prediction is an alternative choice. Recently, deep learning methods have been developed for DDI prediction. However, most of existing methods focus on feature extraction from either molecular SMILES sequences or drug interactive networks, ignoring the valuable complementary information that can be derived from these two views. In this paper, we propose a novel interpretable Multi-View Attention network (MVA-DDI) for DDI prediction. MVA-DDI can effectively extracts drug representations from different perspectives to improve DDI prediction. Specifically, for a given drug, we design a transformer-based encoder and a graph convolutional networkbased encoder to learn sequence and graph representations from SMILES sequence and molecular graph, respectively. To fully exploit the complementary information between the sequence and molecular views, an attention mechanism is further adopted to adaptively aggregate the sequence and graph representations by taking the importance of different views into accounts, generating the final drug representations. Comparison experiments demonstrated that our MVA-DDI 1 model achieved superior performance to state-of-the-art models on DDI prediction.

关键词：

来源：评论

学校读者我要写书评

暂无评论

A Comprehensive Survey of 3D Dense Captioning: Localizing and Describing Objects in 3D Scenes

arXiv

引用

arXiv 2024年

作者： Yu, Ting Lin, Xiaojun Wang, Shuhui Sheng, Weiguo Huang, Qingming Yu, Jun School of Information Science and Technology Hangzhou Normal University Hangzhou311121 China Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences Beijing100190 China School of Computer Science and Technology University of Chinese Academy of Sciences Beijing101408 China Key Laboratory of Complex Systems Modeling and Simulation School of Computer Science and Technology Hangzhou Dianzi University Hangzhou310018 China

Three-Dimensional (3D) dense captioning is an emerging vision-language bridging task that aims to generate multiple detailed and accurate descriptions for 3D scenes. It presents significant potential and challenges due to its closer representation of the real world compared to 2D visual captioning, as well as complexities in data collection and processing of 3D point cloud sources. Despite the popularity and success of existing methods, there is a lack of comprehensive surveys summarizing the advancements in this field, which hinders its progress. In this paper, we provide a comprehensive review of 3D dense captioning, covering task definition, architecture classification, dataset analysis, evaluation metrics, and in-depth prosperity discussions. Based on a synthesis of previous literature, we refine a standard pipeline that serves as a common paradigm for existing methods. We also introduce a clear taxonomy of existing models, summarize technologies involved in different modules, and conduct detailed experiment analysis. Instead of a chronological order introduction, we categorize the methods into different classes to facilitate exploration and analysis of the differences and connections among existing techniques. We also provide a reading guideline to assist readers with different backgrounds and purposes in reading efficiently. Furthermore, we propose a series of promising future directions for 3D dense captioning by identifying challenges and aligning them with the development of related tasks, offering valuable insights and inspiring future research in this field. Our aim is to provide a comprehensive understanding of 3D dense captioning, foster further investigations, and contribute to the development of novel applications in multimedia and related domains. Copyright © 2024, The Authors. All rights reserved.

关键词： Data handling

来源：评论

学校读者我要写书评

暂无评论

Prompting Video-Language Foundation Models with Domain-specific Fine-grained Heuristics for Video Question Answering

arXiv

引用

arXiv 2024年

作者： Yu, Ting Fu, Kunhao Wang, Shuhui Huang, Qingming Yu, Jun School of Information Science and Technology Hangzhou Normal University Hangzhou311121 China Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences Beijing100190 China School of Computer Science and Technology University of Chinese Academy of Sciences Beijing101408 China Key Laboratory of Complex Systems Modeling and Simulation School of Computer Science and Technology Hangzhou Dianzi University Hangzhou310018 China

Video Question Answering (VideoQA) represents a crucial intersection between video understanding and language processing, requiring both discriminative unimodal comprehension and sophisticated cross-modal interaction for accurate inference. Despite advancements in multi-modal pre-trained models and video-language foundation models, these systems often struggle with domain-specific VideoQA due to their generalized pre-training objectives. Addressing this gap necessitates bridging the divide between broad cross-modal knowledge and the specific inference demands of VideoQA tasks. To this end, we introduce HeurVidQA, a framework that leverages domain-specific entity-action heuristics to refine pre-trained video-language foundation models. Our approach treats these models as implicit knowledge engines, employing domain-specific entity-action prompters to direct the model’s focus toward precise cues that enhance reasoning. By delivering fine-grained heuristics, we improve the model’s ability to identify and interpret key entities and actions, thereby enhancing its reasoning capabilities. Extensive evaluations across multiple VideoQA datasets demonstrate that our method significantly outperforms existing models, underscoring the importance of integrating domain-specific knowledge into video-language models for more accurate and context-aware VideoQA. Copyright © 2024, The Authors. All rights reserved.

关键词： Inference engines

来源：评论

学校读者我要写书评

暂无评论

A Fast Algorithm for Moderating Critical Nodes via Edge Removal

arXiv

引用

arXiv 2023年

作者： Liu, Changan Zhou, Xiaotian Zehmakan, Ahad N. Zhang, Zhongzhi Shanghai Key Laboratory of Intelligent Information Processing School of Computer Science Fudan University Shanghai200433 China Center for Complex Decision Analysis Fudan University Shanghai200433 China The School of Computing The Australian National University Canberra Australia

Critical nodes in networks are extremely vulnerable to malicious attacks to trigger negative cascading events such as the spread of misinformation and diseases. Therefore, effective moderation of critical nodes is very vital for mitigating the potential damages caused by such malicious diffusions. The current moderation methods are computationally expensive. Furthermore, they disregard the fundamental metric of information centrality, which measures the dissemination power of nodes. We investigate the problem of removing k edges from a network to minimize the information centrality of a target node v while preserving the network's connectivity. We prove that this problem is computationally challenging: it is NP-complete and its objective function is not supermodular. However, we propose three approximation greedy algorithms using novel techniques such as random walk-based Schur complement approximation and fast sum estimation. One of our algorithms runs in nearly linear time in the number of edges. To complement our theoretical analysis, we conduct a comprehensive set of experiments on synthetic and real networks with over one million nodes. Across various settings, the experimental results illustrate the effectiveness and efficiency of our proposed algorithms. © 2023, CC BY.

关键词： Combinatorial optimization

来源：评论

学校读者我要写书评

暂无评论

A Weighted Flat Lattice Transformer-based Knowledge Extraction Architecture for Chinese Named Entity Recognition

A Weighted Flat Lattice Transformer-based Knowledge Extracti...

引用

International Conference on Computer Supported Cooperative Work in Design

作者： Hengwei Zhang Yuejia Wu Jian-Tao Zhou Inner Mongolia University College of Computer Science Hohhot China Ministry of Education National & Local Joint Engineering Research Center of Intelligent Information Processing Technology for Mongolian Engineering Research Center of Ecological Big Data Hohhot China Inner Mongolia Engineering Laboratory for Cloud Computing and Service Software Hohhot China Inner Mongolia Key Laboratory of Social Computing and Data Processing Hohhot China Inner Mongolia Key Laboratory of Discipline Inspection and Supervision Big Data Hohhot China Inner Mongolia Engineering Laboratory for Big Data Analysis Technology Hohhot China

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

Named Entity Recognition (NER) is one of the contents of Knowledge Extraction (KE) that transforms data into knowledge representation. However, Chinese NER faces the problem of lacking clear word boundaries that limit the effectiveness of the KE. Although the flat lattice Transformer (FLAT) framework, which converts lattice structure into a flat structure including a set of spans, can effectively improve this problem and obtain advanced results, there still exist the problems of insensitivity to entity importance weights and insufficient feature learning. This paper proposes a weighted flat lattice Transformer architecture for Chinese NER, namely WFLAT. The WFLAT first adds a weight matrix into self-attention calculation, which can obtain finer-grained partitioning of entities to improve experimental performance, and then adopts a multi-layer Transformer encoder with each layer using a multi-head self-attention mechanism. Extensive experimental results on benchmarks demonstrate that our proposed KE model can obtain state-of-the-art performance for the Chinese NER task.

关键词： Representation learning Computational modeling Memory management Lattices Named entity recognition Transforms Knowledge representation

来源：评论

学校读者我要写书评

暂无评论

Edge-Preserving Multi-Exposure Fusion with Guided Filtering for Structural Patch Decomposition

Edge-Preserving Multi-Exposure Fusion with Guided Filtering ...

引用

IEEE International Conference on Electronic information and Communication Technology (ICEICT)

作者： Yang Zhen Junwei Qi Yingsong Li College of Information and Communication Engineering Harbin Engineering University Harbin China College of Computer Science and Technology Harbin Engineering University Harbin China Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education Anhui University Hefei China

Multi-exposure image fusion (MEF) is one of the effective ways to obtain high dynamic range (HDR) images. Multi-scale structural patch decomposition based MEF(MSPD) and edge-preserving structural patch decomposition (MESPD) have achieved state-of-the-art fusion quality. MESPD incorporates edge-preserving factors into MSPD to preserve details in a single-scale setting. However, we find that the edge-preserving factors put too much emphasis on the edge, resulting in artifacts on some edges and loss of details. To tackle this issue, guided filter is introduced into MSPD, which is directly used as an edge-preserving filter instead of mean filter to implicitly decompose images. In addition, we have designed a flexible adaptive weight, which can further maintain details of the light and dark areas. Likewise, we inherit MESPD and MSPD to extend our method to multi-scale framework. Extensive experimental results demonstrate our method can produce satisfactory results in both static and dynamic scenes with fewer artifacts and low computational cost.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Distributed Traffic Engineering in Hybrid Software Defined Networks: A Multi-agent Reinforcement Learning Framework

arXiv

引用

arXiv 2023年

作者： Guo, Yingya Tang, Qi Ma, Yulong Tian, Han Chen, Kai The College of Computer and Data Science Fuzhou University China The Fujian Provincial Key Laboratory of Network Computing and Intelligent Information Processing Fuzhou University China The Key Laboratory of Spatial Data Mining & Information Sharing Ministry of Education Fujian 350003 China The Department of Computer Science & Engineering Hong Kong University of Science & Technology Hong Kong

Traffic Engineering (TE) is an efficient technique to balance network flows and thus improves the performance of a hybrid Software Defined Network (SDN). Previous TE solutions mainly leverage heuristic algorithms to centrally optimize link weight setting or traffic splitting ratios under the static traffic demand. Note that as the network scale becomes larger and network management gains more complexity, it is notably that the centralized TE methods suffer from a high computation overhead and a long reaction time to optimize routing of flows when the network traffic demand dynamically fluctuates or network failures happen. To enable adaptive and efficient routing in TE, we propose a Multi-agent Reinforcement Learning method CMRL that divides the routing optimization of a large network into multiple small-scale routing decision-making problems. To coordinate the multiple agents for achieving a global optimization goal, we construct an interactive environment for training the routing agents that own partial link utilization observations. To optimize credit assignment of multi-agent, we introduce the difference reward assignment mechanism for encouraging agents to take better action. Extensive simulations conducted on the real traffic traces demonstrate the superiority of CMRL in improving TE performance, especially when traffic demands change or network failures happen. Copyright © 2023, The Authors. All rights reserved.

关键词： Global optimization

来源：评论

学校读者我要写书评

暂无评论

Large Model-Based Data Augmentation for Imbalanced Text Classification

Large Model-Based Data Augmentation for Imbalanced Text Clas...

引用

Artificial Intelligence, Networking and information Technology (AINIT), International Seminar on

作者： Dawei Zhang Rongxin Mi Peiyao Zhou Dawei Jin Manman Zhang Tianhang Song School of Computer Science Jiangsu University of Science and Technology Zhenjiang Jiangsu China National Computer Network Emergency Response Technical Team/Coordination Center of China Beijing China Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences (CAS) Beijing China

ISBN: (数字)9798350385557

ISBN: (纸本)9798350385564

This study focuses on the application of large models to deal with imbalanced data problems in text classification. In view of the central position of text in web data and the negative impact of class imbalance on classifier performance, researchers have explored the method of using large models to generate high-quality minority class samples to enhance model performance. This paper reviews the technical progress of machine learning, deep learning, and large language models and their applications in text classification tasks. Although large models perform well in complex tasks due to their excellent language understanding ability, traditional machine learning and deep learning methods are popular in text classification scenarios that require fast response due to their simple structure and higher computational efficiency. This study proposes a data augmentation technique inspired by SMOTE, which uses a large language model combined with a simple prompt engineering strategy to generate high-quality minority samples. The experimental results show that the proposed method significantly improves the macro average precision, recall and F1 score on multiple text classification models, and effectively alleviates the challenge of class imbalance.

关键词： Deep learning Seminars Computational modeling Large language models Text categorization Data augmentation Data models

来源：评论

学校读者我要写书评

暂无评论

Soccer match broadcast video analysis method based on detection and tracking

Soccer match broadcast video analysis method based on detect...

引用

作者： Li, Hongyu Yang, Meng Yang, Chao Kang, Jianglang Suo, Xiang Meng, Weiliang Li, Zhen Mao, Lijuan Sheng, Bin Qi, Jun School of Information science and Technology Beijing Forestry University Beijing China Engineering Research Center for Forestry-Oriented Intelligent Information Processing National Forestry and Grassland Administration Beijing China School of Athletic Performance Shanghai University of Sport Shanghai China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation Chinese Academy of Sciences Beijing China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing China Department of Computer Science and Engineering Shanghai Jiao Tong Univerity Shanghai China Department of Computing Xi'an JiaoTong-Liverpool University Suzhou China

We propose a comprehensive soccer match video analysis pipeline tailored for broadcast footage, which encompasses three pivotal stages: soccer field localization, player tracking, and soccer ball detection. Firstly, we introduce sports camera calibration to seamlessly map soccer field images from match videos onto a standardized two-dimensional soccer field template. This addresses the challenge of consistent analysis across video frames amid continuous camera angle changes. Secondly, given challenges such as occlusions, high-speed movements, and dynamic camera perspectives, obtaining accurate position data for players and the soccer ball is non-trivial. To mitigate this, we curate a large-scale, high-precision soccer ball detection dataset and devise a robust detection model, which achieved the (Formula presented.) of 80.9%. Additionally, we develop a high-speed, efficient, and lightweight tracking model to ensure precise player tracking. Through the integration of these modules, our pipeline focuses on real-time analysis of the current camera lens content during matches, facilitating rapid and accurate computation and analysis while offering intuitive visualizations. © 2024 John Wiley & Sons Ltd.

关键词： Visualization

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：