检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Zheng, Haotian Ren, Jinke Sun, Yushan Zhang, Ruichen Zhang, Wenbo Li, Zhen Niyato, Dusit Cui, Shuguang Han, Yatong National Key Laboratory of Autonomous Marine Vehicle Technology Harbin Engineering University Harbin150001 China The Chinese University of Hong Kong Shenzhen518172 China The Guangdong Provincial Key Laboratory of Future Networks of Intelligence The Chinese University of Hong Kong Shenzhen518172 China College of Computing and Data Science Nanyang Technological University Singapore Co. Ltd Shenzhen518048 China SSE The FNii-Shenzhen The Guangdong Provincial Key Laboratory of Future Networks of Intelligence The Chinese University of Hong Kong Shenzhen518172 China FNii-Shenzhen The Guangdong Provincial Key Laboratory of Future Networks of Intelligence The Chinese University of Hong Kong Shenzhen518172 China Infused Synapse AI Shenzhen518048 China

The recent advancements in large language models (LLMs) have significantly improved language understanding and generation capabilities. However, it is difficult to deploy LLMs on resource-constrained edge devices due to their high computational and storage resource demands. To address this issue, we propose a novel LLM model pruning method, namely structurally-aware adaptive pruning (SAAP), to significantly reduce the computational and memory costs while maintaining model performance. We first define an adaptive importance fusion metric to evaluate the importance of all coupled structures in LLMs by considering their homoscedastic uncertainty. Then, we rank the importance of all modules to determine the specific layers that should be pruned to meet particular performance requirements. Furthermore, we develop a new group fine-tuning strategy to improve the inference efficiency of LLMs. Finally, we evaluate the proposed SAAP method on multiple LLMs across two common tasks, i.e., zero-shot classification and text generation. Experimental results show that our SAAP method outperforms several state-of-the-art baseline methods, achieving 2.17%, 2.37%, and 2.39% accuracy gains on LLaMA-7B, Vicuna- 7B, and LLaMA-13B. Additionally, SAAP improves the token generation speed by 5%, showcasing its practical advantages in resource-constrained scenarios. Copyright © 2024, The Authors. All rights reserved.

关键词： Classification (of information)

来源：评论

学校读者我要写书评

暂无评论

Enhancing Small Object Detection in Aerial Imagery Based on Strong Feature Extraction and Batch Dimension

Enhancing Small Object Detection in Aerial Imagery Based on ...

引用

International Joint Conference on Neural Networks (IJCNN)

作者： Bingnan Cao Di Wang Ying Guo Hu Zhang Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center (National Supercomputer Center in Jinan) Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China The Institute of Data Science City University of Macau Macau China

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

Object detection is a fundamental component of computer vision, playing a pivotal role in various applications. However, the accurate detection of small and densely distributed objects remains a challenging problem in this field. This challenge is particularly exacerbated in the context of aerial imagery, characterized by its distinctive bird’s-eye view, intricate backgrounds, and the variability in object appearances. This paper addresses these persistent challenges in object detection, with a focus on the specific difficulties posed by aerial images. We propose a deformable end-to-end object detection with transformers (DETR)-based framework to enhance small object detection accuracy, ultimately contributing to improved computer vision capabilities in domains like remote sensing, surveillance, and autonomous aerial systems. Firstly, in order to aggregate the entire input sequence information in the backbone network and improve the detection accuracy of small objects, we propose DMCA based on deformable features and attention mechanisms. Secondly, in order to capture and model the relationships between samples for dense pixel-level representations in small objects and improve the detection accuracy of small objects, we try to introduce BatchEncoder by implementing an encoder in the batch dimension. Experimental results show that, compared to the baseline, our method significantly improves the accuracy of small object detection in aerial images. The processing and analysis of a large amount of remote sensing data require powerful computing power. The computing power Internet can integrate the scattered computing resources to provide flexible and scalable computing power to meet the computing needs of different sizes and types.

关键词： Computer vision Accuracy Surveillance Object detection Detectors Transformers Feature extraction

来源：评论

学校读者我要写书评

暂无评论

Contrastive Learning for Chest X-ray Classification: A Fusion of Topological data Analysis and ResNet

Contrastive Learning for Chest X-ray Classification: A Fusio...

引用

IEEE International Conference on data Science in Cyberspace (DSC)

作者： Hao Ren Zeyu Luo Fengshi Jing Xinyue Zhang Han He Yonghao Yu Dawei Zhao Faculty of Data Science City University of Macau China Minzu University of China Beijing China Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China

ISBN: (数字)9798350391367

ISBN: (纸本)9798350391374

Lung diseases such as pneumonia and tuberculosis present significant global health challenges, leading to millions of deaths annually. Chest X-ray imaging is crucial for diagnosing these conditions, but interpretation often relies on specialized radiologists, creating barriers in resource-limited areas. This study introduces a novel framework integrating topological data analysis (TDA), deep learning with ResNet-50, and contrastive learning to enhance the accuracy and computational efficiency of chest X-ray analysis. TDA captures global topological structures, while ResNet-50 extracts detailed local features. Contrastive learning then optimizes the feature space, enhancing the model’s discriminative power and generalization capabilities. Comprehensive evaluations on multiple datasets demonstrate the framework’s robustness and effectiveness, showing substantial improvements in diagnostic performance and computational efficiency. These findings suggest that the proposed approach is well-suited for real-time clinical applications, especially in resource-limited settings. Future work will focus on further optimizing the model and exploring its application to other medical imaging modalities, broadening its clinical utility.

关键词： Deep learning Accuracy Computational modeling Contrastive learning Feature extraction Robustness Real-time systems Computational efficiency X-ray imaging Biomedical imaging

来源：评论

学校读者我要写书评

暂无评论

Transformer-Based Hierarchical Dynamic Decoders for Salient Object Detection

SSRN

引用

SSRN 2023年

作者： Zheng, Qingping Zheng, Ling Deng, Jiankang Li, Ying Shang, Changjing Shen, Qiang School of Computer Science National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology Shaanxi Provincial Key Laboratory of Speech & Image Information Processing Northewestern Polytechnical University Shaanxi Xi’an710129 China Fuzhou Institute of Data Technology Fujian350200 China Department of Computing Imperial College London LondonSW7 2AZ United Kingdom

HighlightsTransformer-Based Hierarchical Dynamic Decoders for Salient Object DetectionQingping Zheng, Ling Zheng, Jiankang Deng, Ying Li, Changjing Shang, Qiang Shen• T-HDDNet employs dynamic upsampling and fusion for data-driven salient object detection.• T-HDDNet uses a spatially sensitive loss to learn salient object structures, yielding a high-resolution map.• Our method exceeds benchmarks at 22.19G MACs and 27M Params, reducing costs compared to the top model. © 2023, The Authors. All rights reserved.

关键词： Object detection

来源：评论

学校读者我要写书评

暂无评论

SAV-SE: Scene-aware Audio-Visual Speech Enhancement with Selective State Space Model

arXiv

引用

arXiv 2024年

作者： Qian, Xinyuan Gao, Jiaran Zhang, Yaodan Zhang, Qiquan Liu, Hexin Garcia, Leibny Paola Li, Haizhou The School of Computer and Communication Engineering University of Science and Technology Beijing Beijing100083 China The School of Electrical Engineering and Telecommunications The University of New South Wales Sydney2052 Australia The College of Computing and Data Science Nanyang Technological University Singapore The Center for Language and Speech Processing Johns Hopkins University United States The Guangdong Provincial Key Laboratory of Big Data Computing The Chinese University of Hong Kong Shenzhen518172 China Shenzhen Research Institute of Big data Shenzhen51872 China

Speech enhancement plays an essential role in various applications, and the integration of visual information has been demonstrated to bring substantial advantages. However, the majority of current research concentrates on the examination of facial and lip movements, which can be compromised or entirely inaccessible in scenarios where occlusions occur or when the camera view is distant. Whereas contextual visual cues from the surrounding environment have been overlooked: for example, when we see a dog bark, our brain has the innate ability to discern and filter out the barking noise. To this end, in this paper, we introduce a novel task, i.e. Scene-aware AudioVisual Speech Enhancement (SAV-SE). To our best knowledge, this is the first proposal to use rich contextual information from synchronized video as auxiliary cues to indicate the type of noise, which eventually improves the speech enhancement performance. Specifically, we propose the VC-S2E method, which incorporates the Conformer and Mamba modules for their complementary strengths. Extensive experiments are conducted on public MUSIC, AVSpeech and AudioSet datasets, where the results demonstrate the superiority of VC-S2E over other competitive methods. We will make the source code publicly available. Project demo page: https://***/ © 2024, CC BY.

关键词： Speech enhancement

来源：评论

学校读者我要写书评

暂无评论

StarGAT: Star-Shaped Hierarchical Graph Attentional Network for Heterogeneous Network Representation Learning

StarGAT: Star-Shaped Hierarchical Graph Attentional Network ...

引用

IEEE International Conference on data Mining (ICDM)

作者： Wen-Zhi Li Ling Huang Chang-Dong Wang Yu-Xin Ye School of Computer Science and Engineering Sun Yat-sen University Guangzhou China Guangdong Province Key Laboratory of Computational Science Guangzhou China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education China College of Mathematics and Informatics South China Agricultural University Guangzhou China Guangdong Provincial Key Laboratory of Public Finance and Taxation with Big Data Application Guangzhou China College of Computer Science and Technology Jilin University Changchun China

ISBN: (纸本)9781665423991

Many real-world graphs can be viewed as Heterogeneous Networks or Heterogeneous Information Networks (HINs) for that they comprise a diversity of node types and relation types. Due to the efficient representation ability of Graph Neural Network and the idea of random walk, many recent studies apply graph representation learning to HINs and achieve satisfactory results. However, these works either treat different node types in a metapath equally, which is inconsistent with the original graph semantic information for that different node types should have different statuses, or only consider the first-order (node-level) and second-order (metapath-level, a.k.a. link-level) information aggregation while ignoring the higher-order relations. To tackle these two problems, we propose a novel Star-Shaped Hierarchical Graph Attentional Network (StarGAT) model to boost representation learning in HINs. Specifically, we assume nodes in HINs can be categorized into a star-shaped structure including one center node type and a bunch of auxiliary node types in a specific task; and we encode node-level, link-level and motif-level attentions in a hierarchical manner to capture richer semantic information. Extensive experiments on three datasets illustrate the model effectiveness.

关键词： Representation learning Conferences Semantics Heterogeneous networks Graph neural networks data mining Task analysis

来源：评论

学校读者我要写书评

暂无评论

Prediction of Estimated Time of Arrival for Multi-Airport Systems Via "Bubble" Mechanism

SSRN

引用

SSRN 2022年

作者： Wang, Lechen Mao, Jianfeng Li, Lishuai Li, Xuechun Tu, Yilei School of Data Science The Chinese University of Hong Kong Shenzhen China School of Science and Engineering The Chinese University of Hong Kong Shenzhen China Shenzhen Research Institute of Big Data Guangdong China Guangdong Provincial Key Laboratory of Big Data Computing The Chinese University of Hong Kong Shenzhen China Faculty of Aerospace Engineering Delft University of Technology Delft2600 AA Netherlands School of Data Science City University of Hong Kong Hong Kong

Predicting Estimated Time of Arrival (ETA) for a Multi-Airport System (MAS) is much more challenging than for a single airport system because of complex air route structure, dense air traffic volume and vagaries of traffic conditions in an MAS. In this work, we propose a novel Bubble mechanism to accurately and e ciently predict medium-term ETA for a Multi-Airport System (MAS), in which the prediction of travel time of an origin-destination (OD) pair is decomposed into two stages, termed as out-MAS and in-MAS stages. For the out-MAS stage, Auto-Regressive Integrated Moving Average (ARIMA) is used to predict the travel time of a ight to reach the MAS boundary. For the in-MAS stage, we construct new spatio-temporal features based on clustering analysis of trajectory patterns facilitated by a novel data-driven hybrid polar sampling method. A sequence-to-sequence prediction model, Multi-variate Stacked Fully connected Bidirectional Long-Short Term Memory, is further developed to achieve multi-step-ahead predictions of in-MAS travel time for each trajectory pattern using the spatio-temporal features as input. Finally, the medium-term ETA prediction for an MAS is achieved by integrating the out-MAS and in-MAS prediction with the help of trajectory pattern prediction via random forest. A case study of predicting medium-term ETA for a typical MAS in China, Guangdong-Hong Kong-Macao Greater Bay Area, is conducted to demonstrate the usage and promising performance of the proposed method in comparison to several commonly used end-to-end learning methods. © 2022, The Authors. All rights reserved.

关键词： Forecasting

来源：评论

学校读者我要写书评

暂无评论

Dual Prototypes Contrastive Learning for Semi-Supervised Medical Image Segmentation

SSRN

引用

SSRN 2024年

作者： Yue, Tianai Xu, Rongtao Wu, Jingqian Yang, Wenjie Du, Shide Wang, Changwei Johns Hopkins University Baltimore21218 United States State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation Chinese Academy of Sciences Beijing100190 China The University of Hong Kong Hong Kong999077 Hong Kong College of Computer and Big Data Fuzhou University Fuzhou350108 China Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology Shandong Academy of Sciences Jinan250014 China Shandong Provincial Key Laboratory of Computing Power Internet and Service Computing Shandong Fundamental Research Center for Computer Science Jinan250014 China

Semi-supervised techniques for medical image segmentation have demonstrated potential, effectively training models using scarce labeled data alongside a wealth of unlabeled data. Therefore, semi-supervised medical image segmentation is one of the key issues in engineering applications of medical artificial intelligence. Consistency constraints based on prototype alignment provide an intuitively sensible way to discover valuable insights from unlabeled data that can motivate segmentation performance. In this work, we propose a dual prototypes contrastive network (DPC-Net) to motivate semi-supervised medical segmentation accuracy by imposing image-level global prototype constraints and pixel-level local prototype constraints. First, we introduce a Background-Separation Global Prototype Contrastive Learning technique that utilizes the natural mutual exclusivity of foreground and background to separate the inter-class distances and encourage the segmentation network to obtain segmentation results that are more complete and do not contain background regions. Second, we design a Cross-Consistent Local Prototype Contrastive Learning techniques to extend the perturbation consistency of the two networks to the prototype's localized response to the feature map, thereby shaping a more stable intra-class prototype space and producing accurate and robust pixel-level predictions. Finally, we comprehensively evaluate our method on mainstream semi-supervised medical image segmentation benchmarks and settings, and experimental results show that our DPC-Net outperforms current state-of-the-art methods. © 2024, The Authors. All rights reserved.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

Petri Net Control Method for Pipe-line Systems and Its Implementation via CIF3 ⁎

引用

IFAC-PapersOnLine 2019年第24期52卷 261-266页

作者： YuHao Fu JiLiang Luo Huifeng Wu Jianhong Ye Yi-sheng Huang College Information Science and Engineering Huaqiao University Xiamen 361021 China College Information Science and Engineering Huaqiao University Xiamen 361021 China and also with Fujian Engineering Research Center of Motor Control and System Optimal Schedule Xiamen 361021 China Institute of Intelligent and Software Technology Hangzhou Dianzi University Hangzhou 310018 China Computer Science and Technology Huaqiao University Xiamen 361021 China and also with Fujian Provincial Key Laboratory of Data Intensive Computing Quanzhou 362000 China Department of Electrical Engineering National Ilan University Taiwan

As for a pipe-line system subjected to complex operations, an approach is proposed to synthesize the controller via Petri nets (PNs) such that the plant is run as concurrently as possible and the loads of equipments are balanced. A P-timed and labeled PN is designed to model the whole process of a pipe-line system, where tasks, including transporting material from one tank to another and cleaning tank, are represented by operational places, and level sensors amounted in tanks are represented by labels assigned to transitions. Further, monitor places are designed to resolve the conflict relations among tasks due to the shared valves and pipes. An method is presented to translate an PN controller into a CIF3 (Compositional Interchange Format) model, which can be converted into a PLC program in the CIF3 tool. A beer filtration plant is taken as an example to illustrate the approach, and its simulation experiments are carried out to verify the theoretic results.

关键词： Chemical plant Valve control Petri net CIF3

来源：评论

学校读者我要写书评

暂无评论

ADEdgeDrop: Adversarial Edge Dropping for Robust Graph Neural Networks

arXiv

引用

arXiv 2024年

作者： Chen, Zhaoliang Wu, Zhihao Sadikaj, Ylli Plant, Claudia Dai, Hong-Ning Wang, Shiping Cheung, Yiu-Ming Guo, Wenzhong College of Computer and Data Science Fuzhou University Fuzhou350116 China Department of Computer Science Hong Kong Baptist University Hong Kong Fujian Provincial Key Laboratory of Network Computing and Intelligent Information Processing Fuzhou University Fuzhou350116 China Faculty of Computer Science and with the research network Data Science @ Uni Vienna University of Vienna Vienna1090 Austria

Although Graph Neural Networks (GNNs) have exhibited the powerful ability to gather graph-structured information from neighborhood nodes via various message-passing mechanisms, the performance of GNNs is limited by poor generalization and fragile robustness caused by noisy and redundant graph data. As a prominent solution, Graph Augmentation Learning (GAL) has recently received increasing attention in the literature. Among the existing GAL approaches, edge-dropping methods that randomly remove edges from a graph during training are effective techniques to improve the robustness of GNNs. However, randomly dropping edges often results in bypassing critical edges. Consequently, the effectiveness of message passing is weakened. In this paper, we propose a novel adversarial edgedropping method (ADEdgeDrop) that leverages an adversarial edge predictor guiding the removal of edges, which can be flexibly incorporated into diverse GNN backbones. Employing an adversarial training framework, the edge predictor utilizes the line graph transformed from the original graph to estimate the edges to be dropped, which improves the interpretability of the edge-dropping method. The proposed ADEdgeDrop is optimized alternately by stochastic gradient descent and projected gradient descent. Comprehensive experiments on eight graph benchmark datasets demonstrate that the proposed ADEdgeDrop outperforms state-of-the-art baselines across various GNN backbones, demonstrating improved generalization and robustness. Copyright © 2024, The Authors. All rights reserved.

关键词： Adversarial machine learning

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：