检索结果-内蒙古大学图书馆

International Joint Conference on Neural Networks (IJCNN)

作者： Zixin Zhong Liyan Song Fengzhen Tang Bo Yuan Department of Computer Science and Engineering Guangdong Provincial Key Laboratory of Brain-Inspired Intelligent Computation Southern University of Science and Technology Shenzhen China Faculty of Computing Harbin Institute of Technology Harbin China State Key Laboratory of Robotics Shenyang Institute of Automation Chinese Academy of Sciences Shenyang China

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

In non-stationary data streams, the challenges of concept drift are further compounded by the issue of Intermediate Verification Latency (IVL), which can impede timely model adaptation. IVL refers to the finite delay between the arrival of data features and their corresponding labels. This delay could pose a significant challenge in adapting models to new concepts, ultimately hindering predictive performance. However, existing IVL approaches exhibit certain limitations. Some approaches passively wait for delayed labels, thereby overlooking temporarily unlabeled data. Other approaches employ pseudo-labeling for immediate model updates, but may risk losing valuable information when reverting model states to rectify previous pseudo-labeling mistakes. To overcome these limitations, we propose a novel approach called Micro-cluster based Immediate Pseudo-Labeling with Oriented Synthetic Correction (MIPLOSC). MIPLOSC leverages micro-cluster systems to effectively capture data distributions, thus facilitating its two core components: immediate pseudo-labeling and oriented synthetic correction. The immediate pseudo-labeling mechanism facilitates immediate utilization of temporarily unlabeled data, and the oriented synthetic correction mechanism enables finergrained rectification from previous erroneous pseudo-labels and concept drift, minimizing the loss of learned information. Experimental studies validated the effectiveness of MIPLOSC in addressing IVL, demonstrating its superiority over competing methods in both space consumption and predictive performance across varying degrees of label delay.

关键词： Adaptation models Costs Concept drift Noise Neural networks Predictive models Robustness

来源：评论

学校读者我要写书评

暂无评论

LXL: LiDAR Excluded Lean 3D Object Detection with 4D Imaging Radar and Camera Fusion

arXiv

引用

arXiv 2023年

作者： Xiong, Weiyi Liu, Jianan Huang, Tao Han, Qing-Long Xia, Yuxuan Zhu, Bing The School of Automation Science and Electrical Engineering Beihang University Beijing100191 China Vitalent Consulting Gothenburg Sweden The College of Science and Engineering James Cook University CairnsQLD4878 Australia The School of Science Computing and Engineering Technologies Swinburne University of Technology MelbourneVIC3122 Australia The Department of Electrical Engineering Chalmers University of Technology Gothenburg Sweden

As an emerging technology and a relatively affordable device, the 4D imaging radar has already been confirmed effective in performing 3D object detection in autonomous driving. Nevertheless, the sparsity and noisiness of 4D radar point clouds hinder further performance improvement, and in-depth studies about its fusion with other modalities are lacking. On the other hand, as a new image view transformation strategy, "sampling" has been applied in a few image-based detectors and shown to outperform the widely applied "depth-based splatting" proposed in Lift-Splat-Shoot (LSS), even without image depth prediction. However, the potential of "sampling" is not fully unleashed. This paper investigates the "sampling" view transformation strategy on the camera and 4D imaging radar fusion-based 3D object detection. LiDAR Excluded Lean (LXL) model, predicted image depth distribution maps and radar 3D occupancy grids are generated from image perspective view (PV) features and radar bird’s eye view (BEV) features, respectively. They are sent to the core of LXL, called "radar occupancy-assisted depth-based sampling", to aid image view transformation. We demonstrated that more accurate view transformation can be performed by introducing image depths and radar information to enhance the "sampling" strategy. Experiments on VoD and TJ4DRadSet datasets show that the proposed method outperforms the state-of-the-art 3D object detection methods by a significant margin without bells and whistles. Ablation studies demonstrate that our method performs the best among different enhancement settings. Copyright © 2023, The Authors. All rights reserved.

关键词： Object detection

来源：评论

学校读者我要写书评

暂无评论

Vision-Language Meets the Skeleton: Progressively Distillation with Cross-Modal Knowledge for 3D Action Representation Learning

arXiv

引用

arXiv 2024年

作者： Chen, Yang He, Tian Fu, Junfeng Wang, Ling Guo, Jingcai Hu, Ting Cheng, Hong The School of Information and Communication Engineering University of Electronic Science and Technology of China Chengdu China The School of Automation Engineering University of Electronic Science and Technology of China Chengdu China The Department of Computing The Hong Kong Polytechnic University Hong Kong Hong Kong Polytechnic University Shenzhen Research Institute Shenzhen China The No.1 Orthopedic Hospital of Chengdu Chengdu China

Skeleton-based action representation learning aims to interpret and understand human behaviors by encoding the skeleton sequences, which can be categorized into two primary training paradigms: supervised learning and self-supervised learning. However, the former one-hot classification requires labor-intensive predefined action categories annotations, while the latter involves skeleton transformations (e.g., cropping) in the pretext tasks that may impair the skeleton structure. To address these challenges, we introduce a novel skeleton-based training framework (C2VL) based on Cross-modal Contrastive learning that uses the progressive distillation to learn task-agnostic human skeleton action representation from the VisionLanguage knowledge prompts. Specifically, we establish the vision-language action concept space through vision-language knowledge prompts generated by pre-trained large multimodal models (LMMs), which enrich the fine-grained details that the skeleton action space lacks. Moreover, we propose the intra-modal self-similarity and inter-modal cross-consistency softened targets in the cross-modal representation learning process to progressively control and guide the degree of pulling vision-language knowledge prompts and corresponding skeletons closer. These soft instance discrimination and self-knowledge distillation strategies contribute to the learning of better skeleton-based action representations from the noisy skeleton-vision-language pairs. During the inference phase, our method requires only the skeleton data as the input for action recognition and no longer for vision-language prompts. Extensive experiments on NTU RGB+D 60, NTU RGB+D 120, and PKU-MMD datasets demonstrate that our method outperforms the previous methods and achieves state-of-the-art results. Code is available at: https://***/cseeyangchen/C2VL. Copyright © 2024, The Authors. All rights reserved.

关键词： Musculoskeletal system

来源：评论

学校读者我要写书评

暂无评论

RoW-based Parallel Control for Mixed Traffic Scenario: A Case Study on Lane-Changing

RoW-based Parallel Control for Mixed Traffic Scenario: A Cas...

引用

International Conference on Intelligent Transportation

作者： Jingru Yu Yi Yu Shengyue Yao Ding Wang Pinlong Cai Honghai Li Li Li Fei-Yue Wang Yilun Lin Shanghai Artificial Intelligence Laboratory Urban Computing Shanghai China Research and Development Center of Transport Industry of Autonomous Driving Technology RIOH High and Technology Group Department of Automation Tsinghua University Beijing China Macau Institute of Systems Engineering Macau University of Science and Technology Macau China Institute of Automation Chinese Academy of Sciences Beijing China

To address the challenge of developing effective control methods for governing the entire driving process of both connected and automated vehicles (CAVs) and human-driven vehicles (HDVs) in mixed traffic scenario, this paper proposes a parallel control framework with calibrating module and pricing control module. Based on parallel learning theory, this framework enables intelligent agents to take over both HDVs and CAVs and engage in right-of-way (RoW) negotiations in the mixed traffic network. Game theory is employed to model RoW transactions and incentivize transactions through utility compensation. Empirical datasets are used to showcase the performance of the proposed framework in a lane-changing scenario. Our findings demonstrate that the introduction of incentives can increase the RoW trading probability of drivers significantly. To the best of our knowledge, this is the first parallel control framework based on pricing mechanism allowing both CAVs and HDVs to negotiate based on intelligent agents.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Generative AI for Data Augmentation in Wireless Networks: Analysis, Applications, and Case Study

arXiv

引用

arXiv 2024年

作者： Wen, Jinbo Kang, Jiawen Niyato, Dusit Zhang, Yang Wang, Jiacheng Sikdar, Biplab Zhang, Ping College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics China School of Automation Guangdong University of Technology China College of Computing and Data Science Nanyang Technological University Singapore Department of Electrical and Computer Engineering College of Design and Engineering National University of Singapore Singapore State Key Laboratory of Networking and Switching Technology Beijing University of Posts and Telecommunications China

Data augmentation is a powerful technique to mitigate data scarcity. However, owing to fundamental differences in wireless data structures, traditional data augmentation techniques may not be suitable for wireless data. Fortunately, Generative Artificial Intelligence (GenAI) can be an effective alternative to wireless data augmentation due to its excellent data generation capability. This article systemically explores the potential and effectiveness of GenAI-driven data augmentation in wireless networks. We first briefly review data augmentation techniques, discuss their limitations in wireless networks, and introduce generative data augmentation, including reviewing GenAI models and their applications in data augmentation. We then explore the application prospects of GenAI-driven data augmentation in wireless networks from the physical, network, and application layers, which provides a GenAI-driven data augmentation architecture for each application. Subsequently, we propose a general generative diffusion model-based data augmentation framework for Wi-Fi gesture recognition, which uses transformer-based diffusion models to generate high-quality channel state information data. Furthermore, we develop residual neural network models for Wi-Fi gesture recognition to evaluate the role of augmented data and conduct a case study based on a real dataset. Simulation results demonstrate the effectiveness of the proposed framework. Finally, we discuss research directions for generative data augmentation. Copyright © 2024, The Authors. All rights reserved.

关键词： Generative adversarial networks

来源：评论

学校读者我要写书评

暂无评论

Generative AI in Data Center Networking: Fundamentals, Perspectives, and Case Study

arXiv

引用

arXiv 2024年

作者： Liu, Yinqiu Du, Hongyang Niyato, Dusit Kang, Jiawen Xiong, Zehui Wen, Yonggang In Kim, Dong The College of Computing and Data Science Nanyang Technological University Singapore The Department of Electrical and Electronic Engineering University of Hong Kong Pok Fu Lam Hong Kong The School of Automation Guangdong University of Technology China The Pillar of Information Systems Technology and Design Singapore University of Technology and Design Singapore The College of Information and Communication Engineering Sungkyunkwan University Korea Republic of

Generative AI (GenAI), exemplified by Large Language Models (LLMs) such as OpenAI's ChatGPT, is revolutionizing various fields. Central to this transformation is Data Center Networking (DCN), which not only provides the computational power necessary for GenAI training and inference but also delivers GenAI-driven services to users. This article examines an interplay between GenAI and DCNs, highlighting their symbiotic relationship and mutual advancements. We begin by reviewing current challenges within DCNs and discuss how GenAI contributes to enhancing DCN capabilities through innovations, such as data augmentation, process automation, and domain transfer. We then focus on analyzing the distinctive characteristics of GenAI workloads on DCNs, gaining insights that catalyze the evolution of DCNs to more effectively support GenAI and LLMs. Moreover, to illustrate the seamless integration of GenAI with DCNs, we present a case study on full-lifecycle DCN digital twins. In this study, we employ LLMs equipped with Retrieval Augmented Generation (RAG) to formulate optimization problems for DCNs and adopt Diffusion-Deep Reinforcement Learning (DRL) for optimizing the RAG knowledge placement strategy. This approach not only demonstrates the application of advanced GenAI methods within DCNs but also positions the digital twin as a pivotal GenAI service operating on DCNs. We anticipate that this article can promote further research into enhancing the virtuous interaction between GenAI and DCNs. © 2024, CC BY.

关键词： Deep reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

Incremental Online Learning of Randomized Neural Network with Forward Regularization

arXiv

引用

arXiv 2024年

作者： Wang, Junda Hu, Minghui Li, Ning Al-Ali, Abdulaziz Suganthan, Ponnuthurai Nagaratnam The Key Laboratory of System Control and Information Processing Ministry of Education of China China The Department of Automation Shanghai Jiao Tong University Shanghai200240 China The Shanghai Engineering Research Center of Intelligent Control and Management Shanghai200240 China The School of Electrical and Electronic Nanyang Technological University Singapore The KINDI Computing Research Center College of Engineering Qatar University Qatar

Online learning of deep neural networks suffers from challenges such as hysteretic non-incremental updating, increasing memory usage, past retrospective retraining, and catastrophic forgetting. To alleviate these drawbacks and achieve progressive immediate decision-making, we propose a novel Incremental Online Learning (IOL) process of Randomized Neural Networks (Randomized NN), a framework facilitating continuous improvements to Randomized NN performance in restrictive online scenarios. Within the framework, we further introduce IOL with ridge regularization (-R) and IOL with forward regularization (-F). -R generates stepwise incremental updates without retrospective retraining and avoids catastrophic forgetting. Moreover, we substituted -R with -F as it enhanced precognition learning ability using semi-supervision and realized better online regrets to offline global experts compared to -R during IOL. The algorithms of IOL for Randomized NN with -R/-F on non-stationary batch stream were derived respectively, featuring recursive weight updates and variable learning rates. Additionally, we conducted a detailed analysis and theoretically derived relative cumulative regret bounds of the Randomized NN learners with -R/-F in IOL under adversarial assumptions using a novel methodology and presented several corollaries, from which we observed the superiority on online learning acceleration and regret bounds of employing -F in IOL. Finally, our proposed methods were rigorously examined across regression and classification tasks on diverse datasets, which distinctly validated the efficacy of IOL frameworks of Randomized NN and the advantages of forward regularization. Copyright © 2024, The Authors. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Privacy-Preserving Biometric Verification with Handwritten Random Digit String

arXiv

引用

arXiv 2025年

作者： Zhang, Peirong Liu, Yuliang Lai, Songxuan Li, Hongliang Jin, Lianwen School of Electronic and Information Engineering South China University of Technology Guangzhou China SCUT-Zhuhai Institute of Modern Industrial Innovation Zhuhai China School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China EI Product Department Huawei Cloud Computing Technologies Co. Ltd. Shenzhen China

Handwriting verification has stood as a steadfast identity authentication method for decades. However, this technique risks potential privacy breaches due to the inclusion of personal information in handwritten biometrics such as signatures. To address this concern, we propose using the Random Digit String (RDS) for privacy-preserving handwriting verification. This approach allows users to authenticate themselves by writing an arbitrary digit sequence, effectively ensuring privacy protection. To evaluate the effectiveness of RDS, we construct a new HRDS4BV dataset composed of online naturally handwritten RDS. Unlike conventional handwriting, RDS encompasses unconstrained and variable content, posing significant challenges for modeling consistent personal writing style. To surmount this, we propose the Pattern Attentive VErification Network (PAVENet), along with a Discriminative Pattern Mining (DPM) module. DPM adaptively enhances the recognition of consistent and discriminative writing patterns, thus refining handwriting style representation. Through comprehensive evaluations, we scrutinize the applicability of online RDS verification and showcase a pronounced outperformance of our model over existing methods. Furthermore, we discover a noteworthy forgery phenomenon that deviates from prior findings and discuss its positive impact in countering malicious impostor attacks. Substantially, our work underscores the feasibility of privacy-preserving biometric verification and propels the prospects of its broader acceptance and application. © 2025, CC BY-NC-ND.

关键词： Differential privacy

来源：评论

学校读者我要写书评

暂无评论

Uncovering Neural Scaling Laws in Molecular Representation Learning

arXiv

引用

arXiv 2023年

作者： Chen, Dingshuo Zhu, Yanqiao Zhang, Jieyu Du, Yuanqi Li, Zhixun Liu, Qiang Wu, Shu Wang, Liang Center for Research on Intelligent Perception and Computing Institute of Automation Chinese Academy of Sciences China Department of Computer Science University of California Los Angeles United States The Paul G. Allen School of Computer Science and Engineering University of Washington United States Department of Computer Science Cornell University United States Department of Systems Engineering and Engineering Management The Chinese University of Hong Kong Hong Kong

Molecular Representation Learning (MRL) has emerged as a powerful tool for drug and materials discovery in a variety of tasks such as virtual screening and inverse design. While there has been a surge of interest in advancing model-centric techniques, the influence of both data quantity and quality on molecular representations is not yet clearly understood within this field. In this paper, we delve into the neural scaling behaviors of MRL from a data-centric viewpoint, examining four key dimensions: (1) data modalities, (2) dataset splitting, (3) the role of pre-training, and (4) model capacity. Our empirical studies confirm a consistent power-law relationship between data volume and MRL performance across these dimensions. Additionally, through detailed analysis, we identify potential avenues for improving learning efficiency. To challenge these scaling laws, we adapt seven popular data pruning strategies to molecular data and benchmark their performance. Our findings underline the importance of data-centric MRL and highlight possible directions for future research. Copyright © 2023, The Authors. All rights reserved.

关键词： Benchmarking

来源：评论

学校读者我要写书评

暂无评论

Personalized Federated Learning with Collaborative Aggregation Networks for Multi-Site Brain Disorder Diagnosis

Personalized Federated Learning with Collaborative Aggregati...

引用

Industrial automation, Robotics and Control engineering (IARCE), International Conference on

作者： Qian Si Yang Li School of Cyber Science and Technology Beihang University Beijing China Department of Automation Science and Electrical Engineering Beijing Advanced Innovation Center for Big Data and Brain Computing State Key Laboratory of Virtual Reality Technology and Systems Advanced Institute of Information Technology Peking University Beihang University Beijing China

ISBN: (数字)9798350380323

ISBN: (纸本)9798350380330

In multi-site brain disease diagnosis studies, traditional centralized training methods necessitate sharing medical data, posing significant privacy risks. Federated learning (FL) offers a privacy-preserving solution by enabling global model training through aggregating locally trained models from multiple data centers without sharing raw data. However, current FL approaches rely on a server-based network topology, where central server failure disrupts training. Additionally, data heterogeneity across sites often slows convergence and reduces accuracy. To overcome these issues, we introduce a decentralized personalized federated learning collaborative aggregation network (pFedCAN). This framework has two core components: (1) separating local models into shared and personalized layers, and (2) forming a collaborative aggregation network via similarity detection in the shared layers. Specifically, each center trains its local model, then separates it into shared and personalized layers. The shared layer is exchanged with other centers, while the personalized layer remains local. Data centers analyze similarities in received shared layers to build a collaborative network, where shared layers from similar centers are aggregated to refine the model. This approach flexibly adapts to varying levels of data heterogeneity, enhancing model training efficiency. Validation on public datasets, ABIDE I and ADHD, shows that the proposed method outperforms current leading techniques.

关键词： Training Adaptation models Data centers Federated learning Service robots Collaboration Brain modeling Data models Servers Medical diagnostic imaging

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：