检索结果-内蒙古大学图书馆

IEEE Transactions on Artificial intelligence 2024年第4期5卷 1658-1668页

作者： Zhang, Chunjie Zheng, Xiaolong Beijing Jiaotong University Institute of Information Science Beijing100044 China Beijing Jiaotong University Beijing Key Laboratory of Advanced Information Science and Network Technology Beijing100044 China University of Chinese Academy of Sciences State Key Laboratory of Multimodal Artificial Intelligence Systems The State of Key Laboratory of Management and Control for Complex System Institute of Automation Chinese Academy of Sciences School of Artificial Intelligence Beijing100190 China

Most image classification methods are designed to either boost the classification accuracies with abundant supervision, or cope with the shortage of supervision information. This is often achieved by using the visual and semantic information of other sources. However, these methods use the visual and semantic information within the same class independently, leaving their intrinsic correlations unconsidered. Objects and disturbing components as well as noise exist on the same image. Besides, semantic representations also contain noisy information. To solve the problems mentioned above, we propose a novel method for both fully supervised image classification and few-shot image classification by decomposing visual and semantic correlations. We jointly explore the intrinsic correlations of visual and semantic information of images within the same class. For each class, we decompose its visual and semantic correlations using low-rank and sparse constraint respectively. The decomposed low-rank parts character the intrinsic correlations of images can be used in a linear transformation way. Using the decomposed parts of each class, Classification can be achieved by reconstruction error minimization. We conduct experiments on several datasets for both fully supervised image classification and few-shot image classification. Experimental results well show the effectiveness of the proposed method. © 2020 IEEE.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Does Large Language Model Contain Task-Specific Neurons?

Does Large Language Model Contain Task-Specific Neurons?

引用

2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024

作者： Song, Ran He, Shizhu Jiang, Shuting Xian, Yantuan Gao, Shengxiang Liu, Kang Yu, Zhengtao Faculty of Information Engineering and Automation Kunming University of Science and Technology Kunming China Yunnan Key Laboratory of Artificial Intelligence Kunming China The Key Laboratory of Cognition and Decision Intelligence for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China School of Artificial Intelligence University of Chinese Academy of Science Beijing China

ISBN: (纸本)9798891761643

Large language models (LLMs) have demonstrated remarkable capabilities in comprehensively handling various types of natural language processing (NLP) tasks. However, there are significant differences in the knowledge and abilities required for different tasks. Therefore, it is important to understand whether the same LLM processes different tasks in the same way. Are there specific neurons in a LLM for different tasks? Inspired by neuroscience, this paper pioneers the exploration of whether distinct neurons are activated when a LLM handles different tasks. Compared with current research exploring the neurons of language and knowledge, task-specific neurons present a greater challenge due to their abstractness, diversity, and complexity. To address these challenges, this paper proposes a method for task-specific neuron localization based on Causal Gradient Variation with Special Tokens (CGVST). CGVST identifies task-specific neurons by concentrating on the most significant tokens during task processing, thereby eliminating redundant tokens and minimizing interference from non-essential neurons. Compared to traditional neuron localization methods, our approach can more effectively identify task-specific neurons. We conduct experiments across eight different public tasks. Experiments involving the inhibition and amplification of identified neurons demonstrate that our method can accurately locate task-specific neurons. © 2024 Association for Computational Linguistics.

关键词： Computational linguistics

来源：评论

学校读者我要写书评

暂无评论

Transformer-Based Macroscopic Regulation for High-Speed Railway Timetable Rescheduling

引用

IEEE/CAA Journal of Automatica Sinica 2023年第9期10卷 1822-1833页

作者： Wei Xu Chen Zhao Jie Cheng Yin Wang Yiqing Tang Tao Zhang Zhiming Yuan Yisheng Lv Fei-Yue Wang Faculty of Innovation Engineering Macao University of Science and TechnologyMacao 999078China Signal&Communication Research Institute China Academy Railway SciencesBeijing 100081China School of Artificial Intelligence University of Chinese Academy of SciencesBeijing 100049 State Key Laboratory for Management and Control of Complex Systems Institute of AutomationChinese Academy of SciencesBeijing 100190China IEEE State Key Laboratory for Management and Control of Complex Systems Chinese Academy of SciencesBeijing 100190 Macao Institute of Systems Engineering Macao University of Science and TechnologyMacao 999078China

Unexpected delays in train operations can cause a cascade of negative consequences in a high-speed railway *** such cases,train timetables need to be ***,timely and efficient train timetable rescheduling is still a challenging problem due to its modeling difficulties and low optimization *** paper presents a Transformer-based macroscopic regulation approach which consists of two stages including Transformer-based modeling and policy-based ***,the relationship between various train schedules and operations is described by creating a macroscopic model with the Transformer,providing the better understanding of overall operation in the high-speed railway ***,a policy-based approach is used to solve a continuous decision problem after macro-modeling for fast *** experiments on various delay scenarios are *** results demonstrate the effectiveness of the proposed method in comparison to other popular methods.

关键词： High-speed railway reinforcement learning train timetable rescheduling Transformer

来源：评论

学校读者我要写书评

暂无评论

Semantic Coherence Guided Multiview Similarity for Image Classification with Varied Supervision

IEEE Transactions on Artificial Intelligence

引用

IEEE Transactions on Artificial intelligence 2024年第6期5卷 3072-3082页

作者： Zhang, Chunjie Cao, Ping Bai, Huihui Zheng, Xiaolong Beijing Jiaotong University Institute of Information Science Beijing100044 China Beijing Jiaotong University Beijing Key Laboratory of Advanced Information Science and Network Technology Beijing100044 China University of Chinese Academy of Sciences State Key Laboratory of Multimodal Artificial Intelligence Systems The State of Key Laboratory of Management and Control for Complex System Institute of Automation Beijing100190 China University of Chinese Academy of Sciences School of Artificial Intelligence Beijing100190 China

Pairwise similarity has been widely used for image classification by propagating the class information from labeled images to unlabeled images and predicting the classes of unlabeled images accordingly. Although widely used, pairwise similarity based classification methods have two drawbacks. On one hand, visual-semantic similarity consistency does not always hold due to semantic gap. On the other hand, the reliability of pairwise similarity is also influenced by the number and underlying distribution of labeled images. A well-designed classification model cannot be easily generalized to few-shot classification tasks. To solve these two problems, in this article, we propose a semantic coherence guided multiview similarity (SCG-MV) for image classification method with varied supervision levels. We measure the semantic coherence between image pairs for classifier learning. This is achieved by first conducting line search along the line segment between each image pair, and then measure the semantics of each interval. The similarity of one image pair can then be obtained by aggregating the semantic coherence of all the intervals. In this way, we can model image similarities more finely and discriminatively. To make use of multiview information, we also use the semantic coherence guided image similarities to learn multiview classifiers. The proposed semantic coherence guided method can be combined with other similarity based methods for image classification with various levels of supervision. We conduct both few-shot and fully supervised classification experiments on four datasets with the results well prove the discriminative power and generalization ability of the proposed method. © 2020 IEEE.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

A Brief Overview of ChatGPT:The History,Status Quo and Potential Future Development

引用

IEEE/CAA Journal of Automatica Sinica 2023年第5期10卷 1122-1136页

作者： Tianyu Wu Shizhu He Jingping Liu Siqi Sun Kang Liu Qing-Long Han Yang Tang the Key Laboratory of Smart Manufacturing in Energy Chemical Process East China University of Science and TechnologyShanghai 200237China the Laboratory of Cognition and Decision Intelligence for Complex Systems Institute of AutomationChinese Academy of SciencesBeijing 100190 the School of Artificial Intelligence University of Chinese Academy of SciencesBeijing 100049China the School of Information Science and Engineering East China University of Science and TechnologyShanghai 200237China the Research Institute of Intelligent Complex Systems Fudan UniversityShanghai 200437China the School of Science Computing and Engineering TechnologiesSwinburne University of TechnologyMelbourne VIC 3122Australia

ChatG PT,an artificial intelligence generated content (AIGC) model developed by OpenAI,has attracted worldwide attention for its capability of dealing with challenging language understanding and generation tasks in the form of *** paper briefly provides an overview on the history,status quo and potential future development of ChatGPT,helping to provide an entry point to think about ***,from the limited open-accessed resources,we conclude the core techniques of ChatGPT,mainly including large-scale language models,in-context learning,reinforcement learning from human feedback and the key technical steps for developing *** further analyze the pros and cons of ChatGPT and we rethink the duality of ChatGPT in various *** it has been widely acknowledged that ChatGPT brings plenty of opportunities for various fields,mankind should still treat and use ChatG PT properly to avoid the potential threat,e.g.,academic integrity and safety ***,we discuss several open problems as the potential development of ChatGPT.

关键词： AIGC ChatGPT GPT-3 GPT-4 human feedback large language models

来源：评论

学校读者我要写书评

暂无评论

A DAOs-Based Publishing System for Advancing Open Access 4

A DAOs-Based Publishing System for Advancing Open Access

引用

4th IEEE International Conference on Digital Twins and Parallel intelligence, DTPI 2024

作者： Ma, Siji Li, Juanjuan Guan, Sangtian Ni, Qinghua Lin, Fei Zhang, Tengchao Huang, Jun Wang, Fei-Yue Macau University of Science and Technology Faculty of Innovation Engineering 999078 China Chinese Academy of Sciences State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation Beijing100190 China Chinese Academy of Sciences State Key Laboratory for Management and Control of Complex Systems Institute of Automation Beijing100190 China

ISBN: (纸本)9798350349252

The development of the scientific publishing system has remarkably enhanced global accessibility to research findings and substantially increased the visibility and dissemination of academic publications. However, significant challenges still exist in effectively safeguarding the intellectual property rights of contributors, such as the unauthorized usage of materials, the complexity of enforcing intellectual property rights across various legal jurisdictions, and high instances of plagiarism and content misuse. Additionally, financial barriers related to open access may restrict the participation of economically disadvantaged researchers, potentially biasing scientific records towards more affluent research initiatives. To address these issues, a novel decentralized framework is formulated to ensure truly open access. This framework leverages blockchain for immutable record-keeping and clear attribution of authorship, to prevent unauthorized usage and plagiarism. Besides, it also utilizes a copyright-sharing model based on decentralized autonomous organizations and operations (DAOs), where smart contracts automatically enforce copyright and access policies to ensure fair compensation for authors and researchers. Furthermore, the copyright sharing model based on non-fungible tokens (NFT) and gradual ownership optimization (GOO) mechanism is proposed to ensure fair and accurate recognition and compensation for scholarly contributions. © 2024 IEEE.

关键词： Decentralized finance

来源：评论

学校读者我要写书评

暂无评论

AI4S Based on DeSci: Reference Model and Research Issues

AI4S Based on DeSci: Reference Model and Research Issues

引用

2023 IEEE International Conference on systems, Man, and Cybernetics, SMC 2023

作者： Ding, Wenwen Li, Juanjuan Qin, Rui Guan, Sangtian Wang, Fei-Yue Institute of Automation Chinese Academy of Sciences The State Key Laboratory for Management and Control of Complex Systems The State Key Laboratory of Multimodal Artificial Intelligence Systems Beijing China Macau University of Science and Technology Faculty of Innovation Engineering Macau China Institute of Automation The State Key Laboratory for Management and Control of Complex Systems Chinese Academy of Sciences Beijing China

ISBN: (纸本)9798350337020

The rise of Artificial intelligence for science (AI4S) has highlighted the importance and urgency of ensuring open-ness, fairness, impartiality, diversity, and sustainability in scientific systems. Existing scientific systems, referred to as Centralized science (CeSci), are built on centralized organizational structures and top-down institutional frameworks, which are lagging behind the development and practical requirements of AI4S. To address these limitations, AI4S needs to embrace a new scientific organizational and operational paradigm, namely Decentralized science (DeSci). It can provide strong support to AI4S via effectively addressing issues such as information silos, biases, unfair distribution, and monopolies and promoting multidisciplinary, interdisciplinary, and trans disciplinary cooperation in science. Based on these considerations, this paper presents the framework of AI4S based on DeSci and explores its potential application scenarios and research issues. The research can provide effective guidance for the development of scientific systems. © 2023 IEEE.

关键词： Artificial intelligence for science (AI4S) ChatGPT Decentralized Autonomous Organizations and Operations (DAOs) Decentralized science (De-Sci) Generative Artificial intelligence (GAI) Intelligent science

来源：评论

学校读者我要写书评

暂无评论

The Journey/DAO/TAO of Embodied intelligence: From Large Models to Foundation intelligence and Parallel intelligence

引用

IEEE/CAA Journal of Automatica Sinica 2024年第6期11卷 1313-1316页

作者： Tianyu Shen Jinlin Sun Shihan Kong Yutong Wang Juanjuan Li Xuan Li Fei-Yue Wang College of Information Science and Technology Beijing University of Chemical TechnologyBeijing 100029China School of Electrical and Information Engineering Jiangsu UniversityZhenjiang 212013China State Key Laboratory for Turbulence and Complex Systems Department of Advanced Manufacturing and RoboticsCollege of EngineeringPeking UniversityBeijing 100871China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of AutomationChinese Academy of SciencesBeijing 100190China Peng Cheng Laboratory Shenzhen 518000China State Key Laboratory for Management and Control of Complex Systems Chinese Academy of SciencesBeijing 100190 Faculty of Innovation Engineering Macao University of Science and TechnologyMacao 999078China IEEE

THE tremendous impact of large models represented by ChatGPT[1]-[3]makes it necessary to con-sider the practical applications of such models[4].However,for an artificial intelligence(AI)to truly evolve,it needs to possess a physical“body”to transition from the virtual world to the real world and evolve through interaction with the real *** this context,“embodied intelligence”has sparked a new wave of research and technology,leading AI beyond the digital realm into a new paradigm that can actively act and perceive in a physical environment through tangible entities such as robots and automated devices[5].

关键词： intelligence DAO TAO

来源：评论

学校读者我要写书评

暂无评论

Federated intelligence for Intelligent Vehicles

IEEE Transactions on Intelligent Vehicles

引用

IEEE Transactions on Intelligent Vehicles 2024年第5期9卷 1-5页

作者： Zhang, Weishan Zhang, Baoyu Jia, Xiaofeng Qi, Hongwei Qin, Rui Li, Juanjuan Tian, Yonglin Liang, Xiaolong Wang, Fei-Yue School of China University of Petroleum Qingdao China Department of Data Management Big Data Centre Beijing Beijing China Technology Company Beijing China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation Chinese Academy of Sciences Beijing China Faculty of Innovation Engineering Macau University of Science and Technology Macao China State Key Laboratory for Management and Control of Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China

This letter is a brief summary of a series of IEEE TIV's decentralized and hybrid workshops (DHWs) on Federated intelligence for Intelligent Vehicles. The discussed results are: 1) Different scales of large models (LMs) can be federated and deployed on IVs, and three types of federated collaboration between large and small models can be adopted for IVs. 2) Federated fine-tuning of LMs is beneficial for IVs data security. 3) The sustainability of IVs can be improved through optimizing existing models and continuous learning using federated intelligence. 4) LM-enhanced knowledge can make IVs smarter. IEEE

关键词： Intelligent vehicle highway systems

来源：评论

学校读者我要写书评

暂无评论

SKIntern: Internalizing Symbolic Knowledge for Distilling Better CoT Capabilities into Small Language Models 31

SKIntern: Internalizing Symbolic Knowledge for Distilling Be...

引用

31st International Conference on Computational Linguistics, COLING 2025

作者： Liao, Huanxuan He, Shizhu Hao, Yupu Li, Xiang Zhang, Yuanzhe Zhao, Jun Liu, Kang The Key Laboratory of Cognition and Decision Intelligence for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing China Shanghai Artificial Intelligence Laboratory Shanghai China National Science Library Chinese Academy of Sciences Beijing China

ISBN: (纸本)9798891761964

Small Language Models (SLMs) are attracting attention due to the high computational demands and privacy concerns of Large Language Models (LLMs). Some studies fine-tune SLMs using Chains of Thought (CoT) data distilled from LLMs, aiming to enhance their reasoning ability. Furthermore, Some CoT distillation methods introduce external symbolic knowledge into the generation process to improve the limited knowledge memory, reasoning ability and out-of-domain (OOD) generalization of SLMs. However, the introduction of symbolic knowledge increases computational overhead and introduces potential noise. In this paper, we introduce SKIntern, an innovative approach that empowers SLMs to internalize symbolic knowledge and few-shot examples gradually through a progressive fine-tuning process, guided by a predefined linear decay schedule under curriculum learning. By efficiently internalizing knowledge, SKIntern reduces computational overhead and speeds up the reasoning process by focusing solely on the question during inference. It outperforms state-of-the-art baselines by over 5%, while reducing inference costs (measured in FLOPs) by up to 4× across a wide range of SLMs in both in-domain (ID) and out-of-domain (OOD) tasks. Our code will be available at https://***/Xnhyacinth/SKIntern. © 2025 Association for Computational Linguistics.

关键词： Cost reduction

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：