检索结果-内蒙古大学图书馆

Mixture of Experts for Intelligent Networks: A Large Language Model-enabled Approach

学校读者我要写书评

暂无评论

Mixture of Experts for Intelligent Networks: A Large Languag...

International Wireless Communications and Mobile Computing Conference, IWCMC

作者： Hongyang Du Guangyuan Liu Yijing Lin Dusit Niyato Jiawen Kang Zehui Xiong Dong In Kim School of Computer Science and Engineering Nanyang Technological University Singapore Singapore State Key Laboratory of Networking and Switching Technology Beijing University of Posts and Telecommunications Beijing China School of Automation Guangdong University of Technology and Key Laboratory of Intelligent Information Processing and System Integration of IoT Ministry of Education Guangzhou China Guangdong-HongKong-Macao Joint Laboratory for Smart Discrete Manufacturing Guangzhou China Pillar of Information Systems Technology and Design Singapore University of Technology and Design Singapore Singapore Department of Electrical and Computer Engineering Sungkyunkwan University Suwon South Korea

ISBN: (数字)9798350361261

ISBN: (纸本)9798350361278

Optimizing various wireless user tasks poses a significant challenge for networking systems because of the expanding range of user requirements. Despite advancements in Deep Reinforcement Learning (DRL), the need for customized optimization tasks for individual users complicates developing and applying numerous DRL models, leading to substantial computation resource and energy consumption and can lead to inconsistent outcomes. To address this issue, we propose a novel approach utilizing a Mixture of Experts (MoE) framework, augmented with Large Language Models (LLMs), to analyze user objectives and constraints effectively, select specialized DRL experts, and weigh each decision from the participating experts. Specifically, we develop a gate network to oversee the expert models, allowing a collective of experts to tackle a wide array of new tasks. Furthermore, we innovatively substitute the traditional gate network with an LLM, leveraging its advanced reasoning capabilities to manage expert model selection for joint decisions. Our proposed method reduces the need to train new DRL models for each unique optimization problem, decreasing energy consumption and AI model implementation costs. The LLMenabled MoE approach is validated through a general maze navigation task and a specific network service provider utility maximization task, demonstrating its effectiveness and practical applicability in optimizing complex networking systems.

关键词： Wireless communication Energy consumption Navigation Computational modeling Logic gates Probability Throughput

Plasmon hybridization induced by quasi bound state in the continuum of graphene metasurfaces oriented for high-accuracy polarization-insensitive two-dimensional sensors

学校读者我要写书评

暂无评论

Chinese Optics Letters 2022年第4期20卷 65-70页

作者： Xiuyu Wang Jihong Xin Qun Ren Haocheng Cai Jiaqi Han Chengyi Tian Pengcheng Zhang Lijie Jiang Zhihao Lan Jianwei You Wei E.I.Sha Tianjin Key Laboratory of Imaging and Sensing Microelectronic Technology School of MicroelectronicsTianjin UniversityTianjin 300072China School of Electrical and Information Engineering Tianjin UniversityTianjin 300072China State Key Laboratory of Millimeter Waves School of Information Science and EngineeringSoutheast UniversityNanjing 210096China Key Laboratory of High Speed Circuit Design and EMC of Ministry of Education School of Electronic EngineeringXidian UniversityXi'an 710071China Huawei Technologies Company Ltd. Shanghai 518129China Department of Electronic and Electrical Engineering University College LondonLondon WC1E7JEUK Key Laboratory of Micro-Nano Electronic Devices and Smart Systems of Zhejiang Province College of Information Science and Electronic EngineeringZhejiang UniversityHangzhou 310027China

Plasmonics could provide compact and powerful solutions for manipulating light in deep-subwavelength dimensions,which is promising for a great range of nanophotonic technologies such as plasmonic rulers and ***,the effective area of enhanced localized field induced by surface plasmon polaritons is typically restricted to the structural *** this work,we propose a method to generate high quality-factor extended electromagnetic fields via hybridizing the superradiant state and the quasi bound state in the continuum of graphene *** coupling interaction involved operates as a three-level system with multiple sharp resonances immune to the polarization,which holds great promise for developing nanodevices with high sensing capacity in two dimensions.

关键词： plasmon hybridization quasi bound state in the continuum high-Q sensing

Modeling, simulation and experiment of an origami robot with a coupled bar-hinge mechanism

学校读者我要写书评

暂无评论

Modeling, simulation and experiment of an origami robot with...

Fully Actuated system Theory and Applications (CFASTA), Conference on

作者： Junpeng Mai Hanzhao Shao Shaojie Liu Yuanzhuo Zhang Liangming Chen Huijuan Feng School of System Design and Intelligent Manufacturing and Shenzhen Key Laboratory of Control Theory and Intelligent Systems Southern University of Science and Technology Shenzhen P. R. China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen P. R. China Department of Mechnical and Energy Engineering Southern University of Science and Technology Shenzhen P. R. China

ISBN: (数字)9798350373691

ISBN: (纸本)9798350373707

This paper aims to analyze the motion behavior of an origami robot with a coupled bar-hinge mechanism. By disassembling the planar six-hinge mechanism into two planar four-hinge mechanisms with coupled motion, this paper derives the kinematics of the planar six-hinge mechanism based on the algebraic differential kinematics of the planar four-hinge motions. The rotational angle change and the moving step length of the origami robot are further calculated. Finally, the theoretical motion model is verified with the motion simulation data of the planar six-hinge mechanism origami robot in SolidWorks and the experimental data of the physical model. This verification proves the feasibility of the theoretical analysis, simulation model, and physical model.

关键词： Solid modeling Analytical models Prototypes Kinematics Three-dimensional printing Mathematical models Data models

Mixture of Experts for Network Optimization: A Large Language Model-enabled Approach

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Du, Hongyang Liu, Guangyuan Lin, Yijing Niyato, Dusit Kang, Jiawen Xiong, Zehui Kim, Dong In The School of Computer Science and Engineering Nanyang Technological University Singapore639798 Singapore The State Key Laboratory of Networking and Switching Technology Beijing University of Posts and Telecommunications Beijing100876 China The School of Automation Guangdong University of Technology Key Laboratory of Intelligent Information Processing and System Integration of IoT Ministry of Education Guangzhou510006 China Guangdong-HongKong-Macao Joint Laboratory for Smart Discrete Manufacturing Guangzhou510006 China The Pillar of Information Systems Technology and Design Singapore University of Technology and Design Singapore487372 Singapore The Department of Electrical and Computer Engineering Sungkyunkwan University Suwon16419 Korea Republic of

Optimizing various wireless user tasks poses a significant challenge for networking systems because of the expanding range of user requirements. Despite advancements in Deep Reinforcement Learning (DRL), the need for customized optimization tasks for individual users complicates developing and applying numerous DRL models, leading to substantial computation resource and energy consumption and can lead to inconsistent outcomes. To address this issue, we propose a novel approach utilizing a Mixture of Experts (MoE) framework, augmented with Large Language Models (LLMs), to analyze user objectives and constraints effectively, select specialized DRL experts, and weigh each decision from the participating experts. Specifically, we develop a gate network to oversee the expert models, allowing a collective of experts to tackle a wide array of new tasks. Furthermore, we innovatively substitute the traditional gate network with an LLM, leveraging its advanced reasoning capabilities to manage expert model selection for joint decisions. Our proposed method reduces the need to train new DRL models for each unique optimization problem, decreasing energy consumption and AI model implementation costs. The LLM-enabled MoE approach is validated through a general maze navigation task and a specific network service provider utility maximization task, demonstrating its effectiveness and practical applicability in optimizing complex networking systems. © 2024, CC BY.

关键词： Reinforcement learning

Integration of Mixture of Experts and Multimodal Generative AI in Internet of Vehicles: A Survey

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Xu, Minrui Niyato, Dusit Kang, Jiawen Xiong, Zehui Jamalipour, Abbas Fang, Yuguang Kim, Dong In Shen, Xuemin The School of Computer Science and Engineering Nanyang Technological University Singapore639798 Singapore The School of Automation Guangdong University of Technology Key Laboratory of Intelligent Information Processing and System Integration of IoT Ministry of Education Guangzhou510006 China Guangdong-HongKong-Macao Joint Laboratory for Smart Discrete Manufacturing Guangzhou510006 China The Pillar of Information Systems Technology and Design Singapore University of Technology and Design Singapore487372 Singapore The School of Electrical and Information Engineering University of Sydney SydneyNSW2006 Australia Department of Computer Science City University of Hong Kong Kowloon Hong Kong The Department of Electrical and Computer Engineering Sungkyunkwan University Suwon16419 Korea Republic of The Department of Electrical and Computer Engineering University of Waterloo WaterlooONN2L 3G1 Canada

Generative AI (GAI) can enhance the cognitive, reasoning, and planning capabilities of intelligent modules in the Internet of Vehicles (IoV) by synthesizing augmented datasets, completing sensor data, and making sequential decisions. In addition, the mixture of experts (MoE) can enable the distributed and collaborative execution of AI models without performance degradation between connected vehicles. In this survey, we explore the integration of MoE and GAI to enable Artificial General Intelligence in IoV, which can enable the realization of full autonomy for IoV with minimal human supervision and applicability in a wide range of mobility scenarios, including environment monitoring, traffic management, and autonomous driving. In particular, we present the fundamentals of GAI, MoE, and their interplay applications in IoV. Furthermore, we discuss the potential integration of MoE and GAI in IoV, including distributed perception and monitoring, collaborative decision-making and planning, and generative modeling and simulation. Finally, we present several potential research directions for facilitating the integration. © 2024, CC BY.

关键词： Integration

Bayesian Optimization Framework for Efficient Fleet design in Autonomous Multi-Robot Exploration

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Concha, David Molina Li, Jiping Yin, Haoran Park, Kyeonghyeon Lee, Hyun-Rok Lee, Taesik Sirohi, Dhruv Lee, Chi-Guhn The Dynamic Optimization and Reinforcement Learning Laboratory The Department of Mechanical & Industrial Engineering University of Toronto TorontoONM5S3G8 Canada The Department of Electrical & Computer Engineering University of Toronto TorontoONM5S3G8 Canada The Division of Engineering Science The Faculty of Applied Science and Engineering University of Toronto TorontoONM5S3G8 Canada The Complex System Design Laboratory The Department of Industrial and Systems Engineering Korea Advanced Institute of Science and Technology Daejeon34141 Korea Republic of The Department of Industrial Engineering Inha University Incheon22212 Korea Republic of

This study addresses the challenge of fleet design optimization in the context of heterogeneous multi-robot fleets, aiming to obtain feasible designs that balance performance and costs. In the domain of autonomous multi-robot exploration, reinforcement learning agents play a central role, offering adaptability to complex terrains and facilitating collaboration among robots. However, modifying the fleet composition results in changes in the learned behavior, and training multi-robot systems using multi-agent reinforcement learning is expensive. Therefore, an exhaustive evaluation of each potential fleet design is infeasible. To tackle these hurdles, we introduce Bayesian Optimization for Fleet design (BOFD), a framework leveraging multiobjective Bayesian Optimization to explore fleets on the Pareto front of performance and cost while accounting for uncertainty in the design space. Moreover, we establish a sub-linear bound for cumulative regret, supporting BOFD’s robustness and efficacy. Extensive benchmark experiments in synthetic and simulated environments demonstrate the superiority of our framework over state-of-the-art methods, achieving efficient fleet designs with minimal fleet evaluations. Copyright © 2024, The Authors. All rights reserved.

关键词： Multipurpose robots

Resistive Memory-based Neural Differential Equation Solver for Score-based Diffusion Model

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Yang, Jichang Chen, Hegan Chen, Jia Wang, Songqi Wang, Shaocong Yu, Yifei Chen, Xi Wang, Bo Zhang, Xinyuan Cui, Binbin Li, Yi Lin, Ning Xu, Meng Li, Yi Xu, Xiaoxin Qi, Xiaojuan Wang, Zhongrui Zhang, Xumeng Shang, Dashan Wang, Han Liu, Qi Cheng, Kwang-Ting Liu, Ming Department of Electrical and Electronic Engineering the University of Hong Kong Hong Kong ACCESS – AI Chip Center for Emerging Smart Systems InnoHK Centers Hong Kong Science Park Hong Kong Laboratory of Microelectronic Devices and Integrated Technology Institute of Microelectronics Chinese Academy of Sciences Beijing100029 China State Key Laboratory of Integrated Chips and Systems Frontier Institute of Chip and System Fudan University Shanghai200433 China Institute of the Mind the University of Hong Kong Hong Kong University of Chinese Academy of Sciences Beijing100049 China School of Integrated Circuits Hubei Key Laboratory for Advanced Memories Huazhong University of Science and Technology Wuhan430074 China Department of Electronic and Computer Engineering the Hong Kong University of Science and Technology Hong Kong

Human brains image complicated scenes when reading a novel. Replicating this imagination is one of the ultimate goals of AI-Generated Content (AIGC). However, current AIGC methods, such as score-based diffusion, are still deficient in terms of rapidity and efficiency. This deficiency is rooted in the difference between the brain and digital computers. Digital computers have physically separated storage and processing units, resulting in frequent data transfers during iterative calculations, incurring large time and energy overheads. This issue is further intensified by the conversion of inherently continuous and analog generation dynamics, which can be formulated by neural differential equations, into discrete and digital operations. Inspired by the brain, we propose a time-continuous and analog in-memory neural differential equation solver for score-based diffusion, employing emerging resistive memory. The integration of storage and computation within resistive memory synapses surmount the von Neumann bottleneck, benefiting the generative speed and energy efficiency. The closed-loop feedback integrator is time-continuous, analog, and compact, physically implementing an infinite-depth neural network. Moreover, the software-hardware co-design is intrinsically robust to analog noise. We experimentally validate our solution with 180 nm resistive memory in-memory computing macros. Demonstrating equivalent generative quality to the software baseline, our system achieved remarkable enhancements in generative speed for both unconditional and conditional generation tasks, by factors of 64.8 and 156.5, respectively. Moreover, it accomplished reductions in energy consumption by factors of 5.2 and 4.1. Our approach heralds a new horizon for hardware solutions in edge computing for generative AI applications. © 2024, CC BY-NC-SA.

关键词： Diffusion

Continuous-Time Digital Twin with Analogue Memristive Neural Ordinary Differential Equation Solver

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Chen, Hegan Yang, Jichang Chen, Jia Wang, Songqi Wang, Shaocong Wang, Dingchen Tian, Xinyu Yu, Yifei Chen, Xi Lin, Yinan He, Yangu Wu, Xiaoshan Li, Yi Zhang, Xinyuan Lin, Ning Xu, Meng Li, Yi Zhang, Xumeng Wang, Zhongrui Wang, Han Shang, Dashan Liu, Qi Cheng, Kwang-Ting Liu, Ming Department of Electrical and Electronic Engineering The University of Hong Kong Hong Kong ACCESS – AI Chip Center for Emerging Smart Systems InnoHK Centers Hong Kong Science Park Hong Kong Institute of the Mind The University of Hong Kong Hong Kong Key Laboratory of Microelectronic Devices & Integrated Technology Institute of Microelectronics Chinese Academy of Sciences Beijing100029 China University of Chinese Academy of Sciences Beijing100049 China School of Integrated Circuits Hubei Key Laboratory for Advanced Memories Huazhong University of Science and Technology Wuhan430074 China State Key Laboratory of Integrated Chips and Systems Frontier Institute of Chip and System Fudan University Shanghai200433 China Department of Electronic and Computer Engineering The Hong Kong University of Science and Technology Hong Kong

Digital twins, the cornerstone of Industry 4.0, replicate real-world entities through computer models, revolutionising fields such as manufacturing management and industrial automation. Recent advances in machine learning provide data-driven methods for developing digital twins using discrete-time data and finite-depth models on digital computers. However, this approach fails to capture the underlying continuous dynamics and struggles with modelling complex system behaviour. Additionally, the architecture of digital computers, with separate storage and processing units, necessitates frequent data transfers and Analogue-Digital (A/D) conversion, thereby significantly increasing both time and energy costs. Here, we introduce a memristive neural ordinary differential equation (ODE) solver for digital twins, which is capable of capturing continuous-time dynamics and facilitates the modelling of complex systems using an infinite-depth model. By integrating storage and computation within analogue memristor arrays, we circumvent the von Neumann bottleneck, thus enhancing both speed and energy efficiency. We experimentally validate our approach by developing a digital twin of the HP memristor, which accurately extrapolates its nonlinear dynamics, achieving a 4.2-fold projected speedup and a 41.4-fold projected decrease in energy consumption compared to state-of-the-art digital hardware, while maintaining an acceptable error margin. Additionally, we demonstrate scalability through experimentally grounded simulations of Lorenz96 dynamics, exhibiting projected performance improvements of 12.6-fold in speed and 189.7-fold in energy efficiency relative to traditional digital approaches. By harnessing the capabilities of fully analogue computing, our breakthrough accelerates the development of digital twins, offering an efficient and rapid solution to meet the demands of Industry 4.0. © 2024, CC BY-NC-SA.

关键词： Energy utilization

Hierarchical Nb2o5@Zno Hetero-Branched Nanorods for Enhanced H2s Gas Sensing

学校读者我要写书评

暂无评论

SSRN

SSRN 2022年

作者： Wu, Tao Tao Zhu, Liyuan Wu, Xue-Yan Miao, Xiao-Yong Mao, Li-Wen Jin, Xuan-Hong Lu, Hong-Liang State Key Laboratory of ASIC and System Shanghai Institute of Intelligent Electronics & Systems School of Microelectronics Fudan University Shanghai 200433 China School of Optical-Electrical & Computer Engineering University of Shanghai for Science and Technology Shanghai 200093 China Yiwu Research Institute of Fudan University Chengbei Road Zhejiang Yiwu City322000 China

Hierarchical Nb 2 O 5 @ZnO hetero-branched nanorods used for highly responsive, selective, and stable hydrogen sulfide (H 2 S) sensors were synthesized through a sequential process combining a hydrothermal method, atomic-layer-deposition processing, and modified hydrothermal processing for branching ZnO nanowires. The Nb 2 O 5 @ZnO hetero-branched nanorod sensors exhibited a great response (R a /R g ) of 6.10 towards 20 ppm H 2 S at an optimal working temperature of 400 o C, whose resistance changing rate (~5.10) was 39.2- and 1.9-fold those of Nb 2 O 5 (~0.13) and Nb 2 O 5 @ZnO core-shell nanorod (~2.74) sensors, respectively. The heterojunction formed at the Nb 2 O 5 @ZnO interface and the characteristic reaction between ZnO and H 2 S effectively improved H 2 S sensing performance. Moreover, the branching of ZnO nanowires introduced abundant homojunctions and prominently enlarged the specific surface area, further increasing the response of hetero-branched sensors. Meanwhile, the Nb 2 O 5 @ZnO hetero-branched sensors maintained steady performance over a month, indicating good stability and repeatability. In a word, such hierarchical Nb 2 O 5 @ZnO hetero-branched nanorod gas sensors are promising for the development of sensitive and selective H 2 S detection. © 2022, The Authors. All rights reserved.

关键词： Zinc oxide