We develop controllers for Connected and Automated Vehicles (CAVs) traversing a single-lane roundabout so as to simultaneously determine the optimal sequence and associated optimal motion control jointly minimizing tr...
详细信息
The attention mechanism has become a pivotal component in artificial intelligence, significantly enhancing the performance of deep learning applications. However, its quadratic computational complexity and intricate c...
详细信息
The attention mechanism has become a pivotal component in artificial intelligence, significantly enhancing the performance of deep learning applications. However, its quadratic computational complexity and intricate computations lead to substantial inefficiencies when processing long sequences. To address these challenges, we introduce Attar, a resistive random access memory(RRAM)-based in-memory accelerator designed to optimize attention mechanisms through software-hardware co-optimization. Attar leverages efficient Top-k pruning and quantization strategies to exploit the sparsity and redundancy of attention matrices, and incorporates an RRAM-based in-memory softmax engine by harnessing the versatility of the RRAM crossbar. Comprehensive evaluations demonstrate that Attar achieves a performance improvement of up to 4.88× and energy saving of 55.38% over previous computing-in-memory(CIM)-based accelerators across various models and datasets while maintaining comparable accuracy. This work underscores the potential of in-memory computing to enhance the efficiency of attention-based models without compromising their effectiveness.
The in-memory computing(IMC) architecture implemented by non-volatile memory units shows great possibilities to break the traditional von Neumann bottleneck. In this paper, a 3D IMC architecture is proposed whose unit...
详细信息
The in-memory computing(IMC) architecture implemented by non-volatile memory units shows great possibilities to break the traditional von Neumann bottleneck. In this paper, a 3D IMC architecture is proposed whose unit is based on a multi-bit content-addressable memory(MCAM). The MCAM unit is comprised of two 65 nm flash memory and two transistors(2Flash2T), which is reconfigurable and multifunctional for both data write/search and XNOR logic operation. Moreover, the MCAM array can also support the population count(POPCOUNT) operation, which can be beneficial for the training and inference process in binary neural network(BNN) computing. Based on the well-known MNIST dataset, the proposed 3D MCAM architecture shows a 98.63% recognition accuracy and a 300% noise-tolerant performance without significant accuracy deterioration. Our findings can provide the potential for developing highly energy-efficient BNN computing for complex artificial intelligence(AI) tasks based on flash-based MCAM units.
This paper presents an overview of the state of the art for safety-critical optimal control of autonomous *** control methods are well studied,but become computationally infeasible for real-time applications when ther...
详细信息
This paper presents an overview of the state of the art for safety-critical optimal control of autonomous *** control methods are well studied,but become computationally infeasible for real-time applications when there are multiple hard safety constraints *** guarantee such safety constraints,it has been shown that optimizing quadratic costs while stabilizing affine control systems to desired(sets of)states subject to state and control constraints can be reduced to a sequence of Quadratic Programs(QPs)by using Control Barrier Functions(CBFs)and Control Lyapunov Functions(CLFs).The CBF method is computationally efficient,and can easily guarantee the satisfaction of nonlinear constraints for nonlinear systems,but its wide applicability still faces several ***,safety is hard to guarantee for systems with high relative degree,and the above mentioned QPs can easily be infeasible if tight or time-varying control bounds are *** resulting solution is also sub-optimal due to its myopic solving ***,this method works conditioned on the system dynamics being accurately *** authors discuss recent solutions to these issues and then present a framework that combines Optimal Control with CBFs,hence termed OCBF,to obtain near-optimal solutions while guaranteeing safety constraints even in the presence of noisy *** application of the OCBF approach is included for autonomous vehicles in traffic networks.
Recent decades have witnessed a trend that the echo state network(ESN)is widely utilized in field of time series prediction due to its powerful computational ***,most of the existing research on ESN is conducted under...
详细信息
Recent decades have witnessed a trend that the echo state network(ESN)is widely utilized in field of time series prediction due to its powerful computational ***,most of the existing research on ESN is conducted under the assumption that data is free of noise or polluted by the Gaussian noise,which lacks robustness or even fails to solve real-world *** work handles this issue by proposing a probabilistic regularized ESN(PRESN)with robustness ***,we design a novel objective function for minimizing both the mean and variance of modeling error,and then a scheme is derived for getting output weights of the ***,generalization performance,robustness,and unbiased estimation abilities of the PRESN are revealed by theoretical ***,experiments on a benchmark dataset and two real-world datasets are conducted to verify the performance of the proposed *** source code is publicly available at https://***/LongJinlab/probabilistic-regularized-echo-state-network.
Amidst the pressing need to combat climate change and curb greenhouse gas (GHG) emissions, the building sector emerges as a pivotal sector, substantially impacting worldwide emissions. Despite efforts to improve energ...
详细信息
We consider a class of multi-agent optimal coverage problems in which the goal is to determine the optimal placement of a group of agents in a given mission space so that they maximize a coverage objective that repres...
详细信息
This paper investigates the cooperative output regulation problem of heterogeneous linear multi-agent systems over directed graphs with the constraint of communication *** that there exists an exosystem whose state in...
详细信息
This paper investigates the cooperative output regulation problem of heterogeneous linear multi-agent systems over directed graphs with the constraint of communication *** that there exists an exosystem whose state information is not available to all agents,the authors develop distributed adaptive event-triggered observers for the followers based on relative information between neighboring *** should be pointed out that,two kinds of time-varying gains are introduced to avoid relying on any global information associated with the network,and dynamic triggering conditions are designed to get rid of continuous *** the basis of the designed observers,the authors devise a local controller for each *** with the existing related works,the main contribution of the current paper is that the cooperative output regulation problem for general directed graphs is solved requiring neither global information nor continuous communications.
Proximal gradient algorithms are popularly implemented to achieve convex optimization with nonsmooth regularization. Obtaining the exact solution of the proximal operator for nonsmooth regularization is challenging be...
详细信息
Proximal gradient algorithms are popularly implemented to achieve convex optimization with nonsmooth regularization. Obtaining the exact solution of the proximal operator for nonsmooth regularization is challenging because errors exist in the computation of the gradient; consequently, the design and application of inexact proximal gradient algorithms have attracted considerable attention from researchers. This paper proposes computationally efficient basic and inexact proximal gradient descent algorithms with random reshuffling. The proposed stochastic algorithms take randomly reshuffled data to perform successive gradient descents and implement only one proximal operator after all data pass through. We prove the convergence results of the proposed proximal gradient algorithms under the sampling-without-replacement reshuffling *** computational errors exist in gradients and proximal operations, the proposed inexact proximal gradient algorithms can converge to an optimal solution neighborhood. Finally, we apply the proposed algorithms to compressed sensing and compare their efficiency with some popular algorithms.
This paper introduces a motion planning and cooperative formation control approach for quadruped robots and multi-agent ***,in order to improve the efficiency and safety of quadruped robots navigating in complex envir...
详细信息
This paper introduces a motion planning and cooperative formation control approach for quadruped robots and multi-agent ***,in order to improve the efficiency and safety of quadruped robots navigating in complex environments,this paper proposes a new planning method that combines the dynamic model of quadruped robots and a gradient-optimized obstacle avoidance strategy without Euclidean Signed Distance *** framework is suitable for both static and slow dynamic obstacle environments,aiming to achieve multiple goals of obstacle avoidance,minimizing energy consumption,reducing impact,satisfying dynamic constraints,and ensuring trajectory *** approach differs in that it reduces energy consumption throughout the movement from a new ***,this method effectively reduces the impact of the ground on the robot,thus mitigating the damage to its ***,we combine the dynamic control barrier function and the virtual leader-follower model to achieve efficient and safe formation control through model predictive ***,the proposed algorithm is validated through both simulations and real-world scenarios testing.
暂无评论