The scalability of control algorithms controlling industrial assembly lines either model-based or model-free is still a big barrier from the point of view of implementation. In this paper, various Deep Reinforcement l...
The scalability of control algorithms controlling industrial assembly lines either model-based or model-free is still a big barrier from the point of view of implementation. In this paper, various Deep Reinforcement learning (DRL) algorithms will be tested in a virtual environment of a generic industrial assembly line in terms of optimally with respect to optimal exact solutions, and computational time. The agents will take bigger rewards when they minimize the finishing time while maintaining constraints, such as time precedence between tasks. The control actions will be modeled as a task assignment matrix that assigns the tasks to be completed to specific workstations. Another control action is the resource allocation. Due to the big number of constraints, many actions will be unfeasible leading to a longer time of training of the agent to learn not to apply unfeasible actions, therefore action masking will be introduced to the DRL algorithms to reduce the action space only to the feasible actions, thereby significantly reducing training time. Proximal Policy Optimization (PPO) agent shows faster and more stable convergence to the optimal solution over the Deep-Q Network (DQN) family, including the double DQN and Dueling one.
We present a methodology for designing a dynamic controller with delayed output feedback for achieving non-collocated vibration suppression with a focus on the multi-frequency case. To synthesize the delay-based contr...
详细信息
We present a methodology for designing a dynamic controller with delayed output feedback for achieving non-collocated vibration suppression with a focus on the multi-frequency case. To synthesize the delay-based controller, we first remodel the system of equations as a delay-differential algebraic equation (DDAE) in such a way that existing tools for design of a static output feedback controller can be easily adapted. The problem of achieving non-collocated vibration suppression with sufficient damping is formulated as a constrained optimization problem of minimizing the spectral abscissa in the presence of zero-location constraints, with the constraints exhibiting polynomial dependence on its parameters. We transform the problem into an unconstrained one using elimination, following which we solve the resulting non-convex, non-smooth optimization problem.
Semantic communications represent a significant breakthrough with respect to the current communication paradigm, as they focus on recovering the meaning behind the transmitted sequence of symbols, rather than the symb...
详细信息
In the last years' digitalization process, the creation and management of documents in various domains, particularly in Public Administration (PA), have become increasingly complex and diverse. This complexity ari...
详细信息
Vehicle Make and Model Recognition (VMMR) is a pivotal task in various domains including surveillance, traffic management, and the automotive industry. Despite significant progress in deep learning approaches, existin...
详细信息
ISBN:
(数字)9798350387568
ISBN:
(纸本)9798350387575
Vehicle Make and Model Recognition (VMMR) is a pivotal task in various domains including surveillance, traffic management, and the automotive industry. Despite significant progress in deep learning approaches, existing VMMR systems still struggle to attain robust accuracy, particularly across diverse environments and viewing angles. In this paper, we propose a novel approach based on the fusion of two feature maps extracted from DenseNet201 and ResNet50V2 baseline models, respectively. Additionally, we employ a modified Convolutional Block Attention Module (CBAM) to enhance the resilience and precision of VMMR systems. By incorporating attention mechanisms in the feature extraction process, our modified CBAM model effectively captures both spatial and channel-wise dependencies, facilitating more potent discriminative feature representations. We assess our proposed approach through extensive experiments on two benchmark datasets namely Stanford Cars and CompCarsSV. Achieved accuracies are 93.51% and 99.03%, on Stanford Cars and CompCarsSV, respectively that are better than past methods. The code of our proposed model can be found at: https://***/JUVCSE/featurefusion.
In this paper, the objective for a group of unmanned aerial vehicle agents (UAVs) to achieve three dimensional circumnavigation around a moving target which information is made available to all agents in the group. Th...
In this paper, the objective for a group of unmanned aerial vehicle agents (UAVs) to achieve three dimensional circumnavigation around a moving target which information is made available to all agents in the group. The cooperative circumnavigation is to drive the UAVs to orbit around the target according to a given elliptical desired spatial formation. Due to the thrust limitation needed to fly the drone, existing cyclic pursuit algorithms cannot be extended directly to achieve this objective. Thus the proposed algorithm is worked out to take into account this constraint in order to achieve such objective. The drones are subject to unknown external disturbance, also the masses of those agent drones are assumed to be unknown. Furthermore, the communication cost can be decreased and the Zeno behavior is shown to be excluded. The proposed controller guarantees the bounded control effort irrespective of the external disturbance and model uncertainties of the drone. Numerical simulations are conducted to illustrate the efficacy of the approach.
Cancer disparities are adverse differences in cancer measures that exist among certain population groups. Given that the role they play not only in the disease prognosis but also in therapy response, there is an urgen...
详细信息
ISBN:
(数字)9798350371499
ISBN:
(纸本)9798350371505
Cancer disparities are adverse differences in cancer measures that exist among certain population groups. Given that the role they play not only in the disease prognosis but also in therapy response, there is an urgent need to understand what causes them. Most studies investigate these disparities by analyzing transcriptomic data and in particular miRNAs for their regulatory role, but only focusing on expression levels. To face this challenge we propose MIRROR, a new method which analyzes a differential co-expression network of miRNAs between patients’ cohorts, to study the role they play at the target genes’ level. Doing so, we can study the altered molecular mechanism that are linked to cancer disparities. The application of MIRROR to two different cases of cancer disparities has demonstrated its efficacy in identifying molecular players involved in the considered disparity, presenting itself as a viable option to approach this challenge.
The deployment of robots into human scenarios necessitates advanced planning strategies, particularly when we ask robots to operate in dynamic, unstructured environments. RoboCup offers the chance to deploy robots in ...
详细信息
This paper proposes a user selection scheme for federated learning (FL) over wireless networks to reduce communication time based on channel capacity. In particular, the edge server calculates the Shannon channel capa...
This paper proposes a user selection scheme for federated learning (FL) over wireless networks to reduce communication time based on channel capacity. In particular, the edge server calculates the Shannon channel capacity of each client for each round, and clients with a certain threshold capacity are randomly selected to participate in FL. We show that the convergence time of the proposed scheme outperformed that of the conventional scheme through computer simulation based on an image processing task under a wireless channel with pass-loss, shadowing, and Rician flat-fading. Moreover, the superiority of FL to centralized learning (CL) regarding total time is demonstrated theoretically and validated through computer simulation.
One major goal of digital twin technology applied in the Architecture, engineering, and Construction (AEC) Industry is the mapping of roads and road environments with their associated information. Such digital twins c...
详细信息
暂无评论