This paper deals with a cooperation communication problem (relay selection and power control) for mobile underwater acoustic communication networks. To achieve satisfactory transmission capacity, we propose a reinforc...
详细信息
This paper deals with a cooperation communication problem (relay selection and power control) for mobile underwater acoustic communication networks. To achieve satisfactory transmission capacity, we propose a reinforcement-learning-based cooperation communication scheme to efficiently resist the highly dynamic communication links and strongly unknown time-varying channel states caused by the mobility of Autonomous Underwater Vehicles (AUVs). Firstly, a particular Markov decision process is developed to model the dynamic relay selection process of mobile AUV in the unknown scenario. In the developed model, an experimental statistical-based partition mechanism is proposed to cope with the greatly increasing dimension of the state space caused by the mobility of AUV, reducing the search optimization difficulty. Secondly, a dual-thread reinforcement learning structure with actual and virtual learning threads is proposed to efficiently track the superior relay action. In the actual learning thread, the proposed improved probability greedy policy enables the AUV to strengthen the exploration for the reward information of potential superior relays on the current state. Meanwhile, in the virtual learning thread, the proposed upper-confidence-bound-index-based uncertainty estimation method can estimate the action-reward level of historical states. Consequently, the combination of actual and virtual learning threads can efficiently obtain satisfactory Q value information, thereby making superior relay decision-making in a short time. Thirdly, a power control mechanism is proposed to reuse the current observed action-reward information and transform the multiple unknown parameter nonlinear joint power optimization problem into a convex optimization problem, thereby enhancing network transmission capacity. Finally, simulation results verify the effectiveness of the proposed scheme. IEEE
The growing field of urban monitoring has increasingly recognized the potential of utilizing autonomous technologies,particularly in drone *** deployment of intelligent drone swarms offers promising solutions for enha...
详细信息
The growing field of urban monitoring has increasingly recognized the potential of utilizing autonomous technologies,particularly in drone *** deployment of intelligent drone swarms offers promising solutions for enhancing the efficiency and scope of urban condition *** this context,this paper introduces an innovative algorithm designed to navigate a swarm of drones through urban landscapes for monitoring *** primary challenge addressed by the algorithm is coordinating drone movements from one location to another while circumventing obstacles,such as *** algorithm incorporates three key components to optimize the obstacle detection,navigation,and energy efficiency within a drone ***,the algorithm utilizes a method to calculate the position of a virtual leader,acting as a navigational beacon to influence the overall direction of the ***,the algorithm identifies observers within the swarm based on the current *** further refine obstacle avoidance,the third component involves the calculation of angular velocity using fuzzy *** approach considers the proximity of detected obstacles through operational rangefinders and the target’s location,allowing for a nuanced and adaptable computation of angular *** integration of fuzzy logic enables the drone swarm to adapt to diverse urban conditions dynamically,ensuring practical obstacle *** proposed algorithm demonstrates enhanced performance in the obstacle detection and navigation accuracy through comprehensive *** results suggest that the intelligent obstacle avoidance algorithm holds promise for the safe and efficient deployment of autonomous mobile drones in urban monitoring applications.
The paper deals with complementary changes in scientific research and real economy (exemplified by the farming industry) taking place when using the holistic approach to the industry's digital transformation resul...
详细信息
Dear Editor,This letter is concerned with prescribed-time Nash equilibrium(PTNE)seeking problem in a pursuit-evasion game(PEG)involving agents with second-order *** order to achieve the prior-given and user-defined co...
详细信息
Dear Editor,This letter is concerned with prescribed-time Nash equilibrium(PTNE)seeking problem in a pursuit-evasion game(PEG)involving agents with second-order *** order to achieve the prior-given and user-defined convergence time for the PEG,a PTNE seeking algorithm has been developed to facilitate collaboration among multiple pursuers for capturing the evader without the need for any global ***,it is theoretically proved that the prescribedtime convergence of the designed algorithm for achieving Nash equilibrium of ***,the effectiveness of the PTNE method was validated by numerical simulation results.A PEG consists of two groups of agents:evaders and *** pursuers aim to capture the evaders through cooperative efforts,while the evaders strive to evade *** is a classic noncooperative *** has attracted plenty of attention due to its wide application scenarios,such as smart grids[1],formation control[2],[3],and spacecraft rendezvous[4].It is noteworthy that most previous research on seeking the Nash equilibrium of the game,where no agent has an incentive to change its actions,has focused on asymptotic and exponential convergence[5]-[7].
The Light-Fidelity (Li-Fi) is a wireless communication technology that is light-based and can complete wireless fidelity (Wi-Fi) technologies for many applications. Li-Fi technology which uses light spectrum is a tech...
详细信息
This paper presents a flexible Industrial Internet of Things (IIoT) infrastructure model, highlighting the integration of the Long Short-Term Memory (LSTM) algorithm for predictive analysis. A key component of this mo...
详细信息
controller optimization has mostly been done by minimizing a certain single cost *** practice,however,engineers must contend with multiple and conflicting considerations,denoted as design indices(DIs)in this *** to ac...
详细信息
controller optimization has mostly been done by minimizing a certain single cost *** practice,however,engineers must contend with multiple and conflicting considerations,denoted as design indices(DIs)in this *** to account for such complexity and nuances is detrimental to the applications of any advanced control *** paper addresses this challenge heads on,in the context of active disturbance rejection controller(ADRC)and with four competing DIs:stability margins,tracking,disturbance rejection,and noise *** this end,the lower bound for the bandwidth of the extended state observer is first established for guaranteed closed-loop ***,one by one,the mathematical formula is meticulously derived,connecting each DI to the set of controller *** our best knowledge,this has not been done in the context of *** formulas allow engineers to see quantitatively how the change of each tuning parameter would impact all of the DIs,thus making the guesswork *** example is given to show how such analytical methods can help engineers quickly determine controller parameters in a practical scenario.
In the paper, the authors check the behaviour of Bluetooth Low Energy protocol in a popular smart wristband and a microcontroller in the heart rate monitoring application. The measurements were collected using a devel...
详细信息
The paper presents a computer wireless fire-fighting system based on the ATmega 328 microcontroller. This system is capable of GSM-sending fire alerts to the user's mobile device, as well as accumulating data in t...
详细信息
Longer training times pose a significant challenge in artificial neural networks (ANNs) as it may leads to increasing the computational costs and decreasing the effectiveness of the model. Therefore, it is imperative ...
详细信息
暂无评论