This paper thoroughly explores the role of object detection in smart cities, specifically focusing on advancements in deep learning-based methods. Deep learning models gain popularity for their autonomous feature lear...
详细信息
aaaa The adaptive learning community seeks to provide solutions to customize and enhance students’ learning experiences when accessing web-basedlearningsystems. The adaptation usually occurs from the use of learnin...
详细信息
Curved river sections have complex water flow characteristics and difficulties in maneuvering ships through bends, which pose significant challenges to path planning and ship navigation control. The current path resea...
详细信息
This paper aims to solve an optimal tracking control(OTC) problem of large-scale systems with multitime scales and coupled subsystems using singular perturbation(sP) theory and reinforcement learning(RL) techniques. A...
详细信息
This paper aims to solve an optimal tracking control(OTC) problem of large-scale systems with multitime scales and coupled subsystems using singular perturbation(sP) theory and reinforcement learning(RL) techniques. A considerable contribution of this paper is the development of a data-driven sP-based RL method for the OTC of unknown large-scale systems with multitime scales. To achieve this, a multitime scale tracking problem was decomposed into a linear quadratic tracker problem for slow subsystems and a dynamical game problem for fast subsystems using the sP theory. Then, the distributed composite feedback controllers were found using a distributed off-policy integral RL algorithm that uses only measured data from the system in real time. Thus, the operational index can follow its prescribed target value via an approximately optimal approach. Theoretical analysis and proof are presented to demonstrate that the sum of the performances of reduced-order subsystems is approximately equal to the performance of the original large-scale system. Finally, numerical and practical examples are provided to validate the effectiveness of the proposed method.
In the new industrial revolution, the market demands integrated talents in new engineering fields. To meet the requirements of the new era for cultivating high-level talents in integrated disciplines, this paper takes...
详细信息
Reinforcement learning has been applied to air combat problems in recent years,and the idea of curriculum learning is often used for reinforcement learning,but traditional curriculum learningsuffers from the problem ...
详细信息
Reinforcement learning has been applied to air combat problems in recent years,and the idea of curriculum learning is often used for reinforcement learning,but traditional curriculum learningsuffers from the problem of plasticity loss in neural *** loss is the difficulty of learning new knowledge after the network has *** this end,we propose a motivational curriculum learning distributed proximal policy optimization(MCLDPPO)algorithm,through which trained agents can significantly outperform the predictive game tree and mainstream reinforcement learning *** motivational curriculum learning is designed to help the agent gradually improve its combat ability by observing the agent's unsatisfactory performance and providing appropriate rewards as a ***,a complete tactical maneuver is encapsulated based on the existing air combat knowledge,and through the flexible use of these maneuvers,some tactics beyond human knowledge can be *** addition,we designed an interruption mechanism for the agent to increase the frequency of decisionmaking when the agent faces an *** the number of threats received by the agent changes,the current action is interrupted in order to reacquire observations and make decisions *** the interruption mechanism can significantly improve the performance of the *** simulate actual air combat better,we use digital twin technology to simulate real air battles and propose a parallel battlefield mechanism that can run multiple simulation environmentssimultaneously,effectively improving data *** experimental results demonstrate that the agent can fully utilize the situational information to make reasonable decisions and provide tactical adaptation in the air combat,verifying the effectiveness of the algorithmic framework proposed in this paper.
Accurate operational methods used to measure, verify, and report changes in biomass at large spatial scales are required to support conservation initiatives. In thisstudy, we demonstrate that machine learning can be ...
详细信息
Accurate operational methods used to measure, verify, and report changes in biomass at large spatial scales are required to support conservation initiatives. In thisstudy, we demonstrate that machine learning can be used to model aboveground biomass (AGB) in both tropical and temperate forest ecosystems when provided with a sufficiently large training dataset. Using wavelet-transformed airborne hyperspectral imagery, we trained a shallow neural network (sNN) to model AGB. An existing global AGB map developed as part of the European space Agency's DUE GlobBiomassprojectserved as the training data for all study sites. At the temperate site, we also trained the model on airborne-LiDAR-derived AGB. In comparison, for all study sites, we also trained a separate deep convolutional neural network (3D-CNN) with the hyperspectral imagery. Our resultsshow that extracting both spatial and spectral features with the 3D-CNN produced the lowest RMsE across all study sites. For example, at the tropical forest site the Tortuguero conservation area, with the 3D-CNN, an RMsE of 21.12 Mg/ha (R-2 of 0.94) was reached in comparison to the sNN model, which had an RMsE of 43.47 Mg/ha (R-2 0.72), accounting for a similar to 50% reduction in prediction uncertainty. The 3D-CNN models developed for the other tropical and temperate sites produced similar results, with a range in RMsE of 13.5 Mg/ha-31.18 Mg/ha. In the future, assufficiently large field-based datasets become available (e.g., the national forest inventory), a 3D-CNN approach could help to reduce the uncertainty between hyperspectral reflectance and forest biomass estimates across tropical and temperate bioclimatic domains.
The growing prevalence of uncertainty in global events posessignificant challenges to economic cycle forecasting, emphasizing the need for more robust predictive models. Thisstudy addresses this gap by developing a ...
详细信息
The growing prevalence of uncertainty in global events posessignificant challenges to economic cycle forecasting, emphasizing the need for more robust predictive models. Thisstudy addresses this gap by developing a novel forecasting framework that integrates multiple uncertainty indices to improve accuracy, stability, and interpretability, particularly during uncertainty shocks. To achieve this, several methodological innovations were implemented. First, newssentiment-based uncertainty indices were incorporated as candidate variables to capture uncertainty dynamics. second, Bayesian least absolute shrinkage and selection operator (Bayesian LAssO) was employed for efficient variable selection, mitigating the curse of dimensionality in small samples. Third, the multi-objective Lichtenberg algorithm (MOLA) was applied to optimize the prediction window size, ensuring model robustness. Additionally, a MOLA-based extreme gradient boosting (MOLA-XGBoost) model was developed to fine-tune hyperparameters across dimensions of prediction accuracy, stability, and directional consistency. Finally, sHapley Additive exPlanations (sHAP) theory was used to enhance model interpretability. Thisstudy forecasts China's economic cycle using multiple indicators, demonstrating that the proposed approach consistently delivers accurate and robust predictions even under uncertainty shocks. The findings highlight the crucial role of uncertainty indices in improving economic forecasts, offering new insights and methodologies for predictive modeling in volatile environments.
The increasing sophistication and volume of malware have made it a growing concern in the field of cybersecurity. Traditional detection techniques are becoming less effective as malware continues to evolve, making it ...
详细信息
Meta-heuristic optimization algorithms have become widely used due to their outstanding features, such as gradient-free mechanisms, high flexibility, and great potential for avoiding local optimal solutions. This rese...
详细信息
暂无评论