The escalating prevalence of violent crimes and accidents underscores the urgent need for efficient and timely monitoring systems. Traditional methods reliant on administrative reports often suffer from significant de...
详细信息
sparse rewards pose significant challenges in deep reinforcement learning as agentsstruggle to learn from experiences with limited reward *** experience replay(HER)addresses this problem by creating“small goals”wit...
详细信息
sparse rewards pose significant challenges in deep reinforcement learning as agentsstruggle to learn from experiences with limited reward *** experience replay(HER)addresses this problem by creating“small goals”within a hierarchical decision ***,HER does not consider the value of different episodes for agent *** this paper,we propose sPAHER,a framework for prioritizing hindsight experiencesbased on spatial position *** allows the agent to prioritize more valuable experiences in a manipulation *** achieves this by calculating transition and trajectory spatial position functions to determine the value of each episode for experience *** evaluate sPAHER on eight robot manipulation tasks in the Fetch and Hand environments provided by OpenAI *** resultsshow that our method improves the final mean success rate by an average of 3.63%compared to HER,especially in challenging Hand ***,these improvements are achieved without any increase in computation time.
segmentation is a critical step in computer-aided diagnosis (CAD) systems for skin lesion classification. In thisstudy, we applied the Deeplabv3+ network to segment real dermoscopic images. The model was trained on p...
详细信息
Bike sharing systems (Bss) represent a sustainable and efficient urban transportation solution. A major challenge in Bss is repositioning bikes to avoid shortage events when users encounter empty or full bike lockers....
详细信息
Bike sharing systems (Bss) represent a sustainable and efficient urban transportation solution. A major challenge in Bss is repositioning bikes to avoid shortage events when users encounter empty or full bike lockers. Existing algorithms unrealistically rely on precise demand forecasts and tend to overlook substantial operational costs associated with reallocations. This paper introduces a novel Cost-aware Adaptive Bike Repositioning Agent (CABRA), which harnesses advanced deep reinforcement learning techniques in dock-based Bss. By analyzing demand patterns, CABRA learns adaptive repositioning strategies aimed at reducing shortages and enhancing truck route planning efficiency, significantly lowering operational costs. We perform an extensive experimental evaluation of CABRA utilizing real-world data from Dublin, London, Paris, and New York. The reported resultsshow that CABRA achieves operational efficiency that outperforms or matches very challenging baselines, obtaining a significant cost reduction. Its performance on the largest city comprising 1765 docking stations highlights the efficiency and scalability of the proposed solution even when applied to Bss with a great number of docking stations.
This work demonstrates the use of Deep learning-basedcomputer Vision for Remanufacturing end-of-life consumer electronics products, considering smartphones as the use-case. We implemented automated detection of scree...
详细信息
Keratitis is an intraocular disease that is an inflammation of the cornea and one of the challenges of ophthalmology due to its multifarious character and mild initial symptoms. In this paper, we present KeraNet Deep ...
详细信息
Improving the current level of skill in seasonal climate prediction is urgent for achieving sustainable socioeconomic development, and this is especially true in China where meteorological disasters are experienced fr...
详细信息
Improving the current level of skill in seasonal climate prediction is urgent for achieving sustainable socioeconomic development, and this is especially true in China where meteorological disasters are experienced frequently. In thisstudy, based upon big climate data and traditional statistical prediction experiences, a merged machine learning model(Y-model) was developed to address this, as well as to further explore unknown potential predictors. In Y-model, empirical orthogonal function analysis was firstly applied to reduce the data dimensionality of the target predictand(temperature and precipitation in the four seasons over China). Image recognition techniques were used to automatically identify possible predictors from the big climate data. These predictors, associated with significant circulation anomalies, were recombined into a large ensemble according to different threshold settings for five factors determining the statistical forecast skill. Facebook Prophet was chosen to conduct the independent hindcasts for each season's climate at a lead time of two months. During 2011–2022, the seasonal climate in China wasskillfully predicted by Y-model, with an averaged pattern correlation coefficient skill of 0.60 for temperature and 0.24 for precipitation, outperforming CFsv2. Potential predictor analysis for recent extreme eventssuggested that prior signals from the Indian Ocean and the stratosphere were important for determining the super Mei-yu in 2020, while the prior sea surface temperature over the western Pacific and the soil temperature over West Asia may have contributed to the extreme high temperatures in 2022. Our study provides new insights for seasonal climate prediction in China.
In today's world, energy efficiency in buildings has become a top priority due to the significant energy waste caused by the operation of inefficient electrical appliances. Conventional methods of reducing energy ...
详细信息
In today's world, energy efficiency in buildings has become a top priority due to the significant energy waste caused by the operation of inefficient electrical appliances. Conventional methods of reducing energy waste cause discomfort for occupants inside buildings. One promising way to optimize energy consumption is to synchronize appliance operation with building occupants' dynamic behavior. Internet of Things (IoT) technologies, which allow for widespread data collection and execution of Machine learning (ML) algorithms, enabled the creation of smart Buildings (sBs). sBs can learn patterns from the inhabitant's behavior residing in, and adjust their operations in accordance with these behaviors. By doing so, these sBs could reduce energy waste, enhancing resource efficiency and consequently reduce CO2 gas emissions. Furthermore, they could improve the overall comfort of the living environment and help with sustainability initiatives. In this context, this paper proposes a novel approach that uses a hybrid deep-learning model to recognize complex human activitiesbased on data collected from ultra-wideband (UWB) radar technology. Our approach, called Hybrid Deep learning Model for Activity Recognition (HDL4AR), includes long-short-term memory (LsTM) and a one-dimensional convolutional neural network (1D-CNN). We deploy a real-time case study by collecting data from 22 participants involved in 10 diverse activities at the headquarters of the ICAR-CNR in the IoT Laboratory, Italy. Moreover, we conducted a comprehensive benchmark of the HDL4AR approach against variousstatistical techniques and other deep learning models recently introduced in the literature. Resultsshow that our proposed approach outperformed conventional methods and achieved an impressive accuracy of 98.42%.
The application of high-resolution satellite images in deep learning-based change detection methods has become increasingly popular. However, the down-sampling and cropping strategies deployed to fit the GPU memory co...
详细信息
The realization of trustworthy artificial intelligence strongly relies on privacy, fairness, and accountability requirements. Although model trustworthiness results from the synergy between these requirements, some ef...
详细信息
暂无评论