检索结果-内蒙古大学图书馆

A multi-objective deep reinforcement learning algorithm for spatio-temporal latency optimization in mobile IoT-enabled edge computing networks

引用

Simulation Modelling Practice and Theory 2025年 143卷

作者： Parisa Khoshvaght Amir Haider Amir Masoud Rahmani Farhad Soleimanian Gharehchopogh Ferzat Anka Jan Lansky Mehdi Hosseinzadeh Institute of Research and Development Duy Tan University Da Nang Vietnam School of Engineering & Technology Duy Tan University Da Nang Vietnam Centre for Research Impact & Outcome Chitkara University Institute of Engineering and Technology Chitkara University Rajpura 140401 Punjab India Department of AI and Robotics Sejong University Seoul 05006 Republic of Korea Future Technology Research Center National Yunlin University of Science and Technology Yunlin Taiwan Department of Computer Engineering Ur. C. Islamic Azad University Urmia Iran Data Science Application and Research Center (VEBIM) Fatih Sultan Mehmet Vakif University Istanbul Türkiye Department of Computer Science and Mathematics Faculty of Economic Studies University of Finance and Administration Prague Czech Republic Pattern Recognition and Machine Learning Laboratory School of Computing Gachon University Seongnam Republic of Korea

The rapid increase in Mobile Internet of Things (IoT) devices requires novel computational frameworks. These frameworks must meet strict latency and energy efficiency requirements in Edge and Mobile Edge Computing (MEC) systems. Spatio-temporal dynamics, which include the position of edge servers and the timing of task schedules, pose a complex optimization problem. These challenges are further exacerbated by the heterogeneity of IoT workloads and the constraints imposed by device mobility. The balance between computational overhead and communication challenges is also a problem. To solve these issues, advanced methods are needed for resource management and dynamic task scheduling in mobile IoT and edge computing environments. In this paper, we propose a Deep Reinforcement learning (DRL) multi-objective algorithm, called a Double Deep Q-learning (DDQN) framework enhanced with Spatio-temporal mobility prediction, latency-aware task offloading, and energy-constrained IoT device trajectory optimization for federated edge computing networks. DDQN was chosen for its optimize stability and reduced overestimation in Q-values. The framework employs a reward-driven optimization model that dynamically prioritizes latency-sensitive tasks, minimizes task migration overhead, and balances energy efficiency across devices and edge servers. It integrates dynamic resource allocation algorithms to address random task arrival patterns and real-time computational demands. Simulations demonstrate up to a 35 % reduction in end-to-end latency, a 28 % improvement in energy efficiency, and a 20 % decrease in the deadline-miss ratio compared to benchmark algorithms.

关键词：

来源：评论

学校读者我要写书评

暂无评论

LimeSoDa: A dataset collection for benchmarking of machine learning regressors in digital soil mapping

引用

Geoderma 2025年 459卷

作者： Schmidinger, Jonas Vogel, Sebastian Barkov, Viacheslav Pham, Anh-Duy Gebbers, Robin Tavakoli, Hamed Correa, Jose Tavares, Tiago R. Filippi, Patrick Jones, Edward J. Lukas, Vojtech Boenecke, Eric Ruehlmann, Joerg Schroeter, Ingmar Kramer, Eckart Paetzold, Stefan Kodaira, Masakazu Wadoux, Alexandre M.J.-C. Bragazza, Luca Metzger, Konrad Huang, Jingyi Valente, Domingos S.M. Safanelli, Jose L. Bottega, Eduardo L. Dalmolin, Ricardo S.D. Farkas, Csilla Steiger, Alexander Horst, Taciara Z. Ramirez-Lopez, Leonardo Scholten, Thomas Stumpf, Felix Rosso, Pablo Costa, Marcelo M. Zandonadi, Rodrigo S. Wetterlind, Johanna Atzmueller, Martin Osnabrück University Joint Lab Artificial Intelligence and Data Science Osnabrück Germany Department of Agromechatronics Potsdam Germany Piracicaba Brazil The University of Sydney Sydney Institute of Agriculture Sydney Australia Mendel University in Brno Department of Agrosystems and Bioclimatology Brno Czech Republic Leibniz Institute of Vegetable and Ornamental Crops Next Generation Horticultural Systems Grossbeeren Germany Eberswalde University for Sustainable Development Landscape Management and Nature Conservation Eberswalde Germany —Soil Science and Soil Ecology Bonn Germany Tokyo University of Agriculture and Technology Institute of Agriculture Tokyo Japan LISAH Univ. Montpellier AgroParisTech INRAE IRD L'Institut Agro Montpellier France Agroscope Field-Crop Systems and Plant Nutrition Nyon Switzerland University of Wisconsin-Madison Department of Soil Science Madison United States Federal University of Viçosa Department of Agricultural Engineering Viçosa Brazil Woodwell Climate Research Center Falmouth United States Academic Coordination Santa Maria Brazil Soil Department Santa Maria Brazil Division of Environment and Natural Resources Aas Norway University of Rostock Chair of Geodesy and Geoinformatics Rostock Germany Federal Technological University of Paraná Dois Vizinhos Brazil BÜCHI Labortechnik AG Data Science Department Flawil Switzerland Imperial College London Imperial College Business School London United Kingdom University of Tübingen Department of Geosciences Tübingen Germany University of Tübingen DFG Cluster of Excellence ‘Machine Learning for Science’ Germany Bern University of Applied Sciences Competence Center for Soils Zollikofen Switzerland Simulation and Data Science Müncheberg Germany Federal University of Jataí Institute of Agricultural Sciences Jatai Brazil Federal University of Mato Grosso Instute of Agricultural and Environmental Scinces Sinop Brazil Department of Soil and Environment Skara S

Digital soil mapping (DSM) relies on a broad pool of statistical methods, yet determining the optimal method for a given context remains challenging and contentious. Benchmarking studies on multiple datasets are needed to reveal strengths and limitations of commonly used methods. Existing DSM studies usually rely on a single dataset with restricted access, leading to incomplete and potentially misleading conclusions. To address these issues, we introduce an open-access dataset collection called Precision Liming Soil datasets (LimeSoDa). LimeSoDa consists of 31 field- and farm-scale datasets from various countries. Each dataset has three target soil properties: (1) soil organic matter or soil organic carbon, (2) clay content and (3) pH, alongside a set of features. Features are dataset-specific and were obtained by optical spectroscopy, proximal- and remote soil sensing. All datasets were aligned to a tabular format and are ready-to-use for modeling. We demonstrated the use of LimeSoDa for benchmarking by comparing the predictive performance of four learning algorithms across all datasets. This comparison included multiple linear regression (MLR), support vector regression (SVR), categorical boosting (CatBoost) and random forest (RF). The results showed that although no single algorithm was universally superior, certain algorithms performed better in specific contexts. MLR and SVR performed better on high-dimensional spectral datasets, likely due to better compatibility with principal components. In contrast, CatBoost and RF exhibited considerably better performances when applied to datasets with a moderate number ( © 2025 The Author(s)

关键词： Random forests

来源：评论

学校读者我要写书评

暂无评论

Stroke Home Rehabilitation Approach Using Mobile Application Based on PostNet machine learning Model 23

Stroke Home Rehabilitation Approach Using Mobile Application...

引用

7th International Conference on Medical and Health Informatics, ICMHI 2023

作者： Das, Utpal Chandra Le, Ngoc Thien Benjapolakul, Watit Vitoonpong, Timporn Pluempitiwiriyawej, Charnchai Center of Excellence in Artificial Intelligence Machine Learning and Smart Grid Technology Department of Electrical Engineering Chulalongkorn University Bangkok10330 Thailand Department of Rehabilitation Medicine Faculty of Medicine Chulalongkorn University Bangkok10330 Thailand Multimedia Data Analytics and Processing Research Unit Department of Electrical Engineering Faculty of Engineering Chulalongkorn University Bangkok10330 Thailand

ISBN: (纸本)9798400700712

Stroke is a significant cause of mortality and disability globally, with its occurrence in the human brain and motor function being linked to various parts of the human body. Stroke victims often experience disabilities or mobility problems in affected body parts, either on one or both sides of the body. Physiotherapy exercises are the primary treatment and medication for stroke patients, necessitating daily monitoring by a physiotherapist. However, this approach is expensive, and rehabilitation centers and physicians are scarce. Numerous research studies have been conducted to address this issue from various perspectives. This study proposes a Convolutional Neural Network (CNN) based pose net machine learning (ML) model for stroke home rehabilitation using pose detection and classification with a skeleton base model and human pose estimation drawing. We trained our ML model using different human pose images for this model. The tested accuracy of our CNN model is 100% for our exercise pose image test case. Later we build and mobile application for remote rehabilitation. Tested the application with ten different subjects, achieving a 98% for elbow extension, and in the case of elbow flexion and Normal position of balancing both sides, all the persons achieved a 100 % accuracy rate under a laboratory environment. © 2023 ACM.

关键词： Patient treatment

来源：评论

学校读者我要写书评

暂无评论

ReInform: Selecting paths with reinforcement learning for contextualized link prediction

arXiv

引用

arXiv 2022年

作者： Speranskaya, Marina Methias, Sameh Roth, Benjamin Center for Information and Language Processing LMU Munich Germany Technical University of Munich Munich Germany Research Group Data Mining and Machine Learning University of Vienna Vienna Austria

We propose to use reinforcement learning to inform transformer-based contextualized link prediction models by providing paths that are most useful for predicting the correct answer. This is in contrast to previous approaches, that either used reinforcement learning (RL) to directly search for the answer, or based their prediction on limited or randomly selected context. Our experiments on WN18RR and FB15k-237 show that contextualized link prediction models consistently outperform RL-based answer search, and that additional improvements (of up to 13.5% MRR) can be gained by combining RL with a link prediction model. The PyTorch implementation of the RL agent is available at https://***/marina-sp/reinform. Copyright © 2022, The Authors. All rights reserved.

关键词： Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

Region-Aware Metric learning for Open World Semantic Segmentation via Meta-Channel Aggregation

arXiv

引用

arXiv 2022年

作者： Dong, Hexin Chen, Zifan Yuan, Mingze Xie, Yutong Zhao, Jie Yu, Fei Dong, Bin Zhang, Li Center for Data Science Peking University Beijing China National Biomedical Imaging Center Peking University Beijing China Center for Machine Learning Research Peking University Beijing China Peking University Beijing China

As one of the most challenging and practical segmentation tasks, open-world semantic segmentation requires the model to segment the anomaly regions in the images and incrementally learn to segment out-of-distribution (OOD) objects, especially under a few-shot condition. The current state-of-the-art (SOTA) method, Deep Metric learning Network (DMLNet), relies on pixel-level metric learning, with which the identification of similar regions having different semantics is difficult. Therefore, we propose a method called region-aware metric learning (RAML), which first separates the regions of the images and generates region-aware features for further metric learning. RAML improves the integrity of the segmented anomaly regions. Moreover, we propose a novel meta-channel aggregation (MCA) module to further separate anomaly regions, forming high-quality sub-region candidates and thereby improving the model performance for OOD objects. To evaluate the proposed RAML, we have conducted extensive experiments and ablation studies on Lost And Found and Road Anomaly datasets for anomaly segmentation and the CityScapes dataset for incremental few-shot learning. The results show that the proposed RAML achieves SOTA performance in both stages of open world segmentation. Our code and appendix are available at https://***/czifan/RAML. Copyright © 2022, The Authors. All rights reserved.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

BLESSEMFLOOD21: ADVANCING FLOOD analysis WITH A HIGH-RESOLUTION GEOREFERENCED dataSET FOR HUMANITARIAN AID SUPPORT

arXiv

引用

arXiv 2024年

作者： Polushko, Vladyslav Jenal, Alexander Bongartz, Jens Weber, Immanuel Hatic, Damjan Rösch, Ronald März, Thomas Rauhut, Markus Weinmann, Andreas Image Processing Department Fraunhofer ITWM Kaiserslautern Germany Working Group Algorithms for Computer Vision Imaging and Data Analysis Hochschule Darmstadt Darmstadt Germany Center for Machine Learning and Sensor Technology Hochschule Koblenz Remagen Germany

Floods are an increasingly common global threat, causing emergencies and severe damage to infrastructure. During crises, organisations such as the World Food Programme use remotely sensed imagery, typically obtained through drones, for rapid situational analysis to plan life-saving actions. Computer Vision tools are needed to support task force experts on-site in the evaluation of the imagery to improve their efficiency and to allocate resources strategically. We introduce the BlessemFlood21 dataset to stimulate research on efficient flood detection tools. The imagery was acquired during the 2021 Erftstadt-Blessem flooding event and consists of high-resolution and georeferenced RGB-NIR images. In the resulting RGB dataset, the images are supplemented with detailed water masks, obtained via a semi-supervised human-in-the-loop technique, where in particular the NIR information is leveraged to classify pixels as either water or non-water. We evaluate our dataset by training and testing established Deep learning models for semantic segmentation. With BlessemFlood21 we provide labeled high-resolution RGB data and a baseline for further development of algorithmic solutions tailored to flood detection in RGB imagery. © 2024, CC BY-NC-ND.

关键词： Floods

来源：评论

学校读者我要写书评

暂无评论

An improved finite-time analysis of temporal difference learning with deep neural networks 24

An improved finite-time analysis of temporal difference lear...

引用

Proceedings of the 41st International Conference on machine learning

作者： Zhifa Ke Zaiwen Wen Junyu Zhang Center for Data Science Peking University China Beijing International Center for Mathematical Research Center for Machine Learning Research and Changsha Institute for Computing and Digital Economy Beijing China Department of Industrial Systems Engineering and Management National University of Singapore Singapore

Temporal difference (TD) learning algorithms with neural network function parameterization have well-established empirical success in many practical large-scale reinforcement learning tasks. However, theoretical understanding of these algorithms remains challenging due to the nonlinearity of the action-value approximation. In this paper, we develop an improved nonasymptotic analysis of the neural TD method with a general L-layer neural network. New proof techniques are developed and an improved new Õ(ε-1) sample complexity is derived. To our best knowledge, this is the first finite-time analysis of neural TD that achieves an Õ(ε-1) complexity under the Markovian sampling, as opposed to the best known Õ(ε-2) complexity in the existing literature.

关键词：

来源：评论

学校读者我要写书评

暂无评论

An Improved Finite-time analysis of Temporal Difference learning with Deep Neural Networks

arXiv

引用

arXiv 2024年

作者： Ke, Zhifa Wen, Zaiwen Zhang, Junyu Center for Data Science Peking University China Beijing International Center for Mathematical Research Center for Machine Learning Research Changsha Institute for Computing and Digital Economy Beijing China Department of Industrial Systems Engineering and Management National University of Singapore Singapore

Temporal difference (TD) learning algorithms with neural network function parameterization have well-established empirical success in many practical large-scale reinforcement learning tasks. However, theoretical understanding of these algorithms remains challenging due to the nonlinearity of the action-value approximation. In this paper, we develop an improved non-asymptotic analysis of the neural TD method with a general L-layer neural network. New proof techniques are developed and an improved new Õ(ϵ−1) sample complexity is derived. To our best knowledge, this is the first finite-time analysis of neural TD that achieves an Õ(ϵ−1) complexity under the Markovian sampling, as opposed to the best known Õ(ϵ−2) complexity in the existing literature. Copyright © 2024, The Authors. All rights reserved.

关键词： Asymptotic analysis

来源：评论

学校读者我要写书评

暂无评论

System Architecture for Reading and Interpreting Physical Printouts of Medical Forms

System Architecture for Reading and Interpreting Physical Pr...

引用

Annual Siberian Russian Workshop on Electron Devices and Materials (EDM)

作者： Ekaterina Snegireva Grigory R. Khazankin Igor Mikheenko Stream Data Analytics and Machine Learning laboratory Novosibirsk State University Novosibirsk Russia Novosibirsk State University Novosibirsk Russia Meshalkin National Medical Research Center Novosibirsk Russia

This article describes the developed architecture of the system module for processing and interpreting analog medical data. Patients often undergo examinations in various medical institutions, and since their results are often handed out to the patient in printed form, the receiving institution transfers them to its database manually. There is also a tendency to completely refuse analog media and use only digital ones. But in this case, another problem appears - either loss or conversion of the accumulated analog base into digital format. These days, automatic document management systems for medical institutions - Health information systems (HIS) - are actively developing. The software module developed in accordance with the architecture described in the article can be used by developers of various HIS to automate the work with analog data. If it is necessary, it can also be freely expanded by adding new modules for working with various analog data. In this article, we take ECG scans and medical test results as examples of such data. As a result of the work undertaken the prototype of the designed system was developed and tested.

关键词： Waste materials databases Prototypes Systems architecture Computer architecture Electrocardiography Medical tests

来源：评论

学校读者我要写书评

暂无评论

HERALD: A NATURAL LANGUAGE ANNOTATED LEAN 4 dataSET

arXiv

引用

arXiv 2024年

作者： Gao, Guoxiong Wang, Yutong Jiang, Jiedong Gao, Qi Qin, Zihan Xu, Tianyi Dong, Bin Peking University China National University of Singapore Singapore Center for Data Science Peking University China Beijing International Center for Mathematical Research The New Cornerstone Science Laboratory Peking University China Center for Machine Learning Research Peking University China

Verifiable formal languages like Lean have profoundly impacted mathematical reasoning, particularly through the use of large language models (LLMs) for automated reasoning. A significant challenge in training LLMs for these formal languages is the lack of parallel datasets that align natural language with formal language proofs. To address this challenge, this paper introduces a novel framework for translating the Mathlib4 corpus (a unified library of mathematics in formal language Lean 4) into natural language. Building upon this, we employ a dual augmentation strategy that combines tactic-based and informal-based approaches, leveraging the Lean-jixia system, a Lean 4 analyzer. We present the results of this pipeline on Mathlib4 as Herald (Hierarchy and Retrieval-based Translated Lean dataset). We also propose the Herald Translator, which is fine-tuned on Herald. Herald translator achieves a 93.2% accuracy (Pass@128) on formalizing statements in the miniF2F-test and a 22.5% accuracy on our internal graduate-level textbook dataset, outperforming InternLM2-Math-Plus-7B (74.0% and 7.5%) and TheoremLlama (50.1% and 4.0%). Furthermore, we propose a section-level translation framework for real-world applications. As a direct application of Herald translator, we have successfully translated a template section in the Stack project, marking a notable progress in the automatic formalization of graduate-level mathematical literature. Our model, along with the datasets, are open-sourced to the public.1 © 2024, CC BY.

关键词： Lean production

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：