Watermarking is a very useful technique to ensure the integrity of a document image. But when too many bits are embedded into image, it reduces quality of the document. When limited number of watermark bits are used, ...
详细信息
In this paper, we study a fully-decentralized multi-agent policy evaluation problem, which is an important sub-problem in cooperative multi-agent reinforcement learning, in the presence of up to $f$ faulty agents. I...
详细信息
ISBN:
(数字)9783903176652
ISBN:
(纸本)9798331508722
In this paper, we study a fully-decentralized multi-agent policy evaluation problem, which is an important sub-problem in cooperative multi-agent reinforcement learning, in the presence of up to
$f$
faulty agents. In particular, we focus on the so-called Byzantine faulty model with model poisoning setting. In general, policy evaluation is to evaluate the value function of any given policy. In cooperative multi-agent system, the system-wide rewards are usually modeled as the uniform average of rewards from all agents. We investigate the multi-agent policy evaluation problem in the presence of Byzantine agents, particularly in the setting of heterogeneous local rewards. Ideally, the goal of the agents is to evaluate the accumulated system-wide rewards, which are uniform average of rewards of the normal agents for a given policy. It means that all agents agree upon common values (the consensus part) and furthermore, the consensus values are the value functions (the convergence part). However, we prove that this goal is not achievable. Instead, we consider a relaxed version of the problem, where the goal of the agents is to evaluate accumulated system-wide reward, which is an appropriately weighted average reward of the normal agents. We further prove that there is no correct algorithm that can guarantee that the total number of positive weights exceeds
$\vert \mathcal{N}\vert -f$
, where
$\vert \mathcal{N}\vert$
is the number of normal agents. Towards the end, we propose a Byzantine-tolerant decentralized temporal difference algorithm that can guarantee asymptotic consensus under scalar function approximation. We then empirically test the effective of the proposed algorithm.
Online social networks are huge data exchange platforms that help to promote and share a lot of good information about products, news, education, tourism, health care, etc., also there is a great risk involved to indi...
详细信息
COVID-19 is an infectious illness concerning coronavirus that is transmitted through droplets propagated by an infected person exhales, coughs, or sneezes. People affected by coronavirus have a risk to occur respirato...
详细信息
This paper inaugurates a hybrid non-linear control strategy for DC-DC boost converter in a DC motor driven system. Conventional control methods struggle with the non-linearities and uncertainties of the real world sys...
详细信息
ISBN:
(数字)9798350357509
ISBN:
(纸本)9798350357516
This paper inaugurates a hybrid non-linear control strategy for DC-DC boost converter in a DC motor driven system. Conventional control methods struggle with the non-linearities and uncertainties of the real world system that results into downgrading both performance and efficiency. The hybrid controller integrates the backstepping approach with double-integral sliding mode technique to efficiently manage the changes, disturbances and uncertainties of the DC motor driven system. This paper also incorporates a comparative simulation study with a PID controller to show the robustness and stability of the proposed hybrid controller.
This study evaluates a narrow rectangular microstrip patch antenna designed for 2.4 GHz operation, with potential applications as a wearable antenna. Two antennae were fabricated to investigate the performance (e.g. S...
详细信息
ISBN:
(数字)9798350357509
ISBN:
(纸本)9798350357516
This study evaluates a narrow rectangular microstrip patch antenna designed for 2.4 GHz operation, with potential applications as a wearable antenna. Two antennae were fabricated to investigate the performance (e.g. S 11 & SAR parameter) and compare them with the theoretical design that was done in CST Microwave Studio software. A 64 Portable Vector Network Analyzer (VNA) known as LitaVNA™ is utilized for conducting measurements. The performances of fabricated antennae are compared, which offer a reflection loss below -10 dB for each antenna. The measured performance indicating parameters showed excellent agreement with the simulated results ~ 2.4 GHz. In addition, a list of important parameters (both structural and electrical) of the fabricated antennas is outlined in this analysis, which must be considered carefully during the fabrication process. Finally, the antenna's SAR performance was evaluated with a human body phantom model in CST Microwave Studio for 1 gm and 10 gm tissue, showing that the SAR values are well below the international limits of 1.6 W/Kg and 4 W/Kg for 1 gm and 10 gm tissues, respectively. This analysis will aid in the effective implementation and thorough examination of the designed antenna for wearable applications.
Education plays a significant role in the advancement of a country. The quality of education that a university provides is crucial to this progress. Almost every university stores the assessed grades on the local serv...
详细信息
The objective of this study is to develop a predictive model for identifying individuals at risk of stroke in order to support healthcare services. The model incorporates several key characteristics that play a vital ...
详细信息
Autonomous Vehicles (AVs) require constant sensing and accurate identification of dynamic environmental conditions for prompt decision-making. Limited onboard processing capabilities can impede these vehicles' abi...
详细信息
In this study, a Recurrent Neural Network (RNN)- based PV controller is thoroughly examined and compared with conventional Incremental Conductance techniques for Maximum Power Point Tracking (MPPT). The study emphasiz...
详细信息
ISBN:
(数字)9781665464260
ISBN:
(纸本)9781665475822
In this study, a Recurrent Neural Network (RNN)- based PV controller is thoroughly examined and compared with conventional Incremental Conductance techniques for Maximum Power Point Tracking (MPPT). The study emphasizes the improved responsiveness and efficiency of the RNN controller and focuses on the dynamic adaptation of PV systems to changing environmental conditions. In this study, the better performance of the RNN controller in monitoring the maximum power point, its fast convergence time, and its stability under various environmental conditions are demonstrated by comprehensive simulations and comparative studies. According to the results, using cutting-edge machine learning methods, such as RNNs, may greatly increase PV systems' operational effectiveness, highlighting their potential to optimize renewable energy systems. This study offers insights that advance the realm of renewable energy technologies.
暂无评论