Backpropagation (BP) is the most successful and widely used algorithm in deep learning. However, the computations required by BP are challenging to reconcile with known neurobiology. This difficulty has stimulated int...
ISBN:
(纸本)9781713871088
Backpropagation (BP) is the most successful and widely used algorithm in deep learning. However, the computations required by BP are challenging to reconcile with known neurobiology. This difficulty has stimulated interest in more biologically plausible alternatives to BP. One such algorithm is the inference learning algorithm (IL). IL trains predictive coding models of neural circuits and has achieved equal performance to BP on supervised and auto-associative tasks. In contrast to BP, however, the mathematical foundations of IL are not well-understood. Here, we develop a novel theoretical framework for IL. Our main result is that IL closely approximates an optimization method known as implicit stochastic gradient descent (implicit SGD), which is distinct from the explicit SGD implemented by BP. Our results further show how the standard implementation of IL can be altered to better approximate implicit SGD. Our novel implementation considerably improves the stability of IL across learning rates, which is consistent with our theory, as a key property of implicit SGD is its stability. We provide extensive simulation results that further support our theoretical interpretations and find IL achieves quicker convergence when trained with mini-batch size one while performing competitively with BP for larger mini-batches when combined with Adam.
As a novel 2D material, MoS 2 has shown excellent electrical properties and resistive switching characteristics to work as a switching layer for non-volatile memory. In this work, we drop cast the MoS 2 solution to ...
As a novel 2D material, MoS 2 has shown excellent electrical properties and resistive switching characteristics to work as a switching layer for non-volatile memory. In this work, we drop cast the MoS 2 solution to prepare the thin film and deposit an interfacial layer of Al 2 O 3 . We demonstrate the proposed memristive device with Cu/Al 2 O 3 /MoS 2 /Pt structure to work as an artificial synapse. The device shows a steady resistive switching behavior with the SET and RESET voltages of 1.3 V and -0.5 V, respectively. We further demonstrate the synapse behavior via a Hopfield Neural Network (HNN) and achieve image recognition and reconstruction with a high accuracy of 96% after 15 training epochs.
Many pregnant women still do not want to check their pregnancy to recognize the signs of high-risk pregnant women. High-risk pregnancies refer to abundant women with several risky conditions requiring special care dur...
详细信息
Video super-resolution (VSR) is widely used in various high-definition applications, such as HDTVs and smartphones, requiring a dedicated upscaling technique for realtime full-HD generation. To reduce on-chip buffers ...
详细信息
Endometriosis is a chronic disease that affects a considerable percentage of women of reproductive age and is characterized by the presence of endometrial tissue outside the uterine cavity, leading to symptoms such as...
详细信息
Technological advancements are increasingly evident across various sectors, including automobiles, industry, and healthcare. In precision agriculture, significant progress has been made, with AgroTICs and Smart Agricu...
详细信息
ISBN:
(数字)9798350374575
ISBN:
(纸本)9798350374582
Technological advancements are increasingly evident across various sectors, including automobiles, industry, and healthcare. In precision agriculture, significant progress has been made, with AgroTICs and Smart Agriculture gaining substantial traction in the market. However, a gap remains between cutting-edge technology and family farming, presenting a challenge from both social and applied research perspectives. However, there is still a gap between cutting-edge technology and family farming, which creates a challenge from a social and applied research point of view. In this context, this paper proposes a monitoring model based on Fuzzy Logic and sensor automation applied to estimate the health of a corn crop. The proposed Fuzzy inference system involves calculating an indicator of nutrients as well as the average color and area of corn plants. The nutrient indicator is automatically computed by an ESP32 microcontroller using sensor readings, while the average color and area inputs are manually entered via a mobile application. Additionally, the Fuzzy inference is integrated into the ESP32. The model underwent experimental validation on the health of the plantation, and the results were evaluated in four areas: one was designated for testing, and three were for validation. The model achieved an accuracy of 97.5% in Scenario 3, categorized as ’Very Favorable’, and an accuracy of 65% in Scenarios 2 and 4, categorized as ‘Unfavorable’. The implications of this research contribute to the advancement of AgroTICs among small producers, with the potential to enhance and automate the monitoring of their harvest production.
Learning a sequence of movements is akin to the acquisition of a motor skill. We investigated event-related potentials (ERPs) changes, particularly the error-related negativity (ERN) and P200 components, as participan...
详细信息
Conveyor belts are commonly used in the mining industry for efficient material transport. However, they are prone to failures such as idler anomalies, belt tears, and misalignment. Current monitoring systems only eval...
详细信息
A strategy that combines experiment and simulation to design and optimize electromagnetic (EM) metamaterial absorbers containing a periodic porous structure is described. The approach provides the ability to produce a...
A strategy that combines experiment and simulation to design and optimize electromagnetic (EM) metamaterial absorbers containing a periodic porous structure is described. The approach provides the ability to produce absorbers that meet multiple user-specified objectives. Using the measured intrinsic properties of the baseline materials as an input to EM-field based computational modelling and optimization, absorption by the studied metamaterials measured by their reflection loss (RL) increases significantly. The resulting metamaterials have the potential for lower cost and lighter weight while providing greater protection than traditional metal gaskets and foams.
Endometriosis is a chronic disease that affects a considerable percentage of women of reproductive age and is characterized by the presence of endometrial tissue outside the uterine cavity, leading to symptoms such as...
详细信息
ISBN:
(数字)9798331522216
ISBN:
(纸本)9798331522223
Endometriosis is a chronic disease that affects a considerable percentage of women of reproductive age and is characterized by the presence of endometrial tissue outside the uterine cavity, leading to symptoms such as pelvic pain and dysmenorrhea. The aim of this study is to develop a predictive model for the classification of endometriosis using four Machine Learning algorithms: Random Forest, LASSO, SVM, and Naive Bayes. For this purpose, a dataset from the Global Health Data Exchange was utilized, consisting of 1,000 cases of patients with endometriosis. The methodology included data cleaning and preprocessing, as well as the evaluation of each algorithm's performance using four metrics: precision, recall, F1-Score, and accuracy. The findings revealed that the Random Forest algorithm was the most effective in identifying endometriosis, outperforming the other algorithms with a precision of 0.99 for the “endometriosis” class and an overall accuracy of 0.98.
暂无评论