In recent years, reinforcement learning techniques have gained widespread application in control synthesis. However, in the context of safety-critical systems, employing trial-and-error based reinforcement learning ma...
详细信息
ISBN:
(数字)9798350354409
ISBN:
(纸本)9798350354416
In recent years, reinforcement learning techniques have gained widespread application in control synthesis. However, in the context of safety-critical systems, employing trial-and-error based reinforcement learning may be unacceptable due to the potential risks it poses during the learning process. Consequently, the development of safe reinforcement learning techniques has become imperative. This paper addresses the challenge of safe reinforcement learning for controller synthesis, particularly when safety specifications are intricately linked to the real-time behavior of the system. To articulate time-sensitive requirements, we leverage Metric Interval Temporal Logic (MITL). To ensure safety throughout the learning process, we introduce an additional reactive controller called a shield. Specifically, the shield functions to reject any behavior that violates the real-time specifications, thus mitigating potential risks. The efficacy of our proposed approach is demonstrated through simulation results, highlighting its ability to satisfy safety constraints in the dynamic environment of controller synthesis.
Principal Component Analysis (PCA) is a versatile Unsupervised Learning (UL) technique for reducing the dimensionality of datasets. As a result, PCA is widely used in consumer and research applications as a preprocess...
Principal Component Analysis (PCA) is a versatile Unsupervised Learning (UL) technique for reducing the dimensionality of datasets. As a result, PCA is widely used in consumer and research applications as a preprocessing tool for identifying important features prior to further analysis. In instances where on-site personnel or developers do not have the expertise to apply UL techniques, third party processors are frequently retained. However, the release of client or proprietary data poses a substantial security risk. This risk increases the regulatory and contractual burden on analysts when interacting with sensitive or classified information. Homomorphic Encryption (HE) cryptosystems are a novel family of encryption algorithms that permit approximate addition and multiplication on encrypted data. When applied to UL models, such as PCA, experts may apply their expertise while maintaining data privacy. In order to evaluate the potential application of Homomorphic Encryption, we implemented Principal Component Analysis using the Microsoft SEAL HE libraries. The resulting implementation was applied to the MNIST Handwritten dataset for feature reduction and image reconstruction. Based on our results, HE considerably increased the time required to process the dataset. However, the HE algorithm is still viable for non-real-time applications as it had an average pixel error of near-zero for all image reconstructions.
Ultrasonic Nondestructive Evaluation (NDE) has been extensively used to characterize the microstructure of metallic structures for early exposure of materials integrity. However, industrial NDE requires the processing...
Ultrasonic Nondestructive Evaluation (NDE) has been extensively used to characterize the microstructure of metallic structures for early exposure of materials integrity. However, industrial NDE requires the processing, storage, and real-time transmission of large volumes of ultrasonic data. Therefore, it is indispensable to compress ultrasonic data with high fidelity. In this study, we explore the development of Unsupervised Learning (UL) based Neural Network (NN) models for massive ultrasonic data compression and an innovative multilayer perceptron residual autoencoder: Ultrasonic Residual Compressive Autoencoder (URCA), is introduced to compress ultrasonic data with high compression performance. This URCA can be fast-trained and utilizes the sparsity penalty with residual connection to optimize compression performance. UL-based NNs allow for memory-efficient training and rapid online augmentation of the model. To examine the results, a high-performance ultrasonic signal acquisition system was assembled to automatically collect ultrasonic data from heat-treated 1,018 steel blocks for microstructure characterization. Compression performance is analyzed based on compression ratio, reconstruction accuracy and model training time. The reconstruction accuracy was measured using the Structural Similarity Index Measure (SSIM) and Peak Signal-to-Noise Ratio (PSNR). By training the URCA NN for a high reconstruction performance of 0.96 SSIM, we obtained 91.25% memory space-saving. For a higher compression performance of 0.80 SSIM, we obtained 96.04% memory space-saving.
Markov chain Monte Carlo (MCMC) technique is an approximate Bayesian inference method and generally outperforms linear estimation. It has been adopted to realize channel estimation and symbol detection in underwater a...
详细信息
Mitochondria are subcellular organelles existing in most eukaryotic organisms. They have a pivotal role in lots of bio-chemical processes for cells. Proteins in different compartments of mitochondria have their transp...
详细信息
Decomposition and characterization of backscattered ultrasonic multiple interfering echoes is a critical step for analyzing the ultrasonic propagation path, propagation modes, coupling condition of the transducers and...
Decomposition and characterization of backscattered ultrasonic multiple interfering echoes is a critical step for analyzing the ultrasonic propagation path, propagation modes, coupling condition of the transducers and detecting defects within the propagation path. Chirplet Signal Decomposition (CSD) is an efficient way of analyzing ultrasonic echoes. However, CSD is computationally expensive and time-consuming for real-time signal processing applications. To address this problem, we present a System-on-Chip (SoC) implementation of the CSD algorithm, with the goal of speed optimization and real-time execution without sacrificing the accuracy of the signal decomposition and reconstruction. The implementation was tested on a Zynq Ultrascale+ series FPGA and achieved an echo estimation within two milliseconds.
In recent years, convolutional neural networks have significantly advanced image segmentation, particularly for brain images, where important edge features are automatically found. However, accurate segmentation of tu...
ISBN:
(数字)9798350366860
ISBN:
(纸本)9798350366877
In recent years, convolutional neural networks have significantly advanced image segmentation, particularly for brain images, where important edge features are automatically found. However, accurate segmentation of tumors in a brain remains a challenge across different magnetic resonance modalities, like T1, T2, T1ce, and FLAIR. Using a simple gradient map as an input to the neural networks is not effective due to variations in cross-modality image characteristics. To address this issue, we introduced multi-scale gradient maps that incorporate Holistically Nested Edge Detection (HED) and dilated convolutions into the UNet model. The HED model captures detailed gradient information, enhancing structural feature identification across modalities, while dilated convolutions expand the UNet receptive field for better contextual understanding without increasing parameters. Our method was trained and evaluated on the BraTS2018 dataset. The experimental results demonstrate significant improvements in segmentation accuracy and robustness. Specifically, our method achieved a Dice Similarity Coefficient (DSC) of 0.6902 for T2 to T1ce, 0.6858 for T2 to T1, 0.4329 for FLAIR to T1, and 0.6004 for FLAIR to T1ce, outperforming previous state-of-the-art methods. This demonstrates the effectiveness of our approach in enhancing segmentation performance across different MR image modalities.
This paper presents a system design for a smart bike helmet with multiple safety features that are intended to empower bicycle riders to proactively avoid potential sources of danger or injury. A Smart Sensor/Actuator...
This paper presents a system design for a smart bike helmet with multiple safety features that are intended to empower bicycle riders to proactively avoid potential sources of danger or injury. A Smart Sensor/Actuator Node (SSAN), driven by an Arduino Uno single-board microcontroller, contains input sensors and actuators to provide riders the ability to send and receive warnings promptly on their helmet. A Vision Node, driven by an NVIDIA Jetson Nano and a cable pin-connected camera, executes AI object detection algorithms for any dangerous objects that are out of sight of the rider and sends alerts to the SSAN as needed. By combining safety features of the SSAN and Vision Node while continuously sending data to an IoT-enabled backend web server, the safety operation of a typical bike ride can be substantially improved.
Prostate cancer (PCa) is the second most common cancer in men, making early detection crucial for effective treatment. This study explores the efficacy of machine learning (ML) and deep learning (DL) models in detecti...
详细信息
In this paper, we study the existence of equilibrium in a single-leader-multiple-follower game with decision-dependent chance constraints (DDCCs), where decision-dependent uncertainties (DDUs) exist in the constraints...
详细信息
暂无评论