检索结果-内蒙古大学图书馆

SSRN 2024年

作者： Li, Haoran Feng, Fan Kang, Jiarong Zhang, Jin Gong, Xiaoli Lu, Tingjuan Sun, Zhe Solé-Casals, Jordi College of Computer Science Nankai University Tianjin China Department of Biomedical Engineering School of Medicine Tsinghua University Beijing China Tianjin Key Laboratory of Brain Science and Intelligent Rehabilitation Nankai University Tianjin China State Key Laboratory of High-end Server and Storage Technology China 903rd Hospital of PLA China Faculty of Medicine Faculty of Health Data Science Juntendo University Japan Data and Signal Processing Group University of Vic Central University of Catalonia Catalonia Vic08500 Spain

The electroencephalogram (EEG) provides essential data for analyzing brain activities. However, artifacts such as electrooculography (EOG) and electromyography (EMG) often interleave with the EEG signals, significantly affecting the quality of EEG signal analysis. The heterogeneous distribution of these artifacts in the time-frequency domain makes it challenging to remove multiple artifacts using a unified model. In this paper, we propose an Artifact-Aware EEG Denoising Model, referred to as DADM, to effectively remove various types of artifacts in a unified manner. We first obtain an artifact representation that indicates the type of artifact from a pre-trained artifact classification model. This artifact representation is then used as prior knowledge, which is fused into the denoising model in the frequency-time domain. This enables the model to become aware of the artifact type and precisely remove artifacts based on their type. Due to the heterogeneous distributions of artifacts in the frequency domain, we introduce a frequency enhancement module that can identify specific types of artifacts based on their representation and remove them using a hard attention mechanism. Additionally, we design a time-domain compensation module to enhance the denoising capability of DADM by compensating for potential losses of global information. Comprehensive experiments demonstrate that DADM significantly outperforms the Novel CNN in denoising EEG signals, showing a notable 7.77% improvement in correlation coefficient (CC) metrics. © 2024, The Authors. All rights reserved.

关键词： Electroencephalography

来源：评论

学校读者我要写书评

暂无评论

Technology Roadmap for Flexible Sensors

引用

ACS NANO 2023年第6期17卷 5211-5295页

作者： Luo, Yifei Abidian, Mohammad Reza Ahn, Jong-Hyun Akinwande, Deji Andrews, Anne M. Antonietti, Markus Bao, Zhenan Berggren, Magnus Berkey, Christopher A. Bettinger, Christopher John Chen, Jun Chen, Peng Cheng, Wenlong Cheng, Xu Choi, Seon-Jin Chortos, Alex Dagdeviren, Canan Dauskardt, Reinhold H. Di, Chong-an Dickey, Michael D. Duan, Xiangfeng Facchetti, Antonio Fan, Zhiyong Fang, Yin Feng, Jianyou Feng, Xue Gao, Huajian Gao, Wei Gong, Xiwen Guo, Chuan Fei Guo, Xiaojun Hartel, Martin C. He, Zihan Ho, John S. Hu, Youfan Huang, Qiyao Huang, Yu Huo, Fengwei Hussain, Muhammad M. Javey, Ali Jeong, Unyong Jiang, Chen Jiang, Xingyu Kang, Jiheong Karnaushenko, Daniil Khademhosseini, Ali Kim, Dae-Hyeong Kim, Il-Doo Kireev, Dmitry Kong, Lingxuan Lee, Chengkuo Lee, Nae-Eung Lee, Pooi See Lee, Tae-Woo Li, Fengyu Li, Jinxing Liang, Cuiyuan Lim, Chwee Teck Lin, Yuanjing Lipomi, Darren J. Liu, Jia Liu, Kai Liu, Nan Liu, Ren Liu, Yuxin Liu, Yuxuan Liu, Zhiyuan Liu, Zhuangjian Loh, Xian Jun Lu, Nanshu Lv, Zhisheng Magdassi, Shlomo Malliaras, George G. Matsuhisa, Naoji Nathan, Arokia Niu, Simiao Pan, Jieming Pang, Changhyun Pei, Qibing Peng, Huisheng Qi, Dianpeng Ren, Huaying Rogers, John A. Rowe, Aaron Schmidt, Oliver G. Sekitani, Tsuyoshi Seo, Dae-Gyo Shen, Guozhen Sheng, Xing Shi, Qiongfeng Someya, Takao Song, Yanlin Stavrinidou, Eleni Su, Meng Sun, Xuemei Takei, Kuniharu Tao, Xiao-Ming Tee, Benjamin C. K. Thean, Aaron Voon-Yew Trung, Tran Quang Wan, Changjin Wang, Huiliang Wang, Joseph Wang, Ming Wang, Sihong Wang, Ting Wang, Zhong Lin Weiss, Paul S. Wen, Hanqi Xu, Sheng Xu, Tailin Yan, Hongping Yan, Xuzhou Yang, Hui Yang, Le Yang, Shuaijian Yin, Lan Yu, Cunjiang Yu, Guihua Yu, Jing Yu, Shu-Hong Yu, Xinge Zamburg, Evgeny Zhang, Haixia Zhang, Xiangyu Zhang, Xiaosheng Zhang, Xueji Zhang, Yihui Zhang, Yu Zhao, Siyuan Zhao, Xuanhe Zheng, Yuanjin Zheng, Yu-Qing Zheng, Zijian Zhou, Tao Zhu, Bowen Zhu, Ming Zhu, Rong Zhu, Yangzhi Zhu, Yong Zou, Guijin Chen, Xiaodong 08-03 Innovis Singapore 138634 Republic of Singapore Innovative Centre for Flexible Devices (iFLEX) School of Materials Science and Engineering Nanyang Technological University Singapore 639798 Singapore Department of Biomedical Engineering University of Houston Houston Texas 77024 United States School of Electrical and Electronic Engineering Yonsei University Seoul 03722 Republic of Korea Department of Electrical and Computer Engineering The University of Texas at Austin Austin Texas 78712 United States Microelectronics Research Center The University of Texas at Austin Austin Texas 78758 United States Department of Chemistry and Biochemistry California NanoSystems Institute and Department of Psychiatry and Biobehavioral Sciences Semel Institute for Neuroscience and Human Behavior and Hatos Center for Neuropharmacology University of California Los Angeles Los Angeles California 90095 United States Colloid Chemistry Department Max Planck Institute of Colloids and Interfaces 14476 Potsdam Germany Department of Chemical Engineering Stanford University Stanford California 94305 United States Laboratory of Organic Electronics Department of Science and Technology Campus Norrköping Linköping University 83 Linköping Sweden Wallenberg Initiative Materials Science for Sustainability (WISE) and Wallenberg Wood Science Center (WWSC) SE-100 44 Stockholm Sweden Department of Materials Science and Engineering Stanford University Stanford California 94301 United States Department of Biomedical Engineering and Department of Materials Science and Engineering Carnegie Mellon University Pittsburgh Pennsylvania 15213 United States Department of Bioengineering University of California Los Angeles Los Angeles California 90095 United States School of Chemistry Chemical Engineering and Biotechnology Nanyang Technological University Singapore 637457 Singapore Nanobionics Group Department of Chemical and Biological Engineering Monash University Clayton Australia 3800 Monash

Humans rely increasingly on sensors to address grand challenges and to improve quality of life in the era of digitalization and big data. For ubiquitous sensing, flexible sensors are developed to overcome the limitations of conventional rigid counterparts. Despite rapid advancement in bench-side research over the last decade, the market adoption of flexible sensors remains limited. To ease and to expedite their deployment, here, we identify bottlenecks hindering the maturation of flexible sensors and propose promising solutions. We first analyze continued...challenges in achieving satisfactory sensing performance for real-world applications and then summarize issues in compatible sensor-biology interfaces, followed by brief discussions on powering and connecting sensor networks. Issues en route to commercialization and for sustainable growth of the sector are also analyzed, highlighting environmental concerns and emphasizing nontechnical issues such as business, regulatory, and ethical considerations. Additionally, we look at future intelligent flexible sensors. In proposing a comprehensive roadmap, we hope to steer research efforts towards common goals and to guide coordinated development strategies from disparate communities. Through such collaborative

关键词： soft materials mechanics engineering flexible electronics conformable sensors bioelectronics human-machine interfaces body area sensor networks technology translation sustainable electronics

来源：评论

学校读者我要写书评

暂无评论

Short-Time Variational Mode Decomposition

arXiv

引用

arXiv 2025年

作者： Jia, Hao Cao, Pengfei Liang, Tong Caiafa, Cesar F. Sun, Zhe Kushihashi, Yasuhiro Grau, Antoni Bolea, Yolanda Duan, Feng Solé-Casals, Jordi School of Medicine Nankai University Tianjin China Tianjin Key Laboratory of Interventional Brain-Computer Interface and Intelligent Rehabilitation Tianjin China Universitat Politècnica de Catalunya Barcelona Spain Mechanical Systems Engineering Nippon Institute of Technology Saitama Japan Villa Elisa Argentina Computational Bioengineering Laboratory Faculty of Health Data Science Juntendo University Tokyo Japan Data and Signal Processing Research Group University of Vic-Central University of Catalonia Vic Spain

Variational mode decomposition (VMD) and its extensions like Multivariate VMD (MVMD) decompose signals into ensembles of band-limited modes with narrow central frequencies. These methods utilize Fourier transformations to shift signals between time and frequency domains. However, since Fourier transformations span the entire time-domain signal, they are suboptimal for non-stationary time series. We introduce Short-Time Variational Mode Decomposition (STVMD), an innovative extension of the VMD algorithm that incorporates the Short-Time Fourier transform (STFT) to minimize the impact of local disturbances. STVMD segments signals into short time windows, converting these segments into the frequency domain. It then formulates a variational optimization problem to extract band-limited modes representing the windowed data. The optimization aims to minimize the sum of the bandwidths of these modes across the windowed data, extending the cost functions used in VMD and MVMD. Solutions are derived using the alternating direction method of multipliers, ensuring the extraction of modes with narrow bandwidths. STVMD is divided into dynamic and non-dynamic types, depending on whether the central frequencies vary with time. Our experiments show that non-dynamic STVMD is comparable to VMD with properly sized time windows, while dynamic STVMD better accommodates non-stationary signals, evidenced by reduced mode function errors and tracking of dynamic central frequencies. This effectiveness is validated by steady-state visual-evoked potentials in electroencephalogram signals. Copyright © 2025, The Authors. All rights reserved.

关键词： Cost functions

来源：评论

学校读者我要写书评

暂无评论

signal Detection in MIMO Systems with Hardware Imperfections: Message Passing on Neural Networks

arXiv

引用

arXiv 2022年

作者： Gao, Dawei Guo, Qinghua Liao, Guisheng Eldar, Yonina C. Li, Yonghui Yu, Yanguang Vucetic, Branka The Hangzhou Institute of Technology Xidian University Hangzhou311200 China The National Laboratory of Radar Signal Processing Xidian University Xi’an710071 China The School of Electrical Computer and Telecommunications Engineering University of Wollongong NSW2522 Australia The Faculty of Math and CS Weizmann Institute of Science Rehovot7610001 Israel The School of Electrical and Information Engineering University of Sydney SydneyNSW2006 Australia

In this paper, we investigate signal detection in multiple-input-multiple-output (MIMO) communication systems with hardware impairments, such as power amplifier nonlinearity and in-phase/quadrature imbalance. To deal with the complex combined effects of hardware imperfections, neural network (NN) techniques, in particular deep neural networks (DNNs), have been studied to directly compensate for the impact of hardware impairments. However, it is difficult to train a DNN with limited pilot signals, hindering its practical applications. In this work, we investigate how to achieve efficient Bayesian signal detection in MIMO systems with hardware imperfections. Characterizing combined hardware imperfections often leads to complicated signal models, making Bayesian signal detection challenging. To address this issue, we first train an NN to ‘model’ the MIMO system with hardware imperfections and then perform Bayesian inference based on the trained NN. Modelling the MIMO system with NN enables the design of NN architectures based on the signal flow of the MIMO system, minimizing the number of NN layers and parameters, which is crucial to achieving efficient training with limited pilot signals. We then represent the trained NN with a factor graph, and design an efficient message passing based Bayesian signal detector, leveraging the unitary approximate message passing (UAMP) algorithm. The implementation of a turbo receiver with the proposed Bayesian detector is also investigated. Extensive simulation results demonstrate that the proposed technique delivers remarkably better performance than state-of-the-art methods. Copyright © 2022, The Authors. All rights reserved.

关键词： Deep neural networks

来源：评论

学校读者我要写书评

暂无评论

Novel 3D Geometry-Based Stochastic Models for Non-Isotropic MIMO Vehicle-to-Vehicle Channels

arXiv

引用

arXiv 2023年

作者： Yuan, Yi Wang, Cheng-Xiang Cheng, Xiang Ai, Bo Laurenson, David I. The Joint Research Institute for Signal and Image Processing School of Engineering & Physical Sciences Heriot-Watt University EdinburghEH14 4AS United Kingdom The Research Institute for Modern Communications School of Electronics Engineering & Computer Science Peking University Beijing100871 China The State Key Laboratory of Rail Traffic Control and Safety Beijing Jiaotong University Beijing100044 China The Joint Research Institute for Signal and Image Processing Institute for Digital Communications University of Edinburgh EdinburghEH9 3JL United Kingdom

This paper proposes a novel three-dimensional (3D) theoretical regular-shaped geometry-based stochastic model (RS-GBSM) and the corresponding sum-of-sinusoids (SoS) simulation model for non-isotropic multiple-input multiple-output (MIMO) vehicle-to-vehicle (V2V) Ricean fading channels. The proposed RS-GBSM, combining line-of-sight (LoS) components, a two-sphere model, and an elliptic-cylinder model, has the ability to study the impact of the vehicular traffic density (VTD) on channel statistics, and jointly considers the azimuth and elevation angles by using the von Mises Fisher distribution. Moreover, a novel parameter computation method is proposed for jointly calculating the azimuth and elevation angles in the SoS channel simulator. Based on the proposed 3D theoretical RS-GBSM and its SoS simulation model, statistical properties are derived and thoroughly investigated. The impact of the elevation angle in the 3D model on key statistical properties is investigated by comparing with those of the corresponding two-dimensional (2D) model. It is demonstrated that the 3D model is more accurate to characterize real V2V channels, in particular for pico cell scenarios. Finally, close agreement is achieved between the theoretical model, SoS simulation model, and simulation results, demonstrating the utility of the proposed models. © 2023, CC BY.

关键词： Stochastic systems

来源：评论

学校读者我要写书评

暂无评论

Touchstone benchmark: are we on the right way for evaluating AI algorithms for medical segmentation? 24

Touchstone benchmark: are we on the right way for evaluating...

引用

Proceedings of the 38th International Conference on Neural Information processing Systems

作者： Pedro R. A. S. Bassi Wenxuan Li Yucheng Tang Fabian Isensee Zifu Wang Jieneng Chen Yu-Cheng Chou Saikat Roy Yannick Kirchhoff Maximilian Rokuss Ziyan Huang Jin Ye Junjun He Tassilo Wald Constantin Ulrich Michael Baumgartner Klaus H. Maier-Hein Paul Jaeger Yiwen Ye Yutong Xie Jianpeng Zhang Ziyang Chen Yong Xia Zhaohu Xing Lei Zhu Yousef Sadegheih Afshin Bozorgpour Pratibha Kumari Reza Azad Dorit Merhof Pengcheng Shi Ting Ma Yuxin Du Fan Bai Tiejun Huang Bo Zhao Haonan Wang Xiaomeng Li Hanxue Gu Haoyu Dong Jichen Yang Maciej A. Mazurowski Saumya Gupta Linshan Wu Jiaxin Zhuang Hao Chen Holger Roth Daguang Xu Matthew B. Blaschko Sergio Decherchi Andrea Cavalli Alan L. Yuille Zongwei Zhou Department of Computer Science Johns Hopkins University and Department of Pharmacy and Biotechnology University of Bologna and Center for Biomolecular Nanotechnologies Istituto Italiano di Tecnologia Department of Computer Science Johns Hopkins University NVIDIA Division of Medical Image Computing German Cancer Research Center (DKFZ) and Helmholtz Imaging German Cancer Research Center (DKFZ) ESAT-PSI KU Leuven Division of Medical Image Computing German Cancer Research Center (DKFZ) and Faculty of Mathematics and Computer Science Heidelberg University Division of Medical Image Computing German Cancer Research Center (DKFZ) and Faculty of Mathematics and Computer Science Heidelberg University and HIDSS4Health - Helmholtz Information and Data Science School for Health Shanghai Jiao Tong University Shanghai Artificial Intelligence Laboratory Division of Medical Image Computing German Cancer Research Center (DKFZ) Division of Medical Image Computing German Cancer Research Center (DKFZ) and Pattern Analysis and Learning Group Department of Radiation Oncology Heidelberg University Hospital Helmholtz Imaging German Cancer Research Center (DKFZ) and Interactive Machine Learning Group (IML) DKFZ School of Computer Science and Engineering Northwestern Polytechnical University Australian Institute for Machine Learning The University of Adelaide College of Computer Science and Technology Zhejiang University Hong Kong University of Science and Technology (Guangzhou) Hong Kong University of Science and Technology (Guangzhou) and Hong Kong University of Science and Technology Faculty of Informatics and Data Science University of Regensburg Faculty of Electrical Engineering and Information Technology RWTH Aachen University Faculty of Informatics and Data Science University of Regensburg and Fraunhofer Institute for Digital Medicine MEVIS Electronic & Information Engineering School Harbin Institute of Technology (Shenzhen) Shanghai Jiao Tong University and Beijing Academy of Artificial Intelligence (BAAI) S

ISBN: (纸本)9798331314385

How can we test AI performance? This question seems trivial, but it isn't. Standard benchmarks often have problems such as in-distribution and small-size test sets, oversimplified metrics, unfair comparisons, and short-term outcome pressure. As a consequence, good performance on standard benchmarks does not guarantee success in real-world scenarios. To address these problems, we present Touchstone, a large-scale collaborative segmentation benchmark of 9 types of abdominal organs. This benchmark is based on 5,195 training CT scans from 76 hospitals around the world and 5,903 testing CT scans from 11 additional hospitals. This diverse test set enhances the statistical significance of benchmark results and rigorously evaluates AI algorithms across out-of-distribution scenarios. We invited 14 inventors of 19 AI algorithms to train their algorithms, while our team, as a third party, independently evaluated these algorithms. In addition, we also evaluated pre-existing AI frameworks—which, differing from algorithms, are more flexible and can support different algorithms—including MONAI from NVIDIA, nnU-Net from DKFZ, and numerous other open-source frameworks. We are committed to expanding this benchmark to encourage more innovation of AI algorithms for the medical domain.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Physics-Based Optical Flow Estimation Under Varying Illumination Conditions

SSRN

引用

SSRN 2022年

作者： Liao, Xiaoxin Cai, Zemin Chen, Jun Liu, Tianshu Lai, Jian-Huang The Department of Electronic Engineering Shantou University Guangdong Shantou515063 China Key Laboratory of Digital Signal and Image Processing of Guangdong Province Guangdong Shantou515063 China The School of Industrial Design and Ceramic Art Foshan University Foshan528000 China The Department of Mechanical and Aerospace Engineering Western Michigan University KalamazooMI49008 United States The School of Data and Computer Science Sun Yat-sen University Guangdong Guangzhou510006 China

The physics-based optical flow (PBOF) model was derived from typical flow visulizations and it provided a more solid physical foundation for optical flow calculation. However, like many recent variational optical flow methods, it is not formulated to deal with the effect of illumination variation. In this paper, we propose a new efficient illumination-invariant optical flow estimation method, which improves the physics-based optical flow model. The proposed method introduces a multiplicative product of the velocity gradient and intensity from PBOF and an additive diffusion component to relax the brightness constancy assumption. The proposed method employs a linear transformation to reduce the influence of varying illumination on the data term. Then, a smoothness-sparsity regularization is used to constrain the minimization problem to have good edge-preserving for optical flow. Furthermore, the numerical implementation is given to solve the optimization problem. The accuracy of the developed method and the robustness against varying illumination are evaluated. The proposed method can provide motion estimation with acceptable accuracy for three optical flow datasets and cloud images of Jupiter’s great red spot, which have challenging illumination variations. © 2022, The Authors. All rights reserved.

关键词： Optical flows

来源：评论

学校读者我要写书评

暂无评论

Realization of autonomous heating plates operating with photovoltaic energy and solar batteries

引用

Materials Today: Proceedings 2021年 45卷 7408-7414页

作者： I. Atmane K. Kassmi O. Deblecker N. Bachiri Mohamed First University Faculty of Science Department of Physics Laboratory of Electromagnetic Signal Processing & Renewable Energy LESPRE Team Electronic Materials & Renewable Energy EMRE Oujda Morocco Association Humain and Environnement of Berkane (AHEB) Berkane Morocco University of Mons Polytech. Mons - Electrical Power Engineering Unit Mons Belgium

The work presented in this paper shows the feasibility of an innovative stand-alone solar cooker (hotplate) powered by renewable photovoltaic (PV) energy. This cooker is formed by PV panels (600 W), two DC/DC energy converters, two thermal resistors and a digital control unit. The role of the latter is to manage locally and remotely the operation of the cooker, according to the needs of the users, and to acquire and display the meteorological (lighting and ambient temperature), thermal (temperature of the resistance) and electrical quantities of the system (currents, voltages, powers, yields …). Experimentation of the system during whole days shows that, for an illumination intensity of 1115 W/m 2 and an ambient temperature of about 22 °C, the global electrical power supplied by the PV panels reaches 464 W/peak. The temperature of the thermal resistance reaches 700 °C (70 °C/s) after 10 s, the efficiency of the converters is 87%, the boiling of one liter of water (temperature 90 °C) and the heating of 0.5 L of oil (temperature 270 °C) took place after 20 min. and 60 min respectively. In addition, the study on energy storage in solar batteries shows that the energy produced throughout the day can be stored in 160 Ah batteries (i.e. two 75 Ah batteries). All these results show the feasibility of the proposed cooker, and consequently its use in rural as well as urban households for cooking during sunny days and nights.

关键词： Photovoltaic solar energy Innovative solar photovoltaic cooker (hot plate) Indoor/outdoor cooking Optimized photovoltaic energy Local and remote control system Solar batteries

来源：评论

学校读者我要写书评

暂无评论

Two-Stream Graph Convolutional Network for Intra-oral Scanner Image Segmentation

arXiv

引用

arXiv 2022年

作者： Zhao, Yue Zhang, Lingming Liu, Yang Meng, Deyu Cui, Zhiming Gao, Chenqiang Gao, Xinbo Lian, Chunfeng Shen, Dinggang Chongqing University of Posts and Telecommunications School of Communication and Information Engineering Chongqing400065 China The Chongqing Key Laboratory of Signal and Information Processing Chongqing400065 China Department of Orthodontics Stomatological Hospital of Chongqing Medical University Chongqing401147 China Chongqing Key Laboratory for Oral Diseases and Biomedical Sciences Chongqing401147 China Faculty of Information Technology Macau University of Science and Technology China School of Mathematics and Statistics Xi'an Jiaotong University Xian710049 China School of Biomedical Engineering ShanghaiTech University Shanghai201210 China Shanghai United Imaging Intelligence Co. Ltd. Shanghai200030 China The School of Computer Science The University of Hong Kong 999077 Hong Kong School of Computer Science and Technology Chongqing University of Posts and Telecommunications Chongqing400065 China

Precise segmentation of teeth from intra-oral scanner images is an essential task in computer-aided orthodontic surgical planning. The state-of-the-art deep learning-based methods often simply concatenate the raw geometric attributes (i.e., coordinates and normal vectors) of mesh cells to train a single-stream network for automatic intra-oral scanner image segmentation. However, since different raw attributes reveal completely different geometric information, the naive concatenation of different raw attributes at the (low-level) input stage may bring unnecessary confusion in describing and differentiating between mesh cells, thus hampering the learning of high-level geometric representations for the segmentation task. To address this issue, we design a two-stream graph convolutional network (i.e., TSGCN), which can effectively handle inter-view confusion between different raw attributes to more effectively fuse their complementary information and learn discriminative multi-view geometric representations. Specifically, our TSGCN adopts two input-specific graph-learning streams to extract complementary high-level geometric representations from coordinates and normal vectors, respectively. Then, these single-view representations are further fused by a self-attention module to adaptively balance the contributions of different views in learning more discriminative multi-view representations for accurate and fully automatic tooth segmentation. We have evaluated our TSGCN on a real-patient dataset of dental (mesh) models acquired by 3D intraoral scanners. Experimental results show that our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation. Github: https://***/ZhangLingMing1/TSGCNet. © 2022, CC BY.

关键词： Scanning

来源：评论

学校读者我要写书评

暂无评论

Resource-Efficient Neural Networks for Embedded Systems

arXiv

引用

arXiv 2020年

作者： Roth, Wolfgang Schindler, Günther Klein, Bernhard Peharz, Robert Tschiatschek, Sebastian Fröning, Holger Pernkopf, Franz Ghahramani, Zoubin Graz University of Technology Laboratory of Signal Processing and Speech Communication Austria Institute of Computer Engineering Heidelberg University Germany Institute of Theoretical Computer Science Graz University of Technology Austria Faculty of Computer Science University of Vienna Austria University of Cambridge Cambridge United Kingdom

While machine learning is traditionally a resource intensive task, embedded systems, autonomous navigation, and the vision of the Internet of Things fuel the interest in resourceefficient approaches. These approaches aim for a carefully chosen trade-off between performance and resource consumption in terms of computation and energy. The development of such approaches is among the major challenges in current machine learning research and key to ensure a smooth transition of machine learning technology from a scientific environment with virtually unlimited computing resources into everyday's applications. In this article, we provide an overview of the current state of the art of machine learning techniques facilitating these real-world requirements. In particular, we focus on resource-efficient inference based on deep neural networks (DNNs), the predominant machine learning models of the past decade. We give a comprehensive overview of the vast literature that can be mainly split into three non-mutually exclusive categories: (i) quantized neural networks, (ii) network pruning, and (iii) structural efficiency. These techniques can be applied during training or as post-processing, and they are widely used to reduce the computational demands in terms of memory footprint, inference speed, and energy efficiency. We also briefly discuss different concepts of embedded hardware for DNNs and their compatibility with machine learning techniques as well as potential for energy and latency reduction. We substantiate our discussion with experiments on well-known benchmark data sets using compression techniques (quantization, pruning) for a set of resource-constrained embedded systems, such as CPUs, GPUs and FPGAs. The obtained results highlight the difficulty of finding good trade-offs between resource efficiency and prediction quality. Copyright © 2020, The Authors. All rights reserved.

关键词： Deep neural networks

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：