检索结果-内蒙古大学图书馆

NOVEL REALIZATIONS OF speech-DRIVEN HEAD MOVEMENTS WITH GENERATIVE ADVERSARIAL NETWORKS

学校读者我要写书评

暂无评论

NOVEL REALIZATIONS OF SPEECH-DRIVEN HEAD MOVEMENTS WITH GENE...

IEEE International Conference on Acoustics, speech and signal processing

作者： Najmeh Sadoughi Carlos Busso Multimodal Signal Processing (MSP) Laboratory Department of Electrical and Computer Engineering The University of Texas at Dallas Richardson TX 75080 USA

ISBN: (纸本)9781538646595

Head movement is an integral part of face-to-face communications. It is important to investigate methodologies to generate naturalistic movements for conversational agents (CAs). The predominant method for head movement generation is using rules based on the meaning of the message. However, the variations of head movements by these methods are bounded by the predefined dictionary of gestures. speech-driven methods offer an alternative approach, learning the relationship between speech and head movements from real recordings. However, previous studies do not generate novel realizations for a repeated speech signal. Conditional generative adversarial network (GAN) provides a framework to generate multiple realizations of head movements for each speech segment by sampling from a conditioned distribution. We build a conditional GAN with bidirectional long-short term memory (BLSTM), which is suitable for capturing the long-short term dependencies of time-continuous signals. This model learns the distribution of head movements conditioned on speech prosodic features. We compare this model with a dynamic Bayesian network (DBN) and BLSTM models optimized to reduce mean squared error (MSE) or to increase concordance correlation. The objective evaluations and subjective evaluations of the results showed better performance for the conditional GAN model compared with these baseline systems.

关键词： Head movements synthesis speech-driven animation conditional generative adversarial networks Head Movements speech Head Conditional Voice signal Mean square error

Detection of Fusarium wilt on Phalaenopsis stem base region using band selection techniques 38

学校读者我要写书评

暂无评论

Detection of Fusarium wilt on Phalaenopsis stem base region ...

38th Annual IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2018

作者： Lee, Meng-Chueh Ma, Kenneth-Yeonkong Ouyang, Yen-Chieh Ou-Yang, Mang Guo, Horng-Yuh Liu, Tsang-Sen Chen, Hsian-Min Wu, Chao-Cheng Chang, Chgein-I Department of Communications Engineering National Chung Hsing University Taichung Taiwan Department of Electrical Engineering National Chung Hsing University Taichung Taiwan National Chiao-Tung University Department of Electrical and Computer Engineering Hsinchu City Taiwan Taiwan Agriculture Research Institute Nan-Tou Taiwan Center for Quantitative Imaging in Medicine Taichung Veterans General Hospital Taichung Taiwan Department of Electrical Engineering National Taipei University of Technology Taipei Taiwan Remote Sensing Signal and Image Processing Laboratory Department of Computer Science and Electrical Engineering University of Maryland Baltimore County BaltimoreMD21250 United States

ISBN: (纸本)9781538671504

Phalaenopsis is a significant agriculture product with high economic value in Taiwan. However, the fusarium wilt causes Phalaenopsis leaves turning yellow, thinning, water loss, and finally died. This paper presents an emerging method to detect fusarium wilt on Phalaenopsis stem base. In order to build the detection models, the hyperspectral databases are generated form two statues of Phalaenopsis samples, which are health and disease sample. We applied band selection (BS) processing base on band prioritization (BP) and band de-correlation (BD) to extract the significant bands and eliminate the redundant bands. Then, three algorithms were used, orthogonal subspace projection (OSP), constrain energy minimization (CEM), and support vector machine (SVM) to detect the fusarium wilt. © 2018 IEEE

关键词： Diseases Hyperspectral imaging Support vector machines Agriculture Databases Entropy

BigNeuron: a resource to benchmark and predict performance of algorithms for automated tracing of neurons in light microscopy datasets

学校读者我要写书评

暂无评论

Nature methods 2023年第6期20卷 824-835页

作者： Linus Manubens-Gil Zhi Zhou Hanbo Chen Arvind Ramanathan Xiaoxiao Liu Yufeng Liu Alessandro Bria Todd Gillette Zongcai Ruan Jian Yang Miroslav Radojević Ting Zhao Li Cheng Lei Qu Siqi Liu Kristofer E Bouchard Lin Gu Weidong Cai Shuiwang Ji Badrinath Roysam Ching-Wei Wang Hongchuan Yu Amos Sironi Daniel Maxim Iascone Jie Zhou Erhan Bas Eduardo Conde-Sousa Paulo Aguiar Xiang Li Yujie Li Sumit Nanda Yuan Wang Leila Muresan Pascal Fua Bing Ye Hai-Yan He Jochen F Staiger Manuel Peter Daniel N Cox Michel Simonneau Marcel Oberlaender Gregory Jefferis Kei Ito Paloma Gonzalez-Bellido Jinhyun Kim Edwin Rubel Hollis T Cline Hongkui Zeng Aljoscha Nern Ann-Shyn Chiang Jianhua Yao Jane Roskams Rick Livesey Janine Stevens Tianming Liu Chinh Dang Yike Guo Ning Zhong Georgia Tourassi Sean Hill Michael Hawrylycz Christof Koch Erik Meijering Giorgio A Ascoli Hanchuan Peng Institute for Brain and Intelligence Southeast University Nanjing China. Microsoft Corporation Redmond WA USA. Tencent AI Lab Bellevue WA USA. Computing Environment and Life Sciences Directorate Argonne National Laboratory Lemont IL USA. Kaya Medical Seattle WA USA. University of Cassino and Southern Lazio Cassino Italy. Center for Neural Informatics Structures and Plasticity Krasnow Institute for Advanced Study George Mason University Fairfax VA USA. Faculty of Information Technology Beijing University of Technology Beijing China. Beijing International Collaboration Base on Brain Informatics and Wisdom Services Beijing China. Nuctech Netherlands Rotterdam the Netherlands. Janelia Research Campus Howard Hughes Medical Institute Ashburn VA USA. Department of Electrical and Computer Engineering University of Alberta Edmonton Alberta Canada. Ministry of Education Key Laboratory of Intelligent Computation and Signal Processing Anhui University Hefei China. Paige AI New York NY USA. Scientific Data Division and Biological Systems and Engineering Division Lawrence Berkeley National Lab Berkeley CA USA. Helen Wills Neuroscience Institute and Redwood Center for Theoretical Neuroscience UC Berkeley Berkeley CA USA. RIKEN AIP Tokyo Japan. Research Center for Advanced Science and Technology (RCAST) The University of Tokyo Tokyo Japan. School of Computer Science University of Sydney Sydney New South Wales Australia. Texas A&M University College Station TX USA. Cullen College of Engineering University of Houston Houston TX USA. Graduate Institute of Biomedical Engineering National Taiwan University of Science and Technology Taipei Taiwan. National Centre for Computer Animation Bournemouth University Poole UK. PROPHESEE Paris France. Department of Neuroscience Columbia University New York NY USA. Mortimer B. Zuckerman Mind Brain Behavior Institute Columbia University New York NY USA. Department of Computer Science Northern Illinois Universit

BigNeuron is an open community bench-testing platform with the goal of setting open standards for accurate and fast automatic neuron tracing. We gathered a diverse set of image volumes across several species that is representative of the data obtained in many neuroscience laboratories interested in neuron tracing. Here, we report generated gold standard manual annotations for a subset of the available imaging datasets and quantified tracing quality for 35 automatic tracing algorithms. The goal of generating such a hand-curated diverse dataset is to advance the development of tracing algorithms and enable generalizable benchmarking. Together with image quality features, we pooled the data in an interactive web application that enables users and developers to perform principal component analysis, t-distributed stochastic neighbor embedding, correlation and clustering, visualization of imaging and tracing data, and benchmarking of automatic tracing algorithms in user-defined data subsets. The image quality metrics explain most of the variance in the data, followed by neuromorphological features related to neuron size. We observed that diverse algorithms can provide complementary information to obtain accurate results and developed a method to iteratively combine methods and generate consensus reconstructions. The consensus trees obtained provide estimates of the neuron structure ground truth that typically outperform single algorithms in noisy datasets. However, specific algorithms may outperform the consensus tree strategy in specific imaging conditions. Finally, to aid users in predicting the most accurate automatic tracing results without manual annotations for comparison, we used support vector machine regression to predict reconstruction quality given an image volume and a set of automatic tracings.

关键词：

Metrics Reloaded: Recommendations for image analysis validation

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Maier-Hein, Lena Reinke, Annika Godau, Patrick Tizabi, Minu D. Buettner, Florian Christodoulou, Evangelia Glocker, Ben Isensee, Fabian Kleesiek, Jens Kozubek, Michal Reyes, Mauricio Riegler, Michael A. Wiesenfarth, Manuel Emre Kavur, A. Sudre, Carole H. Baumgartner, Michael Eisenmann, Matthias Heckmann-Nötzel, Doreen Rädsch, Tim Acion, Laura Antonelli, Michela Arbel, Tal Bakas, Spyridon Benis, Arriel Blaschko, Matthew B. Jorge Cardoso, M. Cheplygina, Veronika Cimini, Beth A. Collins, Gary S. Farahani, Keyvan Ferrer, Luciana Galdran, Adrian Ginneken, Bram Van Haase, Robert Hashimoto, Daniel A. Hoffman, Michael M. Huisman, Merel Jannin, Pierre Kahn, Charles E. Kainmueller, Dagmar Kainz, Bernhard Karargyris, Alexandros Karthikesalingam, Alan Kenngott, Hannes Kofler, Florian Kopp-Schneider, Annette Kreshuk, Anna Kurc, Tahsin Landman, Bennett A. Litjens, Geert Madani, Amin Maier-Hein, Klaus Martel, Anne L. Mattson, Peter Meijering, Erik Menze, Bjoern Moons, Karel G.M. Müller, Henning Nichyporuk, Brennan Nickel, Felix Petersen, Jens Rajpoot, Nasir Rieke, Nicola Saez-Rodriguez, Julio Sánchez, Clara I. Shetty, Shravya Smeden, Maarten Van Summers, Ronald M. Taha, Abdel A. Tiulpin, Aleksei Tsaftaris, Sotirios A. Calster, Ben Van Varoquaux, Gaël Jäger, Paul F. Heidelberg Division of Intelligent Medical Systems and HI Helmholtz Imaging Germany Faculty of Mathematics and Computer Science and Medical Faculty Heidelberg University Heidelberg Germany NCT Heidelberg a partnership between DKFZ University Medical Center Heidelberg Germany Faculty of Mathematics and Computer Science Heidelberg University Heidelberg Germany Heidelberg Division of Intelligent Medical Systems Germany partner site Frankfurt/Mainz a partnership between DKFZ and UCT Frankfurt-Marburg Germany Heidelberg Goethe University Frankfurt Germany Department of Medicine Goethe University Frankfurt Germany Department of Informatics Frankfurt Cancer Insititute Germany Department of Computing Imperial College London London United Kingdom Heidelberg Division of Medical Image Computing and HI Applied Computer Vision Lab Germany Institute for AI in Medicine University Medicine Essen Essen Germany Centre for Biomedical Image Analysis Faculty of Informatics Masaryk University Brno Czech Republic ARTORG Center for Biomedical Engineering Research University of Bern Bern Switzerland Department of Radiation Oncology University Hospital Bern University of Bern Bern Switzerland Simula Metropolitan Center for Digital Engineering Oslo Norway UiT The Arctic University of Norway Romsø Norway Heidelberg Division of Biostatistics Germany Heidelberg Division of Intelligent Medical Systems Division of Medical Image Computing HI Applied Computer Vision Lab Germany MRC Unit for Lifelong Health and Ageing UCL Centre for Medical Image Computing Department of Computer Science University College London London United Kingdom School of Biomedical Engineering and Imaging Science King’s College London London United Kingdom Heidelberg Division of Medical Image Computing Germany Instituto de Cálculo CONICET – Universidad de Buenos Aires Buenos Aires Argentina Centre for Medical Image Computing University College London London United Kingdom McGill University Montréal

Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen performance metrics often do not reflect the domain interest, thus failing to adequately measure scientific progress and hindering translation of ML techniques into practice. To overcome this, we created Metrics Reloaded, a comprehensive framework guiding researchers in the problem-aware selection of metrics. It was developed by a large international consortium in a multi-stage Delphi process and is based on the novel concept of a problem fingerprint – a structured representation of the given problem that captures all aspects that are relevant for metric selection, from the domain interest to the properties of the target structure(s), data set and algorithm output. Based on the problem fingerprint, users are guided through the process of choosing and applying appropriate validation metrics while being made aware of potential pitfalls. Metrics Reloaded targets image analysis problems that can be interpreted as a classification task at image, object or pixel level, namely image-level classification, object detection, semantic segmentation, and instance segmentation tasks. To improve the user experience, we implemented the framework in the Metrics Reloaded online tool. Following the convergence of ML methodology across application domains, Metrics Reloaded fosters the convergence of validation methodology. Its applicability is demonstrated for various biomedical use cases. © 2022, CC BY.

关键词： Semantic Segmentation

Forecasting of jump arrivals in stock prices: New attention-based network architecture using limit order book data

学校读者我要写书评

暂无评论

arXiv 2018年

作者： Mäkinen, Milla Kanniainen, Juho Gabbouj, Moncef Iosifidis, Alexandros Laboratory of Signal Processing Tampere University of Technology Finland Laboratory of Industrial and Information Management Tampere University of Technology Finland Department of Engineering Electrical and Computer Engineering Aarhus University Denmark

The existing literature provides evidence that limit order book data can be used to predict short-term price movements in stock markets. This paper proposes a new neural network architecture for predicting return jump arrivals in equity markets with high-frequency limit order book data. This new architecture, based on Convolutional Long Short-Term Memory with Attention, is introduced to apply time series representation learning with memory and to focus the prediction attention on the most important features to improve performance. The data set consists of order book data on five liquid U.S. stocks. The use of the attention mechanism makes it possible to analyze the importance of the inclusion limit order book data and other input variables. By using this mechanism, we provide evidence that the use of limit order book data was found to improve the performance of the proposed model in jump prediction, either clearly or marginally, depending on the underlying stock. This suggests that path-dependence in limit order book markets is a stock specific feature. Moreover, we find that the proposed approach with an attention mechanism outperforms the multi-layer perceptron network as well as the convolutional neural network and Long Short-Term memory model. Copyright © 2018, The Authors. All rights reserved.

关键词： Long short-term memory

Neural signatures of motor skill in the resting brain

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Özdenizci, Ozan Meyer, Timm Wichmann, Felix Peters, Jan Schölkopf, Bernhard Çetin, Müjdat Grosse-Wentrup, Moritz Department of Electrical and Computer Engineering Northeastern University BostonMA United States Signal Processing and Information Systems Laboratory Faculty of Engineering and Natural Sciences Sabancı University Istanbul Turkey Max Planck Institute for Intelligent Systems Tübingen Germany Faculty of Science University of Tübingen Bernstein Center for Computational Neuroscience Tübingen Tübingen Germany FG Intelligente Autonome Systeme Technische Universität Darmstadt Darmstadt Germany Department of Electrical and Computer Engineering University of Rochester RochesterNY United States Research Group Neuroinformatics Faculty of Computer Science University of Vienna Vienna Austria

Stroke-induced disturbances of large-scale cortical networks are known to be associated with the extent of motor deficits. We argue that identifying brain networks representative of motor behavior in the resting brain would provide significant insights for current neurorehabilitation approaches. Particularly, we aim to investigate the global configuration of brain rhythms and their relation to motor skill, instead of learning performance as broadly studied. We empirically approach this problem by conducting a three-dimensional physical space visuomotor learning experiment during electroencephalographic (EEG) data recordings with thirty-seven healthy participants. We demonstrate that across-subjects variations in average movement smoothness as the quantified measure of subjects' motor skills can be predicted from the global configuration of resting-state EEG alpha-rhythms (8-14 Hz) recorded prior to the experiment. Importantly, this neural signature of motor skill was found to be orthogonal to (independent of) task- as well as to learning-related changes in alpha-rhythms, which we interpret as an organizing principle of the brain. We argue that disturbances of such configurations in the brain may contribute to motor deficits in stroke, and that reconfiguring stroke patients' brain rhythms by neurofeedback may enhance post-stroke neurorehabilitation. Copyright © 2019, The Authors. All rights reserved.

关键词： Electroencephalography

AIM 2019 challenge on real-world image super-resolution: Methods and results

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Lugmayr, Andreas Danelljan, Martin Timofte, Radu Fritsche, Manuel Gu, Shuhang Purohit, Kuldeep Kandula, Praveen Suin, Maitreya Rajagopalan, A.N. Joon, Nam Hyung Won, Yu Seung Kim, Guisik Kwon, Dokyeong Hsu, Chih-Chung Lin, Chia-Hsiang Huang, Yuanfei Sun, Xiaopeng Lu, Wen Li, Jie Gao, Xinbo Bell-Kligler, Sefi Computer Vision Lab ETH Zurich Indian Institute Of Technology Madras India Image Communication & Signal Processing Laboratory Hanyang University Seoul Korea Republic of CVML Chung-Ang University Department Management Information Systems National Pingtung University of Science and Technology Department of Electrical Engineering National Cheng-Kung University Xidian University Weizmann Institute of Science Israel

This paper reviews the AIM 2019 challenge on real world super-resolution. It focuses on the participating methods and final results. The challenge addresses the real world setting, where paired true high and low-resolution images are unavailable. For training, only one set of source input images is therefore provided in the challenge. In Track 1: Source Domain the aim is to super-resolve such images while preserving the low level image characteristics of the source input domain. In Track 2: Target Domain a set of high-quality images is also provided for training, that defines the output domain and desired quality of the superresolved images. To allow for quantitative evaluation, the source input images in both tracks are constructed using artificial, but realistic, image degradations. The challenge is the first of its kind, aiming to advance the state-of-the-art and provide a standard benchmark for this newly emerging task. In total 7 teams competed in the final testing phase, demonstrating new and innovative solutions to the problem. Copyright © 2019, The Authors. All rights reserved.

关键词： Optical resolving power

Linear Degrees of Freedom for K-user MISO Interference Channels With Blind Interference Alignment

学校读者我要写书评

暂无评论

Linear Degrees of Freedom for K-user MISO Interference Chann...

作者： Yang, Heecheol Shin, Wonjae Lee, Jungwoo Wireless Signal Processing Laboratory Department of Electrical and Computer Engineering Seoul National University Seoul08826 Korea Republic of

In this paper, we characterize the degrees of freedom (DoF) for K-user M × 1 multiple-input single-output interference channels with reconfigurable antennas, which have N-preset modes at the receivers, assuming linear coding strategies in the absence of channel state information at the transmitters, i.e., blind interference alignment. Our linear DoF converse builds on the lemma that if a set of transmit symbols is aligned at their common unintended receivers, those symbols must have independent signal subspace at their corresponding receivers. This lemma arises from the inherent feature that channel state's changing patterns of the links towards the same receiver are always identical, assuming that the coherence time of the channel is long enough. We derive an upper bound for the linear sum DoF, and propose an achievable scheme that exactly achieves the linear sum DoF upper bound when both of the n∗/M=R1 and MK/n∗=R2 are integers, where n∗ denotes the optimal number of preset modes out of N preset modes. For the other cases, where either R1 or R2 is not an integer, we only give some guidelines how the interfering signals are aligned at the receivers to achieve the upper bound. As an extension, we also show the linear sum DoF upper bound for downlink/uplink cellular networks. © 2017 IEEE.

关键词： Channel state information

An improved dnn-based spectral feature mapping that removes noise and reverberation for robust automatic speech recognition

学校读者我要写书评

暂无评论

arXiv 2018年

作者： Escudero, Juan Pablo Novoa, José Mahu, Rodrigo Wuth, Jorge Huenupán, Fernando Stern, Richard Yoma, Néstor Becerra Electrical Engineering Department Speech Processing and Transmission Laboratory Universidad de Chile Santiago Chile Department of Electrical Engineering Universidad de la Frontera Temuco Chile Department of Electrical and Computer Engineering and Language Technologies Institute Carnegie Mellon University Pittsburgh United States

Reverberation and additive noise have detrimental effects on the performance of automatic speech recognition systems. In this paper we explore the ability of a DNN-based spectral feature mapping to remove the effects of reverberation and additive noise. Experiments with the CHiME-2 database show that this DNN can achieve an average reduction in WER of 4.5%, when compared to the baseline system, at SNRs equal to-6 dB,-3 dB, 0 dB and 3 dB, and just 0.8% at greater SNRs of 6 dB and 9 dB. These results suggest that this DNN is more effective in removing additive noise than reverberation. To improve the DNN performance, we combine it with the weighted prediction error (WPE) method that shows a complementary behavior. While this combination provided a reduction in WER of approximately 11% when compared with the baseline, the observed improvement is not as great as that obtained using WPE alone. However, modifications to the DNN training process were applied and an average reduction in WER equal to 18.3% was achieved when compared with the baseline system. Furthermore, the improved DNN combined with WPE achieves a reduction in WER of 7.9% when compared with WPE alone. Copyright © 2018, The Authors. All rights reserved.

关键词： speech enhancement