检索结果-内蒙古大学图书馆

arXiv 2019年

作者： Peris, Álvaro Casacuberta, Francisco Pattern Recognition and Human Language Technology Research Center Universitat Politècnica de València València Spain

Despite the advances achieved by neural models in sequence to sequence learning, exploited in a variety of tasks, they still make errors. In many use cases, these are corrected by a human expert in a posterior revision process. The interactive-predictive framework aims to minimize the human effort spent on this process by considering partial corrections for iteratively refining the hypothesis. In this work, we generalize the interactive-predictive approach, typically applied in to machine translation field, to tackle other multimodal problems namely, image and video captioning. We study the application of this framework to multimodal neural sequence to sequence models. We show that, following this framework, we approximately halve the effort spent for correcting the outputs generated by the automatic systems. Moreover, we deploy our systems in a publicly accessible demonstration, that allows to better understand the behavior of the interactive-predictive framework. Copyright © 2019, The Authors. All rights reserved.

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

A comparative study on vocabulary reduction for phrase table smoothing

arXiv

引用

arXiv 2019年

作者： Kim, Yunsu Guta, Andreas Wuebker, Joern Ney, Hermann Human Language Technology and Pattern Recognition Group RWTH Aachen University Aachen Germany Lilt Inc

This work systematically analyzes the smoothing effect of vocabulary reduction for phrase translation models. We extensively compare various word-level vocabularies to show that the performance of smoothing is not significantly affected by the choice of vocabulary. This result provides empirical evidence that the standard phrase translation model is extremely sparse. Our experiments also reveal that vocabulary reduction is more effective for smoothing large-scale phrase tables. Copyright © 2019, The Authors. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Comparison of lattice-free and lattice-based sequence discriminative training criteria for LVCSR

arXiv

引用

arXiv 2019年

作者： Michel, Wilfried Schlüter, Ralf Ney, Hermann Human Language Technology and Pattern Recognition Computer Science Department RWTH Aachen University Aachen52056 Germany

Sequence discriminative training criteria have long been a standard tool in automatic speech recognition for improving the performance of acoustic models over their maximum likelihood / cross entropy trained counterparts. While previously a lattice approximation of the search space has been necessary to reduce computational complexity, recently proposed methods use other approximations to dispense of the need for the computationally expensive step of separate lattice creation. In this work we present a memory efficient implementation of the forward-backward computation that allows us to use unigram word-level language models in the denominator calculation while still doing a full summation on GPU. This allows for a direct comparison of lattice-based and lattice-free sequence discriminative training criteria such as MMI and sMBR, both using the same language model during training. We compared performance, speed of convergence, and stability on large vocabulary continuous speech recognition tasks like Switchboard and Quaero. We found that silence modeling seriously impacts the performance in the lattice-free case and needs special treatment. In our experiments lattice-free MMI comes on par with its lattice-based counterpart. Lattice-based sMBR still outperforms all lattice-free training criteria. Copyright © 2019, The Authors. All rights reserved.

关键词： Acoustic Modeling

来源：评论

学校读者我要写书评

暂无评论

A Comparison of Transformer and LSTM Encoder Decoder Models for ASR

A Comparison of Transformer and LSTM Encoder Decoder Models ...

引用

IEEE Workshop on Automatic Speech recognition and Understanding

作者： Albert Zeyer Parnia Bahar Kazuki Irie Ralf Schlüter Hermann Ney AppTek GmbH Aachen Germany Human Language Technology and Pattern Recognition RWTH Aachen University Aachen Germany

ISBN: (数字)9781728103068

ISBN: (纸本)9781728103075

We present competitive results using a Transformer encoder-decoder-attention model for end-to-end speech recognition needing less training time compared to a similarly performing LSTM model. We observe that the Transformer training is in general more stable compared to the LSTM, although it also seems to overfit more, and thus shows more problems with generalization. We also find that two initial LSTM layers in the Transformer encoder provide a much better positional encoding. Data-augmentation, a variant of SpecAugment, helps to improve both the Transformer by 33% and the LSTM by 15% relative. We analyze several pretraining and scheduling schemes, which is crucial for both the Transformer and the LSTM models. We improve our LSTM model by additional convolutional layers. We perform our experiments on Lib-riSpeech 1000h, Switchboard 300h and TED-LIUM-v2 200h, and we show state-of-the-art performance on TED-LIUM-v2 for attention based end-to-end models. We deliberately limit the training on LibriSpeech to 12.5 epochs of the training data for comparisons, to keep the results of practical interest, although we show that longer training time still improves more. We publish all the code and setups to run our experiments.

关键词： Decoding Hidden Markov models Training Convergence Encoding Convolutional codes Data models

来源：评论

学校读者我要写书评

暂无评论

DCFH: A dynamic clustering approach based on fire hawk optimizer in flying ad hoc networks

引用

Vehicular Communications 2024年 47卷

作者： Hosseinzadeh, Mehdi Ali, Saqib Ahmad, Husham Jawad Alanazi, Faisal Yousefpoor, Mohammad Sadegh Yousefpoor, Efat Darwesh, Aso Rahmani, Amir Masoud Lee, Sang-Woong Institute of Research and Development Duy Tan University Da Nang Viet Nam School of Medicine and Pharmacy Duy Tan University Da Nang Viet Nam Department of Information Systems College of Economics and Political Science Sultan Qaboos University Al Khoudh Muscat Oman Department of Communication and Computer Engineering Cihan University-Erbil Kurdistan Region Iraq Department of Electrical Engineering College of Engineering Prince Sattam bin Abdulaziz University Al-Kharj 11942 Saudi Arabia Center of Research and Strategic Studies Lebanese French University Kurdistan Region Iraq Department of Information Technology University of Human Development Kurdistan Region Sulaymaniyah Iraq Future Technology Research Center National Yunlin University of Science and Technology Yunlin Taiwan Pattern Recognition and Machine Learning Lab Gachon University 1342 Seongnamdaero Sujeonggu Seongnam 13120 South Korea

In flying ad hoc networks (FANETs), unmanned aerial vehicles (UAVs) communicate with each other without any fixed infrastructure. Because of frequent topological changes, instability of wireless communication, three-dimensional movement of UAVs, and limited resources, especially energy, FANETs deal with many challenges, especially the instability of UAV swarms. One solution to address these problems is clustering because it maintains network performance and increases scalability. In this paper, a dynamic clustering scheme based on fire hawk optimizer (DCFH) is proposed for FANETs. In DCFH, each cluster head calculates the period of hello messages in its cluster based on its velocity. Then, a fire hawk optimizer (FHO)-based dynamic clustering operation is carried out to determine the role of each UAV (cluster head (CH) or cluster member (CM)) in the network. To calculate the fitness value of each fire hawk, a fitness function is suggested based on four elements, namely the balance of energy consumption, the number of isolated clusters, the distribution of CHs, and the neighbor degree. To improve cluster stability, each CH manages the movement of its CMs and adjusts it based on its movement in the network. In the last phase, DCFH defines a greedy routing process to determine the next-hop node based on a score, which consists of distance between CHs, energy, and buffer capacity. Finally, DCFH is simulated using the network simulator version 2 (NS2), and its performance is compared with three methods, including the mobility-based weighted cluster routing scheme (MWCRSF), the dynamic clustering mechanism (DCM), and the Grey wolf optimization (GWO)-based clustering protocol. The simulation results show that DCFH well manages the number of clusters in the network. It improves the cluster construction time (about 55.51%), cluster lifetime (approximately 11.13%), energy consumption (about 15.16%), network lifetime (about 2.6%), throughput (approximately 3.9%), packet deliver

关键词： Artificial intelligence (AI) Clustering Flying ad hoc networks (FANETs) Optimization algorithms Unmanned aerial vehicles (UAVs)

来源：评论

学校读者我要写书评

暂无评论

An intelligent clustering scheme based on whale optimization algorithm in flying ad hoc networks

引用

Vehicular Communications 2024年 49卷

作者： Hosseinzadeh, Mehdi Tanveer, Jawad Alanazi, Faisal Aurangzeb, Khursheed Yousefpoor, Mohammad Sadegh Yousefpoor, Efat Darwesh, Aso Lee, Sang-Woong Rahmani, Amir Masoud Institute of Research and Development Duy Tan University Da Nang Viet Nam School of Medicine and Pharmacy Duy Tan University Da Nang Viet Nam Department of Computer Science and Engineering Sejong University Seoul 05006 South Korea Department of Electrical Engineering College of Engineering Prince Sattam bin Abdulaziz University Al-Kharj 11942 Saudi Arabia Department of Computer Engineering College of Computer and Information Sciences King Saud University P. O. Box 51178 Riyadh 11543 Saudi Arabia Center of Research and Strategic Studies Lebanese French University Kurdistan Region Iraq Department of Information Technology University of Human Development Kurdistan Region Sulaymaniyah Iraq Pattern Recognition and Machine Learning Lab Gachon University 1342 Seongnamdaero Sujeonggu Seongnam 13120 South Korea Future Technology Research Center National Yunlin University of Science and Technology Yunlin Taiwan

Due to the progress of unmanned aerial vehicles (UAVs), this new technology is widely applied in military and civilian areas. Multi-UAV networks are often known as flying ad hoc networks (FANETs). Due to these applications, FANET must ensure communication stability and have high scalability. These goals are achieved by presenting clustering techniques in FANETs. However, the characteristics of these networks, like high-mobility nodes, limited energy, and dynamic topology, have created great challenges in two important processes of clustering protocols, namely cluster construction and the selection of cluster heads. In this paper, an intelligent clustering scheme based on the whale optimization algorithm called ICW is suggested in flying ad hoc networks. Firstly, each UAV specifies its hello interval based on the lifespan of adjacent links to guarantee the adaptability of ICW to FANET. Then, a centralized clustering process is done using a whale optimization algorithm (WOA) to find the best cluster centers on the network. To determine the membership of each UAV in a cluster, ICW employs a new criterion, i.e. closeness ratio, so that each UAV joins a cluster with the best closeness ratio. In addition, the evaluation of each whale is carried out based on a fitness function, consisting of three components, namely the number of isolated clusters, the ratio of inter-cluster distance to intra-cluster distance, and cluster size. Then, a cluster head is selected for each cluster based on a score value. This score is dependent on the weighted sum of four metrics, namely remaining energy, the average link lifespan between each UAV and its neighbors, neighbor degree, and the average distance between each UAV and its neighbors. In the last step, two routing processes, namely intra-cluster routing and inter-cluster routing, are introduced in FANET. Then, the evaluation and implementation of ICW is performed through the NS2 simulator. After completing the simulation process, ICW i

关键词： Artificial Intelligence (AI) Clustering Flying ad hoc networks (FANETs) Nature-inspired algorithms Unmanned aerial vehicles (UAVs)

来源：评论

学校读者我要写书评

暂无评论

The Vicomtech-PRHLT Speech Transcription Systems for the IberSPEECH-RTVE 2018 Speech to Text Transcription Challenge 4

The Vicomtech-PRHLT Speech Transcription Systems for the Ibe...

引用

4th International Conference on Advances in Speech and language Technologies for Iberian languages, IberSPEECH 2018

作者： Arzelus, Haritz Álvarez, Aitor Bernath, Conrad García, Eneritz Granell, Emilio Martínez-Hinarejos, Carlos D. Vicomtech Human Speech and Language Technology Group Spain Pattern Recognition and Human Language Technologies Research Center Universitat Politècnica de València Spain

This paper describes our joint submission to the IberSPEECH-RTVE Speech to Text Transcription Challenge 2018, which calls for automatic speech transcription systems to be evaluated in realistic TV shows. With the aim of building and evaluating systems, RTVE licensed around 569 hours of different TV programs, which were processed, re-aligned and revised in order to discard segments with imperfect transcriptions. This task reduced the corpus to 136 hours that we considered as nearly perfectly aligned audios and that we employed as in-domain data to train acoustic models. A total of 6 systems were built and presented to the evaluation challenge, three systems per condition. These recognition engines are different versions, evolution and configurations of two main architectures. The first architecture includes an hybrid LSTM-HMM acoustic model, where bidirectional LSTMs were trained to provide posterior probabilities for the HMM states. The language model corresponds to modified Kneser- Ney smoothed 3-gram and 9-gram models used for decoding and re-scoring of the lattices respectively. The second architecture includes an End-To-End based recognition system, which combines 2D convolutional neural networks as spectral feature extractor from spectrograms with bidirectional Gated Recurrent Units as RNN acoustic models. A modified Kneser-Ney smoothed 5-gram model was also integrated to re-score the E2E hypothesis. All the systems' outputs were then punctuated using bidirectional RNN models with attention mechanism and capitalized through recasing techniques. © 4th International Conference, IberSPEECH 2018.

关键词： Speech recognition

来源：评论

学校读者我要写书评

暂无评论

Exploring E2E speech recognition systems for new languages 4

Exploring E2E speech recognition systems for new languages

引用

4th International Conference on Advances in Speech and language Technologies for Iberian languages, IberSPEECH 2018

作者： Bernath, Conrad Álvarez, Aitor Arzelus, Haritz Martínez-Hinarejos, Carlos-D. Human Speech and Language Technology Group Vicomtech Spain Pattern Recognition and Human Language Technologies Research Center Universitat Politècnica de València Spain

Over the last few years, advances in both machine learning algorithms and computer hardware have led to significant improvements in speech recognition technology, mainly through the use of Deep Learning paradigms. As it was amply demonstrated in different studies, Deep Neural Networks (DNNs) have already outperformed traditional Gaussian Mixture Models (GMMs) at acoustic modeling in combination with Hidden Markov Models (HMMs). More recently, new attempts have focused on building end-to-end (E2E) speech recognition architectures, especially in languages with many resources like English and Chinese, with the aim of overcoming the performance of LSTM-HMM and more conventional systems. The aim of this work is first to present the different techniques that have been applied to enhance state-of-the-art E2E systems for American English using publicly available datasets. Secondly, we describe the construction of E2E systems for Spanish and Basque, and explain the strategies applied to overcome the problem of the limited availability of training data, especially for Basque as a low-resource language. At the evaluation phase, the three E2E systems are also compared with LSTM-HMM based recognition engines built and tested with the same datasets. © 4th International Conference, IberSPEECH 2018.

关键词： Hidden Markov models

来源：评论

学校读者我要写书评

暂无评论

Are automatic metrics robust and reliable in specific machine translation tasks? 21

Are automatic metrics robust and reliable in specific machin...

引用

21st Annual Conference of the European Association for Machine Translation, EAMT 2018

作者： Chinea-Rios, Mara Peris, Álvaro Casacuberta, Francisco Pattern Recognition and Human Language Technology Research Center Universitat Politècnica de València València Spain

ISBN: (纸本)9788409019014

We present a comparison of automatic metrics against human evaluations of translation quality in several scenarios which were unexplored up to now. Our experimentation was conducted on translation hypotheses that were problematic for the automatic metrics, as the results greatly diverged from one metric to another. We also compared three different translation technologies. Our evaluation shows that in most cases, the metrics capture the human criteria. However, we face failures of the automatic metrics when applied to some domains and systems. Interestingly, we find that automatic metrics applied to the neural machine translation hypotheses provide the most reliable results. Finally, we provide some advice when dealing with these problematic domains. © 2018 The authors. This article is licensed under a Creative Commons 3.0 licence, no derivative works, attribution, CC-BY-ND.

关键词： Neural machine translation

来源：评论

学校读者我要写书评

暂无评论

Active learning for interactive neural machine translation of data streams 22

Active learning for interactive neural machine translation o...

引用

22nd Conference on Computational Natural language Learning, CoNLL 2018

作者： Peris, Álvaro Casacuberta, Francisco Pattern Recognition and Human Language Technology Research Center Universitat Politècnica de València València Spain

ISBN: (纸本)9781948087728

We study the application of active learning techniques to the translation of unbounded data streams via interactive neural machine translation. The main idea is to select, from an unbounded stream of source sentences, those worth to be supervised by a human agent. The user will interactively translate those samples. Once validated, these data is useful for adapting the neural machine translation model. We propose two novel methods for selecting the samples to be validated. We exploit the information from the attention mechanism of a neural machine translation system. Our experiments show that the inclusion of active learning techniques into this pipeline allows to reduce the effort required during the process, while increasing the quality of the translation system. Moreover, it enables to balance the human effort required for achieving a certain translation quality. Moreover, our neural system outperforms classical approaches by a large margin. © 2018 Association for Computational Linguistics.

关键词： Neural machine translation

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：