检索结果-内蒙古大学图书馆

Dynamic Gesture Recognition with Pose-based CNN Features derived from videos using LSTM 18

学校读者我要写书评

暂无评论

Dynamic Gesture Recognition with Pose-based CNN Features der...

Proceedings of the 11th Indian Conference on computer vision, Graphics and Image Processing

作者： Kankana Roy Rajiv R. Sahay Computational Vision Laboratory Department of Computer Science and Engineering Indian Institute of Technology Kharagpur Computational Vision Laboratory Department of Electrical Engineering Indian Institute of Technology Kharagpur

ISBN: (纸本)9781450366151

In this work, we address the problem of dynamic gesture recognition using a pose based video descriptor. The proposed approach takes as input video frames and extracts pose-specific image regions which are further processed by a pre-trained Convolutional Neural Network (CNN) to derive a pose-based descriptor for each frame. A Long Short Term Memory (LSTM) network is trained from scratch for dynamic gesture classification by learning long-term spatiotemporal relations among features. We also demonstrate that only using video data (RGB frames and optical flow) one can design an effective model for recognizing dynamic gestures. We utilize ChaLearn multi-modal gesture challenge dataset [13] and Cambridge hand gesture dataset [18] for evaluation of the proposed algorithm achieving an accuracy of 91.27% and 96% respectively using only RGB data.

关键词： Long short term memory

Awareness in robotics: An early perspective from the viewpoint of the EIC Pathfinder Challenge "Awareness Inside"

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Santina, Cosimo Della Corbato, Carlos Hernandez Sisman, Burak Leiva, Luis A. Arapakis, Ioannis Vakalellis, Michalis Vanderdonckt, Jean D’Haro, LuisFernando Manzi, Guido Becchio, Cristina Elamrani, Aïda Alirezaei, Mohsen Castellano, Ginevra Dimarogonas, Dimos V. Ghosh, Arabinda Haesaert, Sofie Soudjani, Sadegh Stroeve, Sybert Verschure, Paul Bacciu, Davide Deroy, Ophelia Bahrami, Bahador Gallicchio, Claudio Hauert, Sabine Sanz, Ricardo Lanillos, Pablo Iacca, Giovanni Sigg, Stephan Gasulla, Manel Steels, Luc Sierra, Carles Department of Cognitive Robotics Delft University of Technology Delft Netherlands Oberpfaffenhofen Germany Department of Computer Science University of Luxembourg Luxembourg 4 Telefónica I+D Spain AEGIS IT Research GmbH Germany Université catholique de Louvain Belgium Speech Technology and Machine Learning Group ETSI de Telecomunicación Universidad Politécnica de Madrid Madrid Spain Alien Venture Studio Alien Technology Transfer Rome Italy Hamburg Germany Institut Jean Nicod École Normale Supérieure Paris France Research Technology and Development Department Digital Industry Software Helmond Netherlands Department of Information Technology Uppsala University Uppsala Sweden Division of Decision and Control Systems School of Electrical Engineering and Computer Science KTH Royal Institute of Technology Stockholm Sweden Max Planck Institute for Software Systems Kaiserslautern Germany Department of Electrical Engineering Control Systems Group Eindhoven University of Technology Eindhoven Netherlands Amsterdam Netherlands Donders Centre for Neuroscience Radboud University Nijmegen Netherlands Computer Science Department University of Pisa Pisa Italy Faculty of Philosophy Philosophy of Science The Study of Religion Ludwig Maximilian University of Munich Munich Germany School of Engineering Mathematics and Technology University of Bristol Bristol United Kingdom Autonomous Systems Laboratory Universidad Politécnica de Madrid Spain Madrid Spain Department of Information Engineering and Computer Science University of Trento Trento Italy Department of Information and Communications Engineering Aalto University Espoo Finland Department of Electronic Engineering Universitat Politècnica de Catalunya Barcelona Spain Studio Stelluti Brussels Belgium Barcelona Spain

Consciousness has been historically a heavily debated topic in engineering, science, and philosophy. On the contrary, awareness had less success in raising the interest of scholars in the past. However, things are changing as more and more researchers are getting interested in answering questions concerning what awareness is and how it can be artificially generated. The landscape is rapidly evolving, with multiple voices and interpretations of the concept being conceived and techniques being developed. The goal of this paper is to summarize and discuss the ones among these voices that are connected with projects funded by the EIC Pathfinder Challenge called "Awareness Inside", a nonrecurring call for proposals within Horizon Europe that was designed specifically for fostering research on natural and synthetic awareness. In this perspective, we dedicate special attention to challenges and promises of applying synthetic awareness in robotics, as the development of mature techniques in this new field is expected to have a special impact on generating more capable and trustworthy embodied systems. © 2024, CC BY.

关键词： Robotics

Automatic Classification of Strain in the Singing Voice Using Machine Learning

学校读者我要写书评

暂无评论

Journal of Voice 2025年

作者： Liu, Yuanyuan Reddy, Mittapalle Kiran Yagnavajjula, Madhu Keerthana Räsänen, Okko Alku, Paavo Ikävalko, Tero Hakanpää, Tua Öyry, Aleksi Laukkanen, Anne-Maria Speech and Voice Research Laboratory Tampere University Tampere 33100 Finland Department of Computer Science and Engineering Indian Institute of Information Technology Raichur Karanataka Raichur 584135 India Advanced Technology Development Centre Indian Institute of Technology Kharagpur West Bengal Kharagpur 721302 India Unit of Computing Sciences Tampere University Tampere 33720 Finland Department of Information and Communications Engineering Aalto University Espoo 02150 Finland Faculty of Education University of Turku Turku 20014 Finland Aalto Acoustics Lab Aalto University Espoo 02150 Finland

Objectives: Classifying strain in the singing voice can help protect professional singers from vocal overuse and support singing training. This study investigates whether machine learning can automatically classify singing voices into two levels of perceived strain. The singing samples represent two genres: classical and contemporary commercial music (CCM). Methods: A total of 324 singing voice samples from 15 professional normophonic singers (nine female, six male) were analyzed. Nine singers were classical, and six were CCM singers. The samples consisted of syllable strings produced at three to six pitches and three loudness levels. Based on expert auditory-perceptual ratings, the samples were categorized into two strain levels: normal-mild and moderate-severe. Three acoustic feature sets (mel-frequency cepstral coefficients (MFCCs), the extended Geneva Minimalistic Acoustic Parameter Set (eGeMAPS), and wavelet scattering features) were compared using two classifier models [support vector machine (SVM) and multilayer perceptron (MLP)]. Feature selection was performed using recursive feature elimination, and the Mann-Whitney U test was used to assess the discriminative power of the selected features. Results: The highest classification accuracy of 86.1% was achieved using a subset of wavelet scattering features with the MLP classifier. A comparison between individual features showed that the first MFCC coefficient, representing spectral tilt, exhibited the greatest between-class separation. Conclusion: This study demonstrates that machine learning models utilizing selected acoustic features can classify perceptual strain of singing voices automatically with high accuracy. These preliminary findings highlight the potential for larger studies involving more diverse singer groups across different genres. © 2025 The Authors

关键词： Auditive-perceptual evaluation—Support vector machine—Multiple layer perceptron—Fisher vector—Wavelet scattering coefficients—Mel-frequency cepstral coefficients

Efficient MedSAMs: Segment Anything in Medical Images on Laptop

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Ma, Jun Li, Feifei Kim, Sumin Asakereh, Reza Le, Bao-Hiep Nguyen-Vu, Dang-Khoa Pfefferle, Alexander Wei, Muxin Gao, Ruochen Lyu, Donghang Yang, Songxiao Purucker, Lennart Marinov, Zdravko Staring, Marius Lu, Haisheng Dao, Thuy Thanh Ye, Xincheng Li, Zhi Brugnara, Gianluca Vollmuth, Philipp Foltyn-Dumitru, Martha Cho, Jaeyoung Mahmutoglu, Mustafa Ahmed Bendszus, Martin Pflüger, Irada Rastogi, Aditya Ni, Dong Yang, Xin Zhou, Guang-Quan Wang, Kaini Heller, Nicholas Papanikolopoulos, Nikolaos Weight, Christopher Tong, Yubing Udupa, Jayaram K. Patrick, Cahill J. Wang, Yaqi Zhang, Yifan Contijoch, Francisco McVeigh, Elliot Ye, Xin He, Shucheng Haase, Robert Pinetz, Thomas Radbruch, Alexander Krause, Inga Kobler, Erich He, Jian Tang, Yucheng Yang, Haichun Huo, Yuankai Luo, Gongning Kushibar, Kaisar Amankulov, Jandos Toleshbayev, Dias Mukhamejan, Amangeldi Egger, Jan Pepe, Antonio Gsaxner, Christina Luijten, Gijs Fujita, Shohei Kikuchi, Tomohiro Wiestler, Benedikt Kirschke, Jan S. de la Rosa, Ezequiel Bolelli, Federico Lumetti, Luca Grana, Costantino Xie, Kunpeng Wu, Guomin Puladi, Behrus Martín-Isla, Carlos Lekadir, Karim Campello, Victor M. Shao, Wei Brisbane, Wayne Jiang, Hongxu Wei, Hao Yuan, Wu Li, Shuangle Zhou, Yuyin Wang, Bo AI Collaborative Centre University Health Network Department of Laboratory Medicine and Pathobiology University of Toronto Vector Institute Toronto Canada Peter Munk Cardiac Centre University Health Network Toronto Canada Toronto General Hospital Research Institute University Health Network Department of Computer Science University of Toronto University Health Network Vector Institute Toronto Canada University of Science Vietnam National University Ho Chi Minh City Viet Nam Institute of Computer Science University of Freiburg Freiburg Germany School of Medicine and Health Harbin Institute of Technology Harbin China Division of Image Processing Department of Radiology Leiden University Medical Center Leiden Netherlands Department of System and Control Engineering School of Engineering Institute of Science Tokyo Formerly Tokyo Institute of Technology Tokyo Japan Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Karlsruhe Germany School of Information and Communication Engineering University of Electronic Science and Technology of China Chengdu China School of Electrical Engineering and Computer Science University of Queensland Brisbane Australia School of Cyberspace Hangzhou Dianzi University Hangzhou China Division for Computational Radiology and Clinical AI The Department of Neuroradiology University Hospital Bonn Germany Division for Computational Radiology and Clinical AI The Department of Neuroradiology University Hospital Bonn Germany Department of Neuroradiology Heidelberg University Hospital Heidelberg Germany Division for Computational Radiology and Clinical AI Department of Neuroradiology University Hospital Bonn Germany School of Biomedical Engineering Shenzhen University Shenzhen China School of Biological Science and Medical Engineering Southeast University Nanjing China Department of Urology Cleveland Clinic Cleveland United States Department of Computer Science University of Minnesota Minneapolis United St

Promptable segmentation foundation models have emerged as a transformative approach to addressing the diverse needs in medical images, but most existing models require expensive computing, posing a big barrier to their adoption in clinical practice. In this work, we organized the first international competition dedicated to promptable medical image segmentation, featuring a large-scale dataset spanning nine common imaging modalities from over 20 different institutions. The top teams developed lightweight segmentation foundation models and implemented an efficient inference pipeline that substantially reduced computational requirements while maintaining state-of-the-art segmentation accuracy. Moreover, the post-challenge phase advanced the algorithms through the design of performance booster and reproducibility tasks, resulting in improved algorithms and validated reproducibility of the winning solution. Furthermore, the best-performing algorithms have been incorporated into the open-source software with a user-friendly interface to facilitate clinical adoption. The data and code are publicly available to foster the further development of medical image segmentation foundation models and pave the way for impactful real-world applications. © 2024, CC BY-NC-SA.

关键词： Open source software

RFN-Nest: An end-to-end residual fusion network for infrared and visible images

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Li, Hui Wu, Xiao-Jun Kittler, Josef Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence School of Artificial Intelligence and Computer Science Jiangnan University Wuxi214122 China The Center for Vision Speech and Signal Processing University of Surrey GuildfordGU2 7XH United Kingdom

In the image fusion field, the design of deep learning-based fusion methods is far from routine. It is invariably fusion-task specific and requires a careful consideration. The most difficult part of the design is to choose an appropriate strategy to generate the fused image for a specific task in hand. Thus, devising learnable fusion strategy is a very challenging problem in the community of image fusion. To address this problem, a novel end-to-end fusion network architecture (RFN-Nest) is developed for infrared and visible image fusion. We propose a residual fusion network (RFN) which is based on a residual architecture to replace the traditional fusion approach. A novel detail-preserving loss function, and a feature enhancing loss function are proposed to train RFN. The fusion model learning is accomplished by a novel two-stage training strategy. In the first stage, we train an auto-encoder based on an innovative nest connection (Nest) concept. Next, the RFN is trained using the proposed loss functions. The experimental results on public domain data sets show that, compared with the existing methods, our end-to-end fusion network delivers a better performance than the state-of-the-art methods in both subjective and objective evaluation. The code of our fusion method is available at https://***/hli1221/imagefusion-rfn-nest. © 2021, CC BY-NC-ND.

关键词： Image fusion

PPT Fusion: Pyramid Patch Transformer for a Case Study in Image Fusion

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Fu, Yu Xu, Tianyang Wu, Xiao-Jun Kittler, Josef Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence School of Artificial Intelligence and Computer Science Jiangnan University Wuxi 214122 China Centre for Vision Speech and Signal Processing University of Surrey GuildfordGU2 7XH United Kingdom

The Transformer architecture has witnessed a rapid development in recent years, outperforming the CNN architectures in many computer vision tasks, as exemplified by the vision Transformers (ViT) for image classification. However, existing visual transformer models aim to extract semantic information for high-level tasks, such as classification and detection. These methods ignore the importance of the spatial resolution of the input image, thus sacrificing the local correlation information of neighboring pixels. In this paper, we propose a Patch Pyramid Transformer(PPT) to effectively address the above issues. Specifically, we first design a Patch Transformer to transform the image into a sequence of patches, where transformer encoding is performed for each patch to extract local representations. In addition, we construct a Pyramid Transformer to effectively extract the non-local information from the entire image. After obtaining a set of multi-scale, multi-dimensional, and multi-angle features of the original image, we design the image reconstruction network to ensure that the features can be reconstructed into the original input. To validate the effectiveness, we apply the proposed Patch Pyramid Transformer to image fusion tasks. The experimental results demonstrate its superior performance, compared to the state-of-the-art fusion approaches, achieving the best results on several evaluation indicators. Thanks to the underlying representational capacity of the PPT network, it can directly be applied to different image fusion tasks without redesigning or retraining the network. Copyright © 2021, The Authors. All rights reserved.

关键词： Deep learning

Dual-teacher: Integrating intra-domain and inter-domain teachers for annotation-efficient cardiac segmentation 23rd

学校读者我要写书评

暂无评论

Dual-teacher: Integrating intra-domain and inter-domain teac...

23rd International Conference on Medical Image Computing and computer-Assisted Intervention, MICCAI 2020

作者： Li, Kang Wang, Shujun Yu, Lequan Heng, Pheng-Ann Department of Computer Science and Engineering The Chinese University of Hong Kong Shatin Hong Kong Department of Radiation Oncology Stanford University Stanford United States Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences Shenzhen China

ISBN: (纸本)9783030597092

Medical image annotations are prohibitively time-consuming and expensive to obtain. To alleviate annotation scarcity, many approaches have been developed to efficiently utilize extra information, e.g., semi-supervised learning further exploring plentiful unlabeled data, domain adaptation including multi-modality learning and unsupervised domain adaptation resorting to the prior knowledge from additional modality. In this paper, we aim to investigate the feasibility of simultaneously leveraging abundant unlabeled data and well-established cross-modality data for annotation-efficient medical image segmentation. To this end, we propose a novel semi-supervised domain adaptation approach, namely Dual-Teacher, where the student model not only learns from labeled target data (e.g., CT), but also explores unlabeled target data and labeled source data (e.g., MR) by two teacher models. Specifically, the student model learns the knowledge of unlabeled target data from intra-domain teacher by encouraging prediction consistency, as well as the shape priors embedded in labeled source data from inter-domain teacher via knowledge distillation. Consequently, the student model can effectively exploit the information from all three data resources and comprehensively integrate them to achieve improved performance. We conduct extensive experiments on MM-WHS 2017 dataset and demonstrate that our approach is able to concurrently utilize unlabeled data and cross-modality data with superior performance, outperforming semi-supervised learning and domain adaptation methods with a large margin. © Springer Nature Switzerland AG 2020.

关键词： Distillation

Robust Deep Learning Framework for Predicting Respiratory Anomalies and Diseases 42

学校读者我要写书评

暂无评论

Robust Deep Learning Framework for Predicting Respiratory An...

42nd Annual International Conferences of the IEEE engineering in Medicine and Biology Society, EMBC 2020

作者： Pham, Lam McLoughlin, Ian Phan, Huy Tran, Minh Nguyen, Truc Palaniappan, Ramaswamy University of Kent School of Computing Medway Kent United Kingdom University of Science and Technology of China National Engineering Laboratory for Speech and Language Information Processing Hefei China Queen Mary University School of Electronic Engineering and Computer Science London United Kingdom University of Oxford Nuffield Department of Anaesthesia United Kingdom Graz University of Technology Signal Processing and Speech Communication Lab Austria

ISBN: (数字)9781728119908

ISBN: (纸本)9781728119908

This paper presents a robust deep learning framework developed to detect respiratory diseases from recordings of respiratory sounds. The complete detection process firstly involves front end feature extraction where recordings are transformed into spectrograms that convey both spectral and temporal information. Then a back-end deep learning model classifies the features into classes of respiratory disease or anomaly. Experiments, conducted over the ICBHI benchmark dataset of respiratory sounds, evaluate the ability of the framework to classify sounds. Two main contributions are made in this paper. Firstly, we provide an extensive analysis of how factors such as respiratory cycle length, time resolution, and network architecture, affect final prediction accuracy. Secondly, a novel deep learning based framework is proposed for detection of respiratory diseases and shown to perform extremely well compared to state of the art methods. © 2020 IEEE.

关键词： Network architecture

Cascaded Robust Learning at Imperfect Labels for Chest X-ray Segmentation 23rd

学校读者我要写书评

暂无评论

Cascaded Robust Learning at Imperfect Labels for Chest X-ray...

23rd International Conference on Medical Image Computing and computer-Assisted Intervention, MICCAI 2020

作者： Xue, Cheng Deng, Qiao Li, Xiaomeng Dou, Qi Heng, Pheng-Ann Department of Computer Science and Engineering The Chinese University of Hong Kong Sha Tin Hong Kong Department of Radiation Oncology Stanford University Stanford United States Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences Shenzhen China

ISBN: (纸本)9783030597245

The superior performance of CNN on medical image analysis heavily depends on the annotation quality, such as the number of labeled images, the source of images, and the expert experience. The annotation requires great expertise and labor. To deal with the high inter-rater variability, the study of the imperfect label has great significance in medical image segmentation tasks. In this paper, we present a novel cascaded robust learning framework for chest X-ray segmentation with imperfect annotation at the boundary. Our model consists of three independent networks, which can effectively learn useful information from peer networks. The framework includes two stages. In the first stage, we select the clean annotated samples via a model committee setting, the networks are trained by minimizing a segmentation loss using the selected clean samples. In the second stage, we design a joint optimization framework with label correction to gradually correct the wrong annotation and improve the network performance. We conduct experiments on the public chest X-ray image datasets collected by Shenzhen Hospital. The results show that our methods could achieve a significant improvement on the accuracy in segmentation tasks compared to the previous methods. © 2020, Springer Nature Switzerland AG.

关键词： Medical imaging