检索结果-内蒙古大学图书馆

PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restoration

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Gu, Jinjin Cai, Haoming Chen, Haoyu Ye, Xiaoxing Ren, Jimmy S. Dong, Chao School of Data Science Chinese University of Hong Kong Shenzhen China ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China SenseTime Research SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society China

Image quality assessment (IQA) is the key factor for the fast development of image restoration (IR) algorithms. The most recent IR methods based on Generative Adversarial Networks (GANs) have achieved significant improvement in visual performance, but also presented great challenges for quantitative evaluation. Notably, we observe an increasing inconsistency between perceptual quality and the evaluation results. Then we raise two questions: (1) Can existing IQA methods objectively evaluate recent IR algorithms? (2) When focus on beating current benchmarks, are we getting better IR algorithms? To answer these questions and promote the development of IQA methods, we contribute a large-scale IQA dataset, called Perceptual Image Processing Algorithms (PIPAL) dataset. Especially, this dataset includes the results of GAN-based methods, which are missing in previous datasets. We collect more than 1.13 million human judgments to assign subjective scores for PIPAL images using the more reliable "Elo system". Based on PIPAL, we present new benchmarks for both IQA and super-resolution methods. Our results indicate that existing IQA methods cannot fairly evaluate GAN-based IR algorithms. While using appropriate evaluation methods is important, IQA methods should also be updated along with the development of IR algorithms. At last, we improve the performance of IQA networks on GAN-based distortions by introducing anti-aliasing pooling. Experiments show the effectiveness of the proposed method. Copyright © 2020, The Authors. All rights reserved.

关键词： Image reconstruction

TTPP: Temporal transformer with progressive prediction for efficient action anticipation

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Wang, Wen Peng, Xiaojiang Su, Yanzhou Qiao, Yu Cheng, Jian School of Information and Communication Engineering University of Electronic Science and Technology of China Chengdu Sichuan611731 China ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab. Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society

Video action anticipation aims to predict future action categories from observed frames. Current state-of-the-art approaches mainly resort to recurrent neural networks to encode history information into hidden states, and predict future actions from the hidden representations. It is well known that the recurrent pipeline is inefficient in capturing long-term information which may limit its performance in predication task. To address this problem, this paper proposes a simple yet efficient Temporal Transformer with Progressive Prediction (TTPP) framework, which repurposes a Transformer-style architecture to aggregate observed features, and then leverages a light-weight network to progressively predict future features and actions. Specifically, predicted features along with predicted probabilities are accumulated into the inputs of subsequent prediction. We evaluate our approach on three action datasets, namely TVSeries, THUMOS-14, and TV-Human-Interaction. Additionally we also conduct a comprehensive study for several popular aggregation and prediction strategies. Extensive results show that TTPP not only outperforms the state-of-the-art methods but also more efficient. Copyright © 2020, The Authors. All rights reserved.

关键词： Forecasting

Simultaneous Neural Spike Encoding and Decoding Based on Cross-modal Dual Deep Generative Model

学校读者我要写书评

暂无评论

Simultaneous Neural Spike Encoding and Decoding Based on Cro...

International Joint Conference on Neural Networks (IJCNN)

作者： Qiongyi Zhou Changde Du Dan Li Haibao Wang Jian K. Liu Huiguang He Research Center for Brain-inspired Intelligence and National Laboratory of Pattern Recognition Chinese Academy of Sciences Beijing China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing China Huawei Cloud BU EI Innovation Lab Beijing China Centre for Systems Neuroscience University of Leicester Leicester U.K Center for Excellence in Brain Science and Intelligence Technology Chinese Academy of Sciences Shanghai China

ISBN: (数字)9781728169262

ISBN: (纸本)9781728169279

Neural encoding and decoding of retinal ganglion cells (RGCs) have been attached great importance in the research work of brain-machine interfaces. Much effort has been invested to mimic RGC and get insight into RGC signals to reconstruct stimuli. However, there remain two challenges. On the one hand, complex nonlinear processes in retinal neural circuits hinder encoding models from enhancing their ability to fit the natural stimuli and modelling RGCs accurately. On the other hand, current research of the decoding process is separate from that of the encoding process, in which the liaison of mutual promotion between them is neglected. In order to alleviate the above problems, we propose a cross-modal dual deep generative model (CDDG) in this paper. CDDG treats the RGC spike signals and the stimuli as two modalities, which learns a shared latent representation for the concatenated modality and two modal-specific latent representations. Then, it imposes distribution consistency restriction on different latent space, cross-consistency and cycle-consistency constraints on the generated variables. Thus, our model ensures cross-modal generation from RGC spike signals to stimuli and vice versa. In our framework, the generation from stimuli to RGC spike signals is equivalent to neural encoding while the inverse process is equivalent to neural decoding. Hence, the proposed method integrates neural encoding and decoding and exploits the reciprocity between them. The experimental results demonstrate that our proposed method can achieve excellent encoding and decoding performance compared with the state-of-the-art methods on three salamander RGC spike datasets with natural stimuli.

关键词： Decoding Encoding Retina Visualization Brain modeling Image reconstruction Bidirectional control

BasicVSR: The search for essential components in video super-resolution and beyond

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Chan, Kelvin C.K. Wang, Xintao Yu, Ke Dong, Chao Loy, Chen Change S-Lab Nanyang Technological University Singapore Applied Research Center Tencent PCG CUHK – SenseTime Joint Lab Chinese University of Hong Kong Shenzhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society China

Video super-resolution (VSR) approaches tend to have more components than the image counterparts as they need to exploit the additional temporal dimension. Complex designs are not uncommon. In this study, we wish to untangle the knots and reconsider some most essential components for VSR guided by four basic functionalities, i.e., Propagation, Alignment, Aggregation, and Upsampling. By reusing some existing components added with minimal redesigns, we show a succinct pipeline, BasicVSR, that achieves appealing improvements in terms of speed and restoration quality in comparison to many state-of-the-art algorithms. We conduct systematic analysis to explain how such gain can be obtained and discuss the pitfalls. We further show the extensibility of BasicVSR by presenting an information-refill mechanism and a coupled propagation scheme to facilitate information aggregation. The BasicVSR and its extension, IconVSR, can serve as strong baselines for future VSR approaches. © 2020, CC BY.

关键词： Optical resolving power

OLSR+: A new routing method based on fuzzy logic in flying ad-hoc networks (FANETs)

学校读者我要写书评

暂无评论

Vehicular Communications 2022年 36卷

作者： Rahmani, Amir Masoud Ali, Saqib Yousefpoor, Efat Yousefpoor, Mohammad Sadegh Javaheri, Danial Lalbakhsh, Pooia Hassan Ahmed, Omed Hosseinzadeh, Mehdi Lee, Sang-Woong Future Technology Research Center National Yunlin University of Science and Technology Yunlin Taiwan Department of Information Systems College of Economics and Political Science Sultan Qaboos University Al Khoudh Muscat Oman Department of Computer Engineering Dezful Branch Islamic Azad University Dezful Iran Department of Computer Engineering Chosun University Gwangju 61452 South Korea Department of Data Science and Artificial Intelligence Faculty of Information Technology Monash University Clayton 3800 VIC Australia Department of Information Technology University of Human Development Sulaymaniyah Iraq Pattern Recognition and Machine Learning Lab Gachon University 1342 Seongnamdaero Sujeonggu Seongnam 13120 South Korea

Flying ad-hoc networks (FANETs) have many applications in military, industrial and agricultural areas. Due to specific features of FANETs, such as high-speed nodes, low density of nodes in the network, and rapid changes in the topology, most routing protocols designed for mobile ad hoc networks (MANETs) or vehicular ad hoc networks (VANETs) are not compatible with FANETs. In this paper, we propose a fuzzy logic-based routing approach called OLSR+ for FANETs. In this scheme, we seek to improve the optimized link state routing protocol (OLSR) so that it can efficiently be used in FANETs. OLSR+ includes four main phases: 1) Discovering neighboring nodes. In this phase, we propose a new and efficient technique for estimating the lifetime of the link between two unmanned ariel vehicles (UAVs) based on the link quality, distance, relative velocity, and movement direction. 2) Selecting multipoint relays (MPRs). In this phase, we present a fuzzy mechanism for selecting a set of MPR nodes. According to this mechanism, when a node has higher residual energy, higher link lifetime, and more neighborhood degree compared to others, it achieves more fitness to be selected as MPR. 3) Discovering the network topology. In this phase, we modify the format of the topology control (TC) message and add two fields, including route energy and route lifetime to this message. 4) Calculating the routing table. In OLSR+, we consider two parameters, including route energy and route lifetime, for establishing stable paths. Finally, we simulate OLSR+ using NS3 and compare its performance with two methods, namely greedy optimized link state routing (G-OLSR) and optimized link state routing (OLSR). The simulation results show that OLSR+ successfully reduces delay compared to G-OLSR and OLSR. In addition, it has higher packet delivery rate and throughput than others. Also, it improves energy consumption in the network. However, OLSR+ has more routing overhead than G-OLSR. © 2022 Elsevier Inc.

关键词： artificial intelligence (AI) Flying ad hoc networks (FANETs) Fuzzy logic Routing Unmanned ariel vehicles (UAVs)

A comprehensive study on temporal modeling for online action detection

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Wang, Wen Peng, Xiaojiang Qiao, Yu Cheng, Jian School of Information and Communication Engineering University of Electronic Science and Technology of China Chengdu Sichuan611731 China ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences

—Online action detection (OAD) is a practical yet challenging task, which has attracted increasing attention in recent years. A typical OAD system mainly consists of three modules: a frame-level feature extractor which is usually based on pre-trained deep Convolutional Neural Networks (CNNs), a temporal modeling module, and an action classifier. Among them, the temporal modeling module is crucial which aggregates discriminative information from historical and current features. Though many temporal modeling methods have been developed for OAD and other topics, their effects are lack of investigation on OAD fairly. This paper aims to provide a comprehensive study on temporal modeling for OAD including four meta types of temporal modeling methods, i.e. temporal pooling, temporal convolution, recurrent neural networks, and temporal attention, and uncover some good practices to produce a state-of-the-art OAD system. Many of them are explored in OAD for the first time, and extensively evaluated with various hyper parameters. Furthermore, based on our comprehensive study, we present several hybrid temporal modeling methods, which outperform the recent state-of-the-art methods with sizable margins on THUMOS-14 and TVSeries. Copyright © 2020, The Authors. All rights reserved.

关键词： Convolution

Pixel-wise dense detector for image inpainting

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Zhang, Ruisong Quan, Weize Wu, Baoyuan Li, Zhifeng Yan, Dong-Ming National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing100190 China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing100049 China School of Data Science Chinese University of Hong Kong Shenzhen Hong Kong Secure Computing Lab of Big Data Shenzhen Research Institute of Big Data China Tencent AI Lab Shenzhen China

Recent GAN-based image inpainting approaches adopt an average strategy to discriminate the generated image and output a scalar, which inevitably lose the position information of visual artifacts. Moreover, the adversarial loss and reconstruction loss (e.g., `1 loss) are combined with tradeoff weights, which are also difficult to tune. In this paper, we propose a novel detection-based generative framework for image inpainting, which adopts the min-max strategy in an adversarial process. The generator follows an encoder-decoder architecture to fill the missing regions, and the detector using weakly supervised learning localizes the position of artifacts in a pixel-wise manner. Such position information makes the generator pay attention to artifacts and further enhance them. More importantly, we explicitly insert the output of the detector into the reconstruction loss with a weighting criterion, which balances the weight of the adversarial loss and reconstruction loss automatically rather than manual operation. Experiments on multiple public datasets show the superior performance of the proposed framework. The source code is available at https://***/Evergrow/GDN_Inpainting. Copyright © 2020, The Authors. All rights reserved.

关键词： Pixels

A Self-supervised Multimodal Deep Learning Approach to Differentiate Post-radiotherapy Progression from Pseudoprogression in Glioblastoma

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Gomaa, Ahmed Huang, Yixing Stephan, Pluvio Breininger, Katharina Frey, Benjamin Dörfler, Arnd Schnell, Oliver Delev, Daniel Coras, Roland Schmitter, Charlotte Stritzelberger, Jenny Semrau, Sabine Maier, Andreas Bayer, Siming Schönecker, Stephan Heiland, Dieter H. Hau, Peter Gaipl, Udo S. Bert, Christoph Fietkau, Rainer Schmidt, Manuel A. Putz, Florian Department of Radiation Oncology University Hospital Erlangen Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen91054 Germany Erlangen91054 Germany Erlangen91052 Germany Institute of Neuroradiology University Hospital Erlangen Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen91054 Germany Universität Würzburg Center for Artificial Intelligence and Data Science Würzburg97074 Germany Translational Neurosurgery Alexander-Friedrich-Universität Erlangen-Nürnberg Erlangen91054 Germany Department of Neurosurgery University Hospital Erlangen Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen91054 Germany Department of Neurology University Hospital Erlangen Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen91054 Germany Pattern Recognition Lab Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen Germany Department of Radiation Oncology University Hospital Ludwig Maximilian University of Munich Munich81377 Germany Department of Neurological Surgery Northwestern University Feinberg School of Medicine ChicagoIL60611 United States Department of Neurology University Hospital Regensburg Regensburg Germany Wilhelm Sander-NeuroOncology Unit University Hospital Regensburg Regensburg Germany

Accurate differentiation of pseudoprogression (PsP) from True Progression (TP) following radiotherapy (RT) in glioblastoma patients is crucial for optimal treatment planning. However, this task remains challenging due to the overlapping imaging characteristics of PsP and TP. This study therefore proposes a multimodal deep-learning approach utilizing complementary information from routine anatomical MR images, clinical parameters, and RT treatment planning information for improved predictive accuracy. The approach utilizes a self-supervised Vision Transformer (ViT) to encode multi-sequence MR brain volumes to effectively capture both global and local context from the high dimensional input. The encoder is trained in a self-supervised upstream task on unlabeled glioma MRI datasets from the open BraTS2021, UPenn-GBM, and UCSF-PDGM datasets (n = 2317 MRI studies) to generate compact, clinically relevant representations from FLAIR and T1 post-contrast sequences. These encoded MR inputs are then integrated with clinical data and RT treatment planning information through guided cross-modal attention, improving progression classification accuracy. This work was developed using two datasets from different centers: the Burdenko Glioblastoma Progression Dataset (n = 59) for training and validation, and the GlioCMV progression dataset from the University Hospital Erlangen (UKER) (n = 20) for testing. The proposed method achieved competitive performance, with an AUC of 75.3%, outperforming the current state-of-the-art data-driven approaches. Importantly, the proposed approach relies solely on readily available anatomical MRI sequences, clinical data, and RT treatment planning information, enhancing its clinical feasibility. The proposed approach addresses the challenge of limited data availability for PsP and TP differentiation and could allow for improved clinical decision-making and optimized treatment plans for glioblastoma patients. © 2025, CC BY.

关键词： Radiotherapy

Domain generalization across tumor types, laboratories, and species - insights from the 2022 edition of the Mitosis Domain Generalization Challenge

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Aubreville, Marc Stathonikos, Nikolas Donovan, Taryn A. Klopfleisch, Robert Ammeling, Jonas Ganz, Jonathan Wilm, Frauke Veta, Mitko Jabari, Samir Eckstein, Markus Annuscheit, Jonas Krumnow, Christian Bozaba, Engin Çayır, Sercan Gu, Hongyan Chen, Xiang Jahanifar, Mostafa Shephard, Adam Kondo, Satoshi Kasai, Satoshi Kotte, Sujatha Saipradeep, V.G. Lafarge, Maxime W. Koelzer, Viktor H. Wang, Ziyue Zhang, Yongbing Yang, Sen Wang, Xiyue Breininger, Katharina Bertram, Christof A. Technische Hochschule Ingolstadt Ingolstadt Germany Pathology Department UMC Utrecht Netherlands Department of Anatomic Pathology The Schwarzman Animal Medical Center New York United States Institute of Veterinary Pathology Freie Universität Berlin Berlin Germany Pattern Recognition Lab Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen Germany Department Artificial Intelligence in Biomedical Engineering Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen Germany Computational Pathology Group Radboud UMC Nijmegen Netherlands Institute of Neuropathology University Hospital Erlangen Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen Germany Institute of Pathology University Hospital Erlangen Friedrich-Alexander-Universität Erlangen-Nünberg Erlangen Germany Berlin Berlin Germany Artificial Intelligence Research Team Virasoft Corporation New York United States University of California Los Angeles United States University of Warwick United Kingdom Muroran Institute of Technology Muroran Japan Niigata University of Health and Welfare Niigata Japan TCS Research Tata Consultancy Services Ltd Hyderabad India Department of Pathology and Molecular Pathology University Hospital Zurich University of Zurich Zurich Switzerland Harbin Institute of Technology Shenzhen China College of Biomedical Engineering Sichuan University Chengdu China Department of Radiation Oncology Stanford USA 1 University School of Medicine Palo Alto United States Institute of Pathology University of Veterinary Medicine Vienna Austria

recognition of mitotic figures in histologic tumor specimens is highly relevant to patient outcome assessment. This task is challenging for algorithms and human experts alike, with deterioration of algorithmic performance under shifts in image representations. Considerable covariate shifts occur when assessment is performed on different tumor types, images are acquired using different digitization devices, or specimens are produced in different laboratories. This observation motivated the inception of the 2022 challenge on MItosis Domain Generalization (MIDOG 2022). The challenge provided annotated histologic tumor images from six different domains and evaluated the algorithmic approaches for mitotic figure detection provided by nine challenge participants on ten independent domains. Ground truth for mitotic figure detection was established in two ways: a three-expert majority vote and an independent, immunohistochemistry-assisted set of labels. This work represents an overview of the challenge tasks, the algorithmic strategies employed by the participants, and potential factors contributing to their success. With an F1 score of 0.764 for the top-performing team, we summarize that domain generalization across various tumor domains is possible with today’s deep learning-based recognition pipelines. However, we also found that domain characteristics not present in the training set (feline as new species, spindle cell shape as new morphology and a new scanner) led to small but significant decreases in performance. When assessed against the immunohistochemistry-assisted reference standard, all methods resulted in reduced recall scores, with only minor changes in the order of participants in the ranking. © 2023, CC BY.

关键词： Tumors