检索结果-内蒙古大学图书馆

arXiv 2021年

作者： Zong, Zhuofan Li, Kunchang Song, Guanglu Wang, Yali Qiao, Yu Leng, Biao Liu, Yu School of Computer Science and Engineering Beihang University China SenseTime Research China ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China University of Chinese Academy of Sciences China SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society China Shanghai AI Laboratory China

Vision transformers (ViTs) have become the popular structures and outperformed convolutional neural networks (CNNs) on various vision tasks. However, such powerful transformers bring a huge computation burden, because of the exhausting token-to-token comparison. The previous works focus on dropping insignificant tokens to reduce the computational cost of ViTs. But when the dropping ratio increases, this hard manner will inevitably discard the vital tokens, which limits its efficiency. To solve the issue, we propose a generic self-slimmed learning approach for vanilla ViTs, namely SiT. Specifically, we first design a novel Token Slimming Module (TSM), which can boost the inference efficiency of ViTs by dynamic token aggregation. As a general method of token hard dropping, our TSM softly integrates redundant tokens into fewer informative ones. It can dynamically zoom visual attention without cutting off discriminative token relations in the images, even with a high slimming ratio. Furthermore, we introduce a concise Feature Recalibration Distillation (FRD) framework, wherein we design a reverse version of TSM (RTSM) to recalibrate the unstructured token in a flexible auto-encoder manner. Due to the similar structure between teacher and student, our FRD can effectively leverage structure knowledge for better convergence. Finally, we conduct extensive experiments to evaluate our SiT. It demonstrates that our method can speed up ViTs by 1.7× with negligible accuracy drop, and even speed up ViTs by 3.6× while maintaining 97% of their performance. Surprisingly, by simply arming LV-ViT with our SiT, we achieve new state-of-the-art performance on ImageNet. Code is available at https://***/Sense-X/SiT. © 2021, CC BY.

关键词： Distillation

来源：评论

学校读者我要写书评

暂无评论

More data, more relations, more context and more openness: A review and outlook for relation extraction

arXiv

引用

arXiv 2020年

作者： Han, Xu Gao, Tianyu Lin, Yankai Peng, Hao Yang, Yaoliang Xiao, Chaojun Liu, Zhiyuan Li, Peng Sun, Maosong Zhou, Jie State Key Lab on Intelligent Technology and Systems Institute for Artificial Intelligence Department of Computer Science and Technology Tsinghua University Beijing China Pattern Recognition Center WeChat AI Tencent Inc China

Relational facts are an important component of human knowledge, which are hidden in vast amounts of text. In order to extract these facts from text, people have been working on relation extraction (RE) for years. From early pattern matching to current neural networks, existing RE methods have achieved significant progress. Yet with explosion of Web text and emergence of new relations, human knowledge is increasing drastically, and we thus require "more" from RE: a more powerful RE system that can robustly utilize more data, efficiently learn more relations, easily handle more complicated context, and flexibly generalize to more open domains. In this paper, we look back at existing RE methods, analyze key challenges we are facing nowadays, and show promising directions towards more powerful RE. We hope our view can advance this field and inspire more efforts in the community. Copyright © 2020, The Authors. All rights reserved.

关键词： pattern matching

来源：评论

学校读者我要写书评

暂无评论

Multi-feature super-resolution network for cloth wrinkle synthesis

arXiv

引用

arXiv 2020年

作者： Chen, Lan Ye, Juntao Zhang, Xiaopeng National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing China Zhejiang Lab Zhejiang Province Hangzhou China

Existing physical cloth simulators suffer from expensive computation and difficulties in tuning mechanical parameters to get desired wrinkling behaviors. Data-driven methods provide an alternative solution. They typically synthesize cloth animation at a much lower computational cost, and also create wrinkling effects that are similar to the training data. In this paper we propose a deep learning based method for synthesizing cloth animation with high resolution meshes. To do this we first create a dataset for training: a pair of low and high resolution meshes are simulated and their motions are synchronized. As a result the two meshes exhibit similar large-scale deformation but different small wrinkles. Each simulated mesh pair is then converted into a pair of low and high resolution "images" (a 2D array of samples), with each image pixel being interpreted as any of three descriptors: the displacement, the normal and the velocity. With these image pairs, we design a multi-feature super-resolution (MFSR) network that jointly trains an upsampling synthesizer for the three descriptors. The MFSR architecture consists of shared and task-specific layers to learn multi-level features when super-resolving three descriptors simultaneously. Frame-to-frame consistency is well maintained thanks to the proposed kinematics-based loss function. Our method achieves realistic results at high frame rates: 12 ∼ 14 times faster than traditional physical simulation. We demonstrate the performance of our method with various experimental scenes, including a dressed character with sophisticated collisions. Copyright © 2020, The Authors. All rights reserved.

关键词： Optical resolving power

来源：评论

学校读者我要写书评

暂无评论

Collaborative Multi-View Convolutions With Gating For Accurate And Fast Volumetric Medical Image Segmentation

Collaborative Multi-View Convolutions With Gating For Accura...

引用

IEEE International Symposium on Biomedical Imaging

作者： Cheng Li Jin Ye Junjun He Shanshan Wang Lixu Gu Yu Qiao Paul C. Lauterbur Research Center for Biomedical Imaging SIAT CAS Shenzhen China Shenzhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab SIAT CAS Shenzhen China SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen China School of Biomedical Engineering/the Institute of Medical Robotics Shanghai Jiao Tong University Shanghai China

ISBN: (纸本)9781665412469;9781665429474

Due to their high capacity in capturing 3D spatial information, 3D Fully Convolutional Neural Networks (3D FCNs), especially 3D U-Net, are prevalent for volumetric medical image segmentation. However, 3D convolutions are much more computationally complex than 2D convolutions and thus, are more prone to overfitting. This paper proposes Collaborative Multi-View convolutions (CMV convs) that can keep the model complexity similar to those employing 2D convolutions while capturing the 3D spatial context like 3D convolutions. Specifically, CMV convs simultaneously extract information from three orthogonal views with three parameter-shared 2D convolutions. A Global-Guided Gating mechanism (3G) is further designed that selectively passes information from CMV convs to the next stage. Combined with 3G, a CMV conv become a G-CMV conv that constitutes a plug-and-play module, which can be easily integrated into various 3D CNNs for image segmentation. Extensive experiments utilizing BraTS18 dataset have been conducted. Our method achieves competitive results compared to state-of-the-art methods with over 10× fewer parameters than 3D-UNet.

关键词： Solid modeling Image segmentation Interpolation Three-dimensional displays Computational modeling Biological system modeling Collaboration

来源：评论

学校读者我要写书评

暂无评论

Symmetry-Enhanced Attention Network for Acute Ischemic Infarct Segmentation with Non–Contrast CT Images

arXiv

引用

arXiv 2021年

作者： Liang, Kongming Han, Kai Li, Xiuli Cheng, Xiaoqing Li, Yiming Wang, Yizhou Yu, Yizhou Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing China Deepwise AI Lab Beijing China Department of Medical Imaging Jinling Hospital Nanjing University School of Medicine Jiangsu Nanjing China Department of Computer Science and Technology Peking University Beijing China The University of Hong Kong Pokfulam Hong Kong

Quantitative estimation of the acute ischemic infarct is crucial to improve neurological outcomes of the patients with stroke symptoms. Since the density of lesions is subtle and can be confounded by normal physiologic changes, anatomical asymmetry provides useful information to differentiate the ischemic and healthy brain tissue. In this paper, we propose a symmetry enhanced attention network (SEAN) for acute ischemic infarct segmentation. Our proposed network automatically transforms an input CT image into the standard space where the brain tissue is bilaterally symmetric. The transformed image is further processed by a U-shape network integrated with the proposed symmetry enhanced attention for pixel-wise labelling. The symmetry enhanced attention can efficiently capture context information from the opposite side of the image by estimating long-range dependencies. Experimental results show that the proposed SEAN outperforms some symmetry-based state-of-the-art methods in terms of both dice coefficient and infarct localization. Copyright © 2021, The Authors. All rights reserved.

关键词： Computerized tomography

来源：评论

学校读者我要写书评

暂无评论

Fully automatic HER2 tissue segmentation for interpretable HER2 scoring

引用

Journal of Pathology Informatics 2025年 17卷 100435-100435页

作者： Öttl, Mathias Steenpass, Jana Wilm, Frauke Qiu, Jingna Rübner, Matthias Lang-Schwarz, Corinna Taverna, Cecilia Tava, Francesca Hartmann, Arndt Huebner, Hanna Beckmann, Matthias W. Fasching, Peter A. Maier, Andreas Erber, Ramona Breininger, Katharina Pattern Recognition Lab Department of Computer Science Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen Germany Institute of Pathology University Hospital Erlangen Erlangen Germany Department of Gynecology and Obstetrics Universitätsklinikum Erlangen Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen Germany Department Artificial Intelligence in Biomedical Engineering Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen Germany Center for AI and Data Science (CAIDAS) Universität Würzburg Würzburg Germany Institute of Pathology Klinikum Bayreuth GmbH Bayreuth Germany Surgical Pathology Unit Azienda Sanitaria Locale Presidio Ospedaliero Ospedale San Giacomo Novi Ligure Italy Institute of Pathology University Regensburg Regensburg Germany

Breast cancer is the most common cancer in women, with HER2 (human epidermal growth factor receptor 2) overexpression playing a critical role in regulating cell growth and division. HER2 status, assessed according to established scoring guidelines, offers important information for treatment selection. However, the complexity of the task leads to variability in human rater assessments. In this work, we propose a fully automated, interpretable HER2 scoring pipeline based on pixel-level semantic segmentations, designed to align with clinical guidelines. Using polygon annotations, our method balances annotation effort with the ability to capture fine-grained details and larger structures, such as non-invasive tumor tissue. To enhance HER2 segmentation, we propose the use of a Wasserstein Dice loss to model class relationships, ensuring robust segmentation and HER2 scoring performance. Additionally, based on observations of pathologists' behavior in clinical practice, we propose a calibration step to the scoring rules, which positively impacts the accuracy and consistency of automated HER2 scoring. Our approach achieves an F1 score of 0.832 on HER2 scoring, demonstrating its effectiveness. This work establishes a potent segmentation pipeline that can be further leveraged to analyze HER2 expression in breast cancer tissue. © 2025 The Authors

关键词： Deep learning HER2 HER2 scoring Histopathology Semantic segmentation

来源：评论

学校读者我要写书评

暂无评论

Context-transformer: Tackling object confusion for few-shot detection

arXiv

引用

arXiv 2020年

作者： Yang, Ze Wang, Yali Chen, Xianyu Liu, Jianzhuang Qiao, Yu ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab. Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences Huawei Noah’s Ark Lab. SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society

Few-shot object detection is a challenging but realistic scenario, where only a few annotated training images are available for training detectors. A popular approach to handle this problem is transfer learning, i.e., fine-tuning a detector pretrained on a source-domain benchmark. However, such transferred detector often fails to recognize new objects in the target domain, due to low data diversity of training samples. To tackle this problem, we propose a novel Context-Transformer within a concise deep transfer framework. Specifically, Context-Transformer can effectively leverage source-domain object knowledge as guidance, and automatically exploit contexts from only a few training images in the target domain. Subsequently, it can adaptively integrate these relational clues to enhance the discriminative power of detector, in order to reduce object confusion in few-shot scenarios. Moreover, Context-Transformer is flexibly embedded in the popular SSD-style detectors, which makes it a plug-and-play module for end-to-end few-shot learning. Finally, we evaluate Context-Transformer on the challenging settings of few-shot detection and incremental few-shot detection. The experimental results show that, our framework outperforms the recent state-of-the-art approaches. The codes are available at https://***/Ze-Yang/ContextTransformer. Copyright © 2020, The Authors. All rights reserved.

关键词： Object detection

来源：评论

学校读者我要写书评

暂无评论

Attention in Attention: Modeling Context Correlation for Efficient Video Classification

arXiv

引用

arXiv 2022年

作者： Hao, Yanbin Wang, Shuo Cao, Pei Gao, Xinjian Xu, Tong Wu, Jinmeng He, Xiangnan The CCCD Key Lab of Ministry of Culture and Tourism School of Data Science School of Information Science and Technology University of Science and Technology of China Anhui 230026 China The Wuhan Research Institute of Posts and Telecommunications Hubei Wuhan430205 China The School of Computer Science and Information Engineering School of Artificial Intelligence Hefei University of Technology Anhui 230009 China The School of Data Science School of Computer Science and Technology University of Science and Technology of China Anhui 230026 China The Hubei Key Laboratory of Optical Information and Pattern Recognition Wuhan Institute of Technology Hubei Wuhan430070 China

Attention mechanisms have significantly boosted the performance of video classification neural networks thanks to the utilization of perspective contexts. However, the current research on video attention generally focuses on adopting a specific aspect of contexts (e.g., channel, spatial/temporal, or global context) to refine the features and neglects their underlying correlation when computing attentions. This leads to incomplete context utilization and hence bears the weakness of limited performance improvement. To tackle the problem, this paper proposes an efficient attention-in-attention (AIA) method for element-wise feature refinement, which investigates the feasibility of inserting the channel context into the spatio-temporal attention learning module, referred to as CinST, and also its reverse variant, referred to as STinC. Specifically, we instantiate the video feature contexts as dynamics aggregated along a specific axis with global average and max pooling operations. The workflow of an AIA module is that the first attention block uses one kind of context information to guide the gating weights calculation of the second attention that targets at the other context. Moreover, all the computational operations in attention units act on the pooled dimension, which results in quite few computational cost increase ( Copyright © 2022, The Authors. All rights reserved.

关键词： Machine learning

来源：评论

学校读者我要写书评

暂无评论

Automatic and explainable grading of meningiomas from histopathology images

arXiv

引用

arXiv 2021年

作者： Ganz, Jonathan Kirsch, Tobias Hoffmann, Lucas Bertram, Christof A. Hoffmann, Christoph Maier, Andreas Breininger, Katharina Blümcke, Ingmar Jabari, Samir Aubreville, Marc Technische Hochschule Ingolstadt Ingolstadt Germany Institute of Neuropathology University Hospital Erlangen Erlangen Germany Institute of Pathology University of Veterinary Medicine Vienna Vienna Austria Pattern Recognition Lab Computer Science Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen Germany Department Artificial Intelligence in Biomedical Engineering Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen Germany

Meningioma is one of the most prevalent brain tumors in adults. To determine its malignancy, it is graded by a pathologist into three grades according to WHO standards. This grade plays a decisive role in treatment, and yet may be subject to inter-rater discordance. In this work, we present and compare three approaches towards fully automatic meningioma grading from histology whole slide images. All approaches are following a two-stage paradigm, where we first identify a region of interest based on the detection of mitotic figures in the slide using a state-of-the-art object detection deep learning network. This region of highest mitotic rate is considered characteristic for biological tumor behavior. In the second stage, we calculate a score corresponding to tumor malignancy based on information contained in this region using three different settings. In a first approach, image patches are sampled from this region and regression is based on morphological features encoded by a ResNet-based network. We compare this to learning a logistic regression from the determined mitotic count, an approach which is easily traceable and explainable. Lastly, we combine both approaches in a single network. We trained the pipeline on 951 slides from 341 patients and evaluated them on a separate set of 141 slides from 43 patients. All approaches yield a high correlation to the WHO grade. The logistic regression and the combined approach had the best results in our experiments, yielding correct predictions in 32 and 33 of all cases, respectively, with the image-based approach only predicting 25 cases correctly. Spearman's correlation was 0.7163, 0.7926 and 0.7900 respectively. It might be counter-intuitive at first that morphological features provided by the image patches do not improve model performance. Yet, this mirrors the criteria of the grading scheme, where mitotic count is the only unequivocal *** Codes 68T99 Copyright © 2021, The Authors. All rights reserved.

关键词： Grading

来源：评论

学校读者我要写书评

暂无评论

CUGE: A Chinese Language Understanding and Generation Evaluation Benchmark

arXiv

引用

arXiv 2021年

作者： Yao, Yuan Dong, Qingxiu Guan, Jian Cao, Boxi Zhang, Zhengyan Xiao, Chaojun Wang, Xiaozhi Qi, Fanchao Bao, Junwei Nie, Jinran Zeng, Zheni Gu, Yuxian Zhou, Kun Huang, Xuancheng Li, Wenhao Ren, Shuhuai Lu, Jinliang Xu, Chengqiang Wang, Huadong Zeng, Guoyang Zhou, Zile Zhang, Jiajun Li, Juanzi Huang, Minlie Yan, Rui He, Xiaodong Wan, Xiaojun Zhao, Xin Sun, Xu Liu, Yang Liu, Zhiyuan Han, Xianpei Yang, Erhong Sui, Zhifang Sun, Maosong Department of Computer Science and Technology Tsinghua University China MOE Key Lab of Computational Linguistics School of EECS Peking University China Institute of Software Chinese Academy of Sciences China JD AI Research Beijing China School of Information Science Beijing Language and Culture University China School of Information Renmin University of China China National Laboratory of Pattern Recognition Institute of Automation CAS China Gaoling School of Artificial Intelligence Renmin University of China China Wangxuan Institute of Computer Technology Peking University Beijing Academy of Artificial Intelligence China

Realizing general-purpose language intelligence has been a longstanding goal for natural language processing, where standard evaluation benchmarks play a fundamental and guiding role. We argue that for general-purpose language intelligence evaluation, the benchmark itself needs to be comprehensive and systematic. To this end, we propose CUGE, a Chinese Language Understanding and Generation Evaluation benchmark with the following features: (1) Hierarchical benchmark framework, where datasets are principally selected and organized with a language capability-task-dataset hierarchy. (2) Multilevel scoring strategy, where different levels of model performance are provided based on the hierarchical framework. To facilitate CUGE, we provide a public leaderboard that can be customized to support flexible model judging criteria. Evaluation results on representative pre-trained language models indicate ample room for improvement towards general-purpose language intelligence. CUGE is publicly available at ***. Copyright © 2021, The Authors. All rights reserved.

关键词： Natural language processing systems

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：