检索结果-内蒙古大学图书馆

Identifying and pruning redundant structures for deep neural networks 34

学校读者我要写书评

暂无评论

Identifying and pruning redundant structures for deep neural...

34th IEEE International Conference on Visual Communications and Image Processing, VCIP 2019

作者： Gan, Wenyao Song, Li Chen, Li Xie, Rong Gu, Xiao Shanghai Jiao Tong University Institute of Image Communication and Network Engineering China Shanghai Institute for Advanced Communication and Data Science Shanghai200240 China MoE Key Lab of Artificial Intelligence AI Institute Shanghai Jiao Tong University Shanghai China

ISBN: (纸本)9781728137230

Deep convolutional neural networks have achieved considerable success in the field of computer vision. However, it is difficult to deploy state-of-The-Art models on resource-constrained platforms due to their high storage, memory bandwidth, and computational costs. In this paper, we propose a structured pruning method which employs a three-step process to reduce the resource consumption of neural networks. First, we train an initial network on the training set and evaluate it on the validation set. Next, we introduce an iterative pruning and fine-Tuning algorithm to identify and prune redundant structures, which results in a pruned network with a compact architecture. Finally, we train the pruned network from scratch on both the training set and validation set to obtain the final accuracy on the test set. In the experiments, our pruning method significantly reduces the model size (by 87.2% on CIFAR-10), saves inference time (53.3% on CIFAR-10), and achieves better performance as compared to recent state-of-The-Art methods. © 2019 IEEE.

关键词： Deep neural networks

Object Level Depth Reconstruction for Category Level 6D Object Pose Estimation From Monocular RGB Image

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Fan, Zhaoxin Song, Zhenbo Xu, Jian Wang, Zhicheng Wu, Kejian Liu, Hongyan He, Jun Key Laboratory of Data Engineering and Knowledge Engineering of MOE School of Information Renmin University of China Beijing100872 China School of Computer Science and Engineering Nanjing University of Science and Technology Nanjing210094 China Department of Management Science and Engineering Tsinghua University Beijing100084 China Nreal China

Recently, RGBD-based category-level 6D object pose estimation has achieved promising improvement in performance, however, the requirement of depth information prohibits broader applications. In order to relieve this problem, this paper proposes a novel approach named Object Level Depth reconstruction Network (OLD-Net) taking only RGB images as input for category-level 6D object pose estimation. We propose to directly predict object-level depth from a monocular RGB image by deforming the category-level shape prior into object-level depth and the canonical NOCS representation. Two novel modules named Normalized Global Position Hints (NGPH) and Shape-aware Decoupled Depth Reconstruction (SDDR) module are introduced to learn high fidelity object-level depth and delicate shape representations. At last, the 6D object pose is solved by aligning the predicted canonical representation with the back-projected object-level depth. Extensive experiments on the challenging CAMERA25 and REAL275 datasets indicate that our model, though simple, achieves state-of-the-art performance. Copyright © 2022, The Authors. All rights reserved.

关键词： Image reconstruction

SVT-Net: Super Light-Weight Sparse Voxel Transformer for Large Scale Place Recognition

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Fan, Zhaoxin Song, Zhenbo Liu, Hongyan Lu, Zhiwu He, Jun Du, Xiaoyong Key Laboratory of Data Engineering Knowledge Engineering of MOE School of Information Renmin University of China Beijing100872 China Gaoling School of Artificial Intelligence Renmin University of China Beijing100872 China School of Computer Science and Engineering Nanjing University of Science and Technology Nanjing210094 China Department of Management Science and Engineering Tsinghua University Beijing100084 China

Simultaneous Localization and Mapping (SLAM) and Autonomous Driving are becoming increasingly more important in recent years. Point cloud-based large scale place recognition is the spine of them. While many models have been proposed and have achieved acceptable performance by learning short-range local features, they always skip long-range contextual properties. Moreover, the model size also becomes a serious shackle for their wide applications. To overcome these challenges, we propose a super light-weight network model termed SVT-Net. On top of the highly efficient 3D Sparse Convolution (SP-Conv), an Atom-based Sparse Voxel Transformer (ASVT) and a Cluster-based Sparse Voxel Transformer (CSVT) are proposed respectively to learn both short-range local features and long-range contextual features. Consisting of ASVT and CSVT, SVT-Net can achieve state-of-the-art performance in terms of both recognition accuracy and running speed with a super-light model size (0.9M parameters). Meanwhile, for the purpose of further boosting efficiency, we introduce two simplified versions, which also achieve state-of-the-art performance and further reduce the model size to 0.8M and 0.4M respectively. Copyright © 2021, The Authors. All rights reserved.

关键词： Machine learning

Lightweight Attentional Feature Fusion: A New Baseline for Text-to-Video Retrieval

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Hu, Fan Chen, Aozhu Wang, Ziyue Zhou, Fangming Dong, Jianfeng Li, Xirong MoE Key Lab of DEKE Renmin University of China China AIMC Lab School of Information Renmin University of China China College of Computer and Information Engineering Zhejiang Gongshang University China

In this paper we revisit feature fusion, an old-fashioned topic, in the new context of text-to-video retrieval. Different from previous research that considers feature fusion only at one end, let it be video or text, we aim for feature fusion for both ends within a unified framework. We hypothesize that optimizing the convex combination of the features is preferred to modeling their correlations by computationally heavy multi-head self attention. We propose Lightweight Attentional Feature Fusion (LAFF). LAFF performs feature fusion at both early and late stages and at both video and text ends, making it a powerful method for exploiting diverse (off-the-shelf) features. The interpretability of LAFF can be used for feature selection. Extensive experiments on five public benchmark sets (MSR-VTT, MSVD, TGIF, VATEX and TRECVID AVS 2016-2020) justify LAFF as a new baseline for text-to-video retrieval. Copyright © 2021, The Authors. All rights reserved.

关键词：

A Secure Collusion-Aware and Probability-Aware Range Query Processing in Tiered Sensor Networks

学校读者我要写书评

暂无评论

A Secure Collusion-Aware and Probability-Aware Range Query P...

Reliable Distributed Systems

作者： Lei Dong Xuan Chen Jianxiang Zhu Hong Chen Ke Wang Cuiping Li Key Laboratory of Data Engineering and Knowledge Engineering of Ministry of Education Beijing China School of Information Renmin University of China Beijing China School of Computing Science Simon Fraser University Burnaby BC Canada Key Lab. of Data Eng. & Knowledge Eng. of Minist. of Educ. Beijing China

With high expansibility and efficient power usage, tiered wireless sensor networks are widely deployed in many fields as an important part of Internet of Things (IoTs). It is challenging to process range query while protecting sensitive data from adversaries. Moreover, most existing work focuses on privacy-preserving range query neglecting collusion attacks and probability attacks, which are more threatening to network security. In this paper, we first propose a secure range query protocol called secRQ, which not only protects data privacy, but also resists collusion attacks and probability attacks in tiered wireless sensor networks. Generalized inverse matrices and distance-based range query mechanism are used to guarantee security as well as high efficiency and accuracy. Besides, we propose the mutual verification scheme to verify the integrity of query results. Finally, both theoretical analysis and experimental results confirm the security, efficiency and accuracy of secRQ.

关键词： Wireless sensor networks Protocols data privacy Biomedical monitoring Query processing Monitoring Heart rate

Learning Two-Stream CNN for Multi-Modal Age-related Macular Degeneration Categorization

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Wang, Weisen Li, Xirong Xu, Zhiyan Yu, Weihong Zhao, Jianchun Ding, Dayong Chen, Youxin The MoE Key Lab of Data Engineering and Knowledge Engineering Renmin University of China Beijing100872 China Aimc Lab School of Information Renmin University of China Beijing100872 China Vistel Ai Lab Visionary Intelligence Ltd. Beijing100872 China The Key Lab of Ocular Fundus Disease Chinese Academy of Medical Sciences Dept. of Ophthalmology Peking Union Medical College Hospital Beijing100730 China

This paper tackles automated categorization of Agerelated Macular Degeneration (AMD), a common macular disease among people over 50. Previous research efforts mainly focus on AMD categorization with a single-modal input, let it be a color fundus photograph (CFP) or an OCT B-scan image. By contrast, we consider AMD categorization given a multi-modal input, a direction that is clinically meaningful yet mostly unexplored. Contrary to the prior art that takes a traditional approach of feature extraction plus classifier training that cannot be jointly optimized, we opt for end-to-end multi-modal Convolutional Neural Networks (MM-CNN). Our MM-CNN is instantiated by a two-stream CNN, with spatially-invariant fusion to combine information from the CFP and OCT streams. In order to visually interpret the contribution of the individual modalities to the final prediction, we extend the class activation mapping (CAM) technique to the multi-modal scenario. For effective training of MM-CNN, we develop two data augmentation methods. One is GAN-based CFP/OCT image synthesis, with our novel use of CAMs as conditional input of a high-resolution image-to-image translation GAN. The other method is Loose Pairing, which pairs a CFP image and an OCT image on the basis of their classes instead of eye identities. Experiments on a clinical dataset consisting of 1,094 CFP images and 1,289 OCT images acquired from 1,093 distinct eyes show that the proposed solution obtains better F1 and Accuracy than multiple baselines for multimodal AMD categorization. Code and data are available at https://***/li-xirong/mmc-amd. Copyright © 2020, The Authors. All rights reserved.

关键词： Convolutional neural networks

EvoChart: A Benchmark and a Self-Training Approach Towards Real-World Chart Understanding

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Huang, Muye Lai, Han Zhang, Xinyu Wu, Wenjun Ma, Jie Zhang, Lingling Liu, Jun School of Computer Science and Technology Xi’an Jiaotong University China MOE KLINNS Lab Xi’an Jiaotong University China Shaanxi Province Key Laboratory of Big Data Knowledge Engineering China

Chart understanding enables automated data analysis for humans, which requires models to achieve highly accurate visual comprehension. While existing Visual Language Models (VLMs) have shown progress in chart understanding, the lack of high-quality training data and comprehensive evaluation benchmarks hinders VLM chart comprehension. In this paper, we introduce EvoChart, a novel self-training method for generating synthetic chart data to enhance VLMs’ capabilities in real-world chart comprehension. We also propose EvoChart-QA, a noval benchmark for measuring models’ chart comprehension abilities in real-world scenarios. Specifically, EvoChart is a unique self-training data synthesis approach that simultaneously produces high-quality training corpus and a high-performance chart understanding model. EvoChart-QA consists of 650 distinct real-world charts collected from 140 different websites and 1,250 expert-curated questions that focus on chart understanding. Experimental results on various open-source and proprietary VLMs tested on EvoChart-QA demonstrate that even the best proprietary model, GPT-4o, achieves only 49.8% accuracy. Moreover, the EvoChart method significantly boosts the performance of open-source VLMs on real-world chart understanding tasks, achieving 54.2% accuracy on EvoChart-QA. © 2024, CC BY.

关键词： Visual languages

Abnormality Detection in Chest X-Ray Images Using Uncertainty Prediction Autoencoders 23rd

学校读者我要写书评

暂无评论

Abnormality Detection in Chest X-Ray Images Using Uncertaint...

23rd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2020

作者： Mao, Yifan Xue, Fei-Fei Wang, Ruixuan Zhang, Jianguo Zheng, Wei-Shi Liu, Hongmei School of Data and Computer Science Sun Yat-sen University Guangzhou China Key Laboratory of Machine Intelligence and Advanced Computing MOE Guangzhou China Department of Computer Science and Engineering Southern University of Science and Technology Shenzhen China Pazhou Lab Guangzhou China Guangdong Province Key Laboratory of Information Security Technology Guangzhou China

ISBN: (纸本)9783030597245

Chest radiography is widely used in annual medical screening to check whether lungs are healthy or not. Therefore it would be desirable to develop an intelligent system to help clinicians automatically detect potential abnormalities in chest X-ray images. Here with only healthy X-ray images, we propose a new abnormality detection approach based on an autoencoder which outputs not only the reconstructed normal version of the input image but also a pixel-wise uncertainty prediction. Higher uncertainty often appears at normal region boundaries with relatively larger reconstruction errors, but not at potential abnormal regions in the lung area. Therefore the normalized reconstruction error by the uncertainty provides a natural measurement for abnormality detection in images. Experiments on two chest X-ray datasets show the state-of-the-art performance by the proposed approach. © 2020, Springer Nature Switzerland AG.

关键词： Forecasting

Mining Dual Emotion for Fake News Detection

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Zhang, Xueyao Cao, Juan Li, Xirong Sheng, Qiang Zhong, Lei Shu, Kai Institute of Computing Technology Chinese Academy of Sciences University of Chinese Academy of Sciences China Key Lab of Data Engineering and Knowledge Engineering Renmin University of China Beijing China Illinois Institute of Technology ChicagoIL United States

Emotion plays an important role in detecting fake news online. When leveraging emotional signals, the existing methods focus on exploiting the emotions of news contents that conveyed by the publishers (i.e., publisher emotion). However, fake news often evokes high-arousal or activating emotions of people, so the emotions of news comments aroused in the crowd (i.e., social emotion) should not be ignored. Furthermore, it remains to be explored whether there exists a relationship between publisher emotion and social emotion (i.e., dual emotion), and how the dual emotion appears in fake news. In this paper, we verify that dual emotion is distinctive between fake and real news and propose Dual Emotion Features to represent dual emotion and the relationship between them for fake news detection. Further, we exhibit that our proposed features can be easily plugged into existing fake news detectors as an enhancement. Extensive experiments on three real-world datasets (one in English and the others in Chinese) show that our proposed feature set: 1) outperforms the state-of-the-art task-related emotional features;2) can be well compatible with existing fake news detectors and effectively improve the performance of detecting fake news.1 2 Copyright © 2019, The Authors. All rights reserved.

关键词： Fake detection