检索结果-内蒙古大学图书馆

SceneSketcher: Fine-Grained Image Retrieval with Scene Sketches 16th

学校读者我要写书评

暂无评论

SceneSketcher: Fine-Grained Image Retrieval with Scene Sketc...

16th European Conference on computer Vision, ECCV 2020

作者： Liu, Fang Zou, Changqing Deng, Xiaoming Zuo, Ran Lai, Yu-Kun Ma, Cuixia Liu, Yong-Jin Wang, Hongan State Key Laboratory of Computer Science and Beijing Key Lab of Human-Computer Interaction Institute of Software Chinese Academy of Sciences Beijing China University of Chinese Academy of Sciences Beijing China HMI Laboratory Huawei Technologies Shenzhen China Cardiff University Cardiff United Kingdom Tsinghua University Beijing China

ISBN: (纸本)9783030585280

Sketch-based image retrieval (SBIR) has been a popular research topic in recent years. Existing works concentrate on mapping the visual information of sketches and images to a semantic space at the object level. In this paper, for the first time, we study the fine-grained scene-level SBIR problem which aims at retrieving scene images satisfying the user’s specific requirements via a freehand scene sketch. We propose a graph embedding based method to learn the similarity measurement between images and scene sketches, which models the multi-modal information, including the size and appearance of objects as well as their layout information, in an effective manner. To evaluate our approach, we collect a dataset based on SketchyCOCO and extend the dataset using Coco-stuff. Comprehensive experiments demonstrate the significant potential of the proposed approach on the application of fine-grained scene-level image retrieval. © 2020, Springer Nature Switzerland AG.

关键词： Semantics

KADEL: Knowledge-Aware Denoising Learning for Commit Message Generation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Tao, Wei Zhou, Yucheng Wang, Yanlin Zhang, Hongyu Wang, Haofen Zhang, Wenqiang Shanghai Engineering Research Center of AI and Robotics Academy for Engineering and Technology Fudan University Shanghai China State Key Laboratory of Internet of Things for Smart City Department of Computer and Information Science University of Macau China School of Software Engineering Sun Yat-sen University Guangdong Zhuhai519082 China School of Big Data and Software Engineering Chongqing University Chongqing China College of Design and Innovation Tongji University Shanghai China Engineering Research Center of AI and Robotics Ministry of Education Academy for Engineering and Technology Shanghai Key Lab of Intelligent Information Processing School of Computer Science Fudan University 220 Handan Road Shanghai200433 China

Commit messages are natural language descriptions of code changes, which are important for software evolution such as code understanding and maintenance. However, previous methods are trained on the entire dataset without considering the fact that a portion of commit messages adhere to good practice (i.e., good-practice commits), while the rest do not. On the basis of our empirical study, we discover that training on good-practice commits significantly contributes to the commit message generation. Motivated by this finding, we propose a novel knowledge-aware denoising learning method called KADEL. Considering that good-practice commits constitute only a small proportion of the dataset, we align the remaining training samples with these good-practice commits. To achieve this, we propose a model that learns the commit knowledge by training on good-practice commits. This knowledge model enables supplementing more information for training samples that do not conform to good practice. However, since the supplementary information may contain noise or prediction errors, we propose a dynamic denoising training method. This method composes a distribution-aware confidence function and a dynamic distribution list, which enhances the effectiveness of the training process. Experimental results on the whole MCMD dataset demonstrate that our method overall achieves state-of-the-art performance compared with previous methods. © 2024, CC BY.

关键词： Sampling

Parametric Model Estimation for 3D Clothed Humans from Point Clouds

学校读者我要写书评

暂无评论

Parametric Model Estimation for 3D Clothed Humans from Point...

International Symposium on Mixed and Augmented Reality (ISMAR)

作者： Kangkan Wang Huayu Zheng Guofeng Zhang Jian Yang Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education Jiangsu Key Lab of Image and Video Understanding for Social Security School of Computer Science and Engineering Nanjing University of Science and Technology China State Key Laboratory of CAD&CG Zhejiang University China

This paper presents a novel framework to estimate parametric model- s for 3D clothed humans from partial point clouds. It is a challenging problem due to factors such as arbitrary human shape and pose, large variations in clothing details, and significant missing data. Existing methods mainly focus on estimating the parametric model of undressed bodies or reconstructing the non-parametric 3D shapes from point clouds. In this paper, we propose a hierarchical regression framework to learn the parametric model of detailed human shapes from partial point clouds of a single depth frame. Benefiting from the favorable ability of deep neural networks to model nonlinearity, the proposed framework cascades several successive regression networks to estimate the parameters of detailed 3D human body models in a coarse-to-fine manner. Specifically, the first global regression network extracts global deep features of point clouds to obtain an initial estimation of the undressed human model. Based on the initial estimation, the local regression network then refines the undressed human model by using the local features of neighborhood points of human joints. Finally, the clothing details are inferred as an additive displacement on the refined undressed model using the vertex-level regression network. The experimental results demonstrate that the proposed hierarchical regression approach can accurately predict detailed human shapes from partial point clouds and outperform prior works in the recovery accuracy of 3D human models.

关键词： Deep learning Solid modeling Three-dimensional displays Shape Clothing Estimation Predictive models

Towards Stable Co-saliency Detection and Object Co-segmentation

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Li, Bo Tang, Lv Kuang, Senyun Song, Mofei Ding, Shouhong Youtu Lab Tencent Shanghai200233 China State Key Laboratory for Novel Software Technology Nanjing University Nanjing210000 China Beijing 100049 China School of Information Science and Technology Southwest Jiaotong University Chengdu611756 China School of Computer Science and Engineering Southeast University Nanjing210096 China

In this paper, we present a novel model for simultaneous stable co-saliency detection (CoSOD) and object co-segmentation (CoSEG). To detect co-saliency (segmentation) accurately, the core problem is to well model inter-image relations between an image group. Some methods design sophisticated modules, such as recurrent neural network (RNN), to address this problem. However, order-sensitive problem is the major drawback of RNN, which heavily affects the stability of proposed CoSOD (CoSEG) model. In this paper, inspired by RNN-based model, we first propose a multi-path stable recurrent unit (MSRU), containing dummy orders mechanisms (DOM) and recurrent unit (RU). Our proposed MSRU not only helps CoSOD (CoSEG) model captures robust inter-image relations, but also reduces order-sensitivity, resulting in a more stable inference and training process. Moreover, we design a cross-order contrastive loss (COCL) that can further address order-sensitive problem by pulling close the feature embedding generated from different input orders. We validate our model on five widely used CoSOD datasets (CoCA, CoSOD3k, Cosal2015, iCoseg and MSRC), and three widely used datasets (Internet, iCoseg and PASCAL-VOC) for object co-segmentation, the performance demonstrates the superiority of the proposed approach as compared to the state-of-the-art (SOTA) methods. © 2022, CC0.

关键词： Recurrent neural networks

Towards High-accuracy and Low-latency Spiking Neural Networks with Two-Stage Optimization

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Wang, Ziming Zhang, Yuhao Lian, Shuang Cui, Xiaoxin Yan, Rui Tang, Huajin College of Computer Science and Technology Zhejiang University Hangzhou310027 China Research Center for Intelligent Computing Hardware Zhejiang Lab Hangzhou311100 China School of Integrated Circuits Peking University Beijing100871 China College of Computer Science Zhejiang University of Technology Hangzhou310014 China State Key Laboratory of Brain-Machine Intelligence Zhejiang University Hangzhou310027 China

Spiking neural networks (SNNs) operating with asynchronous discrete events show higher energy efficiency with sparse computation. A popular approach for implementing deep SNNs is ANN-SNN conversion combining both efficient training of ANNs and efficient inference of SNNs. However, the accuracy loss is usually non-negligible, especially under few time steps, which restricts the applications of SNN on latencysensitive edge devices greatly. In this paper, we first identify that such performance degradation stems from the misrepresentation of the negative or overflow residual membrane potential in SNNs. Inspired by this, we decompose the conversion error into three parts: quantization error, clipping error, and residual membrane potential representation error. With such insights, we propose a two-stage conversion algorithm to minimize those errors respectively. Besides, We show each stage achieves significant performance gains in a complementary manner. By evaluating on challenging datasets including CIFAR-10, CIFAR- 100 and ImageNet, the proposed method demonstrates the stateof- the-art performance in terms of accuracy, latency and energy preservation. Furthermore, our method is evaluated using a more challenging object detection task, revealing notable gains in regression performance under ultra-low latency when compared to existing spike-based detection algorithms. Codes are available at https://***/Windere/snn-cvt-dual-phase. Copyright © 2022, The Authors. All rights reserved.

关键词： Object detection

Towards defending against adversarial examples via attack-invariant features

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Zhou, Dawei Liu, Tongliang Han, Bo Wang, Nannan Peng, Chunlei Gao, Xinbo State Key Laboratory of Integrated Services Networks School of Telecommunications Engineering Xidian University China Trustworthy Machine Learning Lab School of Computer Science The University of Sydney Australia Department of Computer Science Hong Kong Baptist University Hong Kong State Key Laboratory of Integrated Services Networks School of Cyber Engineering Xidian University China Chongqing Key Laboratory of Image Cognition Chongqing University of Posts and Telecommunications China

Deep neural networks (DNNs) are vulnerable to adversarial noise. Their adversarial robustness can be improved by exploiting adversarial examples. However, given the continuously evolving attacks, models trained on seen types of adversarial examples generally cannot generalize well to unseen types of adversarial examples. To solve this problem, in this paper, we propose to remove adversarial noise by learning generalizable invariant features across attacks which maintain semantic classification information. Specifically, we introduce an adversarial feature learning mechanism to disentangle invariant features from adversarial noise. A normalization term has been proposed in the encoded space of the attack-invariant features to address the bias issue between the seen and unseen types of attacks. Empirical evaluations demonstrate that our method could provide better protection in comparison to previous state-of-theart approaches, especially against unseen types of attacks and adaptive attacks. Copyright © 2021, The Authors. All rights reserved.

关键词： Deep neural networks

Perceptual Quality Assessment of Virtual Reality Videos in the Wild

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Wen, Wen Li, Mu Yao, Yiru Sui, Xiangjie Zhang, Yabin Lan, Long Fang, Yuming Ma, Kede Department of Computer Science City University of Hong Kong Kowloon Hong Kong School of Computer Science and Technology Harbin Institute of Technology Guangdong Shenzhen518055 China School of Information Management Jiangxi University of Finance and Economics Jiangxi Nanchang330032 China Multimedia Lab Bytedance Inc China Institute for Quantum Information State Key Laboratory of High Performance Computing College of Computer Science and Technology National University of Defense Technology Changsha410073 China

Investigating how people perceive virtual reality (VR) videos in the wild (i.e., those captured by everyday users) is a crucial and challenging task in VR-related applications due to complex *** video databases only consider synthetic distortions, assume fixed viewing conditions, and are limited in size. To overcome these shortcomings, we construct the VR Video Quality in the Wild (VRVQW) database, containing 502 user-generated videos with diverse content and distortion characteristics. Based on VRVQW, we conduct a formal psychophysical experiment to record the scanpaths and perceived quality scores from 139 participants under two different viewing conditions. We provide a thorough statistical analysis of the recordeddata, observing significantimpact of viewing conditions on both human scanpaths and perceived quality. Moreover, we develop an objective quality assessment model for VR videos based on pseudocylindrical representation and convolution. Results on the proposed VRVQW show that our method is superior to existing video quality assessment *** have made the database and code available at https://***/ limuhit/VR-Video-Quality-in-the-Wild. Index Terms-Virtual reality, panoramic videos, video quality assessment, psychophysics. Copyright © 2022, The Authors. All rights reserved.

关键词： Virtual reality

Cardiac Evidence Backtracking for Eating Behavior Monitoring using Collocative Electrocardiogram Imagining

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Zhang, Xu-Lu Yang, Zhen-Qun Jiang, Dong-Mei Liao, Ga Li, Qing Jain, Ramesh Wei, Xiao-Yong College of Computer Science Sichuan University Chengdu610065 China Department of Biomedical Engineering Chinese University of Hong Kong Kowloon Hong Kong Center for Artificial Intelligence Peng Cheng Lab Shenzhen518055 China School of Computer Science Northwestern Polytechnical University Xi’an China State Key Laboratory of Oral Diseases National Clinical Research Center for Oral Diseases West China Hospital of Stomatology Sichuan University Chengdu610041 China Department of Computing Hong Kong Polytechnic University Kowloon Hong Kong Institute for Future Health University of California IrvineCA United States Donald Bren School of Information and Computer Sciences University of California IrvineCA United States

Eating monitoring has remained an open challenge in medical research for years due to the lack of non-invasive sensors for continuous monitoring and the reliable methods for automatic behavior detection. In this paper, we present a pilot study using the wearable 24-hour ECG for sensing and tailoring the sophisticated deep learning for ad-hoc and interpretable detection. This is accomplished using a collocative learning framework in which 1) we construct collocative tensors as pseudo-images from 1D ECG signals to improve the feasibility of 2D image-based deep models;2) we formulate the cardiac logic of analyzing the ECG data in a comparative way as periodic attention regulators so as to guide the deep inference to collect evidence in a human comprehensible manner;and 3) we improve the interpretability of the framework by enabling the backtracking of evidence with a set of methods designed for Class Activation Mapping (CAM) decoding and decision tree/forest generation. The effectiveness of the proposed framework has been validated on the largest ECG dataset of eating behavior with superior performance over conventional models, and its capacity of cardiac evidence mining has also been verified through the consistency of the evidence it backtracked and that of the previous medical studies. © 2025, CC BY.

关键词： Decision trees

Graph Adaptive Semantic Transfer for Cross-domain Sentiment Classification

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Zhang, Kai Zhang, Kun Liu, Qi Huang, Zhenya Zhang, Mengdi Wu, Wei Cheng, Mingyue Chen, Enhong Anhui Province Key Lab. of Big Data Analysis and Application University of S&T of China State Key Laboratory of Cognitive Intelligence Hefei China School of Computer Science and Information Engineering Hefei University of Technology Hefei China Meituan Beijing China Anhui Province Key Lab. of Big Data Analysis and Application University of S&T of China Hefei China

Cross-domain sentiment classification (CDSC) aims to use the transferable semantics learned from the source domain to predict the sentiment of reviews in the unlabeled target domain. Existing studies in this task attach more attention to the sequence modeling of sentences while largely ignoring the rich domain-invariant semantics embedded in graph structures (i.e., the part-of-speech tags and dependency relations). As an important aspect of exploring characteristics of language comprehension, adaptive graph representations have played an essential role in recent years. To this end, in the paper, we aim to explore the possibility of learning invariant semantic features from graph-like structures in CDSC. Specifically, we present Graph Adaptive Semantic Transfer (GAST) model, an adaptive syntactic graph embedding method that is able to learn domain-invariant semantics from both word sequences and syntactic graphs. More specifically, we first raise a POS-Transformer module to extract sequential semantic features from the word sequences as well as the part-of-speech tags. Then, we design a Hybrid Graph Attention (HGAT) module to generate syntax-based semantic features by considering the transferable dependency relations. Finally, we devise an Integrated aDaptive Strategy (IDS) to guide the joint learning process of both modules. Extensive experiments on four public datasets indicate that GAST achieves comparable effectiveness to a range of state-of-the-art models. © 2022, CC BY.

关键词： Sentiment analysis