检索结果-内蒙古大学图书馆

International Conference on Computer Vision (ICCV)

作者： Sixian Zhang Xinhang Song Yubing Bai Weijie Li Yakui Chu Shuqiang Jiang Key Lab of Intelligent Information Processing Laboratory of the Chinese Academy of Sciences (CAS) Institute of Computing Technology Beijing University of Chinese Academy of Sciences Beijing Huawei Application Innovate Laboratory Beijing Institute of Intelligent Computing Technology Suzhou CAS

ISBN: (纸本)9781665428132

The goal of object navigation is to reach the expected objects according to visual information in the unseen environments. Previous works usually implement deep models to train an agent to predict actions in real-time. However, in the unseen environment, when the target object is not in egocentric view, the agent may not be able to make wise decisions due to the lack of guidance. In this paper, we propose a hierarchical object-to-zone (HOZ) graph to guide the agent in a coarse-to-fine manner, and an online-learning mechanism is also proposed to update HOZ according to the real-time observation in new environments. In particular, the HOZ graph is composed of scene nodes, zone nodes and object nodes. With the pre-learned HOZ graph, the real-time observation and the target goal, the agent can constantly plan an optimal path from zone to zone. In the estimated path, the next potential zone is regarded as sub-goal, which is also fed into the deep reinforcement learning model for action prediction. Our methods are evaluated on the AI2-Thor simulator. In addition to widely used evaluation metrics SR and SPL, we also propose a new evaluation metric of SAE that focuses on the effective action rate. Experimental results demonstrate the effectiveness and efficiency of our proposed method. The code is available at https://***/sx-zhang/***.

关键词： Measurement Weight measurement Visualization Computer vision Codes Navigation Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

Diverse and High-Quality Food Image Generation from Only Food Names

引用

ACM Transactions on Multimedia computing, Communications, and Applications 2025年第5期21卷

作者： Dongjian Yu Weiqing Min Xin Jin Qian Jiang Ying Jin Shuqiang Jiang School of Software Yunnan University China Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences China

Food image generation holds promising application prospects in food design, advertising, and food education. However, the existing methods rely on information such as recipes, ingredients, or food names, which leads to generated food images with less intra-class diversity. When recipes, ingredients and food names are identical for the same food, the real-world images may vary significantly in appearance. The question of how to simultaneously ensure the quality and diversity of the generated images is a key issue. To this end, we employ pre-trained diffusion model and Transformer to propose a method for generating diverse and high-quality images of both Chinese and Western food, named CW-Food. Different from previous works that utilize an overall food feature to generate new images, CW-Food first decouples the food images to obtain common intra-class features and private instance features. Additionally, we design a Transformer-based feature fusion module to integrate the common and private features, in order to avoid the shortcomings of conventional methods. Moreover, we also utilize a pre-trained diffusion model as our backbone, which is fine-tuned using LoRA with the fused multi-variate features. Extensive experiments on four datasets demonstrate the advantages of our proposed method, producing diverse and high-quality food images encompassing both Chinese and Western cuisines. To the best of our knowledge, our work is the first attempt to generate Chinese food images using only food names.

关键词： Food image Fine-grained image generation Diffusion model

来源：评论

学校读者我要写书评

暂无评论

Point, Segment and Count: A Generalized Framework for Object Counting

Point, Segment and Count: A Generalized Framework for Object...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Zhizhong Huang Mingliang Dai Yi Zhang Junping Zhang Hongming Shan Shanghai Key Lab of Intelligent Information Processing School of Computer Science Fudan University Shanghai China School of Cyber Science and Engineering Sichuan University Chengdu China Frontiers Center for Brain Science Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence Institute of Science and Technology for Brain-inspired Intelligence & MOE Fudan University Shanghai China

ISBN: (数字)9798350353006

ISBN: (纸本)9798350353013

Class-agnostic object counting aims to count all objects in an image with respect to example boxes or class names, a.k.a few-shot and zero-shot counting. In this paper, we propose a generalized framework for both few-shot and zero-shot object counting based on detection. Our framework combines the superior advantages of two foundation models without compromising their zero-shot capability: (i) SAM to segment all possible objects as mask proposals, and (ii) CLIP to classify proposals to obtain accurate object counts. However, this strategy meets the obstacles of efficiency over-head and the small crowded objects that cannot be localized and distinguished. To address these issues, our framework, termed PseCo, follows three steps: point, segment, and count. Specifically, we first propose a class-agnostic object localization to provide accurate but least point prompts for SAM, which consequently not only reduces computation costs but also avoids missing small objects. Furthermore, we propose a generalized object classification that leverages CLIP image/text embeddings as the classifier, following a hierarhical knowledge distillation to obtain discriminative classifications among hierarchical mask proposals. Extensive experimental results on FSC-147, COCO, and LVIS demonstrate that PseCo achieves state-of-the-art performance in both few-shot/zero-shot object counting/detection.

关键词： Location awareness Image segmentation Computer vision Accuracy Costs Power capacitors Pattern recognition

来源：评论

学校读者我要写书评

暂无评论

Atomic-action-based Contrastive Network for Weakly Supervised Temporal Language Grounding

Atomic-action-based Contrastive Network for Weakly Supervise...

引用

IEEE International Conference on Multimedia and Expo (ICME)

作者： Hongzhou Wu Yifan Lyu Xingyu Shen Xuechen Zhao Mengzhu Wang Xiang Zhang Zhigang Luo Parallel and Distributed Processing Lab National University of Defense Technology Changsha China Institute of Software Chinese Academy of Sciences University of Chinese Academy of Sciences Beijing China School of Computer National University of Defense Technology Changsha China Institute for Quantum Information and the State Key Lab of High Performance Computing National University of Defense Technology Changsha China

As one knows, an event often consists of several actions while each action is atomic. Inspired by this insight, we propose a novel framework named Atomic-action-based Contrastive Network model (ACN) for weakly supervised temporal language grounding task to localize the query-related event moment in an untrimmed video, without access to any temporal annotations. Specifically, ACN first determines the accurate moment boundary of each action in a query-agnostic way. This can adequately exploit homogeneous visual cues while impeding the heterogeneity of the query from hurting the atomicity of visual action, i.e., action boundary. To effectively localize the query-related event, we seek the discriminative words in the given query, and explore a composite-grained contrastive module to retrieve those corresponding atomic actions in the common latent space across modalities. This boosts feature discrimination of visual event segment to remove irrelevant action video segments. Experiments on two popular datasets show the efficacy of our model.

关键词：

来源：评论

学校读者我要写书评

暂无评论

FAN-NET: FOURIER-BASED ADAPTIVE NORMALIZATION FOR CROSS-DOMAIN STROKE LESION SEGMENTATION

arXiv

引用

arXiv 2023年

作者： Yu, Weiyi Lei, Yiming Shan, Hongming Institute of Science and Technology for Brain-inspired Intelligence Fudan University Shanghai200433 China Shanghai Key Lab of Intelligent Information Processing School of Computer Science Fudan University Shanghai200433 China Shanghai Center for Brain Science and Brain-Inspired Technology Shanghai201210 China

Since stroke is the main cause of various cerebrovascular diseases, deep learning-based stroke lesion segmentation on magnetic resonance (MR) images has attracted considerable attention. However, the existing methods often neglect the domain shift among MR images collected from different sites, which has limited performance improvement. To address this problem, we intend to change style information without affecting high-level semantics via adaptively changing the low-frequency amplitude components of the Fourier transform so as to enhance model robustness to varying domains. Thus, we propose a novel FAN-Net, a U-Net-based segmentation network incorporated with a Fourier-based adaptive normalization (FAN) and a domain classifier with a gradient reversal layer. The FAN module is tailored for learning adaptive affine parameters for the amplitude components of different domains, which can dynamically normalize the style information of source images. Then, the domain classifier provides domain-agnostic knowledge to endow FAN with strong domain generalizability. The experimental results on the ATLAS dataset, which consists of MR images from 9 sites, show the superior performance of the proposed FAN-Net compared with baseline methods. © 2023, CC BY.

关键词： Magnetic resonance

来源：评论

学校读者我要写书评

暂无评论

Surface Simulation and Design of C-band Energy Selective Surface

Surface Simulation and Design of C-band Energy Selective Sur...

引用

International Applied Computational Electromagnetics Society Symposium (ACES)

作者： Shangyu Lu Guohui Yang Kuang Zhang Yingsong Li School of Electronics and Information Engineering Harbin Institute of Technology Harbin China Anhui Province Key Laboratory of Target Recognition and Feature Extraction LuAn China Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education Anhui University China

Based on the equivalent circuit model of PIN diode and the full wave simulation method of CST software, the system performance of finite large energy selective surface (ESS) is simulated and analyzed when the number of cells is small. The simulation results show that the working performance of ESS will be degraded by the slight surface deformation caused by external force but not fail completely. Therefore, in the practical application of ESS, attention should be paid to avoid deformation caused by external force extrusion, which will reduce the shielding performance of ESS. The simulation results provide reference value for the practical design and application of energy selective surface.

关键词： Analytical models Deformation Surface waves PIN photodiodes Simulation System performance Force

来源：评论

学校读者我要写书评

暂无评论

CLIMS++: Cross Language Image Matching with Automatic Context Discovery for Weakly Supervised Semantic Segmentation

引用

International Journal of Computer Vision 2025年 1-20页

作者： Xie, Jinheng Deng, Songhe Hou, Xianxu Luo, Zhaochuan Shen, Linlin Huang, Yawen Zheng, Yefeng Shou, Mike Zheng Computer Vision Institute School of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China Department of Computer Science Wenzhou-Kean University Wenzhou325060 China Guangdong Provincial Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen China Show Lab National University of Singapore Singapore639798 Singapore School of AI and Advanced Computing Xi’an Jiaotong-Liverpool University Suzhou215400 China Jarvis Research Center Tencent YouTu Lab Shenzhen518703 China

While promising results have been achieved in weakly-supervised semantic segmentation (WSSS), limited supervision from image-level tags inevitably induces discriminative reliance and spurious relations between target classes and background regions. Thus, Class Activation Map (CAM) usually tends to activate discriminative object regions and falsely includes lots of class-related backgrounds. Without pixel-level supervisions, it could be very difficult to enlarge the foreground activation and suppress those false activation of background regions. In this paper, we propose a novel framework of Cross Language Image Matching with Automatic Context Discovery (CLIMS++), based on the recently introduced Contrastive Language-Image Pre-training (CLIP) model, for WSSS. The core idea of our framework is to introduce natural language supervision to activate more complete object regions and suppress class-related background regions in CAM. In particular, we design object, background region, and text label matching losses to guide the model to excite more reasonable object regions of each category. In addition, we propose to automatically find spurious relations between foreground categories and backgrounds, through which a background suppression loss is designed to suppress the activation of class-related backgrounds. The above designs enable the proposed CLIMS++ to generate a more complete and compact activation map for the target objects. Extensive experiments on PASCAL VOC 2012 and MS COCO 2014 datasets show that our CLIMS++ significantly outperforms the previous state-of-the-art methods. © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2025.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

Bi-Contrastive Alignment for Incomplete Multi-view Clustering

Bi-Contrastive Alignment for Incomplete Multi-view Clusterin...

引用

Chinese Control and Decision Conference, CCDC

作者： Shengxia Gao Yaoying Wang Yuqing Shi Kaiwu Zhang Shiqiang Du Chinese National Information Technology Research Institute Northwest Minzu University Lanzhou China Key Laboratory of Minzu Languages and Cultures Intelligent Information Processing Gansu Province Northwest Minzu University Lanzhou China College of Electrical Engineering Northwest Minzu University Lanzhou China Key Laboratory of Linguistic and Cultural Computing of Ministry of Education Northwest Minzu University Lanzhou China College of Mathematics and Computer Science Northwest Minzu University Lanzhou China

ISBN: (数字)9798350387780

ISBN: (纸本)9798350387797

Multi-view clustering (MVC) represents a significant challenge in the realms of machine learning and data mining. Recently, the advent of contrastive learning (CL) has catalyzed the development of numerous innovative methods within this field. The efficacy of these methods typically hinges on the availability of consistent and comprehensive data. Nevertheless, real-world scenarios of data collection and transmission frequently encounter issues like partial unaligned-views (PU), which result in incomplete datasets and pose formidable challenges for effective MVC. To address this prevalent issue, our paper introduces an innovative framework, termed bi-contrastive alignment for incomplete multi-view clustering (BCA). BCA specifically targets the challenge of incomplete data stemming from PU. It encompasses a unique module, semantic guided bi-contrastive alignment (SGBA), designed to counteract the PU by harnessing semantic similarities. Moreover, the framework augments data alignment by integrating a contrastive learning-based corrective component into the loss function. The comparative experiments demonstrate that the ARI metric of our method surpasses the second-best contrasting method on all four datasets.

关键词： Measurement Semantics Contrastive learning Machine learning Fasteners Data collection Benchmark testing

来源：评论

学校读者我要写书评

暂无评论

Understanding the Robustness of 3D Object Detection with Bird’s-Eye-View Representations in Autonomous Driving

arXiv

引用

arXiv 2023年

作者： Zhu, Zijian Zhang, Yichi Chen, Hai Dong, Yinpeng Zhao, Shu Ding, Wenbo Zhong, Jiachen Zheng, Shibao Institute of Image Communication and Network Engineering Shanghai Jiao Tong University China Dept. of Comp. Sci. and Tech. Institute for AI THBI Lab BNRist Center Tsinghua University China Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education School of Computer Science and Technology Anhui University Information Materials and Intelligent Sensing Laboratory of Anhui Province China SAIC Motor AI Lab China Zhongguancun Laboratory China

3D object detection is an essential perception task in autonomous driving to understand the environments. The Bird’s-Eye-View (BEV) representations have significantly improved the performance of 3D detectors with camera inputs on popular benchmarks. However, there still lacks a systematic understanding of the robustness of these vision-dependent BEV models, which is closely related to the safety of autonomous driving systems. In this paper, we evaluate the natural and adversarial robustness of various representative models under extensive settings, to fully understand their behaviors influenced by explicit BEV features compared with those without BEV. In addition to the classic settings, we propose a 3D consistent patch attack by applying adversarial patches in the 3D space to guarantee the spatiotemporal consistency, which is more realistic for the scenario of autonomous driving. With substantial experiments, we draw several findings: 1) BEV models tend to be more stable than previous methods under different natural conditions and common corruptions due to the expressive spatial representations;2) BEV models are more vulnerable to adversarial noises, mainly caused by the redundant BEV features;3) Camera-LiDAR fusion models have superior performance under different settings with multi-modal inputs, but BEV fusion model is still vulnerable to adversarial noises of both point cloud and image. These findings alert the safety issue in the applications of BEV detectors and could facilitate the development of more robust models. Code available at https: //***/zzj403/BEV_Robust. Copyright © 2023, The Authors. All rights reserved.

关键词： Birds

来源：评论

学校读者我要写书评

暂无评论

Learning Shape-Appearance Based Attributes Representation for Facial Attribute Recognition with Limited labeled Data

Learning Shape-Appearance Based Attributes Representation fo...

引用

International Conference on Automatic Face and Gesture Recognition

作者： Kunyan Li Jie Zhang Shiguang Shan Key Laboratory of Intelligent Information Processing of Chinese Academy of Sciences(CAS) Institute of Computing Technology Beijing CAS China University of Chinese Academy of Sciences Beijing China Institute of Intelligent Computing Technology Suzhou CAS

ISBN: (纸本)9781665431774

The Facial Attribute Recognition (FAR) is a challenging task especially when there exists limited labeled data, which may lead the mainstream fully-supervised FAR methods to be no longer in force. To tackle this problem, we propose a novel unsupervised learning framework named Shape-Appearance Based Attributes Representation Learning (SABAL) by leveraging large-scale unlabeled face data. Considering face attributes are mainly determined by 3D shape and facial appearance, we decouple a face image into 3D shape and appearance features by two branch networks, i.e., 3D Shape Branch and Facial Appearance Branch. 3D Shape Branch and Facial Appearance Branch are jointly trained with orthogonal loss and 2D face reconstruction loss to obtain robust facial representations containing 3D-geometry and texture information, which are beneficial for attributes recognition. Finally, the unsupervised learnt features are transferred to the FAR task by fine-tuning on limited labeled data from CelebA. Extensive experiments show that we achieve comparable results to state-of-the-art methods.

关键词： Representation learning Three-dimensional displays Image recognition Shape Face recognition Lead Task analysis

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：