检索结果-内蒙古大学图书馆

SKT-MOT and DyTracker: A Multiobject Tracking Dataset and a Dynamic Tracker for Speed Skating Video

Scientific Programming 2023年第1期2023卷

作者： Wang, Junwu Li, Zongmin Li, Yachuan Yang, Shaobo Wang, Ben Li, Hua Qingdao266580 China Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences Beijing100190 China

Speed skating serves as a significant application domain for multiobject tracking (MOT), presenting unique challenges such as frequent occlusion, highly similar appearances, and motion blur. To address these challenges, this paper constructs an MOT dataset called SKT-MOT for speed skating and analyzes the shortcomings of existing datasets and methods. Accordingly, we propose a dynamic MOT method called DyTracker. The method builds upon the DeepSORT baseline and enhances three key modules. At the global level, we design the track dynamic management (TDM) algorithm. In the motion branch, a novel metric is proposed to evaluate occlusion and Kalman filter dynamic update (KFDU) is implemented. In the appearance branch, we account for the difference in human posture and propose the feature dynamic selection and updating (FDSU) strategy. This makes our DyTracker flexible and efficient to achieve a multiobject tracking accuracy (MOTA) of 93.70% and identification F1 (IDF1) score of 92.39% on SKT-MOT, which is a significant advantage over existing SOTA methods. To validate the generalization of our proposed module, two dynamic update modules are inserted into other methods and validated on the public dataset MOT17, and the accuracy is generally improved by 0.2%-0.6%. © 2023 Junwu Wang et al.

关键词：

来源：评论

学校读者我要写书评

暂无评论

An Interactive Navigation Method with Effect-oriented Affordance

An Interactive Navigation Method with Effect-oriented Afford...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Xiaohan Wang Yuehu Liu Xinhang Song Yuyi Liu Sixian Zhang Shuqiang Jiang Institute of Artificial Intelligence and Robotics Xi’ an Jiaotong University Xi'an Key Lab of Intelligent Information Processing Laboratory of the Chinese Academy of Sciences (CAS) Institute of Computing Technology Beijing University of Chinese Academy of Sciences Beijing

ISBN: (数字)9798350353006

ISBN: (纸本)9798350353013

Visual navigation is to let the agent reach the target according to the continuous visual input. In most previous works, visual navigation is usually assumed to be done in a static and ideal environment: the target is always reachable with no need to alter the environment. However, the “messy” environments are more general and practical in our daily lives, where the agent may get blocked by obstacles. Thus Interactive Navigation (InterNav) is introduced to navigate to the objects in more realistic “messy” environments according to the object interaction. Prior work on InterNav learns shortterm interaction through extensive trials with reinforcement learning. However, interaction does not guarantee efficient navigation, that is, plan-ning obstacle interactions that make shorter paths and con-sume less effort is also crucial. In this paper, we introduce an effect-oriented affordance map to enable longterm interactive navigation, extending the existing map-based nav-igation framework to the domain of dynamic environment. We train a set of affordance functions predicting availab.e interactions and the time cost of removing obstacles, which informatively support an interactive modular system to ad-dress interaction and longterm planning. Experiments on the ProcTHOR simulator demonstrate the capability of our affordance-driven system in longterm navigation in complex dynamic environments.

关键词： Visualization Computer vision Uncertainty Costs Navigation Affordances Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

Optical and Electrical Analysis of an Advanced 4T All-perovskite Tandem Solar Cell

Optical and Electrical Analysis of an Advanced 4T All-perovs...

引用

Progress in Electromagnetic Research Symposium (PIERS)

作者： Zhaosheng Xia Xingang Ren Shengyang Wei Zhixiang Huang Information Materials and Intelligent Sensing Laboratory of Anhui Province Institute of Physical Science and Information Technology Anhui University Hefei China Key Laboratory of Intelligent Computing & Signal Processing Ministry of Education Anhui University Hefei China

ISBN: (数字)9798350375909

ISBN: (纸本)9798350375916

The investigation of the optoelectronic characteristics of all-perovskite tandem solar cells holds pivotal significance in surpassing the Shockley-Queisser limit of single-junction perovskite solar cells. Initially, we established two distinct four-terminal tandem solar cells (4T TSCs) composed of different perovskite materials: FA 0.8 Cs 0.2 Pb(I 0.7 Br 0.3 ) 3 (E g = 1.75 eV) and MASnI 3 (E g = 1.3 eV). Through numerical simulations of the optoelectronic characteristics of 4T TSCs, we evaluated the performance of the TSCs at varying perovskite layer thicknesses. Following optimization, the power conversion efficiency (PCE) of the 4T TSCs increased from the initial 30.34% to 33.54%. Through an in-depth analysis of the cell and energy distribution in TSCs, it was observed that the light-coupling layer significantly influenced the PCE of the 4T TSCs. Upon optimizing the light-coupling layer, the PCE of the TSC increased from the initial 30.34% to 34.7%. This study provides crucial theoretical and experimental foundations for optimizing the performance of all-perovskite TSCs.

关键词： Photovoltaic cells Numerical simulation Perovskites Optical coupling Optical materials Power conversion Electromagnetics

来源：评论

学校读者我要写书评

暂无评论

Seeing Motion at Nighttime with an Event Camera

arXiv

引用

arXiv 2024年

作者： Liu, Haoyue Peng, Shihan Zhu, Lin Chang, Yi Zhou, Hanyu Yan, Luxin National Key Lab of Multispectral Information Intelligent Processing Technology School of Artificial Intelligence and Automation Huazhong University of Science and Technology China Beijing Institute of Technology China

We focus on a very challenging task: imaging at nighttime dynamic scenes. Most previous methods rely on the low-light enhancement of a conventional RGB camera. However, they would inevitably face a dilemma between the long exposure time of nighttime and the motion blur of dynamic scenes. Event cameras react to dynamic changes with higher temporal resolution (microsecond) and higher dynamic range (120dB), offering an alternative solution. In this work, we present a novel nighttime dynamic imaging method with an event camera. Specifically, we discover that the event at nighttime exhibits temporal trailing characteristics and spatial non-stationary distribution. Consequently, we propose a nighttime event reconstruction network (NER-Net) which mainly includes a learnable event timestamps calibration module (LETC) to align the temporal trailing events and a non-uniform illumination aware module (NIAM) to stabilize the spatiotemporal distribution of events. Moreover, we construct a paired real low-light event dataset (RLED) through a co-axial imaging system, including 64,200 spatially and temporally aligned image GTs and low-light events. Extensive experiments demonstrate that the proposed method outperforms state-of-the-art methods in terms of visual quality and generalization ability on real-world nighttime datasets. The project are availab.e at: https://***/Liu-haoyue/NER-Net. Copyright © 2024, The Authors. All rights reserved.

关键词： Cameras

来源：评论

学校读者我要写书评

暂无评论

Top-ambiguity samples matter: understanding why deep ensemble works in selective classification 23

Top-ambiguity samples matter: understanding why deep ensembl...

引用

Proceedings of the 37th International Conference on Neural information processing Systems

作者： Qiang Ding Yixuan Cao Ping Luo Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS) Institute of Computing Technology CAS Beijing China and University of Chinese Academy of Sciences Beijing China Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS) Institute of Computing Technology CAS Beijing China and University of Chinese Academy of Sciences Beijing China and Peng Cheng Laboratory Shenzhen China

Selective classification allows a machine learning model to reject some hard inputs and thus improve the reliability of its predictions. In this area, the ensemble method is powerful in practice, but there has been no solid analysis on why the ensemble method works. Inspired by an interesting empirical result that the improvement of the ensemble largely comes from top-ambiguity samples where its member models diverge, we prove that, based on some assumptions, the ensemble has a lower selective risk than the member model for any coverage within a range. The proof is nontrivial since the selective risk is a non-convex function of the model prediction. The assumptions and the theoretical results are supported by systematic experiments on both computer vision and natural language processing tasks.

关键词：

来源：评论

学校读者我要写书评

暂无评论

FLIP-80M: 80 Million Visual-Linguistic Pairs for Facial Language-Image Pre-Training 24

FLIP-80M: 80 Million Visual-Linguistic Pairs for Facial Lang...

引用

32nd ACM International Conference on Multimedia, MM 2024

作者： Li, Yudong Hou, Xianxu Dezhi, Zheng Shen, Linlin Zhao, Zhe School of Computer Science and Software Engineering Shenzhen University Shenzhen China Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen China School of AI and Advanced Computing Xi'an Jiaotong-Liverpool University Shenzhen China Guangdong Provincial Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen China Tencent AI Lab Beijing China

ISBN: (纸本)9798400706868

While significant progress has been made in multi-modal learning driven by large-scale image-text datasets, there is still a noticeable gap in the availab.lity of such datasets within the facial domain. To facilitate and advance the field of facial representation learning, we present FLIP-80M, a large-scale visual-linguistic dataset comprising over 80 million face images paired with text descriptions. FLIP-80M is constructed by leveraging the large openly availab.e image-text-pair dataset LAION-5B and a mixed-method approach to filter face-related pairs from both visual and linguistic perspectives. Our curation process involves face detection, face caption classification, text de-noising, and synthesis-based image augmentation. As a result, FLIP-80M stands as the largest face-text dataset to date. To evaluate the potential of our dataset, we fine-tune the CLIP model using the proposed FLIP-80M, to create FLIP (Facial Language-Image Pretraining) and assess its representation capabilities across various downstream tasks. Our experiments demonstrate that our FLIP model achieves state-of-the-art results in a range of face analysis tasks, including face parsing, face alignment, and face attribute classification. The dataset and models are availab.e at https://***/ydli-ai/FLIP. © 2024 ACM.

关键词： Face recognition

来源：评论

学校读者我要写书评

暂无评论

Adaptive Adversarial Patch Attack on Face Recognition Models

Adaptive Adversarial Patch Attack on Face Recognition Models

引用

IEEE International Joint Conference on Biometrics (IJCB)

作者： Bei Yan Jie Zhang Zheng Yuan Shiguang Shan Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS) Institute of Computing Technology CAS Beijing China University of Chinese Academy of Sciences Beijing China

Face recognition models have become widely used for identity authentication in scenarios such as cell phone unlocking and financial payment, but they are vulnerable to adversarial examples. Due to the realizability in the physical world, adversarial patch attack has emerged as a significant security threat. However, most existing adversarial patch attack methods focus on only one aspect of patch generation, such as patch location or shape. To overcome this limitation, we propose a novel unified Adaptive Adversarial Patch (AAP) attack framework for targeted attack on face recognition models. Our method comprehensively considers various factors during patch generation, including location, shape, and number. Our approach adaptively selects patch location and number based on saliency map and clustering, while simultaneously deforming patch shape and optimizing perturbations. Extensive experiments under both white-box and black-box settings demonstrate that our proposed method achieves higher attack success rates compared to SOTA methods.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Deep Subdomain Alignment for Cross-domain Image Classification

Deep Subdomain Alignment for Cross-domain Image Classificati...

引用

IEEE Workshop on Applications of Computer Vision (WACV)

作者： Yewei Zhao Hu Han Shiguang Shan Xilin Chen Key Laboratory of Intelligent Information Processing Chinese Academy of Sciences (CAS) Institute of Computing Technology CAS Beijing China China University of the Chinese Academy of Sciences Beijing China

Unsupervised domain adaptation (UDA), which aims to transfer knowledge learned from a lab.led source domain to an unlab.led target domain, is useful for various cross-domain image classification scenarios. A commonly used approach for UDA is to minimize the distribution differences between two domains, and subdomain alignment is found to be an effective method. However, most of the existing subdomain alignment methods are based on adversarial learning and focus on subdomain alignment procedures without considering the discriminability among individual subdomains, resulting in slow convergence and unsatisfactory adaptation results. To address these issues, we propose a novel deep subdomain alignment method for UDA in image classification, which consists of a Union Subdo-main Contrastive Learning (USCL) module and a Multi-view Subdomain Alignment (MvSA) strategy. USCL can create discriminative and dispersed subdomains by bringing samples from the same subdomain closer while pushing away samples from different subdomains. MvSA makes use of lab.led source domain data and easy target domain data to perform target-to-source and target-to-target alignment. Experimental results on three image classifi-cation datasets (Office-31, Office-Home, Visda-17) demonstrate that our proposed method is effective for UDA and achieves promising results in several cross-domain image classification tasks. Our code will be availab.e: https://***/zhaoyewei/DSACDIC.

关键词：

来源：评论

学校读者我要写书评

暂无评论

SafeCFG: Redirecting Harmful Classifier-Free Guidance for Safe Generation

arXiv

引用

arXiv 2024年

作者： Pan, Jiadong Gao, Hongcheng Li, Liang Zha, Zheng-Jun Huang, Qingming Luo, Jiebo Key Laboratory of Intelligent Information Processing Institute of Computing Technology CAS China University of Chinese Academy of Sciences China University of Science and Technology of China China University of Rochester United States

Diffusion models (DMs) have demonstrated exceptional performance in text-to-image (T2I) tasks, leading to their widespread use. With the introduction of classifier-free guidance (CFG), the quality of images generated by DMs is improved. However, DMs can generate more harmful images by maliciously guiding the image generation process through CFG. Some safe guidance methods aim to mitigate the risk of generating harmful images but often reduce the quality of clean image generation. To address this issue, we introduce the Harmful Guidance Redirector (HGR), which redirects harmful CFG direction while preserving clean CFG direction during image generation, transforming CFG into SafeCFG and achieving high safety and quality generation. We train HGR to redirect multiple harmful CFG directions simultaneously, demonstrating its ability to eliminate various harmful elements while preserving high-quality generation. Additionally, we find that HGR can detect image harmfulness, allowing for unsupervised fine-tuning of safe diffusion models without pre-defined clean or harmful lab.ls. Experimental results show that by incorporating HGR, images generated by diffusion models achieve both high quality and strong safety, and safe DMs trained through unsupervised methods according to the harmfulness detected by HGR also exhibit good safety performance. The codes will be publicly availab.e. Copyright © 2024, The Authors. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

An Entity Alignment Algorithm Based on Ontology Enhancement and Multi-Feature Fusion

An Entity Alignment Algorithm Based on Ontology Enhancement ...

引用

Frontiers technology of information and Computer (ICFTIC), IEEE International Conference on

作者： Hao Song Yuxia Lei Kangli Zi Fuyuan Quan Tianhang Zhang Qi Li School of Computer Science Qufu Normal University Rizhao Shandong China Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences Beijing China

ISBN: (数字)9798331541750

ISBN: (纸本)9798331541767

Entity alignment plays a crucial role in the integration of knowledge graphs. However, current knowledge graphs often suffer from inconsistent construction standards, structural heterogeneity, and imprecise semantic representation of entities, which can lead to suboptimal embedding of structural information. Moreover, most existing entity alignment methods rely heavily on structural information, which limits alignment efficiency. To address these challenges, this paper presents Onto-IMF, an ontology-enhanced entity alignment method based on multi-feature fusion. This approach aims to enhance the semantic representation of entities by incorporating ontology information, thereby reducing structural discrepancies among heterogeneous graphs and improving the embedding of structural information. The multi-feature fusion entity alignment leverages diverse semantic features, including relations, attributes, and entity names, to achieve more accurate alignment. Experimental results on various DBP15K subsets indicate that the proposed method achieves Hits@l scores of 86.6%, 93.0%, and 97.7%, respectively, representing an average improvement of 7.9 % over the best-performing baseline models.

关键词： Accuracy Semantics Knowledge graphs Contrastive learning Ontologies Data models Standards

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：