检索结果-内蒙古大学图书馆

International Conference on Computer Vision (ICCV)

作者： Zhiyu Pan Zhiguo Cao Kewei Wang Hao Lu Weicai Zhong Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Huawei CBG

ISBN: (纸本)9781665428132

We show that relation modeling between visual elements matters in cropping view recommendation. Cropping view recommendation addresses the problem of image recomposition conditioned on the composition quality and the ranking of views (cropped sub-regions). This task is challenging because the visual difference is subtle when a visual element is reserved or removed. Existing methods represent visual elements by extracting region-based convolutional features inside and outside the cropping view boundaries, without probing a fundamental question: why some visual elements are of interest or of discard? In this work, we observe that the relation between different visual elements significantly affects their relative positions to the desired cropping view, and such relation can be characterized by the attraction inside/outside the cropping view boundaries and the repulsion across the boundaries. By instantiating a transformer-based solution that represents visual elements as visual words and that models the dependencies between visual words, we report not only state-of-the-art performance on public benchmarks, but also interesting visualizations that depict the attraction and repulsion between visual elements, which may shed light on what makes for effective cropping view recommendation.

关键词： Visualization Computer vision Computational modeling Benchmark testing Feature extraction Transformers Decoding

来源：评论

学校读者我要写书评

暂无评论

Densely activated self-attention for semantic segmentation

引用

Pattern Recognition 2025年

作者： Liwen Xiao Wenze Liu Zhicheng Wang Yiran Wang Zhiyu Pan Hao Lu Zhiguo Cao Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan 430074 China

In semantic segmentation, pixels often share the same mask lab.ls across a vast region. However, in recent prevalent transformer-based models, predictions frequently suffer from incompleteness or discontinuities. The dilemma is caused by sparse activation of vanilla self-attention during feature extraction. During the vanilla self-attention, each query over-focuses on a small number of relevant keys but neglects numerous keys sharing the same category with it, restricting the capture of universal feature representation for its category. Such sparsely activated self-attention will further cause unignorable feature differences among tokens sharing the same class in feature maps, introducing noise on final predictions. To reduce such differences, we propose the Densely Activated self-attention Module (DAM), a novel pluggable module designed to generate densely activated self-attention. Inserted after the encoder, it encourages each query to attend to a broader range of keys, obtaining more consistent features. Experimental results on three widely used benchmarks with six different baselines demonstrate that DAM consistently improves performance with a negligible increase in parameters and FLOPs. Our work provides a new perspective on the behavior of self-attention in semantic segmentation.

关键词：

来源：评论

学校读者我要写书评

暂无评论

What Matters for 3D Scene Flow Network

arXiv

引用

arXiv 2022年

作者： Wang, Guangming Hu, Yunzhe Liu, Zhe Zhou, Yiyang Tomizuka, Masayoshi Zhan, Wei Wang, Hesheng Department of Automation Key Laboratory of System Control and Information Processing of Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Jiao Tong University China MoE Key Lab of Artificial Intelligence Shanghai Jiao Tong University China Mechanical Systems Control Laboratory University of California Berkeley United States

3D scene flow estimation from point clouds is a low-level 3D motion perception task in computer vision. Flow embedding is a commonly used technique in scene flow estimation, and it encodes the point motion between two consecutive frames. Thus, it is critical for the flow embeddings to capture the correct overall direction of the motion. However, previous works only search locally to determine a soft correspondence, ignoring the distant points that turn out to be the actual matching ones. In addition, the estimated correspondence is usually from the forward direction of the adjacent point clouds, and may not be consistent with the estimated correspondence acquired from the backward direction. To tackle these problems, we propose a novel all-to-all flow embedding layer with backward reliability validation during the initial scene flow estimation. Besides, we investigate and compare several design choices in key components of the 3D scene flow network, including the point similarity calculation, input elements of predictor, and predictor & refinement level design. After carefully choosing the most effective designs, we are able to present a model that achieves the state-of-the-art performance on FlyingThings3D and KITTI Scene Flow datasets. Our proposed model surpasses all existing methods by at least 38.2% on FlyingThings3D dataset and 24.7% on KITTI Scene Flow dataset for EPE3D metric. We release our codes at https://***/IRMVlab.3DFlow. Copyright © 2022, The Authors. All rights reserved.

关键词： Embeddings

来源：评论

学校读者我要写书评

暂无评论

Real-time Multi-person Eyeblink Detection in the Wild for Untrimmed Video

arXiv

引用

arXiv 2023年

作者： Zeng, Wenzheng Xiao, Yang Wei, Sicheng Gan, Jinfang Zhang, Xintao Cao, Zhiguo Fang, Zhiwen Zhou, Joey Tianyi Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China School of Biomedical Engineering Southern Medical University Guangzhou510515 China Department of Rehabilitation Medicine Zhujiang Hospital Southern Medical University Guangzhou510280 China Singapore Singapore

Real-time eyeblink detection in the wild can widely serve for fatigue detection, face anti-spoofing, emotion analysis, etc. The existing research efforts generally focus on single-person cases towards trimmed video. However, multi-person scenario within untrimmed videos is also important for practical applications, which has not been well concerned yet. To address this, we shed light on this research field for the first time with essential contributions on dataset, theory, and practices. In particular, a large-scale dataset termed MPEblink that involves 686 untrimmed videos with 8748 eyeblink events is proposed under multi-person conditions. The samples are captured from unconstrained films to reveal "in the wild" characteristics. Meanwhile, a real-time multi-person eyeblink detection method is also proposed. Being different from the existing counterparts, our proposition runs in a one-stage spatio-temporal way with end-to-end learning capacity. Specifically, it simultaneously addresses the sub-tasks of face detection, face tracking, and human instance-level eyeblink detection. This paradigm holds 2 main advantages: (1) eyeblink features can be facilitated via the face's global context (e.g., head pose and illumination condition) with joint optimization and interaction, and (2) addressing these sub-tasks in parallel instead of sequential manner can save time remarkably to meet the real-time running requirement. Experiments on MPEblink verify the essential challenges of real-time multi-person eyeblink detection in the wild for untrimmed video. Our method also outperforms existing approaches by large margins and with a high inference speed. Copyright © 2023, The Authors. All rights reserved.

关键词： Face recognition

来源：评论

学校读者我要写书评

暂无评论

A2J-Transformer: Anchor-to-Joint Transformer Network for 3D Interacting Hand Pose Estimation from a Single RGB image

A2J-Transformer: Anchor-to-Joint Transformer Network for 3D ...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Changlong Jiang Yang Xiao Cunlin Wu Mingyang Zhang Jinghong Zheng Zhiguo Cao Joey Tianyi Zhou Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Alibaba Group Centre for Frontier AI Research Agency for Science Technology and Research (A*STAR) Singapore Institute of High Performance Computing Agency for Science Technology and Research (A*STAR) Singapore

3D interacting hand pose estimation from a single RGB image is a challenging task, due to serious self-occlusion and inter-occlusion towards hands, confusing similar appearance patterns between 2 hands, ill-posed joint position mapping from 2D to 3D, etc.. To address these, we propose to extend A2J-the state-of-the-art depth-based 3D single hand pose estimation method-to RGB domain under interacting hand condition. Our key idea is to equip A2J with strong local-global aware ability to well capture interacting hands' local fine details and global articulated clues among joints jointly. To this end, A2J is evolved under Transformer's non-local encoding-decoding framework to build A2J- Transformer. It holds 3 main advantages over A2J. First, self-attention across local anchor points is built to make them global spatial context aware to better capture joints' articulation clues for resisting occlusion. Secondly, each anchor point is regarded as learnable query with adaptive feature learning for facilitating pattern fitting capacity, instead of having the same local representation with the others. Last but not least, anchor point locates in 3D space instead of 2D as in A2J, to leverage 3D pose prediction. Experiments on challenging InterHand 2.6M demonstrate that, A2J-Transformer can achieve state-of-the-art model-free performance (3.38mm MPJPE advancement in 2-hand case) and can also be applied to depth domain with strong generalization. The code is avaliable at https://***/ChanglongJiangGit/A2J-Transformer.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Global Consensus for Heterogeneous Saturated Multi-Agent Systems via Sampled-Data control

Global Consensus for Heterogeneous Saturated Multi-Agent Sys...

引用

IEEE Conference on Decision and control

作者： Juan Qian Xiaoling Wang Daniele Astolfi Housheng Su Guo-Ping Jiang College of Automation and the College of Artificial Intelligence Nanjing University of Posts and Telecommunications Nanjing China Jiangsu Engineering Center for IOT Intelligent Robots(IOTRobot) Nanjing China CNRS LAGEPP UMR 5007 43 boulevard du 11 novembre 1918 Université Claude Bernard Lyon 1 Villeurbanne France Key Laboratory of Smart Manufacturing in Energy Chemical Process Ministry of Education East China University of Science and Technology Shanghai China School of Artificial Intelligence and Automation Image Processing and Intelligent Control Key Laboratory of Education Ministry of China Huazhong University of Science and Technology Luoyu Road 1037 Wuhan China

ISBN: (数字)9798350316339

ISBN: (纸本)9798350316346

This paper addresses the global consensus problem for multi-input multi-output saturated systems within a sampled-data framework, aiming to advance global consensus, manage heterogeneous actuator saturation across components, and preserve distributed characteristics by using sampled-data feedback. We propose a distributed control algorithm that incorporates a redesigned saturation function, represented as decentralized dynamic saturation levels. These levels for each agent’s dimensions are autonomously updated through an adaptive strategy, which mitigates heterogeneous saturation by carefully selecting constant and time-varying saturation parameters in it. Lyapunov analysis proves that global consensus can be achieved under the proposed control law, provided the sampling periods of all agents remain below a calculated threshold. An example is given to demonstrate the effectiveness of this approach.

关键词： Actuators Upper bound Heuristic algorithms Decentralized control Multi-agent systems

来源：评论

学校读者我要写书评

暂无评论

An Approach for National-Scale Accessibility Assessment and Vulnerability Analysis of Integrated Multimodal Transportation Systems

SSRN

引用

SSRN 2021年

作者： Zhang Ouyang, Min Sun, Wenjing Hong, Liu School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Key Lab. for Image Processing and Intelligent Control Huazhong University of Science and Technology Ministry of Education Wuhan430074 China

A series of ambitious accessibility-oriented policies have been launched in the world, which center around improving accessibility of the integrated multimodal transportation systems including road, airline, and high-speed rail. The multimodal accessibility assessment is one of the "basic" analyses for the design and implementation of these policies. This paper models the integrated road, high-speed rail, airline, and walking system (IRHAWS) as a four-layer network with the consideration of their interdependencies. An algorithm is then developed to accurately assess accessibility based on the four-layer network with the consideration of daily schedule of high-speed trains and flights, where the accessibility between two nodes is defined as the minimum travel time given a departure time. The proposed approach enables the time-varied accessibility assessment of both off-network and on-network areas at a national or global scale, and is applied to map the multimodal accessibility to 363 city centers in China and analyze the optimal travel modes for on-network travels. Based on the proposed accessibility assessment approach, this paper also investigates the vulnerability of the Chinese integrated multimodal transportation system under the extreme storm event recently occurred in Zhengzhou (July 2021). The findings in this work provide insightful suggestions to plan the road, high-speed rail, and airline systems as a whole. © 2021, The Authors. All rights reserved.

关键词： Railroad transportation

来源：评论

学校读者我要写书评

暂无评论

Watch the Speakers: A Hybrid Continuous Attribution Network for Emotion Recognition in Conversation With Emotion Disentanglement

Watch the Speakers: A Hybrid Continuous Attribution Network ...

引用

International Conference on Tools for Artificial Intelligence (ICTAI)

作者： Shanglin Lei Xiaoping Wang Guanting Dong Jiang Li Yingjian Liu School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Wuhan China School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing China Institute of Artificial Intelligence Huazhong University of Science and Technology (HUST) Wuhan China

Emotion Recognition in Conversation (ERC) has attracted widespread attention in the natural language processing field due to its enormous potential for practical applications. Existing ERC methods face challenges in achieving generalization to diverse scenarios due to insufficient modeling of context, ambiguous capture of dialogue relationships and overfitting in speaker modeling. In this work, we present a Hybrid Continuous Attributive Network (HCAN) to address these issues in the perspective of emotional continuation and emotional attribution. Specifically, HCAN adopts a hybrid recurrent and attention-based module to model global emotion continuity. Then a novel Emotional Attribution Encoding (EAE) is proposed to model intra- and inter-emotional attribution for each utterance. Moreover, aiming to enhance the robustness of the model in speaker modeling and improve its performance in different scenarios, A comprehensive loss function emotional cognitive loss $\mathcal{L}_{EC}$ is proposed to alleviate emotional drift and overcome the overfitting of the model to speaker modeling. Our model achieves state-of-the-art performance on three datasets, demonstrating the superiority of our work. Another extensive comparative experiments and ablation studies on three benchmarks are conducted to provided evidence to support the efficacy of each module. Further exploration of generalization ability experiments shows the plug-and-play nature of the EAE module in our method.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Parametric Design Optimization of a Universal Supernumerary Robotic Limb

Parametric Design Optimization of a Universal Supernumerary ...

引用

International Symposium on Micromechatronics and Human Science (MHS)

作者： Jun Huo Bo Yang Hongge Ru Jian Huang Key Laboratory of Ministry of Education for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology (HUST) Wuhan China

ISBN: (纸本)9781665407748

It is a positive trend for hemiplegia with wearable robots in rehabilitation training. Recently, wearable Supernumerary Robotic Limb (SRL) is rising to a hot spot. The difficulty in modeling SRL for hemiplegia is how to make the SRL mechanism match the human upper and lower limbs' size and function simultaneously. In this paper, a simplified model of a four Degree of Freedoms (DOFs) universal SRL (USRL) is introduced. Based on workspace similarity, which is evaluated by Jaccard Index (JI), we establish a multi-object optimization (MOO) model. By applying the Particle Swarm Optimization (PSO) algorithm, we have found the optimal SRL mechanism parameters that meet the requirement of the human upper limb and the cane simultaneously. Meanwhile, a few impact factors are discussed briefly in the present proposal. The simulation results show that the USRL has a sound match with the human and could assist the hemiplegia subject as a supplemental limb.

关键词： Training Simulation Wearable robots Market research Manufacturing Indexes Proposals

来源：评论

学校读者我要写书评

暂无评论

Large, Complex, and Realistic Safety Clothing and Helmet Detection: Dataset and Method

arXiv

引用

arXiv 2023年

作者： Yu, Fusheng Li, Jiang Wang, Xiaoping Wu, Shaojin Zhang, Junjie Zeng, Zhigang The School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China The Institute of Artificial Intelligence Huazhong University of Science and Technology Wuhan430074 China The Hubei Key Laboratory of Brain-Inspired Intelligent Systems Huazhong University of Science and Technology Wuhan430074 China The Key Laboratory of Image Processing and Intelligent Control Huazhong University of Science and Technology Ministry of Education Wuhan430074 China

Detecting safety clothing and helmets is paramount for ensuring the safety of construction workers. However, the development of deep learning models in this domain has been impeded by the scarcity of high-quality datasets. In this study, we construct a large, complex, and realistic safety clothing and helmet detection (SFCHD) dataset. SFCHD is derived from two authentic chemical plants, comprising 12,373 images, 7 categories, and 50,552 annotations. We partition the SFCHD dataset into training and testing sets with a ratio of 4:1 and validate its utility by applying several classic object detection algorithms. Furthermore, drawing inspiration from spatial and channel attention mechanisms, we design a spatial and channel attention-based low-light enhancement (SCALE) module. SCALE is a plug-and-play component with a high degree of flexibility. Extensive evaluations of the SCALE module on both the ExDark and SFCHD datasets have empirically demonstrated its efficacy in enhancing the performance of detectors under low-light conditions. The dataset and code are publicly availab.e at https://***/lijfrankopen/SFCHD-SCALE. Copyright © 2023, The Authors. All rights reserved.

关键词： Chemical plants

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：