检索结果-内蒙古大学图书馆

arXiv 2022年

作者： Li, Shiqi Xiang, Xiang MoE Key Lab of Image Information Processing Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology China

Recent research on human pose estimation exploits complex structures to improve performance on benchmark datasets, ignoring the resource overhead and inference speed when the model is actually deployed. In this paper, we lighten the computation cost and parameters of the deconvolution head network in SimpleBaseline and introduce an attention mechanism that utilizes original, inter-level, and intra-level information to intensify the accuracy. Additionally, we propose a novel loss function called heatmap weighting loss, which generates weights for each pixel on the heatmap that makes the model more focused on keypoints. Experiments demonstrate our method achieves a balance between performance, resource volume, and inference speed. Specifically, our method can achieve 65.3 AP score on COCO test-dev, while the inference speed is 55 FPS and 18 FPS on the mobile GPU and CPU, respectively. Copyright © 2022, The Authors. All rights reserved.

关键词： Benchmarking

来源：评论

学校读者我要写书评

暂无评论

IEEE VR 2023 Workshops: Workshop: 3D Reconstruction, Digital Twinning, and Simulation for Virtual Experiences (ReDigiTS 2023)

IEEE VR 2023 Workshops: Workshop: 3D Reconstruction, Digital...

引用

2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023

作者： Cannavò, Alberto Kapralos, Bill Seinfeld, Sofia Pratticò, Filippo Gabriele Zhang, Congyi Politecnico di Torino Turin Italy Game Development and Interactive Media Program and MaxSIMhealth Lab Ontario Tech University Oshawa Canada Image Processing and Multimedia Technology Center Universitat Politècnica de Catalunya-Barcelona Tech Terrassa Spain Politecnico di Torino Turin Italy Department of Computer Science The University of Hong Kong Hong Kong Hong Kong

ISBN: (纸本)9798350348392

Today, Augmented Reality (AR), Virtual Reality (VR), and Mixed Reality (MR) technologies are becoming fundamental across a wide variety of application domains. All these technologies fall under the Extended Reality (XR) spectrum. Areas in which XR technologies and, in particular, immersive experiences have been successfully introduced are expanding daily, from traditional areas, such as entertainment and video game production, to novel scenarios, such as industry, healthcare, smart cities, and autonomous vehicles, to mention a few. The spread of XR and VR is also driven by technological advancements that are making new ways of operating within virtual experiences easier, and sometimes even possible. In particular, the availability of new hardware and software tools make the use of '3D reconstructions', 'digital twins' and 'simulations' commonplace in many XR and VR applications. For example, the possibility to leverage networks with higher bandwidth than never before and lower latency makes it possible to transmit the amount of data needed for massive, real-time digital twins, whereas high-performance hardware enables the reconstruction of high-fidelity digital objects and environments, while lowering the time needed for high-demanding simulations. The aim of the 3D Reconstruction, Digital Twinning, and Simulation for Virtual Experiences (ReDigiTS) workshop is to bring together researchers, practitioners, educators, and students to share ideas and promote further work in this growing area of 3D reconstruction, digital twinning, and simulation in VR and related technologies. © 2023 IEEE.

关键词： Augmented reality

来源：评论

学校读者我要写书评

暂无评论

Cascading Enhancement Representation for Face Anti-Spoofing

SSRN

引用

SSRN 2023年

作者： Ma, Yimei Dong, Yangwei Qian, Jianjun Wong, Wai Keung Yang, Jian PCA Lab Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education Jiangsu Key Lab of Image and Video Understanding for Social Security School of Computer Science and Engineering Nanjing University of Science and Technology China Institute of Textiles and Clothing The Hong Kong Polytechnic University Hong Kong

Face anti-spoofing (FAS) is the first security line of defense in face recognition system. The majority of current methods focus on distinguishing the live faces from spoof faces by designing adaptive network with auxiliary information to enhance the feature discrimination, which shows that how to achieve the discriminative representation is also vital to solve FAS task. In this paper, motivated by the idea of cascading enhancement, we propose a novel cascading enhancement representation network (CERN) for effective FAS. Specifically, the CERN utilizes two branches to achieve multi-level feature in cascading enhancement feature extraction stage. The first branch employs the backbone network to concatenate the multi-scale feature in conjunction with attention modules. The second branch utilizes the shared attention modules to enhance the input space for learning the multi-level refinement features. In cascading enhancement feature fusion stage, we transmit the high-level feature to the middle level (mid-level) for enhancing the mid-level representation. The novel mid-level feature is then used to enhance the low-level feature. Moreover, the weight map learning scheme is proposed to further enhance discrimination of the predicted binary map. Additionally, we use meta learning to extend our CERN for solving cross-database testing. Experiments on five benchmark databases demonstrate the effectiveness of our methods against the state-of-art methods. © 2023, The Authors. All rights reserved.

关键词： Face recognition

来源：评论

学校读者我要写书评

暂无评论

Data-driven Sparse Bayesian Learning Discovery of Hysteresis Effects in Electrospinning Processes

Data-driven Sparse Bayesian Learning Discovery of Hysteresis...

引用

第34届中国控制与决策会议

作者： Hongwei Sun Yasen Wang Yaozhong Zheng Xiang Huang Hai-Tao Zhang School of Artificial Intelligence and Automation and Key Laboratory of Image Processing and Intelligent ControlSchool of AutomationHuazhong University of Science and Technology State Key Lab of Digital Manufacturing Equipment and Technology Huazhong University of Science and Technology School of Mechanical Science and Engineering Huazhong University of Science and Technology

Electrospinning is an efficient and feasible method to fabricate hairline fibers from polymers or ***,the hysteresis nonlinearity among pump flow and jet diameter during electrospinning process strongly hinders the improvement of its *** alleviate this effect,it is an urgent yet challenging mission to discover hysteresis effects in near-field Electrospinning *** this work,a nonlinear autoregressive exogenous model is developed for described electrospinning ***,a pure data-driven sparse B ayesian learning(SBL) method is applied to distill the pump flow-jet diameter hysteresis ***,extensive experiments are conducted to verify the discovered effects by the SBL identification method.

关键词： Electrospinning hysteresis nonlinear autoregressive exogenous(NARX) sparse Bayesian learning(SBL)

来源：评论

学校读者我要写书评

暂无评论

SHaRPose: Sparse High-Resolution Representation for Human Pose Estimation

arXiv

引用

arXiv 2023年

作者： An, Xiaoqi Zhao, Lin Gong, Chen Wang, Nannan Wang, Di Yang, Jian PCA Lab Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education Jiangsu Key Lab of Image and Video Understanding for Social Security School of Computer Science and Engineering Nanjing University of Science and Technology China State Key Laboratory of Integrated Services Networks Xidian University China

High-resolution representation is essential for achieving good performance in human pose estimation models. To obtain such features, existing works utilize high-resolution input images or fine-grained image tokens. However, this dense high-resolution representation brings a significant computational burden. In this paper, we address the following question: "Only sparse human keypoint locations are detected for human pose estimation, is it really necessary to describe the whole image in a dense, high-resolution manner?" Based on dynamic transformer models, we propose a framework that only uses Sparse High-resolution Representations for human Pose estimation (SHaRPose). In detail, SHaRPose consists of two stages. At the coarse stage, the relations between image regions and keypoints are dynamically mined while a coarse estimation is generated. Then, a quality predictor is applied to decide whether the coarse estimation results should be refined. At the fine stage, SHaRPose builds sparse high-resolution representations only on the regions related to the keypoints and provides refined high-precision human pose estimations. Extensive experiments demonstrate the outstanding performance of the proposed method. Specifically, compared to the state-of-the-art method ViTPose, our model SHaRPose-Base achieves 77.4 AP (+0.5 AP) on the COCO validation set and 76.7 AP (+0.5 AP) on the COCO test-dev set, and infers at a speed of 1.4× faster than ViTPose-Base. Code is available at https://***/AnxQ/sharpose. Copyright © 2023, The Authors. All rights reserved.

关键词： Machine learning

来源：评论

学校读者我要写书评

暂无评论

Human Attention Based Movie Summarization: Dataset and Baseline Model

Human Attention Based Movie Summarization: Dataset and Basel...

引用

2022 IEEE International Conference on Multimedia and Expo, ICME 2022

作者： Zhao, Defang Zhu, Dandan Min, Xiongkuo Yue, Jiaomin Zhang, Kaiwei Zhou, Qiangqiang Zhai, Guangtao Yang, Xiaokang CloudWalk Technology Shanghai China School of Computer Science and Technology Donghua University Shanghai China Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai China School of Software Jiangxi Normal University Nanchang China Ai Institute Shanghai Jiao Tong University MOE Key Lab of Artificial Intelligence Shanghai China

ISBN: (数字)9781665485630

ISBN: (纸本)9781665485630

The movie summarization model can automatically edit a condensed and succinct version of the movie by selecting the keyframes. Previous works mainly resort to hand-crafted heuristics and most of them are unsupervised. Supervised movie summarization is a new research field and, there is currently no publicly suitable dataset available. Moreover, existing works only focus on the movies themselves while neglecting the audiences, who have the most say in which part of the movie is more attractive. To deal with the aforementioned limitations, we establish a human attention based movie summarization dataset Movie50. Specifically, we explore the human attention variations when watching videos and have the following findings: (1) The attention of humans is concentrated when watching keyframes. (2) The attention of humans is distracted when watching non-keyframes. Inspired by these findings, we collect the eye fixations of 20 participants when watching 50 movies and propose a novel human attention based annotation pipeline. In addition, we introduce A/V-MSNet, an audiovisual neural network that takes advantage of spatio-temporal visual and auditory information to better model human attention as well as exploit more plentiful information. Extensive experiments demonstrate the superiority of the proposed method. © 2022 IEEE.

关键词： Motion pictures

来源：评论

学校读者我要写书评

暂无评论

Tackling Ambiguity from Perspective of Uncertainty Inference and Affinity Diversification for Weakly Supervised Semantic Segmentation

arXiv

引用

arXiv 2024年

作者： Yang, Zhiwei Meng, Yucong Fu, Kexue Wang, Shuo Song, Zhijian Academy for Engineering & Technology Fudan University Shanghai200433 China Digital Medical Research Center School of Basic Medical Science Fudan University China Shanghai Key Lab of Medical Image Computing and Computer Assisted Intervention Shanghai200032 China Shandong Computer Science Center China

Weakly supervised semantic segmentation (WSSS) with image-level labels intends to achieve dense tasks without laborious annotations. However, due to the ambiguous contexts and fuzzy regions, the performance of WSSS, especially the stages of generating Class Activation Maps (CAMs) and refining pseudo masks, widely suffers from ambiguity while being barely noticed by previous literature. In this work, we propose UniA, a unified single-staged WSSS framework, to efficiently tackle this issue from the perspective of uncertainty inference and affinity diversification, respectively. When activating class objects, we argue that the false activation stems from the bias to the ambiguous regions during the feature extraction. Therefore, we design a more robust feature representation with a probabilistic Gaussian distribution and introduce the uncertainty estimation to avoid the bias. A distribution loss is particularly proposed to supervise the process, which effectively captures the ambiguity and models the complex dependencies among features. When refining pseudo labels, we observe that the affinity from the prevailing refinement methods intends to be similar among ambiguities. To this end, an affinity diversification module is proposed to promote diversity among semantics. A mutual complementing refinement is proposed to initially rectify the ambiguous affinity with multiple inferred pseudo labels. More importantly, a contrastive affinity loss is further designed to diversify the relations among unrelated semantics, which reliably propagates the diversity into the whole feature representations and helps generate better pseudo masks. Extensive experiments are conducted on PASCAL VOC, MS COCO, and medical ACDC datasets, which validate the efficiency of UniA tackling ambiguity and the superiority over recent single-staged or even most multi-staged competitors. Codes will be publicly available here. Copyright © 2024, The Authors. All rights reserved.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

Optimized efficient attention-based network for facial expressions analysis in neurological health care

引用

Computers in Biology and Medicine 2024年 179卷 108822-108822页

作者： Munsif, Muhammad Sajjad, Muhammad Ullah, Mohib Tarekegn, Adane Nega Cheikh, Faouzi Alaya Tsakanikas, Panagiotis Muhammad, Khan Sejong University Seoul143-747 Korea Republic of Digital Image Processing Lab Department of Computer Science Islamia College Peshawar25000 Pakistan Department of Computer Science Norwegian University for Science and Technology Gjøvik2815 Norway Department of Computer Science Norwegian University for Science and Technology Gjøvik2815 Norway Institute of Communication and Computer Systems National Technical University of Athens Athens15773 Greece Department of Applied Artificial Intelligence School of Convergence College of Computing and Informatics Sungkyunkwan University Seoul03063 Korea Republic of

Facial Expression Analysis (FEA) plays a vital role in diagnosing and treating early-stage neurological disorders (NDs) like Alzheimer's and Parkinson's. Manual FEA is hindered by expertise, time, and training requirements, while automatic methods confront difficulties with real patient data unavailability, high computations, and irrelevant feature extraction. To address these challenges, this paper proposes a novel approach: an efficient, lightweight convolutional block attention module (CBAM) based deep learning network (DLN) to aid doctors in diagnosing ND patients. The method comprises two stages: data collection of real ND patients, and pre-processing, involving face detection and an attention-enhanced DLN for feature extraction and refinement. Extensive experiments with validation on real patient data showcase compelling performance, achieving an accuracy of up to 73.2%. Despite its efficacy, the proposed model is lightweight, occupying only 3MB, making it suitable for deployment on resource-constrained mobile healthcare devices. Moreover, the method exhibits significant advancements over existing FEA approaches, holding tremendous promise in effectively diagnosing and treating ND patients. By accurately recognizing emotions and extracting relevant features, this approach empowers medical professionals in early ND detection and management, overcoming the challenges of manual analysis and heavy models. In conclusion, this research presents a significant leap in FEA, promising to enhance ND diagnosis and *** code and data used in this work are available at: https://***/munsif200/Neurological-Health-Care. © 2024 Elsevier Ltd

关键词： Feature extraction

来源：评论

学校读者我要写书评

暂无评论

ScanDTM: A Novel Dual-Temporal Modulation Scanpath Prediction Model for Omnidirectional images

引用

IEEE Transactions on Circuits and Systems for Video technology 2025年

作者： Zhu, Dandan Zhang, Kaiwei Min, Xiongkuo Zhai, Guangtao Yang, Xiaokang East China Normal University School of Computer Science and Technology Shanghai200333 China Shanghai Jiao Tong University Institute of Image Communication and Network Engineering Shanghai200240 China Shanghai Jiao Tong University MoE Key Lab of Artificial Intelligence AI Institute Shanghai200240 China

Scanpath prediction for omnidirectional images aims to effectively simulate the human visual perception mechanism to generate dynamic realistic fixation trajectories. However, the majority of scanpath prediction methods for omnidirectional images are still in their infancy as they fail to accurately capture the time-dependency of viewing behavior and suffer from sub-optimal performance along with limited generalization capability. A desirable solution should achieve a better trade-off between prediction performance and generalization ability. To this end, we propose a novel dual-temporal modulation scanpath prediction (ScanDTM) model for omnidirectional images. Such a model is designed to effectively capture long-range time-dependencies between various fixation regions across both internal and external time dimensions, thereby generating more realistic scanpaths. In particular, we design a Dual Graph Convolutional Network (Dual-GCN) module comprising a semantic-level GCN and an image-level GCN. This module servers as a robust visual encoder that captures spatial relationships among various object regions within an image and fully utilizes similar images as complementary information to capture similarity relations across relevant images. Notably, the proposed Dual-GCN focuses on modeling temporal correlations from both local and global perspectives within the internal time dimension. Furthermore, drawing inspiration from the promising generalization capabilities of diffusion models across various generative tasks, we introduce a novel diffusion-guided saliency module. This module formulates the prediction issue as a conditional generative process for the saliency map, utilizing extracted semantic-level and image-level visual features as conditions. With the well-designed diffusion-guided saliency module, our proposed ScanDTM model acting as an external temporal modulator, we can progressively refine the generated scanpath from the noisy map. We conduct extensive expe

关键词： Prediction models

来源：评论

学校读者我要写书评

暂无评论

3D Cinemagraphy from a Single image

arXiv

引用

arXiv 2023年

作者： Li, Xingyi Cao, Zhiguo Sun, Huiqiang Zhang, Jianming Xian, Ke Lin, Guosheng Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology China Adobe Research S-Lab Nanyang Technological University Singapore

We present 3D Cinemagraphy, a new technique that marries 2D image animation with 3D photography. Given a single still image as input, our goal is to generate a video that contains both visual content animation and camera motion. We empirically find that naively combining existing 2D image animation and 3D photography methods leads to obvious artifacts or inconsistent animation. Our key insight is that representing and animating the scene in 3D space offers a natural solution to this task. To this end, we first convert the input image into feature-based layered depth images using predicted depth values, followed by unprojecting them to a feature point cloud. To animate the scene, we perform motion estimation and lift the 2D motion into the 3D scene flow. Finally, to resolve the problem of hole emergence as points move forward, we propose to bidirectionally displace the point cloud as per the scene flow and synthesize novel views by separately projecting them into target image planes and blending the results. Extensive experiments demonstrate the effectiveness of our method. A user study is also conducted to validate the compelling rendering results of our method. Copyright © 2023, The Authors. All rights reserved.

关键词： Animation

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：