检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Dong, Wenlong Huang, Dehao Liu, Jiangshan Tang, Chao Zhang, Hong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

Task-oriented grasping (TOG) is crucial for robots to accomplish manipulation tasks, requiring the determination of TOG positions and directions. Existing methods either rely on costly manual TOG annotations or only extract coarse grasping positions or regions from human demonstrations, limiting their practicality in real-world applications. To address these limitations, we introduce RTAGrasp, a Retrieval, Transfer, and Alignment framework inspired by human grasping strategies. Specifically, our approach first effortlessly constructs a robot memory from human grasping demonstration videos, extracting both TOG position and direction constraints. Then, given a task instruction and a visual observation of the target object, RTAGrasp retrieves the most similar human grasping experience from its memory and leverages semantic matching capabilities of vision foundation models to transfer the TOG constraints to the target object in a training-free manner. Finally, RTAGrasp aligns the transferred TOG constraints with the robot’s action for execution. Evaluations on the public TOG benchmark, TaskGrasp dataset, show the competitive performance of RTAGrasp on both seen and unseen object categories compared to existing baseline methods. Real-world experiments further validate its effectiveness on a robotic arm. Our code, appendix, and video are available at https: //***/view/rtagrasp/home. © 2024, CC BY.

关键词： Robotic arms

来源：评论

学校读者我要写书评

暂无评论

Enhancing Micro Gesture Recognition for Emotion Understanding via Context-aware Visual-Text Contrastive Learning

arXiv

引用

arXiv 2024年

作者： Li, Deng Xing, Bohao Liu, Xin School of Electrical and Information Engineering Tianjin University Tianjin300072 China Computer Vision and Pattern Recognition Laboratory Lappeenranta-Lahti University of Technology LUT Lappeenranta53850 Finland

Psychological studies have shown that Micro Gestures (MG) are closely linked to human emotions. MG-based emotion understanding has attracted much attention because it allows for emotion understanding through nonverbal body gestures without relying on identity information (e.g., facial and electrocardiogram data). Therefore, it is essential to recognize MG effectively for advanced emotion understanding. However, existing Micro Gesture Recognition (MGR) methods utilize only a single modality (e.g., RGB or skeleton) while overlooking crucial textual information. In this letter, we propose a simple but effective visual-text contrastive learning solution that utilizes text information for MGR. In addition, instead of using handcrafted prompts for visual-text contrastive learning, we propose a novel module called Adaptive prompting to generate context-aware prompts. The experimental results show that the proposed method achieves state-of-the-art performance on two public datasets. Furthermore, based on an empirical study utilizing the results of MGR for emotion understanding, we demonstrate that using the textual results of MGR significantly improves performance by 6%+ compared to directly using video as input. Copyright © 2024, The Authors. All rights reserved.

关键词： Gesture recognition

来源：评论

学校读者我要写书评

暂无评论

Multi-Scale Point Octree Encoding Network for Point Cloud Based Place Recognition

Multi-Scale Point Octree Encoding Network for Point Cloud Ba...

引用

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Zhilong Tang Hanjing Ye Hong Zhang Department of Electrical and Electronic Engineering Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology (SUSTech) SUSTech Shenzhen China

Over the past decades, point cloud-based place recognition has garnered significant attention. This research paper presents a pioneering approach, denoted as the Multi-scale Point Octree Encoding Network (MPOE-Net), designed to acquire a discriminative global descriptor for efficient retrieval of places. The key element of the MPOE-Net is the point octree encoding module, which adeptly captures local information for each point by considering its nearest and farthest neighbors. Further enhancing local relationships, a multi-transformer network is introduced, utilizing a novel grouped offset-attention mechanism. To amalgamate the multi-scale attention maps into a comprehensive global descriptor, a multi-NetVLAD layer is incorporated. Through rigorous experimentation across diverse benchmark datasets, our proposed method unequivocally outperforms existing techniques in the realm of point cloud-based place recognition tasks, achieving state-of-the-art results. Our code is released publicly at https://***/Zhilong-Tang/MPOE-Net.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Uncertainty Aware Deep Learning for Fault Prediction Using Multivariate Time Series Signals

Uncertainty Aware Deep Learning for Fault Prediction Using M...

引用

International Joint Conference on Neural Networks (IJCNN)

作者： Md Monibor Rahman L. Vidyaratne A. Carpenter C. Tennant K. Iftekharuddin Department of Electrical and Computer Engineering Vision Lab Old Dominion University Norfolk VA USA Jefferson Laboratory Newport News VA USA

The superconducting radio-frequency cavities are a crucial component of the Continuous Electron Beam Accelerator Facility (CEBAF) at Jefferson Lab. When a cavity faults, beam delivery to experimental end users is disrupted. Prediction of cavity faults prior to onset is essential to reduce operation and maintenance costs. In this work, a parallel long short-term memory (LSTM)-convolutional neural network (CNN)-based deep learning (DL) model is proposed to predict impending faults using pre-fault signals. Further, we introduce an uncertainty quantification approach using Monte Carlo dropout with the LSTM-CNN model to ascertain confidence in the prediction. The model was tested using multivariate time series signals from stable cavity operations and before faults. Initial results show that on the test dataset, the model can identify impending faults before their onset with an average 10-fold cross validation accuracy of 97.39% and a standard deviation of 0.12% using a 100-ms time window. It is also observed that the model performs better as the prediction time moves closer to the fault onset. For additional context, we compare the performance of the model with three machine-learning (ML)-based fault prediction models. Our proposed parallel LSTM-CNN-based DL method shows better performance than the ML-based methods.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Guest Editorial Introduction to the Special Section on Video and Language

引用

IEEE Transactions on Circuits and Systems for Video Technology 2022年第1期32卷 1-4页

作者： Mei, Tao Corso, Jason J. Kim, Gunhee Luo, Jiebo Shen, Chunhua Zhang, Hanwang Computer Vision and Multimedia Laboratory Jd Explore Academy *** Beijing100101 China Department of Electrical Engineering and Computer Science University of Michigan Ann ArborMI48109 United States Department of Computer Science and Engineering Seoul National University Gwanak-gu Seoul08826 Korea Republic of Department of Computer Science University of Rochester RochesterNY14627 United States College of Computer Science and Technology Zhejiang University Hangzhou310058 China School of Computer Science and Engineering Nanyang Technological University 639798 Singapore

computer vision (CV) and Natural Language Processing (NLP) are two most fundamental disciplines under a broad area of artificial intelligence (AI). CV is regarded as a field of research that explores the techniques to teach computers to see and understand digital content such as images and videos. NLP is a branch of linguistics that enables computers to process, interpret, and even generate human language. With the rise and development of deep learning over the past decade, there has been a steady momentum of innovation and breakthroughs that convincingly push the limits and improve the state-of-the-art of both vision and language modeling. An interesting observation is that the research in the two areas starts to interact, with a significant growth in both the volume of publications and extensive applications. Meanwhile, many previous experiences have shown that this can naturally build up the circle of human intelligence.

关键词： Special issues and sections computer vision Question answering (information retrieval) Natural language processing Visual captioning

来源：评论

学校读者我要写书评

暂无评论

Sparkling hot spots in perovskite solar cells under reverse bias

引用

ChemPhysMater 2022年第1期1卷 71-76页

作者： Weiqi Li Keqing Huang Jianhui Chang Caiqi Hu Caoyu Long Hai Zhang Xavier Maldague Biao Liu Jianqiao Meng Yuxia Duan Junliang Yang School of Physics and Electronics Central South UniversityChangsha 410083China Computer Vision and Systems Laboratory Department of Electrical and Computer EngineeringUniversitéLaval1065av.de la MédecineQuébec(QC)Canada G1V 0A6

Perovskite solar cells(PSCs)are attracting much attention and are on the way to ***,some modules are subject to reverse bias in actual fields,so it is meaningful to investigate the reverse-bias behav-ior of ***,an in-situ temperature and current measurement technique was ***,some hot spots were observed and then quickly disappeared in the reverse biased PSCs,along with the simultaneous increase in the current and local ***,the potential mechanism has been revealed and *** abnormal bulge in the perovskite film was found at the hot ***,the appearance and disappearance of hot spots were perfectly explained by band bending and tunneling current caused by ion ***-tionally,statistical analysis suggested that sparkling hot spots were related to reverse voltage and efficiencies of *** research provides a great significance for the study of PSCs under reverse bias.

关键词： Perovskite solar cells Reverse bias Hot spots Stability

来源：评论

学校读者我要写书评

暂无评论

A short review on infrared thermography: history, philosophy, approaches, standards and application examples 45

A short review on infrared thermography: history, philosophy...

引用

Thermosense: Thermal Infrared Applications XLV 2023

作者： Plastropoulos, Angelos Adiuku, Ndidiamaka Avdelidis, Nicolas P. Ibarra-Castanedo, Clemente Maldague, Xavier P.V. Servais, Pierre Integrated Vehicle Health Management Centre School of Aerospace Transport and Manufacturing Cranfield University United Kingdom Computer Vision & Systems Laboratory Department of Electrical & Computer Engineering Laval University Quebec CityG1V 0A6 Canada NDT PRO Srl Le grand enclos 18 LibramontB6800 Belgium

ISBN: (纸本)9781510661868

Infrared thermography is a condition monitoring technique that, from a measurement of the radiant heat pattern emitted by a material, is able to determine regions or points of increased or reduced heat emission that can indicate the presence of an imperfection in the investigated material. The result of an infrared thermographic investigation is a sequence of thermograms or thermal images, in other words a picture of temperature, that can be further processed for qualitative and quantitative purposes. Such images can be presented in either false color or black and white format. In the present work, the philosophy and history of thermal–infrared imaging are reviewed. Moreover, the different evaluation approaches (passive and active), as well as many standards related to infrared thermography are discussed. Finally, various applications of the transient thermography approach are briefly presented. © 2023 SPIE.

关键词： Thermography (imaging)

来源：评论

学校读者我要写书评

暂无评论

Unsupervised HDR Image and Video Tone Mapping via Contrastive Learning

arXiv

引用

arXiv 2023年

作者： Cao, Cong Yue, Huanjing Liu, Xin Yang, Jingyu School of Electrical and Information Engineering Tianjin University China Computer Vision and Pattern Recognition Laboratory School of Engineering Science Lappeenranta-Lahti University of Technology LUT Lappeenranta Finland

Capturing high dynamic range (HDR) images (videos) is attractive because it can reveal the details in both dark and bright regions. Since the mainstream screens only support low dynamic range (LDR) content, tone mapping algorithm is required to compress the dynamic range of HDR images (videos). Although image tone mapping has been widely explored, video tone mapping is lagging behind, especially for the deep-learning-based methods, due to the lack of HDR-LDR video pairs. In this work, we propose a unified framework (IVTMNet) for unsupervised image and video tone mapping. To improve unsupervised training, we propose domain and instance based contrastive learning loss. Instead of using a universal feature extractor, such as VGG to extract the features for similarity measurement, we propose a novel latent code, which is an aggregation of the brightness and contrast of extracted features, to measure the similarity of different pairs. We totally construct two negative pairs and three positive pairs to constrain the latent codes of tone mapped results. For the network structure, we propose a spatial-feature-enhanced (SFE) module to enable information exchange and transformation of nonlocal regions. For video tone mapping, we propose a temporal-feature-replaced (TFR) module to efficiently utilize the temporal correlation and improve the temporal consistency of video tone-mapped results. We construct a large-scale unpaired HDR-LDR video dataset to facilitate the unsupervised training process for video tone mapping. Experimental results demonstrate that our method outperforms state-of-the-art image and video tone mapping methods. Our code and dataset are available at https://***/caocong/UnCLTMO. Copyright © 2023, The Authors. All rights reserved.

关键词： Conformal mapping

来源：评论

学校读者我要写书评

暂无评论

Dependency-aware Task Offloading and Resource Pricing in Vehicular Edge Computing: A Stackelberg Game Approach

Dependency-aware Task Offloading and Resource Pricing in Veh...

引用

International Symposium on Parallel and Distributed Processing with Applications, ISPA

作者： Liang Zhao Shuai Huang Yuxiang Cao Huan Zhou Victor C. M. Leung Hubei Key Laboratory of Intelligent Vision Based Monitoring for Hydroelectric Engineering College of Computer and Information Technology China Three Gorges University Yichang China School of Computer Science Northwestern Polytechnical University Xi’an China Department of Electrical and Computer Engineering The University of British Columbia Vancouver Canada

ISBN: (数字)9798331509712

ISBN: (纸本)9798331509729

Vehicular Edge Computing (VEC) allows vehicles to offload their delay-sensitive tasks to nearby Road Side Units (RSUs) for processing, which improves network quality of service (QoS). However, the self-interested SDN controller is unwilling to ask RSUs to provide free computing resources for vehicles. At the same time, complicated dependencies between vehicular subtasks may cause non-ideal task delay and energy consumption. In order to solve these problems, this paper proposes a Stackelberg game-based Dependency-aware task Offloading and resource Pricing framework (SDOP). Specifically, we first model a vehicular edge network that partially offloads dependency-aware tasks. Then, we depict the interaction between the SDN controller and vehicles as a Stackelberg game, with the goal of maximizing the utility of both parties. Next, we present a Gradient Ascent Plus Genetic algorithm (GAPG) to solve the problem. Finally, numerous simulations are performed, and the results show that compared with other baseline schemes, the proposed GAPG can significantly improve the utility of both the SDN controller and vehicles under various scenarios.

关键词： Energy consumption Computational modeling Road side unit Process control Games Pricing Quality of service Delays Edge computing Genetic algorithms

来源：评论

学校读者我要写书评

暂无评论

DAMPER: A Dual-Stage Medical Report Generation Framework with Coarse-Grained MeSH Alignment and Fine-Grained Hypergraph Matching

arXiv

引用

arXiv 2024年

作者： Huang, Xiaofei Chen, Wenting Liu, Jie Lu, Qisheng Luo, Xiaoling Shen, Linlin Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Shenzhen China Department of Electrical Engineering City University of Hong Kong Kowloon Hong Kong National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China Guangdong Provincial Key Laboratory of Intelligent Information Processing China

Medical report generation is crucial for clinical diagnosis and patient management, summarizing diagnoses and recommendations based on medical imaging. However, existing work often overlook the clinical pipeline involved in report writing, where physicians typically conduct an initial quick review followed by a detailed examination. Moreover, current alignment methods may lead to misaligned relationships. To address these issues, we propose DAMPER, a dual-stage framework for medical report generation that mimics the clinical pipeline of report writing in two stages. In the first stage, a MeSH-Guided Coarse-Grained Alignment (MCG) stage that aligns chest X-ray (CXR) image features with medical subject headings (MeSH) features to generate a rough keyphrase representation of the overall impression. In the second stage, a Hypergraph-Enhanced Fine-Grained Alignment (HFG) stage that constructs hypergraphs for image patches and report annotations, modeling high-order relationships within each modality and performing hypergraph matching to capture semantic correlations between image regions and textual phrases. Finally,the coarse-grained visual features, generated MeSH representations, and visual hypergraph features are fed into a report decoder to produce the final medical report. Extensive experiments on public datasets demonstrate the effectiveness of DAMPER in generating comprehensive and accurate medical reports, outperforming state-of-the-art methods across various evaluation metrics. Copyright © 2024, The Authors. All rights reserved.

关键词： Coarse-grained modeling

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：