检索结果-内蒙古大学图书馆

CLIMS++: Cross Language Image Matching with Automatic Context Discovery for Weakly Supervised Semantic Segmentation

International Journal of Computer Vision 2025年 1-20页

作者： Xie, Jinheng Deng, Songhe Hou, Xianxu Luo, Zhaochuan Shen, Linlin Huang, Yawen Zheng, Yefeng Shou, Mike Zheng Computer Vision Institute School of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China Department of Computer Science Wenzhou-Kean University Wenzhou325060 China Guangdong Provincial Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen China Show Lab National University of Singapore Singapore639798 Singapore School of AI and Advanced Computing Xi’an Jiaotong-Liverpool University Suzhou215400 China Jarvis Research Center Tencent YouTu Lab Shenzhen518703 China

While promising results have been achieved in weakly-supervised semantic segmentation (WSSS), limited supervision from image-level tags inevitably induces discriminative reliance and spurious relations between target classes and background regions. Thus, Class Activation Map (CAM) usually tends to activate discriminative object regions and falsely includes lots of class-related backgrounds. Without pixel-level supervisions, it could be very difficult to enlarge the foreground activation and suppress those false activation of background regions. In this paper, we propose a novel framework of Cross Language Image Matching with Automatic Context Discovery (CLIMS++), based on the recently introduced Contrastive Language-Image Pre-training (CLIP) model, for WSSS. The core idea of our framework is to introduce natural language supervision to activate more complete object regions and suppress class-related background regions in CAM. In particular, we design object, background region, and text label matching losses to guide the model to excite more reasonable object regions of each category. In addition, we propose to automatically find spurious relations between foreground categories and backgrounds, through which a background suppression loss is designed to suppress the activation of class-related backgrounds. The above designs enable the proposed CLIMS++ to generate a more complete and compact activation map for the target objects. Extensive experiments on PASCAL VOC 2012 and MS COCO 2014 datasets show that our CLIMS++ significantly outperforms the previous state-of-the-art methods. © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2025.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

Conditional Video-Text Reconstruction Network with Cauchy Mask for Weakly Supervised Temporal Sentence Grounding

Conditional Video-Text Reconstruction Network with Cauchy Ma...

引用

IEEE International Conference on Multimedia and Expo (ICME)

作者： Jueqi Wei Yuanwu Xu Mohan Chen Yuejie Zhang Rui Feng Shang Gao School of Computer Science Shanghai Key Laboratory of Intelligent Information Processing Shanghai Collaborative Innovation Center of Intelligent Visual Computing Fudan University School of Information Technology Deakin University

Temporal sentence grounding aims to detect the target segment most related to a given query in an untrimmed video. To alleviate the expensive annotation cost for temporal labels, researchers paid more attention to weakly supervised setting. Prior studies neglected the utilization of video representation reconstruction, which led to an unbalanced alignment learning. Moreover, they used different strategies to generate proposals which ignored the temporal structure in a query. In this paper, we propose a novel Conditional Video-Text Reconstruction Network (CVTRN). It supports conditional reconstruction of video and text representation. Specifically, video and text features are fused to compute semantic alignment, which is the condition of reconstruction. A new mask strategy for mask conditioned sentence reconstruction is also devised. This strategy focuses more on boundary regions than the widely used Gaussian mask in previous methods. Experimental results on two public benchmark datasets show that our CVTRN outperforms the state-of-the-art methods.

关键词：

来源：评论

学校读者我要写书评

暂无评论

SPTNET: Span-based Prompt Tuning for Video Grounding

SPTNET: Span-based Prompt Tuning for Video Grounding

引用

IEEE International Conference on Multimedia and Expo (ICME)

作者： Yiren Zhang Yuanwu Xu Mohan Chen Yuejie Zhang Rui Feng Shang Gao School of Computer Science Shanghai Key Laboratory of Intelligent Information Processing Shanghai Collaborative Innovation Center of Intelligent Visual Computing Fudan University School of Information Technology Deakin University

When a Pre-trained Language Model (PLM) is adopted in video grounding task, it usually acts as a text encoder without having its knowledge fully utilized. Also, there exists an inconsistency problem between the pre-training and downstream objectives. To solve the issues, we propose a new paradigm, named Span-based Prompt Tuning (SPTNet). It can convert the video grounding task into a cloze form. Specifically, a query is first changed into a form with mask token by a template, then the video and the query embeddings are integrated through a cross-modal transformer. The start and end points of the query matching time span are predicted with the embedding of the mask token. Experimental results on two public benchmarks ActivityNet Captions and Charades-STA show that our SPTNet achieves surpassing performance compared with state-of-the-art methods.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Subnetwork Reliability Analysis About Complete-Transposition Graph Networks

SSRN

引用

SSRN 2023年

作者： Chen, Qun Deng, Qingying Xiang, Kainan Key Laboratory of Intelligent Computing & Information Processing of Education School of Mathematics and Computational Science Xiangtan University Hunan Xiangtan411105 China

With the size and complexity of a multiprocess computer system grows, the likelihood of having faulty processors in the system increases. How to evaluate the impact of faulty processors on the entire system is what we care about. Reliability evaluation is an important indicator to measure the faulty's effect on the entire system. A typical approach to evaluate the reliability of a system is using the probability that a fault-free subsystem of a specific size is still working in the system when the system has some faulty processors. The higher the probability is the more reliable the system is. In this paper, we will use the probability fault model and the principle of Inclusion-Exclusion to establish the CTn−1 subnetwork reliability of CTn in the case of node failure. An upper bound and lower bound are derived by taking into account the intersection of no more than four subnetworks. In addition, we show that the theoretical results are proved to be in accordance with near to the simulation results, especially when the value of single-node reliability p goes low. © 2023, The Authors. All rights reserved.

关键词： Reliability analysis

来源：评论

学校读者我要写书评

暂无评论

A Radiation Performance Improvement Method of Extremely Low Frequency Acoustics Promoted Antenna

A Radiation Performance Improvement Method of Extremely Low ...

引用

2023 IEEE International Workshop on Electromagnetics: Applications and Student Innovation Competition, iWEM 2023

作者： Qi, Junwei Zhang, Chenwei Li, Yingsong Huang, Zhixiang Loh, Tian Hong Chung, Kwok L. Harbin Engineering University College of Information and Communications Engineering Harbin150001 China Anhui University Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education China National Physical Laboratory Electromagnetic and Eletrochemical Technologies Department Middlesex United Kingdom Huizhou University School of Computer Science and Engineering 516007 China

ISBN: (纸本)9798350336740

In this paper, Q-value theory of conventional antennas is used to analyze reasons of low radiation performance of acoustics promoted antennas, where we modify the radiating structure of existing acoustics promoting antenna using the simulations to get the required improvement on radiation performance. The simulation experiments are carried out in the finite element simulation software Comsol Multiphysics to analyze the radiating performance. © 2023 IEEE.

关键词： Antennas

来源：评论

学校读者我要写书评

暂无评论

Transwnet: Integrating Transformers into CNNS via Row and Column Attention for Abdominal Multi-Organ Segmentation 48

Transwnet: Integrating Transformers into CNNS via Row and Co...

引用

48th IEEE International Conference on Acoustics, Speech and Signal processing, ICASSP 2023

作者： Xie, Yazhen Huang, Yanglin Zhang, Yuan Li, Xuanya Ye, Xiongjun Hu, Kai Xiangtan University Key Laboratory of Intelligent Computing Information Processing of Ministry of Education Xiangtan411105 China Baidu Inc. Beijing100085 China Chinese Academy of Medical Sciences and Peking Union Medical College National Cancer Center Cancer Hospital Beijing100021 China

ISBN: (纸本)9781728163277

Learning how to model global relationships and extract local details is crucial in improving the performance of multi-organ segmentation. Most existing U-shaped structure methods use feature fusion to address these two challenges, but still lack the ability to balance capturing global relationships and local details. To address these issues, we propose a novel multi-organ segmentation framework called TransWnet to mine global relationships and local details from both intra-and inter-scale perspectives. To achieve this, we innovatively design a Row and Column Swin Transformer (RCST) module that can efficiently capture global contextual features and construct local information. Specifically, we design a parallel structure of Row and Column Attention to model the global relationships of multi-scale encoded features, and further mine local information from the global relationships through a local window mechanism. Extensive experiments on the Synapse dataset show that our method outperforms state-of-The-Art approaches and achieves accurate segmentation of abdominal multi-organs. © 2023 IEEE.

关键词： Computerized tomography

来源：评论

学校读者我要写书评

暂无评论

Network Traffic Prediction with Attention-based Spatial-Temporal Graph Network

Network Traffic Prediction with Attention-based Spatial-Temp...

引用

IEEE Workshop on High Performance Switching and Routing

作者： Yufei Peng Yingya Guo Run Hao Junda Lin Department of Computer and Data Science Fuzhou University Fujian Provincial Key Laboratory of Network Computing and Intelligent Information Processing Fuzhou University

Network traffic prediction plays a significant role in network management. Previous network traffic prediction methods mainly focus on the temporal relationship between network traffic, and used time series models to predict network traffic, ignoring the spatial information contained in traffic data. Therefore, the prediction accuracy is limited, especially in long-term prediction. To improve the prediction accuracy of the dynamic network traffic in the long term, we propose an Attention-based Spatial-Temporal Graph Network (ASTGN) model for network traffic prediction to better capture both the temporal and spatial relations between the network traffic. Specifically, in ASTGN, we exploit an encoder-decoder architecture, where the encoder encodes the input network traffic and the decoder outputs the predicted network traffic sequences, integrating the temporal and spatial information of the network traffic data through the Spatio-Temporal Embedding module. The experimental results demonstrate the superiority of our proposed method ASTGN in long-term prediction.

关键词：

来源：评论

学校读者我要写书评

暂无评论

FLIP-80M: 80 Million Visual-Linguistic Pairs for Facial Language-Image Pre-Training 24

FLIP-80M: 80 Million Visual-Linguistic Pairs for Facial Lang...

引用

32nd ACM International Conference on Multimedia, MM 2024

作者： Li, Yudong Hou, Xianxu Dezhi, Zheng Shen, Linlin Zhao, Zhe School of Computer Science and Software Engineering Shenzhen University Shenzhen China Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen China School of AI and Advanced Computing Xi'an Jiaotong-Liverpool University Shenzhen China Guangdong Provincial Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen China Tencent AI Lab Beijing China

ISBN: (纸本)9798400706868

While significant progress has been made in multi-modal learning driven by large-scale image-text datasets, there is still a noticeable gap in the availability of such datasets within the facial domain. To facilitate and advance the field of facial representation learning, we present FLIP-80M, a large-scale visual-linguistic dataset comprising over 80 million face images paired with text descriptions. FLIP-80M is constructed by leveraging the large openly available image-text-pair dataset LAION-5B and a mixed-method approach to filter face-related pairs from both visual and linguistic perspectives. Our curation process involves face detection, face caption classification, text de-noising, and synthesis-based image augmentation. As a result, FLIP-80M stands as the largest face-text dataset to date. To evaluate the potential of our dataset, we fine-tune the CLIP model using the proposed FLIP-80M, to create FLIP (Facial Language-Image Pretraining) and assess its representation capabilities across various downstream tasks. Our experiments demonstrate that our FLIP model achieves state-of-the-art results in a range of face analysis tasks, including face parsing, face alignment, and face attribute classification. The dataset and models are available at https://***/ydli-ai/FLIP. © 2024 ACM.

关键词： Face recognition

来源：评论

学校读者我要写书评

暂无评论

Efficient Finite-Difference Time-Domain Method for Solving Electromagnetic Scattering in Layered Anisotropies

Efficient Finite-Difference Time-Domain Method for Solving E...

引用

International Symposium on Antennas, Propagation and EM Theory (ISAPE)

作者： Yilin Kang Yuxian Zhang Xiaoli Feng Lixia Yang Zhixiang Huang Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education and with the Information Materials and Intelligent Sensing Laboratory of Anhui Province Industry-Education-Research Institute of Advanced Materials and Technology for Integrated Circuits and with School of Electronic and Information Engineering Anhui University Hefei China

ISBN: (数字)9798350353129

ISBN: (纸本)9798350353136

In this article, we propose an efficient numerical method for layered models based on the conventional finite difference time-domain (FDTD) method. The three-dimensional (3-D) layered model is compressed into one-dimensional (1-D) calculation, which improves the problem of large space memory and long running time for 3-D modeling while ensuring the accuracy and feasibility of the algorithm. On the one hand, by employing the transformation relationship between the transverse wave vector and the field in space, the expanded Maxwell's rotation equations are simplified, so that the equation system only retains the spatial transformation in the propagation direction. This processing allows for the calculation of the propagation characteristics of layered media without requiring more computational resources. On the other hand, to ensure the universality of the algorithm, a fully tensor anisotropic medium is selected for detecting the propagation data. At the same time, we design the layered structure and conduct the consistent 3-D modeling in the simulation software COMSOL. The results showed that our proposed efficient numerical algorithm greatly reduced the loss of computing resources while ensuring accuracy.

关键词： Solid modeling Three-dimensional displays Accuracy Tensors Software algorithms Vectors Mathematical models Numerical models Time-domain analysis Finite difference methods

来源：评论

学校读者我要写书评

暂无评论

Alignment-Free RGB-T Salient Object Detection: A Large-scale Dataset and Progressive Correlation Network

arXiv

引用

arXiv 2024年

作者： Wang, Kunpeng Chen, Keke Li, Chenglong Tu, Zhengzheng Luo, Bin Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education Anhui Provincial Key Laboratory of Multimodal Cognitive Computation School of Computer Science and Technology Anhui University China Anhui Provincial Key Laboratory of Security Artificial Intelligence School of Artificial Intelligence Anhui University China

Alignment-free RGB-Thermal (RGB-T) salient object detection (SOD) aims to achieve robust performance in complex scenes by directly leveraging the complementary information from unaligned visible-thermal image pairs, without requiring manual alignment. However, the labor-intensive process of collecting and annotating image pairs limits the scale of existing benchmarks, hindering the advancement of alignment-free RGB-T SOD. In this paper, we construct a large-scale and high-diversity unaligned RGB-T SOD dataset named UVT20K, comprising 20,000 image pairs, 407 scenes, and 1256 object categories. All samples are collected from real-world scenarios with various challenges, such as low illumination, image clutter, complex salient objects, and so on. To support the exploration for further research, each sample in UVT20K is annotated with a comprehensive set of ground truths, including saliency masks, scribbles, boundaries, and challenge attributes. In addition, we propose a Progressive Correlation Network (PCNet), which models inter- and intra-modal correlations on the basis of explicit alignment to achieve accurate predictions in unaligned image pairs. Extensive experiments conducted on unaligned and aligned datasets demonstrate the effectiveness of our method. Copyright © 2024, The Authors. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：