检索结果-内蒙古大学图书馆

IEEE Transactions on Industrial Cyber-Physical Systems 2025年 3卷 48-60页

作者： Liu, Ruonan Hu, Puyuan Zhao, Siheng Sun, Zhijian Han, Te Pang, Zhibo Zhang, Weidong Shanghai Jiao Tong University Department of Automation Shanghai200240 China National Key Laboratory of Marine Engine Science and Technology Shanghai201108 China Crossocean of Suzhou Technology Suzhou215121 China Beijing Institute of Technology Center for Energy and Environmental Policy Research School of Management Beijing100081 China ABB Corporate Research Sweden Department of Automation Technology Vasteras722 26 Sweden KTH Royal Institute of Technology Department of Intelligent Systems Stockholm114 28 Sweden Henan University Henan Key Laboratory of Big Data Analysis and Processing School of Computer and Information Engineering Kaifeng475001 China Shanghai Jiaotong University Department of Automation Shanghai200240 China

Given the critical role of rotating machinery in industrial cyber-physical systems (ICPS), ensuring their reliable operation is essential for the stability and safety of ICPS. Deep neural networks have demonstrated competitive results for intelligent fault diagnosis, which are usually trained via the historical data of all fault modes. However, in real engineering, it is usually difficult to collect samples and exhaust all failures during the training stage. As a result, out-of-distribution fault diagnosis (OOD-FD) becomes a more realistic problem that requires the methods to not only accurately diagnose the known faults, but also effectively recognize unknown ones. Therefore, a novel orthogonal anchor clustering with focal attention (FA-OAC) is proposed in this paper for OOD-FD. Firstly, an orthogonal anchor clustering (OAC) algorithm is proposed to fix the class center of each fault mode orthogonally and distinguish the known and unknown faults at the class level. Then, because the identifiability of different fault modes changes a lot in OOD-FD, the focal attention mechanism is applied to dynamically adjust the attention to different fault modes according to the distance loss of OAC, thus addressing the identifiability imbalance problem. To verify the effectiveness of the proposed method, different OOD-FD tasks are designed based on two rotating machinery datasets. The experimental results and comparison with state-of-the-art fault diagnosis methods have demonstrated that the proposed method has improved the OOD-FD performance greatly and therefore provides an effective tool in real engineering. © 2023 IEEE.

关键词： Rotating machinery

来源：评论

学校读者我要写书评

暂无评论

X-Prompt: Multi-modal Visual Prompt for Video Object Segmentation

arXiv

引用

arXiv 2024年

作者： Guo, Pinxue Li, Wanyun Huang, Hao Hong, Lingyi Zhou, Xinyu Chen, Zhaoyu Li, Jinglun Jiang, Kaixun Zhang, Wei Zhang, Wenqiang Shanghai Engineering Research Center of AI & Robotics Academy for Engineering & Technology Fudan University China Shanghai Key Lab of Intelligent Information Processing School of Computer Science Fudan University China Engineering Research Center of AI & Robotics Ministry of Education Academy for Engineering & Technology Shanghai Key Lab of Intelligent Information Processing School of Computer Science Fudan University China

Multi-modal Video Object Segmentation (VOS), including RGB-Thermal, RGB-Depth, and RGB-Event, has garnered attention due to its capability to address challenging scenarios where traditional VOS methods struggle, such as extreme illumination, rapid motion, and background distraction. Existing approaches often involve designing specific additional branches and performing full-parameter fine-tuning for fusion in each task. However, this paradigm not only duplicates research efforts and hardware costs but also risks model collapse with the limited multi-modal annotated data. In this paper, we propose a universal framework named X-Prompt for all multi-modal video object segmentation tasks, designated as RGB+X. The X-Prompt framework first pretrains a video object segmentation foundation model using RGB data, and then utilize the additional modality of the prompt to adapt it to downstream multi-modal tasks with limited data. Within the X-Prompt framework, we introduce the Multi-modal Visual Prompter (MVP), which allows prompting foundation model with the various modalities to segment objects precisely. We further propose the Multi-modal Adaptation Experts (MAEs) to adapt the foundation model with pluggable modality-specific knowledge without compromising the generalization capacity. To evaluate the effectiveness of the X-Prompt framework, we conduct extensive experiments on 3 tasks across 4 benchmarks. The proposed universal X-Prompt framework consistently outperforms the full fine-tuning paradigm and achieves state-of-the-art performance. Code: https://***/PinxueGuo/***. Copyright © 2024, The Authors. All rights reserved.

关键词： Image segmentation

来源：评论

学校读者我要写书评

暂无评论

AutoConsis: Automatic GUI-driven Data Inconsistency Detection of Mobile Apps

AutoConsis: Automatic GUI-driven Data Inconsistency Detectio...

引用

IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP)

作者： Yongxiang Hu Hailiang Jin Xuan Wang Tiazhen Gu Shiyu Guo Chaoyi Chen Xin Wang Yangfan Zhou School of Computer Science Fudan University Shanghai China Meituan Shanghai China Shanghai Key Laboratory of Intelligent Information Processing School of Computer Science Fudan University Shanghai China

ISBN: (数字)9798400705014

ISBN: (纸本)9798350352177

In industrial practice, many bugs in commercial mobile apps manifest as self-conflicts of data presented in the GUI (Graphical User Interface). Such data inconsistency bugs can bring confusion to the users and deteriorate user experiences. They are a major target of industrial testing practice. However, due to the complication and diversity of GUI implementation and data presentation (e.g., the ways to present the data in natural language), detecting data inconsistency bugs is a very challenging task. It still largely relies on manual efforts. To reduce such human efforts, we proposed Au-toConsis, an automated data inconsistency testing tool we designed for Meituan. one of the largest E-commerce providers with over 600 million transacting users. AutoConsis can automatically analyze GUI pages via a multi-modal deep-learning model and extract target data from textual phrases leveraging LLMs (Large Language Models). With these extracted data, their inconsistencies can then be detected. We evaluate the design of AutoConsis via a set of ablation experiments. Moreover, we demonstrate the effectiveness of AutoConsis when applying it to real-world commercial mobile apps with eight representative cases.

关键词： Target recognition computer bugs Data models Software Mobile applications Data mining Task analysis

来源：评论

学校读者我要写书评

暂无评论

Local to global Tracker: A Siamese Network for Long-term Tracking 3

Local to global Tracker: A Siamese Network for Long-term Tra...

引用

2021 3rd International Conference on Robotics, intelligent Control and Artificial Intelligence, ICRICA 2021

作者： Yang, Ya Zhou, Xinyu Jiang, Kaixun Hou, Xiaonan Wang, Chunlei Zhang, Wenqiang 21st Research Institute of China Electronics Technology Group Corporation Shanghai China Shanghai Key Laboratory of Intelligent Information Processing School of Computer Science Fudan University Shanghai China

Visual object tracking is a basic task in computer vision, which can be applied to different applications. Former methods of single object tracking problem demands to perform target state estimation according to object position of previous frame, but these methods are poorly capable of handling the fast movement of the target. In this paper, we introduce a Siamese network for single object tracking task. The network consists of two branches, one of which is the classification branch used to predict positive or negative samples, and the other is the regression branch used to predict the specific location of the object in sequence. In addition, we propose a local to global algorithm for long-term tracking to expand the search region when the target is out-of-view or full occlusion. Experiments show that our tracker achieves very promising results on VOT2018LT datasets while running at over 89 FPS. © Published under licence by IOP Publishing Ltd.

关键词： Target tracking

来源：评论

学校读者我要写书评

暂无评论

DeTrack: In-model Latent Denoising Learning for Visual Object Tracking

arXiv

引用

arXiv 2025年

作者： Zhou, Xinyu Li, Jinglun Hong, Lingyi Jiang, Kaixun Guo, Pinxue Ge, Weifeng Zhang, Wenqiang Shanghai Key Lab of Intelligent Information Processing School of Computer Science Fudan University Shanghai China Shanghai Engineering Research Center of AI & Robotics Academy for Engineering and Technology Fudan University Shanghai China

Previous visual object tracking methods employ image-feature regression models or coordinate autoregression models for bounding box prediction. Image-feature regression methods heavily depend on matching results and do not utilize positional prior, while the autoregressive approach can only be trained using bounding boxes available in the training set, potentially resulting in suboptimal performance during testing with unseen data. Inspired by the diffusion model, denoising learning enhances the model's robustness to unseen data. Therefore, We introduce noise to bounding boxes, generating noisy boxes for training, thus enhancing model robustness on testing data. We propose a new paradigm to formulate the visual object tracking problem as a denoising learning process. However, tracking algorithms are usually asked to run in real-time, directly applying the diffusion model to object tracking would severely impair tracking speed. Therefore, we decompose the denoising learning process into every denoising block within a model, not by running the model multiple times, and thus we summarize the proposed paradigm as an in-model latent denoising learning process. Specifically, we propose a denoising Vision Transformer (ViT), which is composed of multiple denoising blocks. In the denoising block, template and search embeddings are projected into every denoising block as conditions. A denoising block is responsible for removing the noise in a predicted bounding box, and multiple stacked denoising blocks cooperate to accomplish the whole denoising process. Subsequently, we utilize image features and trajectory information to refine the denoised bounding box. Besides, we also utilize trajectory memory and visual memory to improve tracking stability. Experimental results validate the effectiveness of our approach, achieving competitive performance on several challenging datasets. The proposed in-model latent denoising tracker achieve real-time speed, rendering denoising learning

关键词： Regression analysis

来源：评论

学校读者我要写书评

暂无评论

CT2C-QA: Multimodal Question Answering over Chinese Text, Table and Chart 24

CT2C-QA: Multimodal Question Answering over Chinese Text, Ta...

引用

32nd ACM International Conference on Multimedia, MM 2024

作者： Zhao, Bowen Cheng, Tianhao Zhang, Yuejie Cheng, Ying Feng, Rui Zhang, Xiaobo Fudan University Shanghai China Children's Hospital of Fudan University Shanghai China School of Computer Science Shanghai Key Laboratory of Intelligent Information Processing Fudan University China Shanghai Collaborative Innovation Center of Intelligent Visual Computing. China Fudan Zhangjiang Institute Shanghai China Children's Hospital of Fudan University National Children's Medical Center Shanghai China

ISBN: (纸本)9798400706868

Multimodal Question Answering (MMQA) is crucial as it enables comprehensive understanding and accurate responses by integrating insights from diverse data representations such as tables, charts, and text. Most existing researches in MMQA only focus on two modalities such as image-text QA, table-text QA and chart-text QA, and there remains a notable scarcity in studies that investigate the joint analysis of text, tables, and charts. In this paper, we present CT2C-QA, a pioneering Chinese reasoning-based QA dataset that includes an extensive collection of text, tables, and charts, meticulously compiled from 200 selectively sourced webpages. Our dataset simulates real webpages and serves as a great test for the capability of the model to analyze and reason with multimodal data, because the answer to a question could appear in various modalities, or even potentially not exist at all. Additionally, we present AED (Allocating, Expert and Decision), a multi-agent system implemented through collaborative deployment, information interaction, and collective decision-making among different agents. Specifically, the Assignment Agent is in charge of selecting and activating expert agents, including those proficient in text, tables, and charts. The Decision Agent bears the responsibility of delivering the final verdict, drawing upon the analytical insights provided by these expert agents. We execute a comprehensive analysis, comparing AED with various state-of-the-art models in MMQA, including GPT-4. The experimental outcomes demonstrate that current methodologies, including GPT-4, are yet to meet the benchmarks set by our dataset. © 2024 ACM.

关键词： Question answering

来源：评论

学校读者我要写书评

暂无评论

HiDiff: Hybrid Diffusion Framework for Medical Image Segmentation

arXiv

引用

arXiv 2024年

作者： Chen, Tao Wang, Chenhui Chen, Zhihao Lei, Yiming Shan, Hongming Institute of Science and Technology for Brain-inspired Intelligence Fudan University Shanghai200433 China Shanghai Key Lab of Intelligent Information Processing School of Computer Science Fudan University Shanghai200433 China

Medical image segmentation has been significantly advanced with the rapid development of deep learning (DL) techniques. Existing DL-based segmentation models are typically discriminative;i.e., they aim to learn a mapping from the input image to segmentation masks. However, these discriminative methods neglect the underlying data distribution and intrinsic class characteristics, suffering from unstable feature space. In this work, we propose to complement discriminative segmentation methods with the knowledge of underlying data distribution from generative models. To that end, we propose a novel hybrid diffusion framework for medical image segmentation, termed HiDiff, which can synergize the strengths of existing discriminative segmentation models and new generative diffusion models. HiDiff comprises two key components: discriminative segmentor and diffusion refiner. First, we utilize any conventional trained segmentation models as discriminative segmentor, which can provide a segmentation mask prior for diffusion refiner. Second, we propose a novel binary Bernoulli diffusion model (BBDM) as the diffusion refiner, which can effectively, efficiently, and interactively refine the segmentation mask by modeling the underlying data distribution. Third, we train the segmentor and BBDM in an alternate-collaborative manner to mutually boost each other. Extensive experimental results on abdomen organ, brain tumor, polyps, and retinal vessels segmentation datasets, covering four widely-used modalities, demonstrate the superior performance of HiDiff over existing medical segmentation algorithms, including the state-of-the-art transformer- and diffusion-based ones. In addition, HiDiff excels at segmenting small objects and generalizing to new datasets. Source codes are made available at https://***/takimailto/HiDiff. Copyright © 2024, The Authors. All rights reserved.

关键词： Diffusion

来源：评论

学校读者我要写书评

暂无评论

MMM-RS: A Multi-modal, Multi-GSD, Multi-scene Remote Sensing Dataset and Benchmark for Text-to-Image Generation 38

MMM-RS: A Multi-modal, Multi-GSD, Multi-scene Remote Sensing...

引用

38th Conference on Neural information processing Systems, NeurIPS 2024

作者： Luo, Jialin Wang, Yuanzhi Gu, Ziqi Qiu, Yide Yao, Shuaizhen Wang, Fuyun Xu, Chunyan Zhang, Wenhua Wang, Dan Cui, Zhen PCA Lab Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education School of Computer Science and Engineering Nanjing University of Science and Technology Nanjing China Beijing Institute of Spacecraft System Engineering Beijing China

Recently, the diffusion-based generative paradigm has achieved impressive general image generation capabilities with text prompts due to its accurate distribution modeling and stable training process. However, generating diverse remote sensing (RS) images that are tremendously different from general images in terms of scale and perspective remains a formidable challenge due to the lack of a comprehensive remote sensing image generation dataset with various modalities, ground sample distances (GSD), and scenes. In this paper, we propose a Multi-modal, MultiGSD, Multi-scene Remote Sensing (MMM-RS) dataset and benchmark for text-to-image generation in diverse remote sensing scenarios. Specifically, we first collect nine publicly available RS datasets and conduct standardization for all samples. To bridge RS images to textual semantic information, we utilize a large-scale pretrained vision-language model to automatically output text prompts and perform hand-crafted rectification, resulting in information-rich text-image pairs (including multi-modal images). In particular, we design some methods to obtain the images with different GSD and various environments (e.g., low-light, foggy) in a single sample. With extensive manual screening and refining annotations, we ultimately obtain a MMM-RS dataset that comprises approximately 2.1 million text-image pairs. Extensive experimental results verify that our proposed MMM-RS dataset allows off-the-shelf diffusion models to generate diverse RS images across various modalities, scenes, weather conditions, and GSD. The dataset is available at https://***/ljl5261/MMM-RS. © 2024 Neural information processing systems foundation. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

AS-Det: Active Sampling for Adaptive 3D Object Detection in Point Clouds 39

AS-Det: Active Sampling for Adaptive 3D Object Detection in ...

引用

39th Annual AAAI Conference on Artificial Intelligence, AAAI 2025

作者： Ding, Ziheng Zhang, Xiaze Jing, Qi Cheng, Ying Feng, Rui School of Computer Science Shanghai Key Laboratory of Intelligent Information Processing Fudan University China Shanghai Collaborative Innovation Center of Intelligent Visual Computing China

ISBN: (纸本)157735897X

3D object detection in point clouds is critical in 3D computer vision, autonomous driving, and robotics. Existing point-based detectors, tailored to handle unstructured raw point clouds, often rely on simplistic sampling strategies to select a subset of points for local representation learning and detection. However, the diverse patterns exhibited by multiple types of point cloud data present a significant challenge to the universality of current detectors, particularly those captured by varied sensors (e.g., LiDAR and 4D Imaging Radar). In response to this challenge, we introduce an adaptable point-based single-stage 3D detector, AS-Det, engineered to excel on both LiDAR and 4D Radar point clouds. Specifically, we propose a novel active sampling strategy that actively mines object-related information to achieve efficient sampling and representation across different types of point clouds through end-to-end training. Additionally, we introduce a lightweight multi-scale center feature aggregation module to exploit multi-scale object context for precise and low-cost detection. By integrating the abovementioned modules, AS-Det achieves highly adaptive detection on various point clouds, encompassing different sensors and scales. Experimental results demonstrate the superior performance and adaptability of AS-Det on both LiDAR and 4D Radar point clouds. © 2025, Association for the Advancement of Artificial Intelligence (***). All rights reserved.

关键词： Object detection

来源：评论

学校读者我要写书评

暂无评论

Gaitcotr: Improved Spatial-Temporal Representation for Gait Recognition with a Hybrid Convolution-Transformer Framework

Gaitcotr: Improved Spatial-Temporal Representation for Gait ...

引用

International Conference on Acoustics, Speech, and Signal processing (ICASSP)

作者： Jingqi Li Yuzhen Zhang Hongming Shan Junping Zhang Shanghai Key Lab of Intelligent Information Processing School of Computer Science Institute of Science and Technology for Brain-Inspired Intelligence Fudan University Shanghai China

This work presents a novel hybrid convolution-transformer framework for gait recognition, termed GaitCoTr. The developed framework captures the appearance and short-term temporal features by convolution and extracts the long-term temporal features by transformer architecture, achieving a comprehensive spatial-temporal representation of gait. To unleash the potential of this hybrid framework for extracting richness and generalized temporal features, we propose a new variant of transformer tailored for gait, including temporally shifted tokenization, length-flexible position embedding, and inter-frame encoder. In addition, we introduce an auxiliary task—view label prediction—aiming to disentangle view from ID information. Extensive experimental results on two well-known gait benchmark datasets, CASIA-B and GREW, demonstrate the superior performance of the proposed Gait-CoTr.

关键词： Convolution Speech recognition Benchmark testing Feature extraction Transformers Tokenization Acoustics

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：