检索结果-内蒙古大学图书馆

dugMatting: Decomposed-Uncertainty-Guided Matting

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Wu, Jiawei Zhang, Changqing Li, Zuoyong Fu, Huazhu Peng, Xi Zhou, Joey Tianyi College of Mechanical and Electrical Engineering Fujian Agriculture and Forestry University Fuzhou China College of Intelligence and Computing Tianjin University Tianjin China Fujian Provincial Key Laboratory of Information Processing and Intelligent Control Minjiang University Fuzhou China Institute of High Performance Computing Agency for Science Technology and Research Singapore College of Computer Science Sichuan University Chengdu China Singapore

Cutting out an object and estimating its opacity mask, known as image matting, is a key task in image and video editing. Due to the highly ill-posed issue, additional inputs, typically user-defined trimaps or scribbles, are usually needed to reduce the uncertainty. Although effective, it is either time consuming or only suitable for experienced users who know where to place the strokes. In this work, we propose a decomposed-uncertainty-guided matting (dugMatting) algorithm, which explores the explicitly decomposed uncertainties to efficiently and effectively improve the results. Basing on the characteristic of these uncertainties, the epistemic uncertainty is reduced in the process of guiding interaction (which introduces prior knowledge), while the aleatoric uncertainty is reduced in modeling data distribution (which introduces statistics for both data and possible noise). The proposed matting framework relieves the requirement for users to determine the interaction areas by using simple and efficient labeling. Extensively quantitative and qualitative results validate that the proposed method significantly improves the original matting algorithms in terms of both efficiency and efficacy. Copyright © 2023, The Authors. All rights reserved.

关键词： Uncertainty analysis

A novel neural network classification model based on covering and Affinity Propagation clustering algorithm

学校读者我要写书评

暂无评论

Journal of Computational information Systems 2013年第7期9卷 2565-2573页

作者： Li, Hui Ding, Shifei School of Computer Science and Technology China University of Mining and Technology Xuzhou 221116 China Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences Beijing 100190 China Jiangsu Normal University Xuzhou 221116 China

Affinity Propagation (AP) algorithm can automatically determine the cluster center and does not need a pre-determined number of clustering. This paper presents a novel neural network classification model, using AP clustering method as a pre-processor to cluster high dimensional massive data samples, and combining covering algorithm to automatically determine the center of the covering, and calculating its radius, and then converting these parameters into the weights and thresholds of the hidden layer of classification neural network. The number of hidden layer neurons is the number of covering. The output layer is the M-P neuron layer. By evaluating the input feature of hidden layer to complete the mapping from covering to the output, and gain the corresponding output category of the input feature. Simulation results show that our proposed neural network classification model can get better performance. Copyright © 2013 Binary information Press.

关键词： Clustering algorithms

Vision Language Modeling of Content, Distortion and Appearance for Image Quality Assessment

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhou, Fei Gu, Tianhao Huang, Zhicong Qiu, Guoping College of Electronic and Information Engineering Shenzhen University Shenzhen518060 China Guangdong Provincial Key Laboratory of Intelligent Information Processing Shenzhen518060 China SZU-AFS Joint Innovation Center for Artificial Intelligence Technology Shenzhen518000 China Guangdong-Hong Kong Joint Laboratory for Big Data Imaging and Communication Shenzhen518060 China School of Computer Science The University of Nottingham Ningbo China Zhejiang315100 China School of Computer Science University of Nottingham NottinghamNG8 1BB United Kingdom

The visual quality of an image is confounded by a number of intertwined factors including its semantic content, distortion characteristics and appearance properties such as brightness, contrast, sharpness, and colourfulness. Distilling high level knowledge about all these quality bearing attributes is crucial for developing objective Image Quality Assessment (IQA). While existing solutions have modeled some of these aspects, a comprehensive solution that involves all these important quality related attributes has not yet been developed. In this paper, we present a new blind IQA (BIQA) model termed Self-supervision and Vision-Language supervision Image QUality Evaluator (SLIQUE) that features a joint vision-language and visual contrastive representation learning framework for acquiring high level knowledge about the images semantic contents, distortion characteristics and appearance properties for IQA. For training SLIQUE, we have developed a systematic approach to constructing a first of its kind large image database annotated with all three categories of quality relevant texts. The Text Annotated Distortion, Appearance and Content (TADAC1) database has over 1.6 million images annotated with textual descriptions of their semantic contents, distortion characteristics and appearance properties. The method for constructing TADAC and the database itself will be particularly useful for exploiting vision-language modeling for advanced IQA applications. Extensive experimental results show that SLIQUE has superior performances over state of the art, demonstrating the soundness of its design principle and the effectiveness of its implementation. The link to the TADAC dataset is https://***/documents/tadactextannotated-distortion-appearance-and-content Copyright © 2024, The Authors. All rights reserved.

关键词： Visual languages

A hierarchical image matting model for blood vessel segmentation in fundus images

学校读者我要写书评

暂无评论

arXiv 2017年

作者： Fan, Zhun Lu, Jiewei Li, Wenji Wei, Caimin Huang, Han Cai, Xinye Chen, Xinjian Guangdong Provincial Key Laboratory of Digital Signal and Image Processing College of Engineering Shantou University Shan'tou515063 China Department of Mathematics Shantou University Shan'tou515063 China School of Software Engineering South China University of Technology Guang'zhou510006 China College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics Jiang'su210016 China Medical Image Processing and Analysis Lab School of Electronics and Information Engineering Soochow University Su'zhou215006 China

In this paper, a hierarchical image matting model is proposed to extract blood vessels from fundus images. More specifically, a hierarchical strategy utilizing the continuity and extendibility of retinal blood vessels is integrated into the image matting model for blood vessel segmentation. Normally the matting models require the user specified trimap, which separates the input image into three regions manually: the foreground, background and unknown regions. However, since creating a user specified trimap is a tedious and time-consuming task, region features of blood vessels are used to generate the trimap automatically in this paper. The proposed model has low computational complexity and outperforms many other state-of-art supervised and unsupervised methods in terms of accuracy, which achieves a vessel segmentation accuracy of 96.0%, 95.7% and 95.1% in an average time of 10.72s, 15.74s and 50.71s on images from three publicly available fundus image datasets DRIVE, STARE, and CHASE_DB1, respectively. Copyright © 2017, The Authors. All rights reserved.

关键词： Blood vessels

[Retracted] Optimization Algorithm of Moving Object Detection Using Multiscale Pyramid Convolutional Neural Networks

学校读者我要写书评

暂无评论

Computational Intelligence and Neuroscience 2023年第1期2023卷

作者： Zhe Yang Ziyu Bu Yexin Pan School of Computer Science and Technology Soochow University Suzhou 215006 Chinascu.edu.tw Provincial Key Laboratory for Computer Information Processing Technology Suzhou 215006 China

Object detection and recognition is a very important topic with significant research value. This research develops an optimised model of moving target identification based on CNN to address the issues of insufficient positioning information and low target detection accuracy (convolutional neural network). In this article, the target classification information and semantic location information are obtained through the fusion of the target detection model and the depth semantic segmentation model. The classification and position portion of the target detection model is provided by the simultaneous fusion of the image features carrying various information and a pyramid structure of multiscale image features so that the matched image fusion characteristics can be used by the target detection model to detect targets of various sizes and shapes. According to experimental findings, this method’s accuracy rate is 0.941, which is 0.189 higher than that of the LSTM-NMS algorithm. Through the migration of CNN and the learning of context information, this technique has great robustness and enhances the scene adaptability of feature extraction as well as the accuracy of moving target position detection.

关键词：

Look Inside for More: Internal Spatial Modality Perception for 3D Anomaly Detection

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liang, Hanzhe Xie, Guoyang Hou, Chengbin Wang, Bingshu Gao, Can Wang, Jinbao College of Computer Science and Software Engineering Shenzhen University Shenzhen China Shenzhen Audencia Financial Technology Institute Shenzhen University Shenzhen China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen China Department of Intelligent Manufacturing CATL Ningde China School of Computing and Artificial Intelligence Fuyao University of Science and Technology Fuzhou China School of Software Northwestern Polytechnical University Xi’an China Guangdong Provincial Key Laboratory of Intelligent Information Processing Shenzhen China

3D anomaly detection has recently become a significant focus in computer vision. Several advanced methods have achieved satisfying anomaly detection performance. However, they typically concentrate on the external structure of 3D samples and struggle to leverage the internal information embedded within samples. Inspired by the basic intuition of why not look inside for more, we introduce a straightforward method named Internal Spatial Modality Perception (ISMP) to explore the feature representation from internal views fully. Specifically, our proposed ISMP consists of a critical perception module, Spatial Insight Engine (SIE), which abstracts complex internal information of point clouds into essential global features. Besides, to better align structural information with point data, we propose an enhanced key point feature extraction module for amplifying spatial structure feature representation. Simultaneously, a novel feature filtering module is incorporated to reduce noise and redundant features for further aligning precise spatial structure. Extensive experiments validate the effectiveness of our proposed method, achieving object-level and pixel-level AUROC improvements of 4.2% and 13.1%, respectively, on the Real3D-AD benchmarks. Note that the strong generalization ability of SIE has been theoretically proven and is verified in both classification and segmentation tasks. Copyright © 2024, The Authors. All rights reserved.

关键词： Feature extraction

Consensus algorithms for biased labeling in crowdsourcing

学校读者我要写书评

暂无评论

information Sciences 2017年 382-383卷 254-273页

作者： Jing Zhang Victor S. Sheng Qianmu Li Jian Wu Xindong Wu School of Computer Science and Engineering Nanjing University of Science and Technology Nanjing 210094 P. R. China Key Laboratory of Image and Video Understanding for Social Safety Nanjing University of Science and Technology Nanjing 210094 P. R. China Department of Computer Science University of Central Arkansas Conway AR 72035 USA Jiangsu Engineering Center of Network Monitoring Nanjing University of Information Science and Technology Nanjing 210044 P. R. China Institute of Intelligent Information Processing and Application Soochow University Suzhou 215006 P. R. China School of Computing and Informatics University of Louisiana at Lafayette LA 70504 USA

Although it has become an accepted lay view that when labeling objects through crowdsourcing systems, non-expert annotators often exhibit biases, this argument lacks sufficient evidential observation and systematic empirical study. This paper initially analyzes eight real-world datasets from different domains whose class labels were collected from crowdsourcing systems. Our analyses show that biased labeling is a systematic tendency for binary categorization; in other words, for a large number of annotators, their labeling qualities on the negative class (supposed to be the majority) are significantly greater than are those on the positive class (minority). Therefore, the paper empirically studies the performance of four existing EM-based consensus algorithms , DS, GLAD, RY, and ZenCrowd, on these datasets. Our investigation shows that all of these state-of-the-art algorithms ignore the potential bias characteristics of datasets and perform badly although they model the complexity of the systems. To address the issue of handling biased labeling, the paper further proposes a novel consensus algorithm, namely adaptive weighted majority voting (AWMV), based on the statistical difference between the labeling qualities of the two classes. AWMV utilizes the frequency of positive labels in the multiple noisy label set of each example to obtain a bias rate and then assigns weights derived from the bias rate to negative and positive labels. Comparison results among the five consensus algorithms (AWMV and the four existing) show that the proposed AWMV algorithm has the best overall performance. Finally, this paper notes some potential related topics for future study.

关键词：

Large Generative Model Assisted 3D Semantic Communication

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Jiang, Feibo Peng, Yubo Dong, Li Wang, Kezhi Yang, Kun Pan, Cunhua You, Xiaohu Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing Hunan Normal University Changsha China School of Information Science and Engineering Hunan Normal University Changsha China Changsha Social Laboratory of Artificial Intelligence Hunan University of Technology and Business Changsha China The Department of Computer Science Brunel University London United Kingdom The School of Computer Science and Electronic Engineering University of Essex ColchesterCO4 3SQ United Kingdom Changchun Institute of Technology China The National Mobile Communications Research Laboratory Southeast University Nanjing210096 China The Frontiers Science Center for Mobile Information Communication and Security National Mobile Communications Research Laboratory Southeast University Nanjing China The Purple Mountain Laboratories Nanjing China

Semantic Communication (SC) is a novel paradigm for data transmission in 6G. However, there are several challenges posed when performing SC in 3D scenarios: 1) 3D semantic extraction;2) Latent semantic redundancy;and 3) Uncertain channel estimation. To address these issues, we propose a Generative AI Model assisted 3D SC (GAM-3DSC) system. Firstly, we introduce a 3D Semantic Extractor (3DSE), which employs generative AI models, including Segment Anything Model (SAM) and Neural Radiance Field (NeRF), to extract key semantics from a 3D scenario based on user requirements. The extracted 3D semantics are represented as multi-perspective images of the goal-oriented 3D object. Then, we present an Adaptive Semantic Compression Model (ASCM) for encoding these multi-perspective images, in which we use a semantic encoder with two output heads to perform semantic encoding and mask redundant semantics in the latent semantic space, respectively. Next, we design a conditional Generative adversarial network and Diffusion model aided-Channel Estimation (GDCE) to estimate and refine the Channel State information (CSI) of physical channels. Finally, simulation results demonstrate the advantages of the proposed GAM-3DSC system in effectively transmitting the goal-oriented 3D scenario. Copyright © 2024, The Authors. All rights reserved.

关键词： Semantics

LDGCN: An Edge-End Lightweight Dual GCN Based on Single-Channel EEG for Driver Drowsiness Monitoring

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Huang, Jingwei Wang, Chuansheng Huang, Jiayan Fan, Haoyi Grau, Antoni Zhang, Fuquan The College of Computer and Big Data Fuzhou University Fuzhou China The Department of Automatic Control Polytechnic University of Catalonia Barcelona Spain The New Engineering Industry College Putian University Putian China School of Computer and Artificial Intelligence Zhengzhou University China Fujian Provincial Key Laboratory of Information Processing and Intelligent Control Minjiang University Fuzhou China College of Computer and Control Engineering Minjiang University Fuzhou China Key Laboratory of Sichuan Province Sichuan Conservatory of Music Chengdu China Fuzhou Technology Innovation Center of Intelligent Manufacturing information System Minjiang University Fuzhou China Fujian Polytechnic Normal University Fujian Province University Fuzhou China

Driver drowsiness electroencephalography (EEG) signal monitoring can timely alert drivers of their drowsiness status, thereby reducing the probability of traffic accidents. Graph convolutional networks (GCNs) have shown significant advancements in processing the non-stationary, time-varying, and non-Euclidean nature of EEG signals. However, the existing single-channel EEG adjacency graph construction process lacks interpretability, which hinders the ability of GCNs to effectively extract adjacency graph features, thus affecting the performance of drowsiness monitoring. To address this issue, we propose an edge-end lightweight dual graph convolutional network (LDGCN). Specifically, we are the first to incorporate neurophysiological knowledge to design a Baseline Drowsiness Status Adjacency Graph (BDSAG), which characterizes driver drowsiness status. Additionally, to express more features within limited EEG data, we introduce the Augmented Graph-level Module (AGM). This module captures global and local information at the graph level, ensuring that BDSAG features remain intact while enhancing effective feature expression capability. Furthermore, to deploy our method on the fourth-generation Raspberry Pi, we utilize Adaptive Pruning Optimization (APO) on both channels and neurons, reducing inference latency by almost half. Experiments on benchmark datasets demonstrate that LDGCN offers the best trade-off between monitoring performance and hardware resource utilization compared to existing state-of-the-art algorithms. All our source code can be found at https://***/BryantDom/Driver-Drowsiness-Monitoring. Copyright © 2024, The Authors. All rights reserved.

关键词： Electroencephalography