检索结果-内蒙古大学图书馆

New intra prediction mode for interlaced video in AVS

学校读者我要写书评

暂无评论

Gaojishu Tongxin/Chinese High Technology Letters 2007年第3期17卷 221-225页

作者： Chen, Liang Tan, Yihua Tian, Jinwen State Key Laboratory of Education Ministry for Image Processing and Intelligent Control Institute of Pattern Recognition and Artificial Intelligence Huazhong University of Science and Technology Wuhan 430074 China

The technologies of intra prediction and MBAFF were introduced, and a new intra prediction mode based on the characteristics of spatial distribution in interlaced video was proposed. The spatial correlation of five luma intra prediction modes in AVS-P2 and the new mode were analyzed. From the analysis result, it can be concluded that the new mode can exploit the spatial correlation better and predict the samples more precisely than the existed ones. The experimental results showed that the average gain in peak signal to noise ratio was above 0.12dB and the average reduction in bit-rate was above 1.77%, so the proposed mode is an effective prediction mode for improvement of coding performance.

关键词： AVS Interlaced video Intra prediction Video coding

MGTN: Multi-scale Graph Transformer Network for 3D Point Cloud Semantic Segmentation

学校读者我要写书评

暂无评论

MGTN: Multi-scale Graph Transformer Network for 3D Point Clo...

IEEE Visual Communications and image processing (VCIP)

作者： Da Ai Siyu Qin Zihe Nie Hui Yuan Ying Liu Xi’an Key Laboratory of Image Processing Technology and Applications for Public Security Xi’an University of Posts and Telecommunications Xi’an China School of Communication and Information Engineering Xi’an University of Posts and Telecommunications Xi’an China School of Control Science and Engineering Shandong University Jinan China

ISBN: (数字)9798331529543

ISBN: (纸本)9798331529550

The structural similarity of point clouds presents challenges in accurately recognizing and segmenting semantic information at the demarcation points of complex scenes or objects. In this study, we propose a multi-scale graph transformer network (MGTN) for 3D point cloud semantic segmentation. First, a multi-scale graph convolution (MSG-Conv) is devised to address the limitations faced by existing methods when extracting local and global features of point cloud data with varying densities simultaneously. Subsequently, we employ a graph-transformer (G-T) module to enhance edge details and spatial position information in the point cloud, thereby improving recognition accuracy for small objects and confusing elements such as columns and beams. Extensive testing on ShapeNet parts and S3DIS datasets was conducted to demonstrate the effectiveness of MGTN. Compared to the baseline network DGCNN, our proposed MGTN achieves substantial performance improvements, as evidenced by notable increases in mIoU of 1.5% and 18.5% on the ShapeNet parts and S3DIS datasets respectively. Additionally, MGTN outperforms the recent CFSA- Net by 2.3% and 3.4% on OA and mIoU respectively.

关键词： Point cloud compression Three-dimensional displays Visual communication Convolution Semantic segmentation Semantics Transformers Feature extraction Data mining Testing

Spherical interpolated convolutional network with distance-feature density for 3D semantic segmentation of point clouds

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Wang, Guangming Yang, Yehui Zhang, Huixin Liu, Zhe Wang, Hesheng Department of Automation Insititue of Medical Robotics Key Laboratory of System Control and Information Processing of Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Jiao Tong University Shanghai200240 China Beijing Advanced Innovation Center for Intelligent Robots and Systems Beijing Institute of Technology China Department of Computer Science and Technology University of Cambridge United Kingdom

The semantic segmentation of point clouds is an important part of the environment perception for robots. However, it is difficult to directly adopt the traditional 3D convolution kernel to extract features from raw 3D point clouds because of the unstructured property of point clouds. In this paper, a spherical interpolated convolution operator is proposed to replace the traditional grid-shaped 3D convolution operator. This newly proposed feature extraction operator improves the accuracy of the network and reduces the parameters of the network. In addition, this paper analyzes the defect of point cloud interpolation methods based on the distance as the interpolation weight and proposes the self-learned distance-feature density by combining the distance and the feature correlation. The proposed method makes the feature extraction of spherical interpolated convolution network more rational and effective. The effectiveness of the proposed network is demonstrated on the 3D semantic segmentation task of point clouds. Experiments show that the proposed method achieves good performance on the ScanNet dataset and Paris-Lille-3D dataset. Copyright © 2020, The Authors. All rights reserved.

关键词： Semantic Segmentation

Tracing Intricate Cues in Dialogue: Joint Graph Structure and Sentiment Dynamics for Multimodal Emotion Recognition

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Li, Jiang Wang, Xiaoping Zeng, Zhigang The School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China The Institute of Artificial Intelligence Huazhong University of Science and Technology Wuhan430074 China The Hubei Key Laboratory of Brain-Inspired Intelligent Systems Huazhong University of Science and Technology Wuhan430074 China The Key Laboratory of Image Processing and Intelligent Control Huazhong University of Science and Technology Ministry of Education Wuhan430074 China

Multimodal emotion recognition in conversation (MERC) has garnered substantial research attention recently. Existing MERC methods face several challenges: (1) they fail to fully harness direct inter-modal cues, possibly leading to less-than-thorough cross-modal modeling;(2) they concurrently extract information from the same and different modalities at each network layer, potentially triggering conflicts from the fusion of multi-source data;(3) they lack the agility required to detect dynamic sentimental changes, perhaps resulting in inaccurate classification of utterances with abrupt sentiment shifts. To address these issues, a novel approach named GraphSmile is proposed for tracking intricate emotional cues in multimodal dialogues. GraphSmile comprises two key components, i.e., GSF and SDP modules. GSF ingeniously leverages graph structures to alternately assimilate inter-modal and intra-modal emotional dependencies layer by layer, adequately capturing cross-modal cues while effectively circumventing fusion conflicts. SDP is an auxiliary task to explicitly delineate the sentiment dynamics between utterances, promoting the model’s ability to distinguish sentimental discrepancies. Furthermore, GraphSmile is effortlessly applied to multimodal sentiment analysis in conversation (MSAC), forging a unified multimodal affective model capable of executing MERC and MSAC tasks. Empirical results on multiple benchmarks demonstrate that GraphSmile can handle complex emotional and sentimental patterns, significantly outperforming baseline models. Copyright © 2024, The Authors. All rights reserved.

关键词： Emotion Recognition

Online Attentive Kernel-Based Temporal Difference Learning

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Yang, Guang Chen, Xingguo Yang, Shangdong Wang, Huihui Dong, Shaokang Gao, Yang The the Jiangsu Key Laboratory of Big Data Security & Intelligent Processing Nanjing University of Posts and Telecommunications National Engineering Laboratory for Agri-Product Quality Traceability Beijing Technology and Business University China The State Key Laboratory for Novel Software Technology Nanjing University China The PCA Lab Key Lab of Intelligent Perception and Systems for High-Dimensional Information Ministry of Education Jiangsu Key Lab of Image and Video Understanding for Social Security School of Computer Science and Engineering Nanjing University of Science and Technology China

With rising uncertainty in the real world, online Reinforcement Learning (RL) has been receiving increasing attention due to its fast learning capability and improving data efficiency. However, online RL often suffers from complex Value Function Approximation (VFA) and catastrophic interference, creating difficulty for the deep neural network to be applied to an online RL algorithm in a fully online setting. Therefore, a simpler and more adaptive approach is introduced to evaluate value function with the kernel-based model. Sparse representations are superior at handling interference, indicating that competitive sparse representations should be learnable, non-prior, non-truncated and explicit when compared with current sparse representation methods. Moreover, in learning sparse representations, attention mechanisms are utilized to represent the degree of sparsification, and a smooth attentive function is introduced into the kernel-based VFA. In this paper, we propose an Online Attentive Kernel-Based Temporal Difference (OAKTD) algorithm using two-timescale optimization and provide convergence analysis of our proposed algorithm. Experimental evaluations showed that OAKTD outperformed several Online Kernel-based Temporal Difference (OKTD) learning algorithms in addition to the Temporal Difference (TD) learning algorithm with Tile Coding on public Mountain Car, Acrobot, CartPole and Puddle World tasks. Copyright © 2022, The Authors. All rights reserved.

关键词： Learning algorithms

One-shot distributed algorithm for generalized eigenvalue problem

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Lyu, Kexin He, Fan Huang, Xiaolin Yang, Jie Chen, Liming Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University MOE Key Laboratory of System Control and Information Processing 800 Dongchuan Road Shanghai200240 China Institute of Medical Robotics Shanghai Jiao Tong University 800 Dongchuan Road Shanghai200240 China Ecole Centrale de Lyon France

Nowadays, more and more datasets are stored in a distributed way for the sake of memory storage or data privacy. The generalized eigenvalue problem (GEP) plays a vital role in a large family of high-dimensional statistical models. However, the existing distributed method for eigenvalue decomposition cannot be applied in GEP for the divergence of the empirical covariance matrix. Here we propose a general distributed GEP framework with one-shot communication for GEP. If the symmetric data covariance has repeated eigenvalues, e.g., in canonical component analysis, we further modify the method for better convergence. The theoretical analysis on approximation error is conducted and the relation to the divergence of the data covariance, the eigenvalues of the empirical data covariance, and the number of local servers is analyzed. Numerical experiments also show the effectiveness of the proposed algorithms. Copyright © 2020, The Authors. All rights reserved.

关键词： Eigenvalues and eigenfunctions

DSLO: Deep Sequence LiDAR Odometry Based on Inconsistent Spatio-temporal Propagation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhang, Huixin Wang, Guangming Wu, Xinrui Xu, Chenfeng Ding, Mingyu Tomizuka, Masayoshi Zhan, Wei Wang, Hesheng Department of Automation Key Laboratory of System Control and Information Processing of Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Engineering Research Center of Intelligent Control and Management Shanghai Jiao Tong University Shanghai200240 China Department of Engineering University of Cambridge CambridgeCB2 1PZ United Kingdom UC Berkeley BerkeleyCA94720 United States

This paper introduces a 3D point cloud sequence learning model based on inconsistent spatio-temporal propagation for LiDAR odometry, termed DSLO. It consists of a pyramid structure with a spatial information reuse strategy, a sequential pose initialization module, a gated hierarchical pose refinement module, and a temporal feature propagation module. First, spatial features are encoded using a point feature pyramid, with features reused in successive pose estimations to reduce computational overhead. Second, a sequential pose initialization method is introduced, leveraging the high-frequency sampling characteristic of LiDAR to initialize the LiDAR pose. Then, a gated hierarchical pose refinement mechanism refines poses from coarse to fine by selectively retaining or discarding motion information from different layers based on gate estimations. Finally, temporal feature propagation is proposed to incorporate the historical motion information from point cloud sequences, and address the spatial inconsistency issue when transmitting motion information embedded in point clouds between frames. Experimental results on the KITTI odometry dataset and Argoverse dataset demonstrate that DSLO outperforms state-of-the-art methods, achieving at least a 15.67% improvement on RTE and a 12.64% improvement on RRE, while also achieving a 34.69% reduction in runtime compared to baseline methods. Our implementation will be available at https://***/IRMVLab/DSLO. © 2024, CC BY-NC-ND.

关键词：

Prediction of piRNA-mRNA interactions based on an interactive inference network

学校读者我要写书评

暂无评论

Prediction of piRNA-mRNA interactions based on an interactiv...

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Yajun Liu Ru Li Aimin Li Rong Fei Xie Guo Fang-Xiang Wu Shaanxi Key Laboratory for Network Computing and Security Technology Xi'an University of Technology Xi'an China Shaanxi Key Laboratory of Complex System Control and Intelligent Information Processing Xi'an University of Technology Xi'an China Department of Computer Science Department of Mechanical Engineering Division of Biomedical Engineering University of Saskatchewan Saskatoon Canada

As the largest class of small non-coding RNAs, piRNAs primarily present in the reproductive cells of mammals, which influence post-transcriptional processes of mRNAs in multiple ways. Effective methods for predicting piRNA and mRNA target relationships can help identify piRNA functions, investigate the possibility of piRNAs as biomarkers and therapeutic targets. In this study, we propose a computational approach for classifying the relationships of piRNA-mRNA pairs based on an interactive inference network (IIN). First, we gather piRNA-mRNA target data, collect sequence data by position alignment, and construct a benchmark dataset. Furthermore, a reliable negative set is constructed by positive-unlabeled learning. Finally, we view a piRNA and a mRNA sequence as a premise and hypothesis sentence, respectively, and IIN model is used to predict the relationship between them. The experiments demonstrate that our method effectively characterizes piRNA-mRNA interaction and could be beneficial for researchers to investigate piRNA functions.

关键词：

Study on the Method of image Restoration in the Environment of Dust

学校读者我要写书评

暂无评论

Study on the Method of Image Restoration in the Environment ...

International Conference on Wireless Communications, Networking and Mobile Computing (WiCom)

作者： Yuanyu Wang Yuanzong Li Tianxu Zhang Department of Computer Fundamental Education Taiyuan University Of Technology Taiyuan China College of Mechanical Engineering Taiyuan University Of Technology Taiyuan China Institute of Pattern Recognition and A.I State Key Laboratory of Image Processing and Intelligent Control HuaZhong University of Science and Technology Wuhan China

In order to solve the problem of image degradation caused by dust environments, an image degradation model considering multiple scattering factors caused by dust was first established using the first-order multiple scattering method. Then, a dark channel prior principle was applied to present an image restoration algorithm based on the image degradation model. Finally, GA optimization algorithm was applied to optimize the atmospheric light and the exposure parameters. This optimization algorithm was established according to the criterion of the image evaluation based on kirsch operator with automatic threshold. By using the method an optimistic result of image restoration was obtained. The experimental results have shown that the method not only enhanced luminance and contrast, but also discovered more detail edges information. The method provided a foundation for target recognition in the dust environments.

关键词： image edge detection image restoration Scattering Degradation Gallium Atmospheric modeling Genetic algorithms