检索结果-内蒙古大学图书馆

Video Compression Artifacts Removal With Spatial-Temporal Attention-Guided Enhancement

IEEE Transactions on Multimedia 2024年 26卷 5657-5669页

作者： Jiang, Nanfeng Chen, Weiling Lin, Jielian Zhao, Tiesong Lin, Chia-Wen Fujian Key Laboratory for Intelligent Processing and Wireless Transmission of Media Information Fuzhou University Fuzhou350108 China Fujian Key Laboratory of Pattern Recognition and Image Understanding Xiamen University of Technology Xiamen361024 China Fujian Science and Technology Innovation Laboratory for Optoelectronic Information of China Fuzhou350116 China Department of Electrical Engineering National Tsing Hua University Hsinchu30013 Taiwan Institute of Communications Engineering National Tsing Hua University Hsinchu30013 Taiwan

Recently, many compression algorithms are applied to decrease the cost of video storage and transmission. This will introduce undesirable artifacts, which severely degrade visual quality. Therefore, Video Compression Artifacts Removal (VCAR) aims at reconstructing a high-quality video from its corrupted version of compression. Generally, this task is considered as a vision-related instead of media-related problem. In vision-related research, the visual quality has been significantly improved while the computational complexity and bitrate issues are less considered. In this work, we review the performance constraints of video coding and transfer to evaluate the VCAR outputs. Based on the analyses, we propose a Spatial-Temporal Attention-Guided Enhancement Network (STAGE-Net). First, we employ dynamic filter processing, instead of conventional optical flow method, to reduce the computational cost of VCAR. Second, we introduce self-attention mechanism to design Sequential Residual Attention Blocks (SRABs) to improve visual quality of enhanced video frames with bitrate constraints. Both quantitative and qualitative experimental results have demonstrated the superiority of our proposed method, which achieves high visual qualities and low computational costs. © 2023 IEEE.

关键词： Computational complexity

来源：评论

学校读者我要写书评

暂无评论

FASTC: A Fast Attentional Framework for Semantic Traversability Classification Using Point Cloud

arXiv

引用

arXiv 2024年

作者： Chen, Yirui Wei, Pengjin Liu, Zhenhuan Wang, Bingchao Yang, Jie Liu, Wei Institute of Image Processing and Pattern Recognition Department of Automation Shanghai Jiao Tong University China Key Laboratory of System Control and Information Processing Ministry of Education China

Producing traversability maps and understanding the surroundings are crucial prerequisites for autonomous navigation. In this paper, we address the problem of traversability assessment using point clouds. We propose a novel pillar feature extraction module that utilizes PointNet to capture features from point clouds organized in vertical volume and a 2D encoder-decoder structure to conduct traversability classification instead of the widely used 3D convolutions. This results in less computational cost while even better performance is achieved at the same time. We then propose a new spatio-temporal attention module to fuse multi-frame information, which can properly handle the varying density problem of LIDAR point clouds, and this makes our module able to assess distant areas more accurately. Comprehensive experimental results on augmented Semantic KITTI and RELLIS-3D datasets show that our method is able to achieve superior performance over existing approaches both quantitatively and quantitatively. Our code is publicly available at https://***/chenyirui/FASTC. © 2024, CC BY.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

ProtDAT: A Unified Framework for Protein Sequence Design from Any Protein Text Description

arXiv

引用

arXiv 2024年

作者： Guo, Xiao-Yu Li, Yi-Fan Liu, Yuan Pan, Xiaoyong Shen, Hong-Bin Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai200240 China

Protein design has become a critical method in advancing significant potential for various applications such as drug development and enzyme engineering. However, protein design methods utilizing large language models with solely pretraining and fine-tuning struggle to capture relationships in multi-modal protein data. To address this, we propose ProtDAT, a de novo fine-grained framework capable of designing proteins from any descriptive protein text input. ProtDAT builds upon the inherent characteristics of protein data to unify sequences and text as a cohesive whole rather than separate entities. It leverages an innovative multi-modal cross-attention, integrating protein sequences and textual information for a foundational level and seamless integration. Experimental results demonstrate that ProtDAT achieves the state-of-the-art performance in protein sequence generation, excelling in rationality, functionality, structural similarity, and validity. On 20,000 text-sequence pairs from Swiss-Prot, it improves pLDDT by 6%, TM-score by 0.26, and reduces RMSD by 1.2 Å, highlighting its potential to advance protein design. © 2024, CC BY-NC-SA.

关键词：

来源：评论

学校读者我要写书评

暂无评论

AttSiOff: a self-attention-based approach on siRNA design with inhibition and off-target effect prediction

引用

Med-X 2024年第1期2卷 59-69页

作者： Bin Liu Ye Yuan Xiaoyong Pan Hong-Bin Shen Cheng Jin Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong UniversityShanghaiChina Medical Robot Research Institute School of Biomedical EngineeringShanghai Jiao Tong UniversityShanghaiChina

Small interfering RNA(siRNA)is often used for function study and expression regulation of specific genes,as well as the development of small molecule *** siRNAs with high inhibition and low off-target effects from massive can-didates is always a great *** experimentally-validated samples can prompt the development of machine-learning-based algorithms,including Support Vector Machine(SVM),Convolutional Neural Network(CNN),and Graph Neural Network(GNN).However,these methods still suffer from limited accuracy and poor generalization in designing potent and specific *** this study,we propose a novel approach for siRNA inhibition and off-target effect prediction,named *** combines a self-attention-based siRNA inhibition predictor with an mRNA searching package and an off-target *** predictor gives the inhibition score via analyzing the embedding of siRNA and local mRNA sequences,generated from the pre-trained RNA-FM model,as well as other meaningful prior-knowledge-based ***-attention mechanism can detect potentially decisive features,which may determine the inhibition of *** captures global and local dependencies more efficiently than normal *** tenfold cross-validation results indicate that our model outperforms all existing methods,achieving PCC of 0.81,SPCC of 0.84,and AUC of *** also reaches better performance of generalization and robustness on cross-dataset *** addition,the mRNA searching package could find all mature mRNAs for a given gene name from the GENOMES database,and the off-target filter can calculate the amount of unwanted off-target binding sites,which affects the specificity of *** on five mature siRNA drugs,as well as a new target gene(AGT),show that AttSioff has excellent convenience and operability in practical applications.

关键词： siRNA inhibition prediction Off-target effects Self-attention mechanism

来源：评论

学校读者我要写书评

暂无评论

RBP-Former: Joint Prediction of RNA-protein Binding Sites on Full-length RNA Transcripts for Multiple RBPs

RBP-Former: Joint Prediction of RNA-protein Binding Sites on...

引用

2024 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2024

作者： Li, Yichong Liu, Xiaojian Cheng, Fan Pan, Xiaoyong Yang, Yang Shanghai Jiao Tong University Department of Computer Science and Engineering Shanghai200240 China Shanghai Jiao Tong University Institute of Image Processing and Pattern Recognition Shanghai200240 China Ministry of Education of China Key Laboratory of System Control and Information Processing Shanghai200240 China Key Laboratory of Shanghai Education Commission for Intelligent Interaction and Cognitive Engineering Shanghai200240 China

ISBN: (纸本)9798350386226

RNA-binding proteins (RBPs) are essential for gene expression, and the complex RNA-protein interaction mechanisms require analysis of global RNA information. Therefore, accurate prediction of RBP binding sites on full-length RNA transcripts is crucial for understanding these mechanisms and their roles in diseases. While machine learning methods can predict RBP binding to RNA fragments, extending this to full-length transcripts presents challenges due to sequence length and data imbalance. In this paper, we introduce RBP-Former, a binding site joint prediction model designed specifically for full-length RNA transcripts that can be used for multiple RBPs. This model processes information at both coarse and fine-grained levels to fully exploit sequence data and its interactions with multiple RBPs. We develop multi-level imbalance learning strategies, achieving favorable results on imbalanced data. Our method outperforms existing methods in predicting binding sites on full-length RNA transcripts for multiple RBPs, demonstrating its effectiveness in handling imbalanced label and sample distributions. © 2024 IEEE.

关键词： Binding sites

来源：评论

学校读者我要写书评

暂无评论

Aggregating Correlation Filter with Multiple Kernels Learning for Robust Visual Object Tracking 22

Aggregating Correlation Filter with Multiple Kernels Learnin...

引用

8th International Conference on Computing and Artificial Intelligence, ICCAI 2022

作者： Wei, Yanxia Xiao, Hairong Feng, Deying Mu, Jian Yang, Jie School of Mechanical and Automotive Engineering Liaocheng University China Key Laboratory of System Control and Information Processing Ministry of Education Shanghai China Liaocheng University China Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University China

ISBN: (纸本)9781450396110

Recently, Discriminative Correlation Filter based trackers have increasingly become popular in the domain of visual object tracking, which is benefited by their effective and robustness in terms of tracking performance. However, the significant variations of target appearance, such as Occlusion or Deformation, always suppress the performance improvement. Although the multi-feature fusion strategy partly alleviates the above factors, the synthetic scheme also ambiguates the overall presentation ability of multiple features and results in degradation of discriminative power during classification filter learning. In this paper, we present a novel tracking framework based on the correlation filter with multiple kernel learning. Instead of directly integrating different features, we decompose a tracking process into several module, including low-dimension modules and high-dimension modules. The handcraft features extracted from low-dimension modules are robust to the small variation of target while the semantic convolutional features from the high-dimension modules can distinguish the target object from the relative complex tracking environment. In addition, we also design a reliability detection mechanism based on the confidence map to accurately measure the important degree of each kernel learning and precisely estimate the target state in the subsequent frames. For verifying our proposed tracker, we conduct extensive experiments on several standard sequence benchmark. Experiment results show that our proposed trackers perform favorably against other state-of-the-art trackers. © 2022 ACM.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

FoldExplorer: Fast and Accurate Protein Structure Search with Sequence-Enhanced Graph Embedding

arXiv

引用

arXiv 2023年

作者： Liu, Yuan Shen, Hong-Bin Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai China

The advent of highly accurate protein structure prediction methods has fueled an exponential expansion of the protein structure database. Consequently, there is a rising demand for rapid and precise structural homolog search. Traditional alignment-based methods are dedicated to precise comparisons between pairs, exhibiting high accuracy. However, their sluggish processing speed is no longer adequate for managing the current massive volume of data. In response to this challenge, we propose a novel deep-learning approach FoldExplorer. It harnesses the powerful capabilities of graph attention neural networks and protein large language models for protein structures and sequences data processing to generate embeddings for protein structures. The structural embeddings can be used for fast and accurate protein search. And the embeddings also provide insights into the protein space. FoldExplorer demonstrates a substantial performance improvement of 5% to 8% over the current state-of-the-art algorithm on the benchmark datasets. Meanwhile, FoldExplorer does not compromise on search speed and excels particularly in searching on a large-scale dataset. Copyright © 2023, The Authors. All rights reserved.

关键词： Embeddings

来源：评论

学校读者我要写书评

暂无评论

An Unsupervised Person Search Method for Video Surveillance 22

An Unsupervised Person Search Method for Video Surveillance

引用

8th International Conference on Computing and Artificial Intelligence, ICCAI 2022

作者： Feng, Deying Yang, Jie Wei, Yanxia Xiao, Hairong Zhang, Laigang School of Mechanical and Automotive Engineering Liaocheng University China Key Laboratory of System Control and Information Processing Ministry of Education Shanghai China Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai China Liaocheng University China

ISBN: (纸本)9781450396110

We propose an unsupervised person search method for video surveillance. This method considers both the spatial features of persons within each frame and the temporal relationship of the same person among different frames. Thus, the spatial features are extracted by region convolutional neural network, and the temporal relationship is organized by gate recurrent unit. The spatio-temporal features are generated by the following average pooling layer and indexed by locality sensitive hashing. A surveillance video database is constructed to evaluate the proposed method, and the experimental results demonstrate that our method improves the search accuracy by utilizing the spatio-temporal features. © 2022 ACM.

关键词： Monitoring

来源：评论

学校读者我要写书评

暂无评论

Application of Classification Framework Based on CDR and CNN in Ophthalmic Prediagnosis 1st

Application of Classification Framework Based on CDR and CNN...

引用

1st International Conference on pattern Analysis and Machine Intelligence, ICPAMI 2024

作者： Xu, Yunjiao Yang, Jie Guo, Tianjiao Scientific Research Office Shanghai Normal University Tianhua College Shanghai China Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai China

ISBN: (纸本)9789819633487

The seven-field classification plays a key role in ophthalmology, especially in the diagnosis and treatment of diabetic retinopathy. In this paper, we designed a framework that can classify 7 fields of each eye simultaneously, and applied it to the medical-assisted interactive system of 7 fields of classification。F1 and F2 field of view are detected through a combination of algorithms based on decision rules and convolutional neural networks. The total accuracy on the internal test set is 98.7%(95%CI, 98.4%–99.1%). In external tests, the total accuracy of the algorithm in this paper on the LONGITUDINAL data set is 98.6%(95%CI,97.9%–99.3%). The total accuracy on the Drishti-GS data set is 100%. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Convolutional neural networks

来源：评论

学校读者我要写书评

暂无评论

Encapsulation strategies on 2D materials for field effect transistors and photodetectors

引用

Chinese Chemical Letters 2022年第5期33卷 2281-2290页

作者： Wenjuan Huang Yue Zhang Mengting Song Bugao Wang Huayi Hou Xiaozong Hu Xiangbai Chen Tianyou Zhai Hubei Key Laboratory of Optical Information and Pattern Recognition Wuhan Institute of TechnologyWuhan 430205China State Key Laboratory of Materials Processing and Die&Mould Technology School of Materials Science and EngineeringHuazhong University of Science and TechnologyWuhan 430074China Green Catalysis Center College of ChemistryZhengzhou UniversityZhengzhou 450001China

Two-dimensional(2D)layered materials provide a promising alternative solution for overcoming the scal-ing limits in conventional Si-based ***,practical applications of 2D materials are facing crucial bottlenecks,particularly that arising from the instability under ambient *** studies of degradation mechanisms and protecting strategies for overcoming the ambient instability of 2D materials have attracted extensive research attentions,both experimentally and *** review attempts to provide an overview on the recent progress of the encapsulation strategies for 2D *** en-capsulation strategies of mechanical transfer,polymer capping,atomic layer deposition,in-situ oxidation,and surface functionalization are systematically discussed for improving the ambient stability of 2D *** addition,the current advances in air-stable and high-performance 2D materials-based field effect transistors(FETs)and photodetectors assisted by the encapsulation strategies are ***,the future directions of encapsulation techniques of 2D materials for FETs and photodetectors applications are suggested.

关键词： Two-dimensional materials Encapsulation Degradation Stability Field effect transistors Photodetectors

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：