检索结果-内蒙古大学图书馆

FASTC: A Fast Attentional Framework for Semantic Traversability Classification Using Point Cloud

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Chen, Yirui Wei, Pengjin Liu, Zhenhuan Wang, Bingchao Yang, Jie Liu, Wei Institute of Image Processing and Pattern Recognition Department of Automation Shanghai Jiao Tong University China Key Laboratory of System Control and Information Processing Ministry of Education China

Producing traversability maps and understanding the surroundings are crucial prerequisites for autonomous navigation. In this paper, we address the problem of traversability assessment using point clouds. We propose a novel pillar feature extraction module that utilizes PointNet to capture features from point clouds organized in vertical volume and a 2D encoder-decoder structure to conduct traversability classification instead of the widely used 3D convolutions. This results in less computational cost while even better performance is achieved at the same time. We then propose a new spatio-temporal attention module to fuse multi-frame information, which can properly handle the varying density problem of LIDAR point clouds, and this makes our module able to assess distant areas more accurately. Comprehensive experimental results on augmented Semantic KITTI and RELLIS-3D datasets show that our method is able to achieve superior performance over existing approaches both quantitatively and quantitatively. Our code is publicly available at https://***/chenyirui/FASTC. © 2024, CC BY.

关键词： Semantics

ProtDAT: A Unified Framework for Protein Sequence Design from Any Protein Text Description

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Guo, Xiao-Yu Li, Yi-Fan Liu, Yuan Pan, Xiaoyong Shen, Hong-Bin Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai200240 China

Protein design has become a critical method in advancing significant potential for various applications such as drug development and enzyme engineering. However, protein design methods utilizing large language models with solely pretraining and fine-tuning struggle to capture relationships in multi-modal protein data. To address this, we propose ProtDAT, a de novo fine-grained framework capable of designing proteins from any descriptive protein text input. ProtDAT builds upon the inherent characteristics of protein data to unify sequences and text as a cohesive whole rather than separate entities. It leverages an innovative multi-modal cross-attention, integrating protein sequences and textual information for a foundational level and seamless integration. Experimental results demonstrate that ProtDAT achieves the state-of-the-art performance in protein sequence generation, excelling in rationality, functionality, structural similarity, and validity. On 20,000 text-sequence pairs from Swiss-Prot, it improves pLDDT by 6%, TM-score by 0.26, and reduces RMSD by 1.2 Å, highlighting its potential to advance protein design. © 2024, CC BY-NC-SA.

关键词：

Quaternion CNN With Salient Features for Color image Denoising

学校读者我要写书评

暂无评论

Quaternion CNN With Salient Features for Color Image Denoisi...

International Conference on Acoustics, Speech, and Signal processing (ICASSP)

作者： Yi Liu Qiyu Jin Jie Yang School of Mathematical Science Inner Mongolia University Hohhot China Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai China

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

Deep convolutional neural networks have significantly advanced color image denoising. However, existing models often apply grayscale denoising techniques to color images without accounting for inter-channel correlations, resulting in color distortion, detail loss, and visual artifacts. Moreover, these models frequently neglect salient features within convolutional maps. To address these issues, we propose a quaternion CNN model that captures channel correlations and extracts salient features, thereby enhancing color image denoising performance. Specifically, we convert color images into quaternion matrices to better capture these correlations and design a quaternion convolutional network to learn relevant features. Furthermore, an aggregated feature block is introduced to enhance the extraction of salient features and further refine the denoising process. Experimental results on multiple datasets demonstrate that the proposed model achieves superior performance compared to recent state-of-the-art methods.

关键词： Visualization Correlation Acoustic distortion image color analysis Convolution Quaternions Noise reduction Color Feature extraction Convolutional neural networks

Intergrated Segmentation and Detection Models for Dentex Challenge 2023

学校读者我要写书评

暂无评论

arXiv 2023年

作者： He, Lanshan Liu, Yusheng Wang, Lisheng Institute of Image Processing and Pattern Recognition Department of Automation Shanghai Jiao Tong University Shanghai200240 China

Dental panoramic x-rays are commonly used in dental diagnosing. With the development of deep learning, auto detection of diseases from dental panoramic x-rays can help dentists to diagnose diseases more efficiently. The Dentex Challenge 2023 is a competition for automatic detection of abnormal teeth along with their enumeration ids from dental panoramic x-rays. In this paper, we propose a method integrating segmentation and detection models to detect abnormal teeth as well as obtain their enumeration ids. Our codes are available at https://***/xyzlancehe/DentexSegAndDet. Copyright © 2023, The Authors. All rights reserved.

关键词： Diagnosis

Inferior Alveolar Nerve Segmentation in CBCT images using Connectivity-Based Selective Re-training

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Liu, Yusheng Xin, Rui Yang, Tao Wang, Lisheng Institute of Image Processing and Pattern Recognition Department of Automation Shanghai Jiao Tong University Shanghai200240 China

Inferior Alveolar Nerve (IAN) canal detection in CBCT is an important step in many dental and maxillofacial surgery applications to prevent irreversible damage to the nerve during the procedure. The ToothFairy2023 Challenge aims to establish a 3D maxillofacial dataset consisting of all sparse labels and partial dense labels, and improve the ability of automatic IAN segmentation. In this work, in order to avoid the negative impact brought by sparse labeling, we transform the mixed supervised problem into a semi-supervised problem. Inspired by self-training via pseudo labeling, we propose a selective re-training framework based on IAN connectivity. Our method is quantitatively evaluated on the ToothFairy verification cases, achieving the dice similarity coefficient (DSC) of 0.7956, and 95% hausdorff distance (HD95) of 4.4905, and wining the champion in the competition. Code is available at https://***/GaryNico517/SSLIAN-Retraining. © 2023, CC BY-NC-ND.

关键词： image segmentation

Airway Labeling Meets Clinical Applications: Reflecting Topology Consistency and Outliers via Learnable Attentions

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Li, Chenyu Zhang, Minghui Zhang, Chuyan Gu, Yun Institute of Medical Robotics Shanghai Jiao Tong University Shanghai China Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai China

Purpose: Accurate airway anatomical labeling is crucial for clinicians to identify and navigate complex bronchial structures during bronchoscopy. Automatic airway anatomical labeling is challenging due to significant individual variability and anatomical variations. Previous methods are prone to generate inconsistent predictions, which is harmful for preoperative planning and intraoperative navigation. This paper aims to address these challenges by proposing a novel method that enhances topological consistency and improves the detection of abnormal airway branches. Methods: We propose a novel approach incorporating two modules: the Soft Subtree Consistency (SSC) and the Abnormal Branch Saliency (ABS). The SSC module constructs a soft subtree to capture clinically relevant topological relationships, allowing for flexible feature aggregation within and across subtrees. The ABS module facilitates the interaction between node features and prototypes to distinguish abnormal branches, preventing the erroneous aggregation of features between normal and abnormal nodes. Results: Evaluated on a challenging dataset characterized by severe airway distortion and atrophy, our method achieves superior performance compared to state-of-the-art approaches. Specifically, it attains a 91.4% accuracy at the segmental level and an 83.7% accuracy at the subsegmental level, representing a Copyright © 2024, The Authors. All rights reserved.

关键词： Topology

Stock Investor Sentiment Analysis Based on NLP 1st

学校读者我要写书评

暂无评论

Stock Investor Sentiment Analysis Based on NLP

1st International Conference on pattern Analysis and Machine Intelligence, ICPAMI 2024

作者： Liang, Jingxin Deng, Chao Yang, Jie Shanghai Normal University Tianhua College AI School Shanghai China Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai China

ISBN: (纸本)9789819633487

This study investigates the reciprocal relationship between investor sentiment and capital market dynamics, leveraging advanced techniques in data extraction and analysis. By employing web crawling and natural language processing (NLP), we gather and categorize investor comments from stock forums pertinent to the Shanghai and Shenzhen Indices. Utilizing Support Vector Machines and Logistic Regression within an NLP framework, we develop an automated system that transforms comments into sentiment indicators. These indicators are further quantified into daily sentiment indices following denoising procedures to emphasize persistent market trends. Comparative assessments reveal strong correlations between refined sentiment indices and actual stock index movements, confirming their predictive power for market fluctuations. The study offers investors a sentiment-analytics tool, augmenting the multi-faceted approach to investment strategy formulation. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Web crawler

Application of Classification Framework Based on CDR and CNN in Ophthalmic Prediagnosis 1st

学校读者我要写书评

暂无评论

Application of Classification Framework Based on CDR and CNN...

1st International Conference on pattern Analysis and Machine Intelligence, ICPAMI 2024

作者： Xu, Yunjiao Yang, Jie Guo, Tianjiao Scientific Research Office Shanghai Normal University Tianhua College Shanghai China Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai China

ISBN: (纸本)9789819633487

The seven-field classification plays a key role in ophthalmology, especially in the diagnosis and treatment of diabetic retinopathy. In this paper, we designed a framework that can classify 7 fields of each eye simultaneously, and applied it to the medical-assisted interactive system of 7 fields of classification。F1 and F2 field of view are detected through a combination of algorithms based on decision rules and convolutional neural networks. The total accuracy on the internal test set is 98.7%(95%CI, 98.4%–99.1%). In external tests, the total accuracy of the algorithm in this paper on the LONGITUDINAL data set is 98.6%(95%CI,97.9%–99.3%). The total accuracy on the Drishti-GS data set is 100%. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Convolutional neural networks

Leveraging Open Knowledge for Advancing Task Expertise in Large Language Models

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Yang, Yuncheng Qin, Yulei Wu, Tong Xu, Zihan Li, Gang Guo, Pengcheng Shao, Hang Shi, Yuchen Li, Ke Sun, Xing Yang, Jie Gu, Yun Institute of Image Processing and Pattern Recognition Institute of Medical Robotics Shanghai Jiao Tong University Shanghai200240 China Tencent YouTu Lab Shanghai200233 China

The cultivation of expertise for large language models (LLMs) to solve tasks of specific areas often requires special-purpose tuning with calibrated behaviors on the expected stable outputs. To avoid huge cost brought by manual preparation of instruction datasets and training resources up to hundreds of hours, the exploitation of open knowledge including a wealth of low rank adaptation (LoRA) models and instruction datasets serves as a good starting point. However, existing methods on model and data selection focus on the performance of general-purpose capabilities while neglecting the knowledge gap exposed in domain-specific deployment. In the present study, we propose to bridge such gap by introducing few human-annotated samples (i.e., K-shot) for advancing task expertise of LLMs with open knowledge. Specifically, we develop an efficient and scalable pipeline to cost-efficiently produce task experts where K-shot data intervene in selecting the most promising expert candidates and the task-relevant instructions. A mixture-of-expert (MoE) system is built to make the best use of individual-yet-complementary knowledge between multiple experts. We unveil the two keys to the success of a MoE system, 1) the abidance by K-shot, and 2) the insistence on diversity. For the former, we ensure that models that truly possess problem-solving abilities on K-shot are selected rather than those blind guessers. Besides, during data selection, instructions that share task-relevant contexts with K-shot are prioritized. For the latter, we highlight the diversity of constituting experts and that of the fine-tuning instructions throughout the model and data selection process. Extensive experimental results confirm the superiority of our approach over existing methods on utilization of open knowledge across various tasks. Our codes will be available at https://***/Yaphabates/Rocket. © 2024, CC BY.

关键词： Pipeline codes