检索结果-内蒙古大学图书馆

Retraction Note: Multimodal deep learning approach for identifying and categorizing intracranial hemorrhage

Multimedia Tools and Applications 2024年第42期83卷 90695-90695页

作者： S, Anand Hareendran SS, Vinod Chandra Department of Computer Science and Engineering Muthoot Institute of Technology and Science Kochi India Machine Intelligence Laboratory Department of Computer Science University of Kerala Thiruvananthapuram India

来源：评论

学校读者我要写书评

暂无评论

Consistent Brain Age Difference in Childhood Autism Spectrum Disorder and its Subtypes 4th

Consistent Brain Age Difference in Childhood Autism Spectrum...

引用

4th International Workshop on Human Brain and Artificial intelligence, HBAI 2024

作者： Sun, Fangling Liang, Chuang Shao, Wei Fu, Zening Zhang, Daoqiang Jiang, Rongtao Qi, Shile Calhoun, Vince D. Department of Computer Science and Technology Nanjing University of Aeronautics and Astronautics Nanjing China Key Laboratory of Brain-Machine Intelligence Technology Ministry of Education Nanjing University of Aeronautics and Astronautics Nanjing China MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Nanjing University of Aeronautics and Astronautics Nanjing China Georgia State University Institute of Technology Emory University AtlantaGA United States Department of Radiology and Biomedical Imaging Yale University New HavenCT United States

ISBN: (纸本)9789819640003

Autism spectrum disorder (ASD) is a neurodevelopmental condition characterized by impairments in social interaction and behavior as well as structural abnormalities regarding brain development. The difference between neuroimaging-predicted brain age and the chronological age (predicted age difference;PAD) is a potential biomarker reflecting individual differences in brain developmental trajectories. However, current findings of PAD in ASD are inconsistent due to the biases introduced by different prediction models. Here, 6 classic 3-dimensional convolutional neural network (3D-CNN) models were used to assess brain age to identify consistent and reliable PAD and its interpretable features for ASD. No significant PAD differences between ASD and typically developing controls (TDC) were observed, but PAD differences in younger age and subtypes were found. Occlusion sensitivity analysis showed that default mode network (DMN) and salience network (SAN) drove the atypical brain developmental trajectories in ASD. Our findings were replicable across 6 CNN models, showing the promise of neuroimaging targets for exploring atypical developmental patterns in ASD. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Convolutional neural networks

来源：评论

学校读者我要写书评

暂无评论

HQG-Net: Unpaired Medical Image Enhancement with High-Quality Guidance

arXiv

引用

arXiv 2023年

作者： He, Chunming Li, Kai Xu, Guoxia Yan, Jiangpeng Tang, Longxiang Zhang, Yulun Li, Xiu Wang, Yaowei Tsinghua Shenzhen International Graduate School Tsinghua University Shenzhen518055 China Machine Learning Department NEC Laboratories America Inc. NJ08540 United States Department of Computer Science Norwegian University of Science and Technology Gjovik2815 Norway The Computer Vision Lab ETH Zürich Zürich8092 Switzerland Peng Cheng Laboratory Shenzhen518066 China

Unpaired Medical Image Enhancement (UMIE) aims to transform a low-quality (LQ) medical image into a high-quality (HQ) one without relying on paired images for training. While most existing approaches are based on Pix2Pix/CycleGAN and are effective to some extent, they fail to explicitly use HQ information to guide the enhancement process, which can lead to undesired artifacts and structural distortions. In this paper, we propose a novel UMIE approach that avoids the above limitation of existing methods by directly encoding HQ cues into the LQ enhancement process in a variational fashion and thus model the UMIE task under the joint distribution between the LQ and HQ domains. Specifically, we extract features from an HQ image and explicitly insert the features, which are expected to encode HQ cues, into the enhancement network to guide the LQ enhancement with the variational normalization module. We train the enhancement network adversarially with a discriminator to ensure the generated HQ image falls into the HQ domain. We further propose a content-aware loss to guide the enhancement process with wavelet-based pixel-level and multi-encoder-based feature-level constraints. Additionally, as a key motivation for performing image enhancement is to make the enhanced images serve better for downstream tasks, we propose a bi-level learning scheme to optimize the UMIE task and downstream tasks cooperatively, helping generate HQ images both visually appealing and favorable for downstream tasks. Experiments on three medical datasets, including two newly collected datasets, verify that the proposed method outperforms existing techniques in terms of both enhancement quality and downstream task performance. We will make the code and the newly collected datasets publicly available for community study. Copyright © 2023, The Authors. All rights reserved.

关键词： Image enhancement

来源：评论

学校读者我要写书评

暂无评论

Improving AlphaFLOW for Efficient Protein Ensembles Generation

arXiv

引用

arXiv 2024年

作者： Li, Shaoning Li, Mingyu Wang, Yusong He, Xinheng Zheng, Nanning Zhang, Jian Heng, Pheng Ann Department of Computer Science and Engineering The Chinese University of Hong Kong Hong Kong Medicinal Chemistry and Bioinformatics Center Shanghai Jiao Tong University School of Medicine China National Key Laboratory of Human-Machine Hybrid Augmented Intelligence Institute of Artificial Intelligence and Robotics Xi'an Jiaotong University China Shanghai Institute of Materia Medica Chinese Academy of Sciences China

Investigating conformational landscapes of proteins is a crucial way to understand their biological functions and properties. AlphaFLOW stands out as a sequence-conditioned generative model that introduces flexibility into structure prediction models by fine-tuning AlphaFold under the flow-matching framework. Despite the advantages of efficient sampling afforded by flow-matching, AlphaFLOW still requires multiple runs of AlphaFold to finally generate one single conformation. Due to the heavy consumption of AlphaFold, its applicability is limited in sampling larger set of protein ensembles or the longer chains within a constrained timeframe. In this work, we propose a feature-conditioned generative model called AlphaFLOW-Lit to realize efficient protein ensembles generation. In contrast to the full fine-tuning on the entire structure, we focus solely on the light-weight structure module to reconstruct the conformation. AlphaFLOW-Lit performs on-par with AlphaFLOW and surpasses its distilled version without pretraining, all while achieving a significant sampling acceleration of around 47 times. The advancement in efficiency showcases the potential of AlphaFLOW-Lit in enabling faster and more scalable generation of protein ensembles. © 2024, CC BY.

关键词： Proteins

来源：评论

学校读者我要写书评

暂无评论

State Derivative Normalization for Continuous-Time Deep Neural Networks

引用

IFAC-PapersOnLine 2024年第15期58卷 253-258页

作者： Jonas Weigand Gerben I. Beintema Jonas Ulmen Daniel Görges Roland Tóth Maarten Schoukens Martin Ruskowski Chair of Machine Tools and Control Systems RPTU Kaiserslautern and the German Research Center for Artificial Intelligence Kaiserslautern Germany Control Systems (CS) Group at the Department of Electrical Engineering Eindhoven University of Technology Netherlands. R. Tóth is also affiliated to the Systems and Control Laboratory at the Institute for Computer Science and Control Budapest Hungary Institute for Electromobility RPTU Kaiserslautern Germany

The importance of proper data normalization for deep neural networks is well known. However, in continuous-time state-space model estimation, it has been observed that improper normalization of either the hidden state or hidden state derivative of the model estimate, or even of the time interval can lead to numerical and optimization challenges with deep learning based methods. This results in a reduced model quality. In this contribution, we show that these three normalization tasks are inherently coupled. Due to the existence of this coupling, we propose a solution to all three normalization challenges by introducing a normalization constant at the state derivative level. We show that the appropriate choice of the normalization constant is related to the dynamics of the to-be-identified system and we derive multiple methods of obtaining an effective normalization constant. We compare and discuss all the normalization strategies on a benchmark problem based on experimental data from a cascaded tanks system and compare our results with other methods of the identification literature.

关键词： System Identification Continuous-Time Neural Ordinary Differential Equations Nonlinear State-Space

来源：评论

学校读者我要写书评

暂无评论

Beyond Instruction Following: Evaluating Inferential Rule Following of Large Language Models

arXiv

引用

arXiv 2024年

作者： Sun, Wangtao Zhang, Chenxiang Zhang, Xueyou Yu, Xuanqing Huang, Ziyang Xu, Haotian Chen, Pei He, Shizhu Zhao, Jun Liu, Kang The Laboratory of Cognition and Decision Intelligence for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing China CAS Engineering Laboratory for Intelligent Industrial Vision Institute of Automation Chinese Academy of Sciences Beijing China Department of Computer Science and Engineering Texas A&M University United States Shanghai Artificial Intelligence Laboratory China Xiaohongshu Inc China AI Lab AIGility Cloud Innovation Beijing China

Although Large Language Models (LLMs) have demonstrated strong instruction-following ability, they are further supposed to be controlled and guided by inferential rules in real-world scenarios to be safe, accurate, and intelligent. This demands the possession of inferential rule-following capability of LLMs. However, no prior work has made a clear evaluation of the inferential rule-following capability of LLMs. Previous studies that try to evaluate the inferential rule-following capability of LLMs fail to distinguish the inferential rule-following scenarios from the instruction-following scenarios. Therefore, this paper first clarifies the concept of inferential rule-following and proposes a comprehensive benchmark, RuleBench, to evaluate a diversified range of inferential rule-following abilities. Our experimental results on a variety of LLMs show that they are still limited in following rules. Our analysis based on the evaluation results provides insights into the improvements for LLMs toward a better inferential rule-following intelligent agent. We further propose Inferential Rule-Following Tuning (IRFT). The experimental results show that through IRFT, LLMs can learn abstract inferential rule-following abilities from purely synthetic data and then generalize to RuleBench. The data and code can be found at: https://***/r/llm-rulefollowing-B3E3/ Copyright © 2024, The Authors. All rights reserved.

关键词： Intelligent agents

来源：评论

学校读者我要写书评

暂无评论

Your transformer may not be as powerful as you expect 22

Your transformer may not be as powerful as you expect

引用

Proceedings of the 36th International Conference on Neural Information Processing Systems

作者： Shengjie Luo Shanda Li Shuxin Zheng Tie-Yan Liu Liwei Wang Di He National Key Laboratory of General Artificial Intelligence School of Intelligence Science and Technology Peking University and Zhejiang Lab Machine Learning Department School of Computer Science Carnegie Mellon University Microsoft Research National Key Laboratory of General Artificial Intelligence School of Intelligence Science and Technology Peking University and Center for Data Science Peking University National Key Laboratory of General Artificial Intelligence School of Intelligence Science and Technology Peking University

ISBN: (纸本)9781713871088

Relative Positional Encoding (RPE), which encodes the relative distance between any pair of tokens, is one of the most successful modifications to the original Transformer. As far as we know, theoretical understanding of the RPE-based Transformers is largely unexplored. In this work, we mathematically analyze the power of RPE-based Transformers regarding whether the model is capable of approximating any continuous sequence-to-sequence functions. One may naturally assume the answer is in the affirmative—RPE-based Transformers are universal function approximators. However, we present a negative result by showing there exist continuous sequence-to-sequence functions that RPE-based Transformers cannot approximate no matter how deep and wide the neural network is. One key reason lies in that most RPEs are placed in the softmax attention that always generates a right stochastic matrix. This restricts the network from capturing positional information in the RPEs and limits its capacity. To overcome the problem and make the model more powerful, we first present sufficient conditions for RPE-based Transformers to achieve universal function approximation. With the theoretical guidance, we develop a novel attention module, called Universal RPE-based (URPE) Attention, which satisfies the conditions. Therefore, the corresponding URPE-based Transformers become universal function approximators. Extensive experiments covering typical architectures and tasks demonstrate that our model is parameter-efficient and can achieve superior performance to strong baselines in a wide range of applications.

关键词：

来源：评论

学校读者我要写书评

暂无评论

CodeEnhance: A Codebook-Driven Approach for Low-Light Image Enhancement

arXiv

引用

arXiv 2024年

作者： Wu, Xu Hou, XianXu Lai, Zhihui Zhou, Jie Zhang, Ya-Nan Pedrycz, Witold Shen, Linlin The Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen518060 China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen518060 China School of AI and Advanced Computing Xi’an Jiaotong-Liverpool University China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University SZU Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society Guangdong Shenzhen518060 China The Department of Electrical & Computer Engineering University of Alberta University of Alberta Canada

Low-light image enhancement (LLIE) aims to improve low-illumination images. However, existing methods face two challenges: (1) uncertainty in restoration from diverse brightness degradations;(2) loss of texture and color information caused by noise suppression and light enhancement. In this paper, we propose a novel enhancement approach, CodeEnhance, by leveraging quantized priors and image refinement to address these challenges. In particular, we reframe LLIE as learning an image-to-code mapping from low-light images to discrete codebook, which has been learned from high-quality images. To enhance this process, a Semantic Embedding Module (SEM) is introduced to integrate semantic information with low-level features, and a Codebook Shift (CS) mechanism, designed to adapt the pre-learned codebook to better suit the distinct characteristics of our low-light dataset. Additionally, we present an Interactive Feature Transformation (IFT) module to refine texture and color information during image reconstruction, allowing for interactive enhancement based on user preferences. Extensive experiments on both real-world and synthetic benchmarks demonstrate that the incorporation of prior knowledge and controllable information transfer significantly enhances LLIE performance in terms of quality and fidelity. The proposed CodeEnhance exhibits superior robustness to various degradations, including uneven illumination, noise, and color distortion. Copyright © 2024, The Authors. All rights reserved.

关键词： Image enhancement

来源：评论

学校读者我要写书评

暂无评论

Anchor Ball Regression Model for Large-Scale 3d Skull Landmark Detection

SSRN

引用

SSRN 2023年

作者： He, Tao Xu, Guikun Cui, Li Tang, Wei Long, Jie Guo, Jixiang Machine Intelligence Laboratory College of Computer Science Sichuan University Chengdu610065 China Department of Oral and Maxillofacial Surgery West China Hospital of Stomatology Chengdu610041 China Department of Oral and Maxillofacial Surgery Daping Hospital Army Medical University Chongqing400042 China

Recent deep learning models have exhibited impressive performance in the area of 3D skull landmark detection, but most of them aimed to detect a fixed number of landmarks. This paper focuses on automatically detecting an arbitrary number of landmarks on CT volumes, which meets the real clinical needs. To achieve robust performance for detecting arbitrary molar landmarks, we propose a novel 3D landmark detection model named Anchor Ball Regression Model (ABRM), which combines landmark detection and landmark classification losses for network training. For landmark detection, a novel landmark regression loss is proposed by predicting offsets to anchor balls instead of directly predicting landmarks. For landmark classification, an online hard negative mining loss is used to reduce absent landmarks’ learning errors, and a small regularization constraint loss is performed for voxels outside the anchor balls. The network backbone of ABRM is obtained by manually pruning popular 3D-CNNs. We also present an available largescale benchmark dataset in this paper, which, to the best of our knowledge, is the largest dataset for 3D skull landmark detection. The dataset comprises of 658 CT volumes, with 14 landmarks labeled by two junior and one senior doctors. The ABRM presents a good robust performance and outperforms other models on this dataset. The codes and dataset are accessible at https:/***/ithet1007/mmld code. © 2023, The Authors. All rights reserved.

关键词： Network coding

来源：评论

学校读者我要写书评

暂无评论

Learning Physics-Informed Neural Networks without Stacked Back-propagation

arXiv

引用

arXiv 2022年

作者： He, Di Li, Shanda Shi, Wenlei Gao, Xiaotian Zhang, Jia Bian, Jiang Wang, Liwei Liu, Tie-Yan National Key Laboratory of General Artificial Intelligence School of Intelligence Science and Technology Peking University China Machine Learning Department School of Computer Science Carnegie Mellon University United States Microsoft Research Center for Data Science Peking University China

Physics-Informed Neural Network (PINN) has become a commonly used machine learning approach to solve partial differential equations (PDE). But, facing high-dimensional second-order PDE problems, PINN will suffer from severe scalability issues since its loss includes second-order derivatives, the computational cost of which will grow along with the dimension during stacked back-propagation. In this work, we develop a novel approach that can significantly accelerate the training of Physics-Informed Neural Networks. In particular, we parameterize the PDE solution by the Gaussian smoothed model and show that, derived from Stein's Identity, the second-order derivatives can be efficiently calculated without back-propagation. We further discuss the model capacity and provide variance reduction methods to address key limitations in the derivative estimation. Experimental results show that our proposed method can achieve competitive error compared to standard PINN training but is significantly faster. Our code is released at https://***/LithiumDA/PINN-without-Stacked-BP. Copyright © 2022, The Authors. All rights reserved.

关键词： Backpropagation

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：