检索结果-内蒙古大学图书馆

12th International Conference on Learning Representations, ICLR 2024

作者： Wang, Chenyu Gupta, Sharut Uhler, Caroline Jaakkola, Tommi Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology United States Eric and Wendy Schmidt Center Broad Institute of MIT and Harvard United States Laboratory for Information and Decision Systems Massachusetts Institute of Technology United States

High-throughput drug screening - using cell imaging or gene expression measurements as readouts of drug effect - is a critical tool in biotechnology to assess and understand the relationship between the chemical structure and biological activity of a drug. Since large-scale screens have to be divided into multiple experiments, a key difficulty is dealing with batch effects, which can introduce systematic errors and non-biological associations in the data. We propose InfoCORE, an Information maximization approach for COnfounder REmoval, to effectively deal with batch effects and obtain refined molecular representations. InfoCORE establishes a variational lower bound on the conditional mutual information of the latent representations given a batch identifier. It adaptively reweighs samples to equalize their implied batch distribution. Extensive experiments on drug screening data reveal InfoCORE's superior performance in a multitude of tasks including molecular property prediction and molecule-phenotype retrieval. Additionally, we show results for how InfoCORE offers a versatile framework and resolves general distribution shifts and issues of data fairness by minimizing correlation with spurious features or removing sensitive attributes. The code is available at https://***/uhlerlab/InfoCORE. © 2024 12th International Conference on Learning Representations, ICLR 2024. All rights reserved.

关键词： Systematic errors

来源：评论

学校读者我要写书评

暂无评论

Panacea: pareto alignment via preference adaptation for LLMs 24

Panacea: pareto alignment via preference adaptation for LLMs

引用

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Yifan Zhong Chengdong Ma Xiaoyuan Zhang Ziran Yang Haojun Chen Qingfu Zhang Siyuan Qi Yaodong Yang Institute for Artificial Intelligence Peking University and State Key Laboratory of General Artificial Intelligence Department of Computer Science City University of Hong Kong Yuanpei College Peking University State Key Laboratory of General Artificial Intelligence Institute for Artificial Intelligence Peking University

ISBN: (纸本)9798331314385

Current methods for large language model alignment typically use scalar human preference labels. However, this convention tends to oversimplify the multidimensional and heterogeneous nature of human preferences, leading to reduced expressivity and even misalignment. This paper presents Panacea, an innovative approach that reframes alignment as a multi-dimensional preference optimization problem. Panacea trains a single model capable of adapting online and Pareto-optimally to diverse sets of preferences without the need for further tuning. A major challenge here is using a low-dimensional preference vector to guide the model's behavior, despite it being governed by an overwhelmingly large number of parameters. To address this, Panacea is designed to use singular value decomposition (SVD)-based low-rank adaptation, which allows the preference vector to be simply injected online as singular values. Theoretically, we prove that Panacea recovers the entire Pareto front with common loss aggregation methods under mild conditions. Moreover, our experiments demonstrate, for the first time, the feasibility of aligning a single LLM to represent an exponentially vast spectrum of human preferences through various optimization methods. Our work marks a step forward in effectively and efficiently aligning models to diverse and intricate human preferences in a controllable and Pareto-optimal manner.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Tabular Insights, Visual Impacts: Transferring Expertise from Tables to Images 41

Tabular Insights, Visual Impacts: Transferring Expertise fro...

引用

41st International Conference on Machine Learning, ICML 2024

作者： Jiang, Jun-Peng Ye, Han-Jia Wang, Leye Yang, Yang Jiang, Yuan Zhan, De-Chuan School of Artificial Intelligence Nanjing University Nanjing China National Key Laboratory for Novel Software Technology Nanjing University Nanjing China Ministry of Education & School of Computer Science Peking University Beijing China School of Computer Science and Engineering Nanjing University of Science and Technology Nanjing China

Transferring knowledge across diverse data modalities is receiving increasing attention in machine learning. This paper tackles the task of leveraging expert-derived, yet expensive, tabular data to enhance image-based predictions when tabular data is unavailable during inference. The primary challenges stem from the inherent complexity of accurately mapping diverse tabular data to visual contexts, coupled with the necessity to devise distinct strategies for numerical and categorical tabular attributes. We propose CHannel tAbulaR alignment with optiMal tranSport (CHARMS), which establishes an alignment between image channels and tabular attributes, enabling selective knowledge transfer that is pertinent to visual features. Specifically, CHARMS measures similarity distributions across modalities to effectively differentiate and transfer relevant tabular features, with a focus on morphological characteristics, enhancing the capabilities of visual classifiers. By maximizing the mutual information between image channels and tabular features, knowledge from both numerical and categorical tabular attributes are extracted. Experimental results demonstrate that CHARMS not only enhances the performance of image classifiers but also improves their interpretability by effectively utilizing tabular knowledge. Copyright 2024 by the author(s)

关键词： Knowledge transfer

来源：评论

学校读者我要写书评

暂无评论

STA+: Spatiotemporal Adaptation with Adaptive Model Selection for Video Action Recognition 4

STA+: Spatiotemporal Adaptation with Adaptive Model Selectio...

引用

4th IEEE International Conference on Digital Twins and Parallel intelligence, DTPI 2024

作者： Li, Minghui Zhang, Chunjie Zheng, Xiaolong Beijing Jiaotong University Beijing Key Laboratory of Advanced Information Science and Network Technology School of Computer Science and Technology Beijing China Chinese Academy of Sciences State Key Laboratory of Multimodal Artifical Intelligence Systems Institute of Automation Beijing China University of Chinese Academy of Sciences School of Artificial Intelligence Beijing China

ISBN: (纸本)9798350349252

Recent breakthroughs in video models have achieved remarkable success by integrating vision transformers into the video domain through adaptation. However, prevalent approaches in existing literature often entail a single branch, incorporating additional spatiotemporal learning modules. This approach cannot fully satisfy the unique and targeted learning requirements of temporal and spatial representations. It lacks a well-balanced spatiotemporal understanding of videos, particularly in recognizing human actions, which requires a comprehensive understanding of space and time. In this study, we introduce a novel two-stream architecture named SpatioTemporal Adaptation with Adaptive Model Selection (STA+) to achieve synchronized spatiotemporal understanding of video with only RGB inputs. We propose an adaptive model selection method based on the intrinsic categorization judgment of the samples to enhance overall performance. We validate the effectiveness of our proposed method through rigorous experiments conducted on public benchmarks such as Diving-48 and Something-Something- V2. Our method consistently achieves competitive performance on these datasets. © 2024 IEEE.

关键词： adaptation spatiotemporal Video action recognition

来源：评论

学校读者我要写书评

暂无评论

When Does Sora Show:The Beginning of TAO to Imaginative intelligence and Scenarios Engineering

引用

IEEE/CAA Journal of Automatica Sinica 2024年第4期11卷 809-815页

作者： Fei-Yue Wang Qinghai Miao Lingxi Li Qinghua Ni Xuan Li Juanjuan Li Lili Fan Yonglin Tian Qing-Long Han School of Artificial Intelligence University of Chinese Academy of SciencesBeijing 100049China State Key Laboratory for Management and Control of Complex Systems Chinese Academy of SciencesBeijing 100190China Faculty of Innovation Engineering Macao University of Science and TechnologyMacao 999078China Department of Electrical and Computer Engineering Indiana University-Purdue University IndianapolisIndianapolisIN 46202USA Faculty of Innovation Engineering Macao University of Science and TechnologyMacao 999078China Virtual Reality Fundamental Research Laboratory Department of Mathematics and TheoriesPeng Cheng LaboratoryShenzhen 518000China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of AutomationChinese Academy of SciencesBeijing 100190China School of Information and Electronics Beijing Institute of TechnologyBeijing 100081China School of Science Computing and Engineering TechnologiesSwinburne University of TechnologyMelbourneVIC 3122Australia

DURING our discussion at workshops for writing“What Does ChatGPT Say:The DAO from Algorithmic intelligence to Linguistic intelligence”[1],we had expected the next milestone for artificial intelligence(AI)would be in the direction of Imaginative intelligence(II),i.e.,something similar to automatic wordsto-videos generation or intelligent digital movies/theater technology that could be used for conducting new“Artificiofactual Experiments”[2]to replace conventional“Counterfactual Experiments”in scientific research and technical development for both natural and social studies[2]-[6].Now we have OpenAI’s Sora,so soon,but this is not the final,actually far away,and it is just the beginning.

关键词： something intelligence replace

来源：评论

学校读者我要写书评

暂无评论

Vision Transformer Based Hash Coding for Efficient Image and Audio Retrieval with Global and Local Equilibrium Distance Constraints

Vision Transformer Based Hash Coding for Efficient Image and...

引用

2024 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2024

作者： Liu, Ye Pan, Yan Yin, Jian School of Computer Science and Engineering Sun Yat-sen University Guangzhou China Guangdong Key Laboratory of Big Data Analysis and Processing Guangzhou China Lizhi Inc. Artificial Intelligence and Big Data Department Guangzhou Beijing China School of Artificial Intelligence Sun Yat-sen University Zhuhai China

ISBN: (纸本)9781665410205

With the application of efficient retrieval in information systems and retrieval augmented generation with vector database for large language models, hash coding algorithms have made progress in recent years. The rise of transformer technology in the field of deep learning has brought the possibility to further improve the effect of hash coding algorithms. We introduce the vision transformer framework to both images and audios, and propose a novel approach for the tasks of multi-label image retrieval and audio event retrieval. In the proposed hash coding model, global and local equilibrium distance constraints are integrated, so that the hash codes for images can be better obtained through the global hash centers and local similar samples. In order to realize end-to-end training and hash code generation for audios, we adopt the adapter of mel spectrogram, thus the proposed approach can be simply converted and applied to audio hash coding. Comparative experiments verify that better results can be achieved on multiple image and audio datasets. © 2024 IEEE.

关键词： Image coding

来源：评论

学校读者我要写书评

暂无评论

Lay CO:Achieving Least Lossy Accuracy for Most Efficient RRAM-Based Deep Neural Network Accelerator via Layer-Centric Co-Optimization

引用

计算机科学技术学报（英文版） 2023年第2期38卷 328-347页

作者： Shao-Feng Zhao Fang Wang Bo Liu Dan Feng Yang Liu Wuhan National Laboratory for Optoelectronics Huazhong University of Science and TechnologyWuhan 430074China School of Computer Science and Technology Huazhong University of Science and TechnologyWuhan 430074China Cloud Computing and Big Data Institute Henan University of Economics and LawZhengzhou 450001China Wuhan National Laboratory for Optoelectronics Huazhong University of Science and TechnologyWuhan 430074China School of Computer Science and Technology Huazhong University of Science and TechnologyWuhan 430074China Research Institute of Huazhong University of Science and Technology in Shenzhen Shenzhen 518057China School of Computer and Artificial Intelligence Zhengzhou UniversityZhengzhou 450001China Wuhan National Laboratory for Optoelectronics Huazhong University of Science and TechnologyWuhan 430074China School of Computer Science and Technology Huazhong University of Science and TechnologyWuhan 430074China Cloud Computing and Big Data Institute Henan University of Economics and LawZhengzhou 450001China

Resistive random access memory(RRAM)enables the functionality of operating massively parallel dot prod-ucts and ***-based accelerator is such an effective approach to bridging the gap between Internet of Things devices'constrained resources and deep neural networks'tremendous *** to the huge overhead of Analog to Digital(A/D)and digital accumulations,analog RRAM buffer is introduced to extend the processing in analog and in *** analog RRAM buffer offers potential solutions to A/D conversion issues,the energy consumption is still challenging in resource-constrained environments,especially with enormous intermediate data ***,criti-cal concerns over endurance must also be resolved before the RRAM buffer could be frequently used in reality for DNN in-ference *** we propose LayCO,a layer-centric co-optimizing scheme to address the energy and endurance con-cerns altogether while strictly providing an inference accuracy *** relies on two key ideas:1)co-optimizing with reduced supply voltage and reduced bit-width of accelerator architectures to increase the DNN's error tolerance and achieve the accelerator's energy efficiency,and 2)efficiently mapping and swapping individual DNN data to a correspond-ing RRAM partition in a way that meets the endurance *** evaluation with representative DNN models demonstrates that LayCO outperforms the baseline RRAM buffer based accelerator by 27x improvement in energy effi-ciency(over TIMELY-like configuration),308x in lifetime prolongation and 6x in area reduction(over RAQ)while main-taining the DNN accuracy loss less than 1％.

关键词： deep learning accelerator resistive random access memory (RRAM) energy efficiency error tolerance

来源：评论

学校读者我要写书评

暂无评论

CrossFuse: A Novel Cross Attention Mechanism based Infrared and Visible Image Fusion Approach

arXiv

引用

arXiv 2024年

作者： Li, Hui Wu, Xiao-Jun International Joint Laboratory on Artificial Intelligence of Jiangsu Province School of Artificial Intelligence and Computer Science Jiangnan University Wuxi 214122 China

Multimodal visual information fusion aims to integrate the multi-sensor data into a single image which contains more complementary information and less redundant features. However the complementary information is hard to extract, especially for infrared and visible images which contain big similarity gap between these two modalities. The common cross attention modules only consider the correlation, on the contrary, image fusion tasks need focus on complementarity (uncorrelation). Hence, in this paper, a novel cross attention mechanism (CAM) is proposed to enhance the complementary information. Furthermore, a two-stage training strategy based fusion scheme is presented to generate the fused images. For the first stage, two auto-encoder networks with same architecture are trained for each modality. Then, with the fixed encoders, the CAM and a decoder are trained in the second stage. With the trained CAM, features extracted from two modalities are integrated into one fused feature in which the complementary information is enhanced and the redundant features are reduced. Finally, the fused image can be generated by the trained decoder. The experimental results illustrate that our proposed fusion method obtains the SOTA fusion performance compared with the existing fusion networks. The codes of our fusion method will be available soon. Copyright © 2024, The Authors. All rights reserved.

关键词： Image fusion

来源：评论

学校读者我要写书评

暂无评论

Attention-Based Residual Dense Shrinkage Network for ECG Denoising

引用

computer Modeling in Engineering & sciences 2024年第3期138卷 2809-2824页

作者： Dengyong Zhang Minzhi Yuan Feng Li Lebing Zhang Yanqiang Sun Yiming Ling Hunan Provincial Key Laboratory of Intelligent Processing of Big Data on Transportation Changsha University of Science and TechnologyChangsha410114China School of Computer and Communication Engineering Changsha University of Science and TechnologyChangsha410114China School of Computer and Artificial Intelligence Huaihua UniversityHuaihua418000China School of Computer National University of Defense TechnologyChangsha410073China New Energy Centralized Control Center CHN Energy Hunan Power New Energy Co.Ltd.Changsha410000China

Electrocardiogram(ECG)signal is one of the noninvasive physiological measurement techniques commonly usedin cardiac ***,in real scenarios,the ECGsignal is susceptible to various noise erosion,which affectsthe subsequent pathological ***,the effective removal of the noise from ECG signals has becomea top priority in cardiac diagnostic *** at the problem of incomplete signal shape retention andlow signal-to-noise ratio(SNR)after denoising,a novel ECG denoising network,named attention-based residualdense shrinkage network(ARDSN),is proposed in this ***,the shallow ECG characteristics are extractedby a shallow feature extraction network(SFEN).Then,the residual dense shrinkage attention block(RDSAB)isused for adaptive noise ***,feature fusion representation(FFR)is performed on the hierarchicalfeatures extracted by a series of RDSABs to reconstruct the de-noised ECG *** on the MIT-BIHarrhythmia database and MIT-BIH noise stress test database indicate that the proposed scheme can effectively resistthe interference of different sources of noise on the ECG signal.

关键词： Electrocardiogram signal denoising signal-to-noise ratio attention-based residual dense shrinkage network MIT-BIH

来源：评论

学校读者我要写书评

暂无评论

Automatic recognition of white blood cell images with memory efficient superpixel metric GNN: SMGNN

引用

Mathematical Biosciences and Engineering 2024年第2期21卷 2163-2188页

作者： Jiang, Yuanhong Shen, Yiqing Wang, Yuguang Ding, Qiaoqiao School of Mathematical Sciences MOE-LSC Shanghai Jiao Tong University Shanghai200030 China Institute of Natural Sciences Shanghai Jiao Tong University Shanghai200030 China Department of Computer Science Johns Hopkins University United States Shanghai Artificial Intelligence Laboratory Shanghai200433 China

An automatic recognizing system of white blood cells can assist hematologists in the diagnosis of many diseases, where accuracy and efficiency are paramount for computer-based systems. In this paper, we presented a new image processing system to recognize the five types of white blood cells in peripheral blood with marked improvement in efficiency when juxtaposed against mainstream methods. The prevailing deep learning segmentation solutions often utilize millions of parameters to extract high-level image features and neglect the incorporation of prior domain knowledge, which consequently consumes substantial computational resources and increases the risk of overfitting, especially when limited medical image samples are available for training. To address these challenges, we proposed a novel memory-efficient strategy that exploits graph structures derived from the images. Specifically, we introduced a lightweight superpixel-based graph neural network (GNN) and broke new ground by introducing superpixel metric learning to segment nucleus and cytoplasm. Remarkably, our proposed segmentation model superpixel metric graph neural network (SMGNN) achieved state of the art segmentation performance while utilizing at most 10000× less than the parameters compared to existing approaches. The subsequent segmentation-based cell type classification processes showed satisfactory results that such automatic recognizing algorithms are accurate and efficient to execeute in hematological laboratories. Our code is publicly available at https://***/jyh6681/SPXL-GNN. © 2024 the Author(s).

关键词： Cells

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：