检索结果-内蒙古大学图书馆

DNACoder: a CNN-LSTM attention-based network for genomic sequence data compression

Neural Computing and Applications 2024年第29期36卷 18363-18376页

作者： Sheena, K.S. Nair, Madhu S. Artificial Intelligence & amp Computer Vision Lab Department of Computer Science Cochin University of Science and Technology Kerala Kochi682022 India

Genomic sequencing has become increasingly prevalent, generating massive amounts of data and facing a significant challenge in long-term storage and transmission. A solution that reduces the storage and transfer requirements without compromising data integrity is needed. The effectiveness of neural networks has already been endorsed in tasks like image and speech compression. Adapting them to recognize the intricate patterns in genomic sequences could help to find more redundancies and reduce storage requirements. The proposed method, called DNACoder, leverages deep learning techniques to achieve significant compression ratios while preserving the essential information in genomic data and offers a high-performance compression for genomic sequences in any data format. The results of the experiments clearly demonstrate the effectiveness of the method and its potential applications in genomic data storage. Our proposed method improves compression by 21.1% on bits per base compared to existing compressors on the benchmarked dataset. By using a deep learning prediction model that is structured as a convolutional layer followed by an attention-based long short-term memory network, we propose a novel lossless and reference-free compression approach (DNACoder), which can also be utilized as a reference-based compressor. The experimental outcome on the tested data illustrates that the advocated compression algorithm’s CNN-LSTM model makes generalizations effectively for genomic sequence data and outperforms the state-of-the-art methods. © The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2024.

关键词： Long short-term memory

来源：评论

学校读者我要写书评

暂无评论

ChemDFM-X: towards large multimodal model for chemistry

引用

science China(Information sciences) 2024年第12期67卷 99-100页

作者： Zihan ZHAO Bo CHEN Jingpiao LI Lu CHEN Liyang WEN Pengyu WANG Zichen ZHU Danyang ZHANG Yansi LI Zhongyang DAI Xin CHEN Kai YU X-LANCE Lab Department of Computer Science and EngineeringMoE Key Lab of Artificial Intelligence AI Institute Shanghai Jiao Tong University Suzhou Laboratory

Chemistry, as a naturally multimodal discipline, plays a crucial role in various vital fields such as pharmaceutical research and material manufacturing. Therefore, research on artificial intelligence(AI) for chemistry has garnered increasing attention. Despite the rapid development, most of the chemical AI models today mainly focus on single tasks with unimodal input [1].

关键词：

来源：评论

学校读者我要写书评

暂无评论

A survey on cross-user federated recommendation

引用

science China(Information sciences) 2025年第4期68卷 7-32页

作者： Enyue YANG Yudi XIONG Wei YUAN Weike PAN Qiang YANG Zhong MING College of Computer Science and Software Engineering Shenzhen University School of Electrical Engineering and Computer Science The University of Queensland WeBank AI Lab WeBank Department of Computer Science and Engineering Hong Kong University of Science and Technology College of Big Data and Internet Shenzhen Technology University Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)

Recommender systems are effective in mitigating information overload, yet the centralized storage of user data raises significant privacy concerns. Cross-user federated recommendation(CUFR) provides a promising distributed paradigm to address these concerns by enabling privacy-preserving recommendations directly on user devices. In this survey, we review and categorize current progress in CUFR, focusing on four key aspects: privacy, security, accuracy, and efficiency. Firstly,we conduct an in-depth privacy analysis, discuss various cases of privacy leakage, and then review recent methods for privacy protection. Secondly, we analyze security concerns and review recent methods for untargeted and targeted *** untargeted attack methods, we categorize them into data poisoning attack methods and parameter poisoning attack methods. For targeted attack methods, we categorize them into user-based methods and item-based methods. Thirdly,we provide an overview of the federated variants of some representative methods, and then review the recent methods for improving accuracy from two categories: data heterogeneity and high-order information. Fourthly, we review recent methods for improving training efficiency from two categories: client sampling and model compression. Finally, we conclude this survey and explore some potential future research topics in CUFR.

关键词： cross-user federated recommendation federated recommendation federated learning recommender systems user privacy

来源：评论

学校读者我要写书评

暂无评论

UP2ME: Univariate Pre-training to Multivariate Fine-tuning as a General-purpose Framework for Multivariate Time Series Analysis 41

UP2ME: Univariate Pre-training to Multivariate Fine-tuning a...

引用

41st International Conference on Machine Learning, ICML 2024

作者： Zhang, Yunhao Liu, Minghao Zhou, Shengyang Yan, Junchi School of Artificial Intelligence Department of Computer Science and Engineering MoE Key Lab of Artificial Intelligence Shanghai Jiao Tong University China

Despite the success of self-supervised pre-training in texts and images, applying it to multivariate time series (MTS) falls behind tailored methods for tasks like forecasting, imputation and anomaly *** propose a general-purpose framework, named UP2ME (Univariate Pre-training to Multivariate Fine-tuning).It conducts task-agnostic pre-training when downstream tasks are *** the task and setting (*** length) are determined, it gives sensible solutions with frozen pre-trained parameters, which has not been achieved ***2ME is further refined by fine-tuning.A univariate-to-multivariate paradigm is devised to address the heterogeneity of temporal and cross-channel *** univariate pre-training, univariate instances with diverse lengths are generated for Masked AutoEncoder (MAE) pre-training, discarding cross-channel *** pretrained model handles downstream tasks by formulating them into specific mask-reconstruction *** multivariate fine-tuning, it constructs a dependency graph among channels using the pre-trained encoder to enhance cross-channel dependency *** on eight real-world datasets show its SOTA performance in forecasting and imputation, approaching task-specific performance in anomaly *** code is available at https://***/Thinklab-SJTU/UP2ME. Copyright 2024 by the author(s)

关键词： Time series

来源：评论

学校读者我要写书评

暂无评论

SinGRAV: Learning a Generative Radiance Volume from a Single Natural Scene

引用

Journal of computer science & Technology 2024年第2期39卷 305-319页

作者：王玉洁陈学霖陈宝权 School of Computer Science and Technology Shandong UniversityQingdao 266237China State Key Laboratory of General Artificial Intelligence Beijing 100871China School of Intelligence Science and Technology Peking UniversityBeijing 100871China Tencent AI Lab Tencent Holdings LimitedShenzhen 518057China

We present SinGRAV, an attempt to learn a generative radiance volume from multi-view observations of a single natural scene, in stark contrast to existing category-level 3D generative models that learn from images of many object-centric scenes. Inspired by SinGAN, we also learn the internal distribution of the input scene, which necessitates our key designs w.r.t. the scene representation and network architecture. Unlike popular multi-layer perceptrons (MLP)-based architectures, we particularly employ convolutional generators and discriminators, which inherently possess spatial locality bias, to operate over voxelized volumes for learning the internal distribution over a plethora of overlapping regions. On the other hand, localizing the adversarial generators and discriminators over confined areas with limited receptive fields easily leads to highly implausible geometric structures in the spatial. Our remedy is to use spatial inductive bias and joint discrimination on geometric clues in the form of 2D depth maps. This strategy is effective in improving spatial arrangement while incurring negligible additional computational cost. Experimental results demonstrate the ability of SinGRAV in generating plausible and diverse variations from a single scene, the merits of SinGRAV over state-of-the-art generative neural scene models, and the versatility of SinGRAV by its use in a variety of applications. Code and data will be released to facilitate further research.

关键词： generative model neural radiance field 3D scene generation

来源：评论

学校读者我要写书评

暂无评论

SpikingMiniLM: energy-efficient spiking transformer for natural language understanding

引用

science China(Information sciences) 2024年第10期67卷 115-128页

作者： Jiayu ZHANG Jiangrong SHEN Zeke WANG Qinghai GUO Rui YAN Gang PAN Huajin TANG College of Computer Science and Technology Zhejiang University The State Key Lab of Brain-Machine Intelligence Zhejiang University Collaborative Innovation Center of Artificial Intelligence Zhejiang University Advanced Computing and Storage Laboratory Huawei Technologies Co. Ltd. College of Computer Science and Technology Zhejiang University of Technology MOE Frontier Science Center for Brain Science and Brain-Machine Integration Zhejiang University

In the era of large-scale pretrained models, artificial neural networks（ANNs） have excelled in natural language understanding（NLU） tasks. However, their success often necessitates substantial computational resources and energy consumption. To address this, we explore the potential of spiking neural networks（SNNs） in NLU——a promising avenue with demonstrated advantages, including reduced power consumption and improved efficiency due to their event-driven characteristics. We propose the SpikingMiniLM,a novel spiking Transformer model tailored for natural language understanding. We first introduce a multi-step encoding method to convert text embeddings into spike trains. Subsequently, we redesign the attention mechanism and residual connections to make our model operate on the pure spike-based paradigm without any normalization technique. To facilitate stable and fast convergence, we propose a general parameter initialization method grounded in the stable firing rate principle. Furthermore, we apply an ANN-to-SNN knowledge distillation to overcome the challenges of pretraining SNNs. Our approach achieves a macro-average score of 75.5 on the dev sets of the GLUE benchmark, retaining 98% of the performance exhibited by the teacher model MiniLMv2. Our smaller model also achieves similar performance to BERTMINIwith fewer parameters and much lower energy consumption, underscoring its competitiveness and resource efficiency in NLU tasks.

关键词： spiking neural networks natural language understanding spiking Transformer spike-based attention multi-step encoding ANN-to-SNN distillation

来源：评论

学校读者我要写书评

暂无评论

Characterizing the app recommendation relationships in the iOS app store: a complex network's perspective

引用

science China(Information sciences) 2025年第4期68卷 284-299页

作者： Gang HUANG Fuqi LIN Yun MA Haoyu WANG Qingxiang WANG Gareth TYSON Xuanzhe LIU Key Lab of High Confidence Software Technologies (Peking University) Ministry of Education School of Computer Science Peking University Institute for Artificial Intelligence Peking University School of Cyber Science and Engineering Huazhong University of Science and Technology Alibaba Group Hong Kong University of Science and Technology (Guangzhou)

Mobile apps have become widely adopted in our daily lives. To facilitate app discovery, most app markets provide recommendations for users, which may significantly impact how apps are accessed. However, little has been known about the underlying relationships and how they reflect(or affect) user behaviors. To fill this gap, we characterize the app recommendation relationships in the i OS app store from the perspective of the complex network. We collect a dataset containing over 1.3 million apps and 50 million app recommendations. This dataset enables us to construct a complex network that captures app recommendation relationships. Through this, we explore the recommendation relationships between mobile apps and how these relationships reflect or affect user behavior patterns. The insights gained from our research can be valuable for understanding typical user behaviors and identifying potential policy-violating apps.

关键词： mobile app recommendation complex network user behavior policy-violating app

来源：评论

学校读者我要写书评

暂无评论

Synthetic Socio-Technical Systems: Poiêsis as Meaning Making

引用

Philosophy and Technology 2024年第3期37卷 94页

作者： Bisconti, Piercosma McIntyre, Andrew Russo, Federica Artificial Intelligence and Intelligent Systems Lab Interuniversity Consortium for Computer Science University of Amsterdam University of Utrecht University College London DEXAI - Artificial Ethics

With the recent renewed interest in AI, the field has made substantial advancements, particularly in generative systems. Increased computational power and the availability of very large datasets has enabled systems such as ChatGPT to effectively replicate aspects of human social interactions, such as verbal communication, thus bringing about profound changes in society. In this paper, we explain that the arrival of generative AI systems marks a shift from ‘interacting through’ to ‘interacting with’ technologies and calls for a reconceptualization of socio-technical systems as we currently understand them. We dub this new generation of socio-technical systems synthetic to signal the increased interactions between human and artificial agents, and, in the footsteps of philosophers of information, we cash out agency in terms of ‘poiêsis’. We close the paper with a discussion of the potential policy implications of synthetic socio-technical system. © The Author(s) 2024.

关键词： Actor-network theory Generative AI Philosophy of technology Poietic agent Socio-technical systems

来源：评论

学校读者我要写书评

暂无评论

A glance at in-context learning

引用

Frontiers of computer science 2024年第5期18卷 231-232页

作者： Yongliang WU Xu YANG School of Computer Science&Engineering Key Lab of New Generation Artificial Intelligence Technology&Its Interdisciplinary Applications(Ministry of Education)Southeast UniversityNanjing 211189China

The advent of large scale models such as CLIP[1],GPT-2[2],and GPT-3[3]has marked a significant shift in the field of artificial intelligence(AI).Unlike the early days of Al,characterized by the design of distinct models or the utilization of pre-trained models for fine-tuning in specific tasks,these modern models adopt a unified approach.

关键词： such has unified

来源：评论

学校读者我要写书评

暂无评论

INDISCRIMINATE POISONING ATTACKS ON UNSUPERVISED CONTRASTIVE LEARNING 11

INDISCRIMINATE POISONING ATTACKS ON UNSUPERVISED CONTRASTIVE...

引用

11th International Conference on Learning Representations, ICLR 2023

作者： He, Hao Zha, Kaiwen Katabi, Dina Computer Science and Artificial Intelligence Lab Massachusetts Institute of Technology United States

Indiscriminate data poisoning attacks are quite effective against supervised learning. However, not much is known about their impact on unsupervised contrastive learning (CL). This paper is the first to consider indiscriminate poisoning attacks of contrastive learning. We propose Contrastive Poisoning (CP), the first effective such attack on CL. We empirically show that Contrastive Poisoning, not only drastically reduces the performance of CL algorithms, but also attacks supervised learning models, making it the most generalizable indiscriminate poisoning attack. We also show that CL algorithms with a momentum encoder are more robust to indiscriminate poisoning, and propose a new countermeasure based on matrix completion. Code is available at: https://***/kaiwenzha/contrastive-poisoning. © 2023 11th International Conference on Learning Representations, ICLR 2023. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：