检索结果-内蒙古大学图书馆

arXiv 2023年

作者： Zhang, Hailin Wang, Yujing Chen, Qi Chang, Ruiheng Zhang, Ting Miao, Ziming Hou, Yingyan Ding, Yang Miao, Xupeng Wang, Haonan Pang, Bochen Zhan, Yuefeng Sun, Hao Deng, Weiwei Zhang, Qi Yang, Fan Xie, Xing Yang, Mao Cui, Bin School of Computer Science Key Lab of High Confidence Software Technologies Peking University China Microsoft United States Aerospace Information Research Institute Key Laboratory of Target Cognition and Application Technology Chinese Academy of Sciences China Institute of Information Engineering Chinese Academy of Sciences China Carnegie Mellon University United States National University of Singapore Singapore National Engineering Laboratory for Big Data Analysis and Applications Peking University China

Embedding-based retrieval methods construct vector indices to search for document representations that are most similar to the query representations. They are widely used in document retrieval due to low latency and decent recall performance. Recent research indicates that deep retrieval solutions offer better model quality, but are hindered by unacceptable serving latency and the inability to support document updates. In this paper, we aim to enhance the vector index with endto- end deep generative models, leveraging the differentiable advantages of deep retrieval models while maintaining desirable serving efficiency. We propose Modelenhanced Vector Index (MEVI), a differentiable model-enhanced index empowered by a twin-tower representation model. MEVI leverages a Residual Quantization (RQ) codebook to bridge the sequence-to-sequence deep retrieval and embeddingbased models. To substantially reduce the inference time, instead of decoding the unique document ids in long sequential steps, we first generate some semantic virtual cluster ids of candidate documents in a small number of steps, and then leverage the well-adapted embedding vectors to further perform a fine-grained search for the relevant documents in the candidate virtual clusters. We empirically show that our model achieves better performance on the commonly used academic benchmarks MSMARCO Passage and Natural Questions, with comparable serving latency to dense retrieval solutions. Copyright © 2023, The Authors. All rights reserved.

关键词： Embeddings

来源：评论

学校读者我要写书评

暂无评论

An Equivariant Generative Framework for Molecular Graph-Structure Co-Design

arXiv

引用

arXiv 2023年

作者： Zhang, Zaixi Liu, Qi Lee, Chee-Kong Hsieh, Chang-Yu Chen, Enhong Anhui Province Key Lab of Big Data Analysis and Application University of Science and Technology of China Anhui Hefei230026 China State Key Laboratory of Cognitive Intelligence Anhui Hefei230088 China Tencent America Palo AltoCA94306 United States Innovation Institute for Artificial Intelligence Medicine of Zhejiang University College of Pharmaceutical Sciences Zhejiang University Zhejiang Hangzhou310058 China

Designing molecules with desirable physiochemical properties and functionalities is a long-standing challenge in chemistry, material science, and drug discovery. Recently, machine learning-based generative models have emerged as promising approaches for de novo molecule design. However, further refinement of methodology is highly desired as most existing methods lack unified modeling of 2D topology and 3D geometry information and fail to effectively learn the structure-property relationship for molecule design. Here we present MolCode, a roto-translation equivariant generative framework for Molecular graph-structure Co-design. In MolCode, 3D geometric information empowers the molecular 2D graph generation, which in turn helps guide the prediction of molecular 3D structure. Extensive experimental results show that MolCode outperforms previous methods on a series of challenging tasks including de novo molecule design, targeted molecule discovery, and structure-based drug design. Particularly, MolCode not only consistently generates valid (99.95% Validity) and diverse (98.75% Uniqueness) molecular graphs/structures with desirable properties, but also generate drug-like molecules with high affinity to target proteins (61.8% high affinity ratio), which demonstrates MolCode’s potential applications in material design and drug discovery. Our extensive investigation reveals that the 2D topology and 3D geometry contain intrinsically complementary information in molecule design, and provides new insights into machine learning-based molecule representation and generation. © 2023, CC BY-NC-SA.

关键词： Molecules

来源：评论

学校读者我要写书评

暂无评论

Boosting Factorization Machines via Saliency-Guided Mixup

arXiv

引用

arXiv 2022年

作者： Wu, Chenwang Lian, Defu Ge, Yong Zhou, Min Chen, Enhong Tao, Dacheng School of Data Science University of Science and Technology of China Anhui Hefei230000 China Anhui Province Key Laboratory of Big Data Analysis and Application School of Computer Science and Technology University of Science and Technology of China Anhui Hefei230000 China Eller College of Management University of Arizona United States Huawei Noah’s Ark Lab Hong Kong JD Explore Academy in *** China University of Sydney Australia

Factorization machines (FMs) are widely used in recommender systems due to their adaptability and ability to learn from sparse data. However, for the ubiquitous non-interactive features in sparse data, existing FMs can only estimate the parameters corresponding to these features via the inner product of their embeddings. Undeniably, they cannot learn the direct interactions of these features, which limits the model’s expressive power. To this end, we first present MixFM, inspired by Mixup, to generate auxiliary training data to boost FMs. Unlike existing augmentation strategies that require labor costs and expertise to collect additional information such as position and fields, these extra data generated by MixFM only by the convex combination of the raw ones without any professional knowledge support. More importantly, if the parent samples to be mixed have non-interactive features, MixFM will establish their direct interactions. Second, considering that MixFM may generate redundant or even detrimental instances, we further put forward a novel Factorization Machine powered by Saliency-guided Mixup (denoted as SMFM). Guided by the customized saliency, SMFM can generate more informative neighbor data. Through theoretical analysis, we prove that the proposed methods minimize the upper bound of the generalization error, which hold a beneficial effect on enhancing FMs. Significantly, we give the first generalization bound of FM, implying the generalization requires more data and a smaller embedding size under the sufficient representation capability. Finally, extensive experiments on five datasets confirm that our approaches are superior to baselines. Besides, the results show that"poisoning" mixed data is likewise beneficial to the FM variants. Copyright © 2022, The Authors. All rights reserved.

关键词： Recommender systems

来源：评论

学校读者我要写书评

暂无评论

Model-enhanced vector index 23

Model-enhanced vector index

引用

Proceedings of the 37th International Conference on Neural Information Processing Systems

作者： Hailin Zhang Yujing Wang Qi Chen Ruiheng Chang Ting Zhang Ziming Miao Yingyan Hou Yang Ding Xupeng Miao Haonan Wang Bochen Pang Yuefeng Zhan Hao Sun Weiwei Deng Qi Zhang Fan Yang Xing Xie Mao Yang Bin Cui School of Computer Science & Key Lab of High Confidence Software Technologies Peking University and Microsoft Microsoft Microsoft and Aerospace Information Research Institute & Key Laboratory of Target Cognition and Application Technology Chinese Academy of Sciences Microsoft and Institute of Information Engineering Chinese Academy of Sciences Carnegie Mellon University National University of Singapore School of Computer Science & Key Lab of High Confidence Software Technologies Peking University and National Engineering Laboratory for Big Data Analysis and Applications Peking University

Embedding-based retrieval methods construct vector indices to search for document representations that are most similar to the query representations. They are widely used in document retrieval due to low latency and decent recall performance. Recent research indicates that deep retrieval solutions offer better model quality, but are hindered by unacceptable serving latency and the inability to support document updates. In this paper, we aim to enhance the vector index with end-to-end deep generative models, leveraging the differentiable advantages of deep retrieval models while maintaining desirable serving efficiency. We propose Model-enhanced Vector Index (MEVI), a differentiable model-enhanced index empowered by a twin-tower representation model. MEVI leverages a Residual Quantization (RQ) codebook to bridge the sequence-to-sequence deep retrieval and embedding-based models. To substantially reduce the inference time, instead of decoding the unique document ids in long sequential steps, we first generate some semantic virtual cluster ids of candidate documents in a small number of steps, and then leverage the well-adapted embedding vectors to further perform a fine-grained search for the relevant documents in the candidate virtual clusters. We empirically show that our model achieves better performance on the commonly used academic benchmarks MSMARCO Passage and Natural Questions, with comparable serving latency to dense retrieval solutions.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Full-Atom Protein Pocket Design via Iterative Refinement

arXiv

引用

arXiv 2023年

作者： Zhang, Zaixi Lu, Zepu Hao, Zhongkai Zitnik, Marinka Liu, Qi Anhui Province Key Lab of Big Data Analysis and Application School of Computer Science and Technology University of Science and Technology of China China State Key Laboratory of Cognitive Intelligence Anhui Hefei China Dept. of Comp. Sci. and Tech. Institute for AI THBI Lab BNRist Center Tsinghua-Bosch Joint ML Center Tsinghua China Harvard University United States

The design of de novo functional proteins that bind specific ligand molecules is paramount in therapeutics and bio-engineering. A critical yet formidable task in this endeavor is the design of the protein pocket, which is the cavity region of the protein where the ligand binds. Current methods are plagued by inefficient generation, inadequate context modeling of the ligand molecule, and the inability to generate side-chain atoms. Here, we present the Full-Atom Iterative Refinement (FAIR) method, designed to address these challenges by facilitating the co-design of protein pocket sequences, specifically residue types, and their corresponding 3D structures. FAIR operates in two steps, proceeding in a coarse-to-fine manner (transitioning from protein backbone to atoms, including side chains) for a full-atom generation. In each iteration, all residue types and structures are simultaneously updated, a process termed full-shot refinement. In the initial stage, the residue types and backbone coordinates are refined using a hierarchical context encoder, complemented by two structure refinement modules that capture both inter-residue and pocket-ligand interactions. The subsequent stage delves deeper, modeling the side-chain atoms of the pockets and updating residue types to ensure sequence-structure congruence. Concurrently, the structure of the binding ligand is refined across iterations to accommodate its inherent flexibility. Comprehensive experiments show that FAIR surpasses existing methods in designing superior pocket sequences and structures, producing average improvement exceeding 10% in AAR and RMSD metrics. FAIR is available at https://***/zaixizhang/FAIR. © 2023, CC BY.

关键词： Atoms

来源：评论

学校读者我要写书评

暂无评论

Identification of soybean in Argentina using Sentinel-2 composite images

引用

International Journal of Agricultural and Biological Engineering 2024年第5期17卷 266-274页

作者： Linsheng Huang Yue Chen Yuhao Pan Zihang Lou Shijun Zheng Xiaoyang Zhang Le Yu Shengwei Liu Dailiang Peng National Engineering Research Center for Agro-Ecological Big Data Analysis&Application Anhui UniversityHefei 230601China Key Laboratory of Digital Earth Science Aerospace Information Research InstituteChinese Academy of SciencesBeijing 100094China Research Area of Ecology and Biodiversity School of Biological SciencesThe University of Hong KongPokfulamHong KongChina College of Environmental and Resource Sciences Zhejiang UniversityHangzhou 310058China Department of Earth System Science Ministry of Education Key Laboratory for Earth System ModelingInstitute for Global Change StudiesTsinghua UniversityBeijing 100084China Geospatial Sciences Center of Excellence Department of Geography&Geospatial SciencesSouth Dakota State UniversityBrookingsSD 57007USA Ministry of Education Ecological Field Station for East Asian Migratory Birds Beijing 100084China Tsinghua University(Department of Earth System Science)-Xi’an Institute of Surveying and Mapping Joint Research Center for Next-Generation Smart Mapping Beijing 100084China School of Surveying and Land Information Engineering Henan Polytechnic UniversityJiaozuo 454000HenanChina

Soybean is one of the most important oil crops, and Argentina is the third-largest soybean producer in the world, accounting for 17% of the global soybean yield. Timely and accurate information on soybean spatial distribution is critical for ensuring global food security. Sentinel-2 multispectral data and machine learning classification models are used to investigate the potential of soybean identification in the early stage of the growing season in Argentina, with the help of Google Earth Engine (GEE). The earliest time window and optimal feature set for soybean identification are explored. Results are as follows: 1) the random forest (RF) classification model demonstrated the highest level of classification accuracy compared to the backpropagation neural network (BPNN), support vector machine (SVM), and naive Bayes (NB) models;2) Soybean can be accurately identified as early as the end of February (filling stage), which is approximately one month before harvest;3) The optimal feature-subset can reduce the amount of input data by 80% while maintaining high classification accuracy. The overall accuracy (OA) of the RF classification model is 85.87%, and the relative error between the estimated soybean planting area and the agricultural statistics is 3.45%. This study provided a high-precision method for early-season identification of soybeans over large scales. The results can provide a data support for early futures trading and agricultural insurance, as well as a reference for policy-making to ensure global soybean food security.

关键词： soybean machine learning time window feature selection Sentinel-2 Google Earth Engine

来源：评论

学校读者我要写书评

暂无评论

Estimating China's poverty reduction efficiency by integrating multi-source geospatial data and deep learning techniques

引用

地球空间信息科学学报（英文版） 2024年第4期27卷 1000-1016页

作者： Yao Yao Jianfeng Zhou Zhenhui Sun Qingfeng Guan Zhiqiang Guo Yin Xu Jinbao Zhang Ye Hong Yuyang Cai Ruoyu Wang School of Geography and Information Engineering China University of GeosciencesWuhanChina Center for Spatial Information Science The University of TokyoChibaJapan Alibaba Group HangzhouChina Foshan Surveying Mapping and Geoinformation Research Institute FoshanChina Key Laboratory of Spatial-Temporal Big Data Analysis and Application of Natural Resources in Megacities(Ministry of Natural Resources) School of Geographic SciencesEast China Normal UniversityShanghaChina School of Geography and Information Engineering China University of GeosciencesWuhanChina Institute of International Rivers and Eco-Security Yunnan UniversityKunmingChina Institute of Geography and Spatial Information School of Earth SciencesZhejiang UniversityHangzhouChina School of Geography and Planning Sun Yat-Sen UniversityGuangzhouChina Institute of Cartography and Geoinformation ETH ZurichZürichSwitzerland Department of Civil Environmental and Geomatic Engineering School of EngineeringUniversity College LondonLondonUK Centre for Public Health Queen's University BelfastBelfastNorthern IrelandUK

Poverty threatens human development especially for developing countries,so ending poverty has become one of the most important United Nations Sustainable Development Goals(SDGs).This study aims to explore China's progress in poverty reduction from 2016 to 2019 through time-series multi-source geospatial data and a deep learning *** poverty reduction efficiency(PRE)is measured by the difference in the out-of-poverty rates(which measures the probability of being not poor)of 2016 and *** study shows that the probability of poverty in all regions of China has shown an overall decreasing trend(PRE=0.264),which indicates that the progress in poverty reduction during this period is *** Hu Huanyong Line(Hu Line)shows an uneven geographical pattern of out-of-poverty rate between Southeast and Northwest *** 2016 to 2019,the centroid of China's out-of-poverty rate moved 105.786 km to the northeast while the standard deviation ellipse of the out-of-poverty rate moved 3 degrees away from the Hu Line,indicating that the regions with high out-of-poverty rates are more concentrated on the east side of the Hu Line from 2016 to *** results imply that the government's future poverty reduction policies should pay attention to the infrastructure construction in poor areas and appropriately increase the population density in poor *** study fills the gap in the research on poverty reduction under multiple scales and provides useful implications for the government's poverty reduction policy.

关键词： Poverty reduction efficiency(PRE) driving forces multisource big data deep learning random forest(RF)

来源：评论

学校读者我要写书评

暂无评论

Dual Test-time Training for Out-of-distribution Recommender System

arXiv

引用

arXiv 2024年

作者： Yang, Xihong Wang, Yiqi Chen, Jin Fan, Wenqi Zhao, Xiangyu Zhu, En Liu, Xinwang Lian, Defu School of Computer National University of Defense Technology Changsha410073 China School of Business and Management Hong Kong University of Science and Technology Hong Kong The Hong Kong Polytechnic University Hong Kong Department of Data Science City University of Hong Kong Hong Kong Anhui Province Key Laboratory of Big Data Analysis and Application School of Computer Science and Technology University of Science and Technology of China Anhui Hefei230000 China

Deep learning has been widely applied in recommender systems, which has recently achieved revolutionary progress. However, most existing learning-based methods assume that the user and item distributions remain unchanged between the training phase and the test phase. However, the distribution of user and item features can naturally shift in real-world scenarios, potentially resulting in a substantial decrease in recommendation performance. This phenomenon can be formulated as an Out-Of-Distribution (OOD) recommendation problem. To address this challenge, we propose a novel Dual Test-Time-Training framework for OOD Recommendation, termed DT3OR. In DT3OR, we incorporate a model adaptation mechanism during the test-time phase to carefully update the recommendation model, allowing the model to adapt specially to the shifting user and item features. To be specific, we propose a self-distillation task and a contrastive task to assist the model learning both the user’s invariant interest preferences and the variant user/item characteristics during the test-time phase, thus facilitating a smooth adaptation to the shifting features. Furthermore, we provide theoretical analysis to support the rationale behind our dual test-time training framework. To the best of our knowledge, this paper is the first work to address OOD recommendation via a test-time-training strategy. We conduct experiments on five datasets with various backbones. Comprehensive experimental results have demonstrated the effectiveness of DT3OR compared to other state-of-the-art baselines. Copyright © 2024, The Authors. All rights reserved.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

BroadCAM: Outcome-agnostic Class Activation Mapping for Small-scale Weakly Supervised applications

arXiv

引用

arXiv 2023年

作者： Lin, Jiatai Han, Guoqiang Xu, Xuemiao Liang, Changhong Wong, Tien-Tsin Chen, C.L. Philip Liu, Zaiyi Han, Chu The School of Computer Science and Engineering South China University of Technology Guangdong Guangzhou510006 China Guangdong Provincial Key Laboratory of Artificial Intelligence in Medical Image Analysis and Application Guangzhou510080 China Southern Medical University Guangzhou510080 China School of Computer Science and Engineering South China University of Technology State Key Laboratory of Subtropical Building Science Ministry of Education Key Laboratory of Big Data and Intelligent Robot Guangdong Provincial Key Lab of Computational Intelligence and Cyberspace Information China Department of Computer Science and Engineering The Chinese University of Hong Kong Hong Kong

Class activation mapping (CAM), a visualization technique for interpreting deep learning models, is now commonly used for weakly supervised semantic segmentation (WSSS) and object localization (WSOL). It is the weighted aggregation of the feature maps by activating the high class-relevance ones. Current CAM methods achieve it relying on the training outcomes, such as predicted scores (forward information), gradients (backward information), etc. However, when with small-scale data, unstable training may lead to less effective model outcomes and generate unreliable weights, finally resulting in incorrect activation and noisy CAM seeds. In this paper, we propose an outcome-agnostic CAM approach, called BroadCAM, for small-scale weakly supervised applications. Since broad learning system (BLS) is independent to the model learning, BroadCAM can avoid the weights being affected by the unreliable model outcomes when with small-scale data. By evaluating BroadCAM on VOC2012 (natural images) and BCSS-WSSS (medical images) for WSSS and OpenImages30k for WSOL, BroadCAM demonstrates superior performance than existing CAM methods with small-scale data (less than 5%) in different CNN architectures. It also achieves SOTA performance with large-scale training data. Extensive qualitative comparisons are conducted to demonstrate how BroadCAM activates the high class-relevance feature maps and generates reliable CAMs when with small-scale training data. © 2023, CC BY.

关键词： Learning systems

来源：评论

学校读者我要写书评

暂无评论

引用

IEEE International Conference on Multimedia and Expo (ICME)

作者： Xiaoke Zhu Danyang Li Xiaopan Chen Fumin Qi Fan Zhang Xiao-Yuan Jing School of Computer and Information Engineering Henan University Kaifeng China Henan Engineering Research Center of Intelligent Technology and Application Henan University Kaifeng China Department of System Operation National Supercomuting Center in Shenzhen Shenzhen China Henan Key Laboratory of Big Data Analysis and Processing Henan University Kaifeng China School of Computer Science Wuhan University Wuhan China

ISBN: (数字)9798350390155

ISBN: (纸本)9798350390162

Facial image based kinship verification aims to decide whether there exists kinship between the given facial images. In practice, the cross-generation differences will cause adverse effects on kinship verification, which limits the performance. Therefore, how to mine the implied similarity from facial images with large cross-generation divergence is an important problem in kinship verification, which has not yet been well studied. In view of this, we propose a Similarity Mining via Implicit matching pattern LEarning (SMILE) approach for kinship verification. Specifically, SMILE mainly consists of two modules, including a Semi-coupled Multi-pattern Similarity Learning (SMSL) module and a Cross-Generation Feature Normalization (CGFN) module. The SMSL module is designed to learn multiple semi-coupled matching patterns for mining the implicit facial similarity information from different perspectives. The CGFN module aims to reduce the divergence between facial images of parent and child. Extensive experiments demonstrate that the proposed approach outperforms the existing state-of-the-art methods.

关键词： Pattern matching Similarity learning

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：