检索结果-内蒙古大学图书馆

Sparse Learning for Neural Networks with A Generalized Sparse Regularization

Procedia Computer Science 2022年 214卷 747-754页

作者： Anda Tang Tongsheng Yao Lingfeng Niu Yong Shi School of Mathematical Sciences University of Chinese Academy of Sciences Beijing 100190 China Key Laboratory of Big Data Mining and Knowledge Management Chinese Academy of Sciences Beijing 100190 China

Deep neural networks (DNNs) is very important and have achieved remarkable accuracies in tasks such as image processing. However, the success of DNNs heavily relies on excessive computation and parameter storage costs. To cut down the overheads, a wide range of regularization terms are proposed on netwok compression, which have their own scope of application though. To further reduce computation, structural sparsity learning is a matter of great concern where group sparse regularizations are blossoming in radiant splendour. However, the group sparse regularizations used in network compression is relatively scarce. A majority of structural compression only stem from ℓ 2,1 regularization. In addition, sparse regularization in structural network compression lacks unified form and theoretical guidance. Therefore, we focus our attention on a generalized sparse regularization in sparse learning of deep learning. We put a series of sparse regularization into a framework where some group sparse regularizations with different properties are introduced. The transformation of regularizations can be completed through the selection of hyper-parameters. In this case, we can use the optimization strategy for unification and theoretical guidance, and transform different sparse regularizations to adapt to different tasks. To our knowledge, it is the first work applying the generalized sparse regularization with novel group sparsity in compression of DNNs. The proposed ℓ p , q , r regularization can achieve both neuron-level and connection-level sparsity. And we give the analytical solutions for some specific ( p,q, r ) thus the compression can be achieved throughout the standard optimization process. We perform extensive experiments to illustrate the advantages and characteristics of our new method for further applications.

关键词： Deep neural networks Model compression Group Sparse optimization Regularization Sparse Learning

来源：评论

学校读者我要写书评

暂无评论

Impact of Consumer Characteristics on IP Product Purchase: Empirical Evidence from a Chinese Chain Retailer 10

Impact of Consumer Characteristics on IP Product Purchase: E...

引用

10th International Conference on Information Technology and Quantitative management, ITQM 2023

作者： Tang, Jiayu Wang, Tingyan Tian, Xin Cai, Qiang Research Center on Fictitious Economy and Data Science Chinese Academy of Sciences Beijing100190 China School of Economics and Management University of Chinese Academy of Sciences Beijing100190 China Key Laboratory of Big Data Mining and Knowledge Management Chinese Academy of Sciences Beijing100190 China Sino-Danish College University of Chinese Academy of Sciences Beijing100190 China Nuffield Department of Medicine University of Oxford South Parks Road OxfordOX1 3SY United Kingdom NIHR Oxford Biomedical Research Centre Big Data Institute University of Oxford Old Road Campus OxfordOX3 7LF United Kingdom School of Economics and Management Ningbo University of Technology Ningbo315211 China

Developing IP product has become a common differentiation strategy for retailers to attract customers and remain competence strength. This study uses empirical model to relate consumer characteristics with IP product purchase. The results show that consumers shopping on weekends are more likely to buy IP products, and consumers who have stocking behavior are less likely to purchase IP products. Consumers who are members of the retailer also have lower probability to buy IP products. These findings provide suggestions for the retailers who want to apply differentiation strategy by introducing co-branded IP products. © 2023 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (https://***/licenses/by-nc-nd/4.0) Peer-review under responsibility of the scientific committee of the Tenth International Conference on Information Technology and Quantitative management.

关键词： Consumer behavior

来源：评论

学校读者我要写书评

暂无评论

A Brief Survey of Distribution Robust Graph Neural Networks

引用

Procedia Computer Science 2024年 242卷 1281-1286页

作者： Lei Zheng Pei Quan Yong Shi Lingfeng Niu The School of Mathematical Sciences University of Chinese Academy of Sciences Beijing 100190 China Research Center on Fictitious Economy and Data Science Chinese Academy of Sciences Beijing 100190 China Key Laboratory of Big Data Mining and Knowledge Management Chinese Academy of Sciences Beijing 100190 China The College of Economics and Management Beijing University of Technology Beijing 100124 China The School of Economics and Management University of Chinese Academy of Sciences Beijing 1001090 China

Graph neural network is a powerful tool for solving various graph tasks, such as node classification and graph classification. However, there is increasing evidence suggesting that it is sensitive to distribution shifts and its performance is reduced by at least 10% when distribution shifts happen. In the last three years, to solve the wide existing distribution shifts, some distribution robust strategies have been designed specifically for graph neural networks. It is also one of the popular research topics in graph neural networks in recent years. Therefore, in this paper, we divide these strategies into three categories depending on the specific problems they solve: distribution shift for semi-supervised node classification, distribution shift for unsupervised node classification, and out-of-distribution shift for graph classification. Furthermore, we discuss and summarize the strategies for each type of problem. After investigating these strategies, we put forward future development direction.

关键词： Graph neural networks Shift robust Distribution generalization

来源：评论

学校读者我要写书评

暂无评论

Exploring Freight Loading management by Deep Learning: a Case Study in Home Furnishing Industry

引用

Annals of data Science 2022年第2期9卷 213-228页

作者： Deng, Wei Patil, Rajvardhan Liu, Fangyao Daji, Ergu Shi, Yong College of Big Data Statistics Guizhou University of Finance and Economics Guizhou550025 China College of Computer and Information Science Arkansas Tech University RussellvilleAR68182 United States College of Information Science and Technology University of Nebraska at Omaha OmahaNE68182 United States Research Center on Fictitious Economy and Data Science The Chinese Academy of Sciences Beijing100190 China Key Laboratory of Big Data Mining and Knowledge Management Chinese Academy of Sciences Beijing100190 China School of Economics and Management University of Chinese Academy of Sciences Beijing100190 China Nebraska Furniture Mart OmahaNE68124 United States Division of Science Research and Technology Southwest Minzu University Chengdu610041 China

Long short-term memory (LSTM) networks as state-of-the-art Deep Learning models, have achieved remarkable results in time series forecasting. However, they are less commonly applied to the industry of logistics. This paper presents two novel LSTM networks to predict the freight loading of routing areas, and the design of a smart loading management system is introduced. While most existing works on LSTM utilize the power of its prediction very well, our study shows less accurate and instable results if only LSTM network is applied, that arise from the big variation in the dataset. Instead, two constraints are inspired in this paper. The first constraint adds a time factor node to strengthen the correlation between predicted final loading units and booked loading units as close to delivery date. And the second proposal extends to parallel training by groupwise constraint. Experiments with across 3-year records in a national wide home furnishing retail company show that constraint LSTM networks significantly improve both the accuracy and stability of the prediction. Besides, the design of a smart loading management system will be shown, in which LSTM model plays the core rule to predict loading capacity, meanwhile the rule-based system triggers different events based on loading prediction and truck size. © 2021, The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.

关键词： Long short-term memory

来源：评论

学校读者我要写书评

暂无评论

When liver disease diagnosis encounters deep learning:Analysis,challenges,and prospects

引用

iLIVER 2023年第1期2卷 73-87页

作者： Yingjie Tian Minghao Liu Yu Sun Saiji Fu School of Economics and Management University of Chinese Academy of SciencesBeijing 100190China School of Computer Science and Technology University of Chinese Academy of SciencesBeijing 100049China Research Center on Fictitious Economy and Data Science Chinese Academy of SciencesBeijing 100190China Key Laboratory of Big Data Mining and Knowledge Management University of Chinese Academy of SciencesBeijing 100190China MOE Social Science Laboratory of Digital Economic Forecasts and Policy Simulation at UCAS Beijing 100190China Tsinghua University Press Beijing 102611China School of Economics and Management Beijing University of Posts and TelecommunicationsBeijing 100876China

The liver is the second-largest organ in the human body and is essential for digesting food and removing toxic ***,obesity,alcohol use,and other factors can damage the liver and cause liver *** diagnosis of liver disease used to depend on the clinical experience of doctors,which made it subjective,difficult,and *** learning has made breakthroughs in various fields;thus,there is a growing interest in using deep learning methods to solve problems in liver research to assist doctors in diagnosis and *** this paper,we provide an overview of deep learning in liver research using 139 papers from the last 5 *** also show the relationship between data modalities,liver topics,and applications in liver research using Sankey diagrams and summarize the deep learning methods used for each liver topic,in addition to the relations and trends between these ***,we discuss the challenges of and expectations for deep learning in liver research.

关键词： Liver Deep learning data modality Liver topic Application

来源：评论

学校读者我要写书评

暂无评论

Iterative Privileged Learning for Multi-view Classification 10

Iterative Privileged Learning for Multi-view Classification

引用

10th International Conference on Information Technology and Quantitative management, ITQM 2023

作者： Fu, Saiji Tian, Yingjie Tang, Jingjing School of Economics and Management Beijing University of Posts and Telecommunications Beijing100876 China School of Economics and Management University of Chinese Academy of Sciences Beijing100190 China Research Center on Fictitious Economy and Data Science Chinese Academy of Sciences Beijing100190 China Key Laboratory of Big Data Mining and Knowledge Management Chinese Academy of Sciences Beijing100190 China MOE Social Science Laboratory of Digital Economic Forecasts and Policy Simulation UCAS Beijing100190 China School of Business Administration Faculty of Business Administration Southwestern University of Finance and Economics Sichuan 611130 China

Multi-view data is closely associated with privileged information, presenting opportunities for advancements in current studies. Firstly, they often overlook the dynamic nature of privileged information;Secondly, the current state-of-the-art privileged support vector machine, dSVM+, is primarily designed for single-view learning;Thirdly, some methods only address two-view classification problems;Finally, the performance enhancements achieved by these approaches remain unsatisfactory. To this end, this paper proposes a multi-view privileged support vector machine called MVdSVM+. The iterative learning strategy is put forward to update the privileged information dynamically. To our best knowledge, this is the first attempt of dSVM+ in multi-view learning. Meanwhile, it is designed for multiple views. Experiments show the effectiveness of MVdSVM+ over the benchmark methods. © 2023 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (https://***/licenses/by-nc-nd/4.0) Peer-review under responsibility of the scientific committee of the Tenth International Conference on Information Technology and Quantitative management.

关键词： Classification (of information)

来源：评论

学校读者我要写书评

暂无评论

A Study on The Multi-Attribute Decision Theory and Methods 9th

A Study on The Multi-Attribute Decision Theory and Methods

引用

9th International Conference on Information Technology and Quantitative management, ITQM 2022

作者： Feng, Jinyuan Yan, Yunxi Huang, Manling Du, Yang Lu, Zhichen Li, Biao School of Business Administration Faculty of Business Administration Southwestern University of Finance and Economics Chengdu611130 China College of Dance Minzu University of China Beijing China School of Economics and Management University of Chinese Academy of Sciences Beijing101408 China Research Center on Fictitious Economy and Data Science Key Laboratory of Big Data Mining and Knowledge Management Chinese Academy of Sciences Beijing100190 China

Multi-attribute decision-making problem (MADM) is a kind of multi-criteria decision-making (MCDM), which is often used to solve decision-making problems where the decision variables are discrete and the number of decision-making schemes is limited. This paper reviews the basic definition of multi-attribute decision making (MADM) through the performance evaluation of science and technology funds in a city, and then deduces the TODIM decision making method and TOPSIS decision making method in detail. Finally, the clue case is decided by combining these two decision making methods. This paper specifically shows the usage scenarios and limitations of the TODIM decision method and the TOPSIS decision method through the clue case, analyzes the advantages and disadvantages of the two methods through the comparison of the two methods, and puts forward suggestions for the clue case based on the results of the two schemes. © 2022 The Authors. Published by Elsevier B.V.

关键词： Decision theory

来源：评论

学校读者我要写书评

暂无评论

Not All Diffusion Model Activations Have Been Evaluated as Discriminative Features 38

Not All Diffusion Model Activations Have Been Evaluated as D...

引用

38th Conference on Neural Information Processing Systems, NeurIPS 2024

作者： Meng, Benyuan Xu, Qianqian Wang, Zitai Cao, Xiaochun Huang, Qingming Institute of Information Engineering CAS China School of Cyber Security University of Chinese Academy of Sciences China Key Lab. of Intelligent Information Processing Institute of Computing Technology CAS China Peng Cheng Laboratory China School of Cyber Science and Tech. Shenzhen Campus of Sun Yat-sen University China School of Computer Science and Tech. University of Chinese Academy of Sciences China Key Laboratory of Big Data Mining and Knowledge Management CAS China

Diffusion models are initially designed for image generation. Recent research shows that the internal signals within their backbones, named activations, can also serve as dense features for various discriminative tasks such as semantic segmentation. Given numerous activations, selecting a small yet effective subset poses a fundamental problem. To this end, the early study of this field performs a large-scale quantitative comparison of the discriminative ability of the activations. However, we find that many potential activations have not been evaluated, such as the queries and keys used to compute attention scores. Moreover, recent advancements in diffusion architectures bring many new activations, such as those within embedded ViT modules. Both combined, activation selection remains unresolved but overlooked. To tackle this issue, this paper takes a further step with a much broader range of activations evaluated. Considering the significant increase in activations, a full-scale quantitative comparison is no longer operational. Instead, we seek to understand the properties of these activations, such that the activations that are clearly inferior can be filtered out in advance via simple qualitative evaluation. After careful analysis, we discover three properties universal among diffusion models, enabling this study to go beyond specific models. On top of this, we present effective feature selection solutions for several popular diffusion models. Finally, the experiments across multiple discriminative tasks validate the superiority of our method over the SOTA competitors. Our code is available at this url. © 2024 Neural information processing systems foundation. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Topic Selection Model Based on Network Group Intelligence 9th

Topic Selection Model Based on Network Group Intelligence

引用

9th International Conference on Information Technology and Quantitative management, ITQM 2022

作者： Zhang, Lingling Xue, Bowen Huang, Siting School of Economics and Management University of Chinese Academy of Sciences Beijing100190 China Key Laboratory of Big Data Mining and Knowledge Management Chinese Academy of Sciences Beijing100190 China Moe Social Science Laboratory of Digital Economic Forecasts and Policy Simulation at Ucas Beijing100190 China Ping An Securities Group Limited Shenzheng518000 China

关键词： Collective Intelligence Consensus Analysis Social Network Topic Selection User influence

来源：评论

学校读者我要写书评

暂无评论

Deep Feature Inpainting for Unsupervised Visual Anomaly Detection 10

Deep Feature Inpainting for Unsupervised Visual Anomaly Dete...

引用

10th International Conference on Information Technology and Quantitative management, ITQM 2023

作者： Yang, Jie Lyu, Mengjin Qi, Zhiquan Tian, Yingjie Shi, Yong School of Mathematical Science University of Chinese Academy of Sciences Beijing101408 China School of Economics and Management University of Chinese Academy of Sciences Beijing101408 China Research Center on Fictitious Economy and Data Science Chinese Academy of Sciences Beijing100190 China Key Laboratory of Big Data Mining and Knowledge Management Chinese Academy of Sciences Beijing100190 China College of Information Science and Technology University of Nebraska OmahaNE68182 United States School of Computer Science and Technology University of Chinese Academy of Sciences Beijing101408 China

Visual anomaly detection is an important and challenging problem in the field of machine learning and computer vision. In this paper, we address the problem of unsupervised visual anomaly detection from the perspective of image feature restoration. We propose deep feature inpainting (DFI) where we develop a deep learning model that can automatically inpainting the normal image patterns or features from the anomalous images by eliminating the irregular structures or patterns. By comparing the anomalous features and their reconstructed counterparts, we can identify and analyze the anomalous structures in the images. Extensive experiments have been carried out to demonstrate the effectiveness of the approach. © 2023 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (https://***/licenses/by-nc-nd/4.0) Peer-review under responsibility of the scientific committee of the Tenth International Conference on Information Technology and Quantitative management.

关键词： Anomaly detection

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：