Deep neural networks (DNNs) is very important and have achieved remarkable accuracies in tasks such as image processing. However, the success of DNNs heavily relies on excessive computation and parameter storage costs...
详细信息
Deep neural networks (DNNs) is very important and have achieved remarkable accuracies in tasks such as image processing. However, the success of DNNs heavily relies on excessive computation and parameter storage costs. To cut down the overheads, a wide range of regularization terms are proposed on netwok compression, which have their own scope of application though. To further reduce computation, structural sparsity learning is a matter of great concern where group sparse regularizations are blossoming in radiant splendour. However, the group sparse regularizations used in network compression is relatively scarce. A majority of structural compression only stem from ℓ 2,1 regularization. In addition, sparse regularization in structural network compression lacks unified form and theoretical guidance. Therefore, we focus our attention on a generalized sparse regularization in sparse learning of deep learning. We put a series of sparse regularization into a framework where some group sparse regularizations with different properties are introduced. The transformation of regularizations can be completed through the selection of hyper-parameters. In this case, we can use the optimization strategy for unification and theoretical guidance, and transform different sparse regularizations to adapt to different tasks. To our knowledge, it is the first work applying the generalized sparse regularization with novel group sparsity in compression of DNNs. The proposed ℓ p , q , r regularization can achieve both neuron-level and connection-level sparsity. And we give the analytical solutions for some specific ( p,q, r ) thus the compression can be achieved throughout the standard optimization process. We perform extensive experiments to illustrate the advantages and characteristics of our new method for further applications.
Graph neural network is a powerful tool for solving various graph tasks, such as node classification and graph classification. However, there is increasing evidence suggesting that it is sensitive to distribution shif...
详细信息
As the main international trade channel of China's "westward development", the opening of China Railway Express has significantly improved the trade facilitation of countries along the route. This paper ...
详细信息
Recent developments in large language models (LLMs) have opened new avenues for the real estate industry. These models not only understand language but also function as intelligent agents, engaging with investors thro...
详细信息
In this study, to address search index selection and volatility problems, we propose a learning-based search index collection method that collects the search data fraction for modeling by learning the best criteria fr...
详细信息
The rapid development of artificial intelligence (AI) has brought the AI threat theory as well as the problem about how to evaluate the intelligence level of intelligent products. Both need to find a quantitative meth...
详细信息
data analysis is used as a common method in modern science research, which is across communication science, computer science and biology science. Clustering, as the basic composition of data analysis, plays a signific...
data analysis is used as a common method in modern science research, which is across communication science, computer science and biology science. Clustering, as the basic composition of data analysis, plays a significant role. On one hand, many tools for cluster analysis have been created, along with the information increase and subject intersection. On the other hand, each clustering algorithm has its own strengths and weaknesses, due to the complexity of information. In this review paper, we begin at the definition of clustering, take the basic elements involved in the clustering process, such as the distance or similarity measurement and evaluation indicators, into consideration, and analyze the clustering algorithms from two perspectives, the traditional ones and the modern ones. All the discussed clustering algorithms will be compared in detail and comprehensively shown in Appendix Table 22.
Despite the widespread adoption of technology in inventory management, empirical research that examines the effect of these technologies is scarce. Does IT capability really have a positive effect on the inventory man...
详细信息
Despite the widespread adoption of technology in inventory management, empirical research that examines the effect of these technologies is scarce. Does IT capability really have a positive effect on the inventory management? This paper empirically studies the usage of information technology by the definition of IT capability. Our unique panel data set allows us to explore the relationship between technology usage and inventory management. Our results show that IT capability has a positive effect on the inventory strategy and inventory operation process, and has a negative effect on the out-of-stock level. Our research demonstrates the superiority of the usage of technology.
暂无评论