In this paper, we study the application of quasi-Newton methods for solving empirical risk minimization (ERM) problems defined over a large dataset. Traditional deterministic and stochastic quasi-Newton methods can be...
ISBN:
(纸本)9781713845393
In this paper, we study the application of quasi-Newton methods for solving empirical risk minimization (ERM) problems defined over a large dataset. Traditional deterministic and stochastic quasi-Newton methods can be executed to solve such problems; however, it is known that their global convergence rate may not be better than first-order methods, and their local superlinear convergence only appears towards the end of the learning process. In this paper, we use an adaptive sample size scheme that exploits the superlinear convergence of quasi-Newton methods globally and throughout the entire learning process. The main idea of the proposed adaptive sample size algorithms is to start with a small subset of data points and solve their corresponding ERM problem within its statistical accuracy, and then enlarge the sample size geometrically and use the optimal solution of the problem corresponding to the smaller set as an initial point for solving the subsequent ERM problem with more samples. We show that if the initial sample size is sufficiently large and we use quasi-Newton methods to solve each subproblem, the subproblems can be solved superlinearly fast (after at most three iterations), as we guarantee that the iterates always stay within a neighborhood that quasi-Newton methods converge superlinearly. Numerical experiments on various datasets confirm our theoretical results and demonstrate the computational advantages of our method.
神经信息处理系统大会(conference on Neural Information processing Systems,Neur IPS)是机器学习领域的顶级会议,在中国计算机学会(China Computer Federation,CCF)推荐国际学术会议中被评为人工智能领域的A类会议,一直广受关注。Neu...
详细信息
神经信息处理系统大会(conference on Neural Information processing Systems,Neur IPS)是机器学习领域的顶级会议,在中国计算机学会(China Computer Federation,CCF)推荐国际学术会议中被评为人工智能领域的A类会议,一直广受关注。Neur IPS 2020收到了创纪录的9467篇投稿,最终录用1898篇论文。收录的论文涵盖了人工智能的各种主题,包括深度学习及其应用、强化学习与规划、纯理论研究、概率方法、优化及机器学习与社会等。本文回顾了Neur IPS 2020的亮点及论文录用情况,详细解读了特邀报告、最佳论文、口头报告及部分海报论文,希望能帮助读者快速了解Neur IPS 2020的盛况。
Synthetic aperture radar (SAR) image despeckling is recognized as the basis for SAR imageprocessing and interpretation. Over the past decades, many impressed speckle reduction methods have been developed and achieved...
详细信息
This paper presents a noble approach for the efficient examination and classification of surface textures on medium- and large-sized mold products, such as used for automobiles, TVs, and refrigerators. Although there ...
详细信息
Compared with the air transportation and land transportation, water transportation has many advantages such as larger loading capacity, lower unit transportation cost, lower construction investment and so on. What’s ...
详细信息
ISBN:
(纸本)9781665426565
Compared with the air transportation and land transportation, water transportation has many advantages such as larger loading capacity, lower unit transportation cost, lower construction investment and so on. What’s more, water transportation has played an important role in the economical development of China, especially in the aspect of international trade. Therefore, the improvement in the efficiency of water transportation will be of great significance. In this paper, we designed a system to predict the containers’ entering time distribution of a given voyage at a specific port by using machine learning algorithms and statisticalmethods. Using Shanghai Yangshan Port phase IV automated terminal’s data, we perform some experiments, and the result shows that our system can provide valid predictions.
This paper makes an attempt to develop an automated facial complexion recognition method for objective and quantitative facial diagnosis. In TCM diagnosis, some regions of the face like Ting, Jia and Mingtang, can pro...
详细信息
ISBN:
(纸本)9781728160429
This paper makes an attempt to develop an automated facial complexion recognition method for objective and quantitative facial diagnosis. In TCM diagnosis, some regions of the face like Ting, Jia and Mingtang, can provide the most valuable information, so we use deep learning technique to determine the 68 landmarks of face and use their location to segment the regions of interest (ROI). The statistical characteristics of color histograms in multiple color space and texture features, lip color features are then introduced to describe the facial complexion. Finally, several machine learning methods including KNN, SVM and BPNN are used for classification. To verify the validity of our method, we collected a dataset of 575 face images from professional TCM medical institutions. The results show that the process of ROIs' segmentation can improve the accuracy efficiently, higher than unsegmented image. The proposed method by fusing all three features achieves an accuracy of 91.03% which is higher than the existing methods and proves the effectiveness of the proposed method for facial complexion recognition. We confirm that extracting the complexion features particularly from the regions of interest of the face image achieves higher classification accuracy than characterizing the overall complexion directly from the unsegmented images. We show that the facial color features provide the most important clues for complexion classification among all the used features, which is consistent with the TCM diagnosis. Finally, we prove that the facial texture feature and lip color feature can be used as complementary clues and fused with the facial color features for further improving the complexion classification accuracy.
Dental caries are common chronic infectious oral diseases affecting most teenagers and adults worldwide. Optical coherence tomography (OCT) has been studied extensively for the detection of early carious lesions. Deep...
详细信息
ISBN:
(纸本)9781510631977;9781510631984
Dental caries are common chronic infectious oral diseases affecting most teenagers and adults worldwide. Optical coherence tomography (OCT) has been studied extensively for the detection of early carious lesions. Deep learning techniques are a rapidly emerging new area of biomedical research and have yielded impressive results in diagnosis and prediction in the field of oral radiology. Deep learning models particularly deep convolutional neural networks (CNN) can be employed along with OCT imaging system to more accurately identify early dental caries. In this work, after OCT data acquisition, data augmentation was performed to obtain a large amount of training data in order to effectively learn, where collection of such training data is often expensive and laborious. For the backpropagation process, seven optimization methods, namely Adadelta, AdaGrad, Adam, AdaMax, Nadam, RMSProp, and stochastic Gradient Descent (SGD) were utilized to improve the accuracy of a CNN classifier for diagnosing dental caries. In this study, 75% of the data were utilized for training and 25% for testing. The diagnostic accuracy, sensitivity, specificity, positive predictive value, negative predictive value, and receiver operating characteristic (ROC) curve were calculated for detection and diagnostic performance of the deep CNN algorithm. This study highlighted the performance of various optimization methods for deep CNN models with OCT images to detect dental caries.
Counterfeiting of quality rice was rife in Indonesia. This research was conducted to develop technology to identify differences in premium and non-premium rice quality based on pre-existing digital images. Artificial ...
Counterfeiting of quality rice was rife in Indonesia. This research was conducted to develop technology to identify differences in premium and non-premium rice quality based on pre-existing digital images. Artificial neural networks and digital imageprocessingmethods to identify premium and medium (non-premium) rice quality were applied in this research. statistical analysis of this study used the SPSS program. This research is observation-type research. This research design uses an artificial neural network with uses 3 layers, namely the results of shape feature extraction on the metric, eccentricity, area, and perimeter parameters as input or input layers, hidden or hidden layers, and premium rice and non-premium (medium) rice as output or output layers. This research uses 52 images as training and 20 images as testing. The obtained image was taken at a distance of 25 cm. This research showed that the results of training using artificial neural networks (ANN) on 52 images obtained an accuracy of 92%. The test results using 20 images obtained 95% accuracy, 63.33% sensitivity, and 10% specificity. Based on statistical analysis using the Mann-Whitney test, it obtained the asymph value. Sig (2-tailed) < 0.05 indicates the difference between premium and non-premium rice using metric, eccentricity, perimeter, and area parameters.
Chaos theory one of the complex approaches with encryption methods is known as a perfect candidate. This is due to using cryptography applications to its properties like unpredictability and sensitive initial states. ...
详细信息
Recently developed sophisticated imageprocessing techniques and tools have made easier the creation of high-quality forgeries of handwritten documents including financial and property records. To detect such forgerie...
详细信息
Recently developed sophisticated imageprocessing techniques and tools have made easier the creation of high-quality forgeries of handwritten documents including financial and property records. To detect such forgeries of handwritten documents, this paper presents a new method by exploring the combination of Chebyshev-Harmonic-Fourier-Moments (CHFM) and deep Convolutional Neural Networks (D-CNNs). Unlike existing methods work based on abrupt changes due to distortion created by forgery operation, the proposed method works based on inconsistencies and irregular changes created by forgery operations. Inspired by the special properties of CHFM, such as its reconstruction ability by removing redundant information, the proposed method explores CHFM to obtain reconstructed images for the color components of the Original, Forged Noisy and Blurred classes. Motivated by the strong discriminative power of deep CNNs, for the reconstructed images of respective color components, the proposed method used deep CNNs for forged handwriting detection. Experimental results on our dataset and benchmark datasets (namely, ACPR 2019, ICPR 2018 FCD and IMEI datasets) show that the proposed method outperforms existing methods in terms of classification rate.
暂无评论