Recent research has shown that the improvement of mean retrieval effectiveness (e.g., MAP) may sacrifice the retrieval stability across queries, implying a tradeoff between effectiveness and stability. The evaluation ...
详细信息
ISBN:
(纸本)9781450325981
Recent research has shown that the improvement of mean retrieval effectiveness (e.g., MAP) may sacrifice the retrieval stability across queries, implying a tradeoff between effectiveness and stability. The evaluation of both effectiveness and stability are often based on a baseline model, which could be weak or biased. In addition, the effectiveness-stability tradeoff has not been systematically or quantitatively evaluated over TREC participated systems. The above two problems, to some extent, limit our awareness of such tradeoff and its impact on developing future IR models. In this paper, motivated by a recently proposed bias-variance based evaluation, we adopt a strong and unbiased "baseline", which is a virtual target model constructed by the best performance (for each query) among all the participated systems in a retrieval task. We also propose generalized bias-variance metrics, based on which a systematic and quantitative evaluation of the effectiveness-stability tradeoff is carried out over the participated systems in the TREC Ad-hoc Track (1993-1999) and Web Track (2010-2012). We observe a clear effectiveness-stability tradeoff, with a trend of becoming more obvious in more recent years. This implies that when we pursue more effective IR systems over years, the stability has become problematic and could have been largely overlooked. Copyright 2014 ACM.
The use of orthogonal channels for the cooperative transmission results in a loss of rate or spectral efficiency, and the exiting full-rate cooperative transmission schemes based on space-time code design have the def...
详细信息
Despite numerous efforts on blur measurement of partially blurred images, there still lacks an effective blur measure that is both pixel-wise and locally sharp consistent. The paper proposes a novel method with two co...
详细信息
Despite numerous efforts on blur measurement of partially blurred images, there still lacks an effective blur measure that is both pixel-wise and locally sharp consistent. The paper proposes a novel method with two contributions to overcome this limitation: 1) A new pixel-based blur metric, Multi-resolution Singular Value (MSV), which leverages the average singular value of high frequency bands to measure the blur of each pixel, and 2) a locally continuous strategy, maximum-likelihood estimation (MLE) based refinement, that ensures local continuity by imposing the local sharp consistency on pixel blur in a local correcting process. Experimental results show that our method is effective to smoothly measure the partially blurred images without local discontinuity.
Mining from ambiguous data is very important in data mining. This paper discusses one of the tasks for mining from ambiguous data known as multi-instance problem. In multi-instance problem, each pattern is a lab.led b...
详细信息
Mining from ambiguous data is very important in data mining. This paper discusses one of the tasks for mining from ambiguous data known as multi-instance problem. In multi-instance problem, each pattern is a lab.led bag that consists of a number of unlab.led instances. A bag is negative if all instances in it are negative. A bag is positive if it has at least one positive instance. Because the instances in the positive bag are not lab.led, each positive bag is an ambiguous. The mining aim is to classify unseen bags. The main idea of existing multi-instance algorithms is to find true positive instances in positive bags and convert the multi-instance problem to the supervised problem, and get the lab.ls of test bags according to predict the lab.ls of unknown instances. In this paper, we aim at mining the multi-instance data from another point of view, i.e., excluding the false positive instances in positive bags and predicting the lab.l of an entire unknown bag. We propose an algorithm called Multi-Instance Covering kNN (MICkNN) for mining from multi-instance data. Briefly, constructive covering algorithm is utilized to restructure the structure of the original multi-instance data at first. Then, the kNN algorithm is applied to discriminate the false positive instances. In the test stage, we lab.l the tested bag directly according to the similarity between the unseen bag and sphere neighbors obtained from last two steps. Experimental results demonstrate the proposed algorithm is competitive with most of the state-of-the-art multi-instance methods both in classification accuracy and running time.
In this paper, we propose an improved graph model for Chinese spell checking. The model is based on a graph model for generic errors and two independentlytrained models for specific errors. First, a graph model repres...
详细信息
Vector Taylor Series (VTS) model based compensation approach has been successfully applied to various robust speech recognition tasks. In this paper, a novel method to derive the formula to calculate the static and dy...
详细信息
ISBN:
(纸本)9781479928941
Vector Taylor Series (VTS) model based compensation approach has been successfully applied to various robust speech recognition tasks. In this paper, a novel method to derive the formula to calculate the static and dynamic statistics based on second-order VTS (sVTS) is presented, which provides a new insight on the VTS approximation. Lengthy derivation could therefore be avoided when high order VTS is used and the proposed approach is more compact and easier to implement compared to previous high order VTS approaches. Experiments on Aurora 4 showed that the proposed sVTS based model compensation approach obtained 16.7% relative WER reduction over traditional first-order VTS (fVTS) approach.
To simplify the design process of coding matrices for data forwarding in two-way wireless relay networks with multiple relay nodes, a distributed cooperative transmission scheme based on cyclic delay diversity (CDD) a...
详细信息
To simplify the design process of coding matrices for data forwarding in two-way wireless relay networks with multiple relay nodes, a distributed cooperative transmission scheme based on cyclic delay diversity (CDD) and conventional space-time codes is proposed in this paper. All relay nodes are divided into several groups firstly. In each group, the relay nodes adopt CDD ways to amplify-and-forward (AF) their received signals and thereby obtain the potential diversity gains. The forwarded signals among different groups are encoded into the form of one full-rate space-time code, which can solve the problem on limited error correction ability in conventional relay schemes only using CDD ways and then further reduce the bit error rate (BER) of the distributed wireless system. Consequently, the design process for two-way relay transmissions is simplified and this method can be extended to other complicated cases. Simulation results verify that the proposed scheme is able to achieve high diversity gains and good bit error performance.
A new structure of coupled-fed loop antenna con- nected with two branch radiators for eight-band LTE/WWAN (LTE700/GSM850/900/1800/1900/UMTS/LTE2300/2500) operation in the ultra-thin laptop computer is presented. The t...
详细信息
A new structure of coupled-fed loop antenna con- nected with two branch radiators for eight-band LTE/WWAN (LTE700/GSM850/900/1800/1900/UMTS/LTE2300/2500) operation in the ultra-thin laptop computer is presented. The two branch strips of the antenna are e±cient radiators and contributing multi-resonant modes to greatly enhance the bandwidth of the antenna. The proposed antenna on the top shielding metal wall of the laptop display, with a planar and compact size of 12:5 × 70 × 0:8mm3, is suitable to be embedded inside the casing of the laptop computer. The proposed antenna is fabricated and tested, and good radiation performances are obtained. Compared with the existing published antennas, the volume of the planar antenna is quite small.
In order to accomplish tracking of moving objects requirements, and overcome the defect of occlusion in the process of tracking moving object, this paper presents a method which uses a combination of MeanShift and Kal...
详细信息
The cooperative transmission schemes based on the amplify and forward(AF) mode have the defect of low transmission rate and the exiting full-rate cooperative transmission schemes based on space-time code design have...
详细信息
ISBN:
(纸本)9781467349994
The cooperative transmission schemes based on the amplify and forward(AF) mode have the defect of low transmission rate and the exiting full-rate cooperative transmission schemes based on space-time code design have the defect of high detection ***,this paper makes the best of linear constellation precoding(LCP) technique and cyclic delay diversity(CDD) technique,and adopts the nonorthogonal amplify and forward(NAF) mode,finally proposes a new full-rate wireless cooperative transmission scheme based on space-time-frequency code *** with the cooperative transmission schemes that only pursue the transmission rate or the BER performance,this new scheme can apply to multi-relay scenario,and has the advantages of simple structure,low signal detection complexity that does not increases with the number of relay *** of above makes the real-time data transmission service of high quality come to be possible.
暂无评论