The tracking of deformable hand gesture is a very important task in vision-based HCI (human-computerinteraction) research. A novel real-time tracking approach is proposed to capture the motion of deformable hand gest...
详细信息
The tracking of deformable hand gesture is a very important task in vision-based HCI (human-computerinteraction) research. A novel real-time tracking approach is proposed to capture the motion of deformable hand gesture with single camera. The proposed approach uses a set of 2D hand models in place of high-dimensional 3D model. It achieves auto-initialization by firstly using Bayesian classifier to do posture recognition, and then locating fingers and fingertips to fit image features to recognized posture. It solves the problem of interference among fingers during tracking successfully by the integration of K-means clustering and particle filter. Moreover, a state checking process is embedded into tracking method, and it realizes resumption from tracking failure and update of hand models automatically. Experimental results show that the proposed method can achieve continuous real-time tracking of deformable hand gesture with high precision, and thus it can meet the requirements from real-time vision-based human-computerinteraction.
As technologies are rapidly evolving in the area of storage, recognition and displays, the vision of multi-modal interaction is positioning the human needs central to pervasive access to services. Users expect better ...
详细信息
As technologies are rapidly evolving in the area of storage, recognition and displays, the vision of multi-modal interaction is positioning the human needs central to pervasive access to services. Users expect better looking interfaces that are also easy to use to improve high efficiency and productivity and to focus on task itself instead of tools as providing the invisibility in pervasive computing. However, it is hard to obtain the right service at the right time naturally in the multimedia environment based on current interaction approaches. In this paper, we propose a framework for multi-modal interaction which offers the sketch and speech interactive models without limitation of the diversity and richness of the provided services in the pervasive computing environment. Furthermore, it is applied to describe sample application and shows how it is used to create a new interface with high performance
An efficient digital ink data coding algorithm IWPHSP (integer wavelet packet based hierarchical set partitioned) is proposed in this paper. The algorithm compresses digital ink multi-dimension data losslessly using t...
详细信息
An efficient digital ink data coding algorithm IWPHSP (integer wavelet packet based hierarchical set partitioned) is proposed in this paper. The algorithm compresses digital ink multi-dimension data losslessly using three approaches: integer wavelet packet transform, hierarchical set partitioned, significant bits combination code and fast adaptive arithmetic code. The experiments show that the IWPHSP algorithm is efficient.
Following the great improvement in interaction devices and software technologies, lots of novel interaction technologies which are based on Post-WIMP user interface are studied. It is crucial that the designer chooses...
详细信息
Following the great improvement in interaction devices and software technologies, lots of novel interaction technologies which are based on Post-WIMP user interface are studied. It is crucial that the designer chooses the interaction component or the interaction technology properly and efficiently to adapt to the various interaction devices and environments in the user interface designing. According to the analysis of the interaction process and the design level of the Post-WIMP user interface, an interaction-Centered Hierarchical Post-WIMP User Interface Model is presented. It is described and analyzed from the aspects of the user, task, device, behaviors and entity in interaction. Moreover, a Post-WIMP user interface auto-generate tool is designed and implemented based on the model, to help the designers to insert those novel interaction technologies into the system flexibly, and to develop and evaluate the prototype quickly and efficiently. Experiments show that, the model can guide the process of user interface design, the implement of prototype, and the evaluation of the result of design.
Pen-Based user interface software is widely applicable due to its natural and efficient interaction style, whose important characteristics are interaction-centered and individual by user-required. In order to map the ...
详细信息
Pen-Based user interface software is widely applicable due to its natural and efficient interaction style, whose important characteristics are interaction-centered and individual by user-required. In order to map the intention of users into the designs exactly and efficiently, PUIDM (Pen based User Interfaces software Domain Model) is presented, which is described and analyzed from the aspects of context, component, UI features and architecture, and implemented based on XML. Moreover, a user-centered design process based on the PUIDM is introduced. Experiments show that PUIDM can guide the process of design exactly and efficiently and make the designed software achieve the demand of usability.
The latest research developments at home and abroad on constructing 3D conceptual models based on gesture are summarized. The gesture-based human-computerinteraction and its key technologies are also discussed. At la...
详细信息
The latest research developments at home and abroad on constructing 3D conceptual models based on gesture are summarized. The gesture-based human-computerinteraction and its key technologies are also discussed. At last, future directions of the research are presented.
Ubiquitous computing provides the new research challenges for the next generation interactions. Natural User Interface is one of the important aspects. Pen and paper are the natural and simple tools to use in our dail...
详细信息
ISBN:
(纸本)8528500500
Ubiquitous computing provides the new research challenges for the next generation interactions. Natural User Interface is one of the important aspects. Pen and paper are the natural and simple tools to use in our daily life, which can fit for the imprecise and flexible design mode in conceptual design. Gestures are the useful and natural mode in the pen-based interaction which can be introduced and used through the similar mode to the existing resources in interaction. Inherent problems exist with collaborative conceptual design because the simultaneous group interaction required for users to smoothly and effectively work together in the same virtual space. In this paper, we provide solutions to these problems by devising a fast and direct gesture-based user interface, a set of visual effects that better enable a user's awareness of the operations done by other participants, and a set of tools for enhancing visual communication between participants. A gesture description language (GDL) is given to provide the useful gestures to the applications conveniently.
This paper proposes a fast search method of algebraic codebook in CELP coders. In the proposed method, the sequence of codebook search is reordered according to the criterion of mean squared weighted error between tar...
详细信息
ISBN:
(纸本)0780350413
This paper proposes a fast search method of algebraic codebook in CELP coders. In the proposed method, the sequence of codebook search is reordered according to the criterion of mean squared weighted error between target vector and filtered adaptive codebook vector, and the algebraic codebook is searched until a predetermined threshold is satisfied. This method reduces the computations considerably compared with G.729 at the expense of a slight degradation of speech quality. Moreover, it gives better speech quality with smaller average search space than G.729A.
This paper proposes a new 4 kbit/s speech coder based on CELP structure with 45 ms total codec delay. The coder is mainly featured by the renewal codebook of the excitation signal and the linked split-vector quantizer...
详细信息
ISBN:
(纸本)0818679190
This paper proposes a new 4 kbit/s speech coder based on CELP structure with 45 ms total codec delay. The coder is mainly featured by the renewal codebook of the excitation signal and the linked split-vector quantizer of line spectrum pair parameters which enable the coder to get high quality speech at low bit rate. In addition, techniques of formant enhancement in the spectral envelop and harmonic recovery in the transient region are also introduced to reduce buzzy and hoarse sounds, respectively. From the intensive listening test with intermediated response system (IRS) speech, we obtained a comparable subjective quality to 32 kbit/s ADPCM (ITU Recommendation G.726) under a nominal speech input level of -26 dB overload.
暂无评论