Lipreading with single‐channel vibrotactile presentation of voice fundamental frequency

作     者：Lynne E. Bernstein Silvio P. Eberhardt Marilyn E. Demorest 

作者机构：Speech Processing Laboratory Department of Electrical and Computer Engineering Johns Hopkins University Baltimore MD 21218 Department of Psychology University of Maryland Baltimore County Catonsville MD 21228 

出 版 物：《The Journal of the Acoustical Society of America》 

年 卷 期：2005年第82卷第S1期

页      面：S22-S22页

学科分类：07[理学] 082403[工学-水声工程] 08[工学] 070206[理学-声学] 0824[工学-船舶与海洋工程] 0702[理学-物理学] 

摘      要：A study evaluated several transformations of voice fundamental frequency (F0) for use by a single‐channel vibrotactile device to supplement lipreading. The experimental procedure involved lipreading stimuli from a corpus of over 1500 sentences stored on a video laserdisk [L. E. Bernstein and S. P. Eberhardt, 1986, Johns Hopkins Lipreading Corpus]. There were five experimental conditions. Three transformations of voice F0 were tested: two transformed F0 to a pulse rate code, the third employed two sine waves that were amplitude modulated as a function of F0. Condition 4 provided both F0 and a second stimulator indicating high‐frequency speech energy. Condition 5 was visual alone. Subjects were 15 normal‐hearing adults in a multiple single‐subject design with alternating baseline and test sessions. Analyses of covariance for words correct, words per stimulus sentence, and syllables per sentence showed that all subjects improved in lipreading. Subjects who received a single vibrator for voice F0 lipread more successfully than subjects who did not receive the vibrotactile supplement or who received the dual tactile stimulation.