This work addresses motion coding in end-to-end learned video compression. The efficiency of motion coding is critical at low bit rates, at which a large portion of the bitstream signals motion information. Most end-t...
详细信息
ISBN:
(数字)9781665496209
ISBN:
(纸本)9781665496209
This work addresses motion coding in end-to-end learned video compression. The efficiency of motion coding is critical at low bit rates, at which a large portion of the bitstream signals motion information. Most end-to-end learned video codecs adopt an intra-coding approach to codingmotion information as individual optical flow maps. Some recent studies introduce predictive motion coding to encode optical flow map residuals. Still, motion coding remains an active research area for learned video compression. We present an incremental optical flow coding scheme. It first leverages an extrapolated flow together with the reference frame in estimating an incremental flow between the reference and the target frames for efficient motion coding. It then derives the final flow map for motion compensation by integrating the incremental and the extrapolated flows in a double-warping scheme. Experimental results on commonly used datasets show the superiority of our method over predictive motion coding and other advanced schemes.
When a brief flash is quickly presented aligned with a moving target, the flash typically appears to lag behind the moving stimulus. This effect is widely known in the literature as a flash-lag illusion (FLI). The fla...
详细信息
When a brief flash is quickly presented aligned with a moving target, the flash typically appears to lag behind the moving stimulus. This effect is widely known in the literature as a flash-lag illusion (FLI). The flash-lag is an example of a motion-induced position shift. Since auditory deprivation leads to both enhanced visual skills and impaired temporal abilities, both crucial for the perception of the flash-lag effect, here we hypothesized that lack of audition could influence the FLI. 13 early deaf and 18 hearing individuals were tested in a visual FLI paradigm to investigate this hypothesis. As expected, results demonstrated a reduction of the flash-lag effect following early deafness, both in the central and peripheral visual fields. Moreover, only for deaf individuals, there is a positive correlation between the flash-lag effect in the peripheral and central visual field, suggesting that the mechanisms underlying the effect in the center of the visual field expand to the periphery following deafness. Overall, these findings reveal that lack of audition early in life profoundly impacts early visual processing underlying the flash-lag effect.
暂无评论