Change blindness is a phenomenon where an individual fails to notice alterations in a visual scene when a change occurs during a brief interruption or distraction. Understanding this phenomenon is specifically importa...
详细信息
ISBN:
(纸本)9798350328387
Change blindness is a phenomenon where an individual fails to notice alterations in a visual scene when a change occurs during a brief interruption or distraction. Understanding this phenomenon is specifically important for the technique that uses a visual stimulus, such as Virtual Reality (VR) or Augmented Reality (AR). Previous research had primarily focused on 2D environments or conducted limited controlled experiments in 3D immersive environments. In this paper, we design and conduct two formal user experiments to investigate the effects of different visual attention-disrupting conditions (Flickering and Head-Turning) and object alternative conditions (Removal, Color Alteration, and Size Alteration) on change blindness detection in VR and AR environments. Our results reveal that participants detected changes more quickly and had a higher detection rate with Flickering compared to Head-Turning. Furthermore, they spent less time detecting changes when an object disappeared compared to changes in color or size. Additionally, we provide a comparison of the results between VR and AR environments.
We present a lightweight and efficient rain sound synthesis method for interactive virtual environments. Existing rain sound simulation methods require massive superposition of scene-specific precomputed rain sounds, ...
详细信息
ISBN:
(纸本)9798350348156
We present a lightweight and efficient rain sound synthesis method for interactive virtual environments. Existing rain sound simulation methods require massive superposition of scene-specific precomputed rain sounds, which is excessive memory consumption for virtual reality systems (e.g. video games) with limited audio memory budgets. Facing this issue, we reduce the audio memory budgets by introducing a lightweight rain sound synthesis method which is only based on eight physically-inspired basic rain sounds. First, in order to generate sufficiently various rain sounds with limited sound data, we propose an exponential moving average based frequency domain additive (FDA) synthesis method to extend and modify the pre-computed basic rain sounds. Each rain sound is generated in the frequency domain before conversion back to the time domain, allowing us to extend the rain sound which is free of temporal distortions and discontinuities. Next, we introduce an efficient binaural rendering method to simulate the 3D perception that coheres with the visual scene based on a set of Near-Field Transfer Functions (NFTF). Various results demonstrate that the proposed method drastically decreases the memory cost (77 times compressed) and overcomes the limitations of existing methods in terms of interaction.
Natural face-to-face human-robot conversation is one of the most important features for virtual human in virtual reality and metaverse. However, the unintended wake-up of robot is often activated with only Voice Activ...
详细信息
ISBN:
(纸本)9798350348392
Natural face-to-face human-robot conversation is one of the most important features for virtual human in virtual reality and metaverse. However, the unintended wake-up of robot is often activated with only Voice Activity Detection (VAD). To address this issue, we propose a Multimodal Activity Detection (MAD) scheme, which considers not only voice but also gaze, lip-movement and talking content to decide whether the person is activating the robot. A dataset for large screen-based virtual human conversation is collected from various challenging cases. The experimental results show that the proposed MAD greatly outperforms VAD-only method.
Although talking is one of the most common activities in social VR, there is little empirical work identifying what people say and how they communicate in immersive, virtual settings. The current paper addresses this ...
详细信息
ISBN:
(纸本)9798350348392
Although talking is one of the most common activities in social VR, there is little empirical work identifying what people say and how they communicate in immersive, virtual settings. The current paper addresses this opportunity by performing automated text analysis on over 4,800 minutes of in-VR, small group conversations. These conversations took place over the span of two months during a university course where 171 students attended discussion sections via head -mounted displays, We provide a methodology for analyzing verbal communication along two dimensions: content and structure. We implement methods to describe linguistic patterns from the class and introduce a preliminary VR Dictionary.
While technologies for human-robot collaboration are rapidly advancing, plenty of aspects still need further investigation, such as ensuring workspace awareness, enabling the operator to reschedule tasks on the fly, a...
详细信息
ISBN:
(纸本)9798350328387
While technologies for human-robot collaboration are rapidly advancing, plenty of aspects still need further investigation, such as ensuring workspace awareness, enabling the operator to reschedule tasks on the fly, and how users prefer to coordinate and collaborate with robots. To address these, we propose an Augmented Reality interface that supports human-robot collaboration in an assembly task by (1) enabling the inspection of planned and ongoing robot processes through dynamic task lists and a path visualization, (2) allowing the operator to also delegate tasks to the robot, and (3) presenting step-by-step assembly instructions. We evaluate our AR interface in comparison to a state-of-the-art tablet interface in a user study, where participants collaborated with a robot arm in a shared workspace to complete an assembly task. Our findings confirm the feasibility and potential of AR-assisted human-robot collaboration, while pointing to some central challenges that require further work.
Interpreting and managing social interactions is vital for social well-being, yet existing technologies fall short, particularly in group settings. This research aims to develop advanced machine perception systems for...
详细信息
ISBN:
(纸本)9798400704628
Interpreting and managing social interactions is vital for social well-being, yet existing technologies fall short, particularly in group settings. This research aims to develop advanced machine perception systems for Social Signal Processing to accurately model human social behavior. Our multi-modal generative model aims to integrate multi-modal sensory data input data, contextual information and subjective observers narratives, utilizing them as complex input to an adapted Large Language Model, and producing plausible narratives that reflect various human perspectives. This human-centered approach leverages both low-level cues and high-order events, ensuring adaptability to diverse observers and contexts. The models potential areas of application include cross-cultural interactions, social group integration, and professional meetings, enhancing social harmony and productivity.
Visualization literacy,the ability to interpret and comprehend visual designs,is recognized as an essential skill by the visualization *** identify and investigate barriers to comprehending parallel coordinates plots(...
详细信息
Visualization literacy,the ability to interpret and comprehend visual designs,is recognized as an essential skill by the visualization *** identify and investigate barriers to comprehending parallel coordinates plots(PCPs),one of the advanced graphical representations for the display of multivariate and high-dimensional *** develop a parallel coordinates literacy test with diverse images generated using popular PCP software *** test improves PCP literacy and evaluates the user’s literacy *** introduce an interactive educational tool that assists the teaching and learning of parallel coordinates by offering a more active learning *** this pedagogical tool,we aim to advance novice users’parallel coordinates literacy *** on the hypothesis that an interactive tool that links traditional Cartesian Coordinates with PCPs interactively will enhance PCP literacy further than static slides,we compare the learning experience using traditional slides with our novel software tool and investigate the efficiency of the educational software with an online,crowdsourced ***-study results show that our pedagogical tool positively impacts a user’s PCP comprehension.
This paper presents a bottom-up approach to designing and developing a high-fidelity simulation environment that fosters human acceptance of artificial intelligence (AI) as teammates by refining their mental models of...
详细信息
Infographics are often an integral component of scientific documents for reporting qualitative or quantitative findings as they make it much simpler to comprehend the underlying complex information. However, their int...
详细信息
People who are blind and visually impaired (BVI) primarily rely on white canes for everyday mobility. Smart canes were introduced to address the limitations of traditional white canes and to inform users of their surr...
详细信息
ISBN:
(纸本)9783031050398;9783031050381
People who are blind and visually impaired (BVI) primarily rely on white canes for everyday mobility. Smart canes were introduced to address the limitations of traditional white canes and to inform users of their surroundings more efficiently. While the smart cane's advantages are evident, these devices are not used often in the BVI community. To gain a better understanding of the low adoption rate, we spoke with orientation and mobility specialists for some background on BVI mobility, conducted a survey to gauge user awareness and initial perceptions of the smart cane, and interviewed 16 participants for an in-depth view regarding their smart cane experiences. While most of the participants' apprehension was based on initial product cost, we found that other factors like user personality, durability, battery life, experience bias, as well as the lack of awareness from the users all contribute to the low adoption rate of smart canes. As such, our findings are structured based on four main themes: (1) Impact of Participant Characteristics on Adoption, (2) Perceived Advantages and Disadvantages, (3) Product-Related Concerns, and (4) Building Trust. We contribute a user-centered investigation on the merits of the smart cane and suggestions for future design considerations based on user feedback.
暂无评论