We proposed a hand-free Natural userinterface (NUI) for VR Head-Mounted-Display (HMD) with infra-red (IR) based sensor tracking facial gestures. We have realized NUI based on the real-time recognition of user intuiti...
详细信息
ISBN:
(纸本)9781450355483
We proposed a hand-free Natural userinterface (NUI) for VR Head-Mounted-Display (HMD) with infra-red (IR) based sensor tracking facial gestures. We have realized NUI based on the real-time recognition of user intuitions for VR HMD without any additional control devices except for a built-in Gyroscope and IR couplers with readout circuitry integrated in the foam interface of an HMD. We implemented seven control commands affordable for 3D interactions with virtual objects. The experimental data show that the proposed system provides a convenient and efficient 2D/3D userinterface for both manipulating objects and controlling commands while wearing a VR HMD.
PhotoelasticTouch is a novel tabletop system designed to intuitively facilitate touch-based interaction via real objects made from transparent elastic material. The system utilizes vision-based recognition techniques ...
详细信息
ISBN:
(纸本)9781605587455
PhotoelasticTouch is a novel tabletop system designed to intuitively facilitate touch-based interaction via real objects made from transparent elastic material. The system utilizes vision-based recognition techniques and the photoelastic properties of the transparent rubber to recognize deformed regions of the elastic material. Our system works with elastic materials over a wide variety of shapes and does not require any explicit visual markers. Compared to traditional interactive surfaces, our 2.5 dimensional interface system enables direct touch interaction and soft tactile feedback. In this paper we present our force sensing technique using photoelasticity and describe the implementation of our prototype system. We also present three practical applications of PhotoelasticTouch, a force-sensitive touch panel, a tangible face application, and a paint application.
Recent Generative AI models have been shown to be substantially useful in different fields, often bridging modal gaps, such as text-prompted image or human motion generation. However, their accompanying interfaces do ...
详细信息
ISBN:
(纸本)9798400700965
Recent Generative AI models have been shown to be substantially useful in different fields, often bridging modal gaps, such as text-prompted image or human motion generation. However, their accompanying interfaces do not sufficiently support iteration and interaction between models, and due to the computational intensity of generative technology, can be unforgiving to user errors and missteps. We propose DeckFlow, a no-code interface for multimodal generative workflows which encourages rapid iteration and experimentation between disparate models. DeckFlow emphasizes the persistence of output, the maintenance of generation settings and dependencies, and continual steering through user-defined concept groups. Taking design cues from Card Games and Affinity Diagrams, DeckFlow is aimed to lower the barrier for non-experts to explore and interact with generative AI.
The VIMSYS project provides environmental scientists with the ability to perform content-based querying over a database of satellite images. This paper descriks the enduser query interface which facilitates identifica...
详细信息
ISBN:
(纸本)089791628X
The VIMSYS project provides environmental scientists with the ability to perform content-based querying over a database of satellite images. This paper descriks the enduser query interface which facilitates identification of multiple object types, reduces emphasis on numerical data, and simplifies the use of numerous sets of parameters. To address these issues in a way that can be applied to similar databases, the end-user query interface utilizes abstract query structures called clusters, in addition to frames and links. We describe the requirements of the system, review commonly available query methods, discuss how the VIMSYS interface meets the needs of the audience, present user reaction to the prototype, and summarize other relevant details of VIMSYS.
The web is now rich with information and functionality, allowing users to only use portions of webpages to complete their tasks. However, current desktop interfaces only allow us to manage entire windows, leading to i...
详细信息
ISBN:
(纸本)9798400700965
The web is now rich with information and functionality, allowing users to only use portions of webpages to complete their tasks. However, current desktop interfaces only allow us to manage entire windows, leading to inefcient use of screen space and suboptimal workfows. We present Masonview, a content-driven viewport management system that provides mechanisms to detach desired elements from their webpages as viewports and compose these views into UI mashups with viewplates. We demonstrate how these mechanisms enable more free-form organization and management of content.
This TechNote introduces WebCard, an integrated mail/news reader and Web browser. As a mail/news reader, WebCard is fairly conventional;the innovation is that Web pages are fully integrated in the mail/news reader. Th...
详细信息
ISBN:
(纸本)9780897917094
This TechNote introduces WebCard, an integrated mail/news reader and Web browser. As a mail/news reader, WebCard is fairly conventional;the innovation is that Web pages are fully integrated in the mail/news reader. The userinterface is based on folders, where an 'item' in a folder can be a mail message, news article or Web page. When displaying a Web page, users can follow links, and the new pages will appear as items in the current folder. users can copy and move items between folders, forward items, and can also use folders to organize material on the Web, such as hotlists, query results, and breadth-first expansions.
Dido is an application (and application development environment) in a web page. It is a single web page containing rich structured data, an AJAXy interactive visualizer/editor for that data, and a "metaeditor&quo...
详细信息
ISBN:
(纸本)9781605587455
Dido is an application (and application development environment) in a web page. It is a single web page containing rich structured data, an AJAXy interactive visualizer/editor for that data, and a "metaeditor" for WYSIWYG editing of the visualizer/editor. Historically, users have been limited to the data schemas, visualizations, and interactions offered by a small number of heavyweight applications. In contrast, Dido encourages and enables the end user to edit (not code) in his or her web browser a distinct ephemeral interaction "wrapper" for each data collection that is specifically suited to its intended use. Dido's active document metaphor has been explored before but we show how, given today's web infrastructure, it can be deployed in a small self-contained HTML document without touching a web client or server.
Faceted browsers offer an effective way to explore relationships and build new knowledge across data sets. So far, web-based faceted browsers have been hampered by limited feature performance and scale. QWIC, Quick We...
详细信息
ISBN:
(纸本)9781605588438
Faceted browsers offer an effective way to explore relationships and build new knowledge across data sets. So far, web-based faceted browsers have been hampered by limited feature performance and scale. QWIC, Quick Web interface Control, describes a set of design heuristics to address performance speed both at the interface and the backend to operate on large-scale sources.
Tracking both hands in free-space with accompanying speech input can augment the user's ability to communicate with computers. This paper discusses the kinds of situations which call for two-handed input and not j...
详细信息
ISBN:
(纸本)0897915496
Tracking both hands in free-space with accompanying speech input can augment the user's ability to communicate with computers. This paper discusses the kinds of situations which call for two-handed input and not just the single hand, and reports a prototype in which two-handed gestures serve to input concepts, both static and dynamic, manipulate displayed items, and specify actions to be taken. Future directions include enlargement of the vocabulary of two-handed “coverbal” gestures and the modulation by gaze of gestural intent.
暂无评论