Knowledge Components (KCs) linked to assessments enhance the measurement of student learning, enrich analytics, and facilitate adaptivity. However, generating and linking KCs to assessment items requires significant e...
详细信息
Identifying gaze targets in videos of human-robot interaction is useful for measuring engagement. In practice, this requires manually annotating for a fixed set of objects that a participant is looking at in a video, ...
详细信息
ISBN:
(数字)9798350375022
ISBN:
(纸本)9798350375039
Identifying gaze targets in videos of human-robot interaction is useful for measuring engagement. In practice, this requires manually annotating for a fixed set of objects that a participant is looking at in a video, which is very time-consuming. To address this issue, we propose an annotation pipeline for automating this effort. In this work, we focus on videos in which the objects looked at do not move. As input for the proposed pipeline, we therefore only need to annotate object bounding boxes for the first frame of each video. The benefit, moreover, of manually annotating these frames is that we can also draw bounding boxes for objects outside of it, which enables estimating gaze targets in videos where not all objects are visible. A second issue that we address is that the models used for automating the pipeline annotate individual video frames. In practice, however, manual annotation is done at the event level for video segments instead of single frames. Therefore, we also introduce and investigate several variants of algorithms for aggregating frame-level to event-level annotations, which are used in the last step in our annotation *** compare two versions of our pipeline: one that uses a state-of-the-art gaze estimation model (GEM) and a second one using a state-of-the-art target detection model (TDM). Our results show that both versions successfully automate the annotation, but the GEM pipeline performs slightly (≈10%) better for videos where not all objects are visible. Analysis of our aggregation algorithm, moreover, shows that there is no need for manual video segmentation because a fixed time interval for segmentation yields very similar results. We conclude that the proposed pipeline can be used to automate almost all of the annotation effort.
The Internet-of-Things (IoT) promises to enhance everyday objects with computing, but rarely enables directly authoring or composing that behavior. Lightweight IoT approaches attach identifiers (e.g., RFID tags) to ob...
The Internet-of-Things (IoT) promises to enhance everyday objects with computing, but rarely enables directly authoring or composing that behavior. Lightweight IoT approaches attach identifiers (e.g., RFID tags) to objects to enable networked services. Typically these tags are passive, and so, depend on activity recognition and predefined context. This limits interaction to invoking predetermined behavior. Instead, this work presents The IoT Codex: a lightweight approach to customizing everyday objects with IoT by enabling interactive attachable IDs (aIDs) to compose software-supported behavior in situ. This work contributes 1) paper engineering techniques to construct aIDs that embody state, and 2) a tangible, end user programming (EUP) language for customizing IoT within symbolic and idiosyncratic contexts. Here, we provide preliminary validation of our approach with an empirically informed design space, sample applications, and a small co-design workshop. In doing so, we offer preliminary evidence for tangible, end user programming to enable meaningful control over IoT services.
Painting is an expression of visual psychological intentions, which presents inner thoughts and emotions to the outside. This expression and the displayed picture works have an initial diagnostic function and can be u...
详细信息
This paper proposes a novel model for predicting body mass index and various body part sizes using front, side, and back body images. The model is trained on a large dataset of labeled images. The results show that th...
详细信息
Behavioral health is a broad term which encompasses our overall mental and physical well-being. Behavioral health issues do not just impact an individual's life, they also impact wider society. First responders ar...
详细信息
Using the computational prowess of machine learning, this study presents a fresh method for assessing the relative standing and fiscal health of employers across different sectors. The research makes use of a wide var...
详细信息
The Instruction-Driven Game Engine (IDGE) project aims to democratize game development by enabling a large language model (LLM) to follow free-form game descriptions and generate game-play processes. The IDGE allows u...
Behavioral health, which covers mental health, lifestyle choices, addictions, and crises, poses serious issues in the community. Thus, appropriately analyzing and classifying behavioral health data is crucial for maki...
详细信息
暂无评论