检索结果-内蒙古大学图书馆

Using Language-Aligned Gesture Embeddings for Understanding Gestures Accompanying Math Terms

学校读者我要写书评

暂无评论

Using Language-Aligned Gesture Embeddings for Understanding ...

IEEE computer Society Conference on computer Vision and Pattern Recognition Workshops (CVPRW)

作者： Tristan Maidment Purav J Patel Erin Walker Adriana Kovashka Intelligent Systems Program University of Pittsburgh Pittsburgh PA USA University of Maryland College Park MD USA Computer Science University of Pittsburgh Pittsburgh PA USA Learning Research and Development Center University of Pittsburgh Pittsburgh PA USA

ISBN: (数字)9798350365474

ISBN: (纸本)9798350365481

In this paper, we introduce an approach for recognizing and classifying gestures that accompany mathematical terms, in a new collection we name the "GAMT" dataset. Our method uses language as a means of providing context to classify gestures. Specifically, we use a CLIP-style framework to construct a shared embedding space for gestures and language, experimenting with various methods for encoding gestures within this space. We evaluate our method on our new dataset containing a wide array of gestures associated with mathematical terms. The shared embedding space leads to a substantial improvement in gesture classification. Furthermore, we identify an efficient model that excelled at classifying gestures from our unique dataset, thus contributing to the further development of gesture recognition in diverse interaction scenarios.

关键词： computer vision Conferences Computational modeling Gesture recognition Mathematical models Encoding

Multimodal Temporal Modeling of Emotion using Physiological Signals

学校读者我要写书评

暂无评论

TechRxiv

TechRxiv 2023年

作者： Hinduja, Saurabh Bilalpur, Maneesh Jivnani, Liza Vimalkumar Canavan, Shaun Dept. of Psychology University of Pittsburgh United States Dept. of Intelligent Systems Program University of Pittsburgh United States Dept. of Computer Science University of South Florida United States

Modeling of human emotion is a challenging problem that can require multiple signals types, as well as contextual information that has been obtained over time. Considering this, in this paper we present our approach, based on physiological signals, to the Emotion Physiology and Experience Collaboration (EPIC) challenge at Affective Computing & intelligent Interaction (ACII), 2023. In total there are four scenarios that we model: 1) across time;2) across subjects;3) across elicitor;and 4) across version. To tackle this challenge, we propose to use a physiological fusion-based approach to solve each scenario. Along with this, we give a detailed analysis of the evaluated physiological signals and personalized predictions for each subject are shown. Our proposed approach shows encouraging results with the lowest root mean square error achieved for scenario 4 (across version) for both valence and arousal on the challenge test set. © 2023, CC BY.

关键词： Physiology

Notes on the pursuit-evasion games between unmanned aerial vehicles operating in uncertain environments

学校读者我要写书评

暂无评论

Notes on the pursuit-evasion games between unmanned aerial v...

2021 International Conference Engineering and Telecommunication, En and T 2021

作者： Khachumov, Mikhail Khachumov, Vyacheslav Systems Institute of RAS Intelligent Control Laboratory Program Pereslavl-Zalessky Russia RUDN University Federal Research Center 'Computer Science and Control' of RAS Information Technologies Department Moscow Russia

ISBN: (纸本)9781728183909

We solve the planar case of the urgent pursuit-evasion problem for players using various strategies of motion. The following options are considered: players perform piecewise-linear motions;the pursuer moves in a straight line, and the evader moves in a circle;both players move along circular arcs. We propose schemes to solve the formulated problem based on the construction of Apollonius circles, which are geometric invariants. As participants of the game, we assume unmanned aerial vehicles (UAVs) operating in a non-deterministic environment. To solve the problem under uncertainty we use the theory of intelligent geometric control aimed at the joint application of complementary methods of precise geometric and flexible intelligent control as parts of one robotic system. Experimental studies of pursuit-evasion games are carried out in the MATLAB system using mathematical models of UAVs motion and wind loads. © 2021 IEEE.

关键词： intelligent control

PAC Bayesian performance guarantees for deep (Stochastic) networks in medical imaging

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Sicilia, Anthony Zhao, Xingchen Sosnovskikh, Anastasia Hwang, Seong Jae Intelligent Systems Program University of Pittsburgh Department of Computer Science University of Pittsburgh

Application of deep neural networks to medical imaging tasks has in some sense become commonplace. Still, a "thorn in the side" of the deep learning movement is the argument that deep networks are prone to overfitting and are thus unable to generalize well when datasets are small (as is common in medical imaging tasks). One way to bolster confidence is to provide mathematical guarantees, or bounds, on network performance after training which explicitly quantify the possibility of overfitting. In this work, we explore recent advances using the PAC-Bayesian framework to provide bounds on generalization error for large (stochastic) networks. While previous efforts focus on classification in larger natural image datasets (e.g., MNIST and CIFAR-10), we apply these techniques to both classification and segmentation in a smaller medical imagining dataset: the ISIC 2018 challenge set. We observe the resultant bounds are competitive compared to a simpler baseline, while also being more explainable and alleviating the need for holdout sets. © 2021, CC BY.

关键词： Medical imaging

Improvement of Spatial Ambiguity in Multi-Channel Speech Separation Using Channel Attention

学校读者我要写书评

暂无评论

Improvement of Spatial Ambiguity in Multi-Channel Speech Sep...

2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2021

作者： Hong, Qian-Bei Wu, Chung-Hsien Nguyen, Thanh Binh Wang, Hsin-Min National Cheng Kung University and Academia Sinica Graduate Program of Multimedia Systems and Intelligent Computing Tainan Taiwan National Cheng Kung University Department of Computer Science and Information Engineering Tainan Taiwan

ISBN: (纸本)9789881476890

Multi-channel speech separation has been successfully applied in a complex real-world environment such as the far-field condition. The common solution to deal with the far-field condition is using a multi-channel signal captured by a structured microphone array and leveraging the inner difference between channels to enhance the speech separation performance. The spatial feature has been widely used in recent speech separation research. This feature appears to be insufficient when the location information becomes ambiguous. This is known as the spatial ambiguity problem. In order to deal with the spatial ambiguity problem, this study proposes an attention mechanism for the Temporal-Spatial Neural Filter (TSNF), in which the channel attention on merged features and the feature map of 1D convolution block in the temporal convolution network is proposed. The proposed method is evaluated on the multi-channel reverberant dataset which is built based on the WSJ0-2mix dataset. The dataset is simulated in the real-environment room by using the Room Impulse Response generator. In the experimental results, the proposed methods produced the SI -SNR improvement of about 1.2dB in close speakers' case, while a small decrease of 0.1dB in other cases. © 2021 APSIPA.

关键词： Convolution

Explaining Legal Concepts with Augmented Large Language Models (GPT-4)

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Savelka, Jaromir Ashley, Kevin D. Gray, Morgan A. Westermann, Hannes Xu, Huihui Computer Science Department Carnegie Mellon University Pittsburgh United States Intelligent Systems Program University of Pittsburgh Pittsburgh United States Cyberjustice Laboratory Faculté de droit Université de Montréal Québec Canada

Interpreting the meaning of legal open-textured terms is a key task of legal professionals. An important source for this interpretation is how the term was applied in previous court cases. In this paper, we evaluate the performance of GPT-4 in generating factually accurate, clear and relevant explanations of terms in legislation. We compare the performance of a baseline setup, where GPT-4 is directly asked to explain a legal term, to an augmented approach, where a legal information retrieval module is used to provide relevant context to the model, in the form of sentences from case law. We found that the direct application of GPT-4 yields explanations that appear to be of very high quality on their surface. However, detailed analysis uncovered limitations in terms of the factual accuracy of the explanations. Further, we found that the augmentation leads to improved quality, and appears to eliminate the issue of hallucination, where models invent incorrect statements. These findings open the door to the building of systems that can autonomously retrieve relevant sentences from case law and condense them into a useful explanation for legal scholars, educators or practicing lawyers alike. © 2023, CC BY.

关键词： Laws and legislation

The Change that Matters in Discourse Parsing: Estimating the Impact of Domain Shift on Parser Error

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Atwell, Katherine Siciliaz, Anthony Hwang, Seong Jae Alikhani, Malihe Department Of Computer Science University Of Pittsburgh United States Intelligent Systems Program University Of Pittsburgh United States Department Of Artificial Intelligence Yonsei University Korea Republic of

Discourse analysis allows us to attain inferences of a text document that extend beyond the sentence-level. The current performance of discourse models is very low on texts outside of the training distribution's coverage, diminishing the practical utility of existing models. There is need for a measure that can inform us to what extent our model generalizes from the training to the test sample when these samples may be drawn from distinct distributions. While this can be estimated via distribution shift, we argue that this does not directly correlate with change in the observed error of a classifier (i.e. error-gap). Thus, we propose to use a statistic from the theoretical domain adaptation literature which can be directly tied to error-gap. We study the bias of this statistic as an estimator of error-gap both theoretically and through a large-scale empirical study of over 2400 experiments on 6 discourse datasets from domains including, but not limited to: news, biomedical texts, TED talks, Reddit posts, and fiction. Our results not only motivate our proposal and help us to understand its limitations, but also provide insight on the properties of discourse models and datasets which improve performance in domain adaptation. For instance, we find that non-news datasets are slightly easier to transfer to than news datasets when the training and test sets are very different. Our code and an associated Python package are available to allow practitioners to make more informed model and dataset choices. © 2022, CC BY.

关键词： Errors

Can GPT-4 Support Analysis of Textual Data in Tasks Requiring Highly Specialized Domain Expertise?

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Savelka, Jaromir Ashley, Kevin D. Gray, Morgan A. Westermann, Hannes Xu, Huihui Computer Science Department Carnegie Mellon University PittsburghPA United States Intelligent Systems Program University of Pittsburgh PA United States Cyberjustice Laboratory Faculté de droit Université de Montréal Montréal Canada

We evaluated the capability of generative pre-trained transformers (GPT-4) in analysis of textual data in tasks that require highly specialized domain expertise. Specifically, we focused on the task of analyzing court opinions to interpret legal concepts. We found that GPT-4, prompted with annotation guidelines, performs on par with well-trained law student annotators. We observed that, with a relatively minor decrease in performance, GPT-4 can perform batch predictions leading to significant cost reductions. However, employing chain-of-thought prompting did not lead to noticeably improved performance on this task. Further, we demonstrated how to analyze GPT-4’s predictions to identify and mitigate deficiencies in annotation guidelines, and subsequently improve the performance of the model. Finally, we observed that the model is quite brittle, as small formatting related changes in the prompt had a high impact on the predictions. These findings can be leveraged by researchers and practitioners who engage in semantic/pragmatic annotations of texts in the context of the tasks requiring highly specialized domain expertise. © 2023, CC BY.

关键词： Forecasting

Application of Geometric Invariants in the Problem of Trajectory Tracking for UAVs

学校读者我要写书评

暂无评论

Application of Geometric Invariants in the Problem of Trajec...

Siberian Conference on Control and Communications (SIBCON)

作者： Mikhail Khachumov Intelligent Control Laboratory Ailamazyan Program Systems Institute of RAS Pereslavl-Zalessky Russia Federal Research Center “Computer Science and Control” of Russian Academy of Sciences Moscow Russia

ISBN: (纸本)9781665476294

The study discusses approaches and an apply example of using geometric invariants in problems of control theory. An analytical review of modern papers in the field of trajectory tracking and path following control problems for unmanned aerial vehicles (UAVs) has been carried out. To increase the autonomy and ability to cope with uncertainties, it is proposed to use the theory of intelligent-geometric control. The problem of the trajectory tracking is considered in the framework of the pursuit-evasion differential game. Control invariants are considered in the form of ellipsoids, that can be used, for example, in pursuit-evasion problems. The task of determining the parameters of the pursuer’s motion to meet the evader on an ellipsoid is solved. The dependence of the pursuer’s speed on the parameters of the ellipse is shown. A modeling scheme is proposed aimed at joint application of optimal and intelligent control methods to solve trajectory tracking problem in difficult conditions. Simulations carried out in a disturbed environment on controlling the motion of a UAV group showed prospects of the proposed approach.

关键词： Uncertainty Trajectory tracking Shape Differential games Autonomous aerial vehicles Task analysis Ellipsoids