检索结果-内蒙古大学图书馆

multimodal language Rights and Indigenous Totemic Identity: Cross-Cultural Participatory Research

JOURNAL OF language IDENTITY AND EDUCATION 2025年第2期24卷 449-467页

作者： Mills, Kathy A. Doyle, Katherine Friend, Lesley Australian Catholic Univ Brisbane Qld Australia Griffith Univ Brisbane Qld Australia Queensland Univ Technol Sch Early Childhood & Inclus Educ Brisbane Qld Australia Australian Catholic Univ Inst Learning Sci & Teacher Educ GPO Box 2587 Brisbane Qld 4001 Australia

Indigenous language rights and identity practices are marginalised in education, bringing a need for mainstream educators to understand and respect Indigenous ways of knowing, being, and sharing knowledge. Engaging elementary students (ages 4.5 to 12 years), the cross-cultural participatory research was conducted for three years to understand Indigenous language practices that were multimodal, including digital storytelling, singing, e-book making, dance and video making. The Indigenous school community gave central place to totemic traditions in their multimodal language use. To understand Indigenous views of lifeworlds through a non-linear view of time, Bakhtin's chronotope is used to illuminate time-space in the students' multimodal texts. The findings are significant because failure to engage with and understand Indigenous knowledge contributes to the production and maintenance of inequity. The research counters hegemonic effects and silencing of Indigenous communities, demonstrating how Indigenous culture and multimodal literacies can be taught hand-in-hand in the 21st century.

关键词： Bakhtin culture digital media Indigenous multimodal language totem

来源：评论

学校读者我要写书评

暂无评论

multimodal language Processing in Human Communication

引用

TRENDS IN COGNITIVE SCIENCES 2019年第8期23卷 639-652页

作者： Holler, Judith Levinson, Stephen C. Max Planck Inst Psycholinguist Nijmegen Netherlands Radboud Univ Nijmegen Donders Inst Brain Cognit & Behav Nijmegen Netherlands Radboud Univ Nijmegen Ctr Language Studies Nijmegen Netherlands

The natural ecology of human language is face-to-face interaction comprising the exchange of a plethora of multimodal signals. Trying to understand the psycholinguistic processing of language in its natural niche raises new issues, first and foremost the binding of multiple, temporally offset signals under tight time constraints posed by a turn-taking system. This might be expected to overload and slow our cognitive system, but the reverse is in fact the case. We propose cognitive mechanisms that may explain this phenomenon and call for a multimodal, situated psycholinguistic framework to unravel the full complexities of human language processing.

关键词： binding cross-level prediction multimodal gestalts multimodal language segregation

来源：评论

学校读者我要写书评

暂无评论

multimodal language in child-directed versus adult-directed speech

引用

QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY 2024年第4期77卷 716-728页

作者： Kandemir, Songul Ozer, Demet Aktan-Erciyes, Asli Kadir Has Univ Istanbul Turkiye Kadir Has Univ TR-34083 Istanbul Turkiye

Speakers design their multimodal communication according to the needs and knowledge of their interlocutors, phenomenon known as audience design. We use more sophisticated language (e.g., longer sentences with complex grammatical forms) when communicating with adults compared with children. This study investigates how speech and co-speech gestures change in adult-directed speech (ADS) versus child-directed speech (CDS) for three different tasks. Overall, 66 adult participants (M-age = 21.05, 60 female) completed three different tasks (story-reading, storytelling and address description) and they were instructed to pretend to communicate with a child (CDS) or an adult (ADS). We hypothesised that participants would use more complex language, more beat gestures, and less iconic gestures in the ADS compared with the CDS. Results showed that, for CDS, participants used more iconic gestures in the story-reading task and storytelling task compared with ADS. However, participants used more beat gestures in the storytelling task for ADS than CDS. In addition, language complexity did not differ across conditions. Our findings indicate that how speakers employ different types of gestures (iconic vs beat) according to the addressee's needs and across different tasks. Speakers might prefer to use more iconic gestures with children than adults. Results are discussed according to audience design theory.

关键词： Audience design multimodal language adult-directed speech child-directed speech

来源：评论

学校读者我要写书评

暂无评论

User study of a life-supporting humanoid directed in a multimodal language

引用

ARTIFICIAL LIFE AND ROBOTICS 2011年第2期16卷 224-228页

作者： Oka, Tetsushi Abe, Toyokazu Sugita, Kaoru Yokota, Masao Nihon Univ Coll Ind Technol Dept Math Informat Engn 1-2-1 Izumicho Narashino Chiba 2758575 Japan Nihon Comp Kaihatsu Co Tokyo Japan Fukuoka Inst Technol Fac Informat Engn Fukuoka Japan

This article describes a user study of a life-supporting humanoid directed in a multimodal language, and discusses the results. Twenty inexperienced users commanded the humanoid in a computer-simulated remote home environment in the multimodal language by pressing keypad buttons and speaking to the robot. The results show that they comprehended the language well and were able to give commands successfully. They often chose a press-button action in place of verbal phrases to specify a direction, speed, length, angle, and/or temperature value, and preferred multimodal commands to spoken commands. However, they did not think that it was very easy to give commands in the language. This article discusses the results and points out both strong and weak points of the language

关键词： Life-supporting robot multimodal language User study Humanoid Human-robot interaction

来源：评论

学校读者我要写书评

暂无评论

A multimodal language to communicate with life-supporting robots through a touch screen and a speech interface

引用

ARTIFICIAL LIFE AND ROBOTICS 2011年第3期16卷 292-296页

作者： Oka, T. Matsumoto, H. Kibayashi, R. Nihon Univ Coll Ind Technol 1-2-1 Izumicho Narashino Chiba 2758575 Japan Fukuoka Inst Technol Fac Informat Engn Fukuoka Japan

This article proposes a multimodal language to communicate with life-supporting robots through a touch screen and a speech interface. The language is designed for untrained users who need support in their daily lives from cost-effective robots. In this language, the users can combine spoken and pointing messages in an interactive manner in order to convey their intentions to the robots. Spoken messages include verb and noun phrases which describe intentions. Pointing messages are given when the user's finger touches a camera image, a picture containing a robot body, or a button on a touch screen at hand which convey a location in their environment, a direction, a body part of the robot, a cue, a reply to a query, or other information to help the robot. This work presents the philosophy and structure of the language.

关键词： Life-supporting robot multimodal language Speech Touch screen Human-robot interaction

来源：评论

学校读者我要写书评

暂无评论

Fusing AI: multimodal language Models Inference Across Diverse Inputs

引用

COMPUTER 2024年第11期57卷 124-130页

作者： Jovanovic, Mladan Campbell, Mark Singidunum Univ Belgrade 11000 Serbia Founder 3dot Insights Sedalia CO 80135 USA

Despite the various hurdles multimodal language models (MLMs) face, their broad applicability outweighs the implementation effort. As MLM technologies advance, they will support additional modalities, new learning and... 详细信息

关键词： language Model multimodal Model multimodal language Inference Methods Data Modalities multimodal Learning Training Data Natural language Personal Data Diffusion Model Question Answering Application Programming Interface Text Representation Fine Tuned Model Image Captioning Context Window

来源：评论

学校读者我要写书评

暂无评论

User study of a life-supporting humanoid directed in a multimodal language

User study of a life-supporting humanoid directed in a multi...

引用

16th International Symposium on Artificial Life and Robotics (AROB 16th '11)

作者： Oka, T. Abe, T. Sugita, K. Yokota, M. Nihon Univ 1-2-1 Izumicho Narashino Chiba 2758575 Japan Nihon Comp Kaihatsu Co Ltd Shinagawa Ku Tokyo 1400013 Japan Fukuoka Inst Technol Higashi Ku Fukuoka 8110295 Japan

ISBN: (纸本)9784990288051

This paper describes a user study of a life-supporting humanoid directed in a multimodal language and discusses the results. Twenty inexperienced users commanded the humanoid in a computer simulated remote home environment in the language by pressing keypad buttons and speaking to the robot. The results show that they comprehended the language well and were able to give commands successfully. They often chose a button press action in place of verbal phrases to specify a direction, speed, length, angle, and/or temperature value, and preferred multimodal commands to spoken commands. However, they did not think that it was very easy to give commands in the language. This paper discusses the results and points out both strong and weak points of the language and robots.

关键词： Life-supporting robot multimodal language user study humanoid human-robot interaction

来源：评论

学校读者我要写书评

暂无评论

Gesture Reduces Mapping Difficulties in the Development of Spatial language Depending on the Complexity of Spatial Relations

引用

COGNITIVE SCIENCE 2025年第2期49卷 e70046页

作者： Unal, Ercenur Kirbasoglu, Kevser Karadoller, Dilay Z. Sumer, Beyza Ozyurek, Asli Max Planck Inst Psycholinguist Multimodal Language Dept Nijmegen Netherlands Ozyegin Univ Dept Psychol Istanbul Turkiye Middle East Tech Univ Dept Psychol Ankara Turkiye Univ Amsterdam Dept Linguist Amsterdam Netherlands Radboud Univ Nijmegen Donders Inst Brain Cognit & Behav Nijmegen Netherlands

In spoken languages, children acquire locative terms in a cross-linguistically stable order. Terms similar in meaning to in and on emerge earlier than those similar to front and behind, followed by left and right. This order has been attributed to the complexity of the relations expressed by different locative terms. An additional possibility is that children may be delayed in expressing certain spatial meanings partly due to difficulties in discovering the mappings between locative terms in speech and spatial relation they express. We investigate cognitive and mapping difficulties in the domain of spatial language by comparing how children map spatial meanings onto speech versus visually motivated forms in co-speech gesture across different spatial relations. Twenty-four 8-year-old and 23 adult native Turkish-speakers described four-picture displays where the target picture depicted in-on, front-behind, or left-right relations between objects. As the complexity of spatial relations increased, children were more likely to rely on gestures as opposed to speech to informatively express the spatial relation. Adults overwhelmingly relied on speech to informatively express the spatial relation, and this did not change across the complexity of spatial relations. Nevertheless, even when spatial expressions in both speech and co-speech gesture were considered, children lagged behind adults when expressing the most complex left-right relations. These findings suggest that cognitive development and mapping difficulties introduced by the modality of expressions interact in shaping the development of spatial language.

关键词： Spatial language Gesture multimodal language language development Spatial cognition

来源：评论

学校读者我要写书评

暂无评论

The integration of the visual-gestural modality in research on child language development: A commentary on Karadöller, Sümer and Özyürek

引用

FIRST language 2025年

作者： Morgenstern, Aliyah Caet, Stephanie Sorbonne Nouvelle Univ 8 Ave St Mande F-75012 Paris Ile De France France Univ Lille Lille France

This commentary builds on Karad & ouml;ller et al.'s endeavor to include gesture studies on the one hand and sign language studies on the other to highlight the crucial part played by the visual-gestural modality in child language development. While we acknowledge the invaluable contribution of their paper to research on multimodal language development, we question the authors' phrasing of the relationship between gesture and language, as well as the selection of reviewed studies, arguing that it might narrow perspectives on methodologies, contexts, age groups, and cultural influences. We advocate for a deeper recognition of the parallels within visual-gestural modality across both sign and spoken (multimodal) languages.

关键词： Visual-gestural modality sign language gesture multimodal language

来源：评论

学校读者我要写书评

暂无评论

Computational methods and grammars in language evolution: a survey

引用

ARTIFICIAL INTELLIGENCE REVIEW 2016年第3期45卷 369-403页

作者： Grifoni, Patrizia D'Ulizia, Arianna Ferri, Fernando CNR Rome Italy

The interest in language evolution by various disciplines, such as linguistics, computer science, biology, etc., makes language evolution models an active research topic and many models have been defined in the last decade. In this work, an overview of computational methods and grammars in language evolution models is given. It aims to introduce readers to the main concepts and the current approaches in language evolution research. Some of the language evolution models, developed during the decade 2003-2012, have been described and classified considering both the grammatical representation (context-free, attribute, Christiansen, fluid construction, or universal grammar) and the computational methods (agent-based, evolutionary computation-based or game theoretic). Finally, an analysis of the surveyed models has been carried out to evaluate their possible extension towards multimodal language evolution.

关键词： language evolution Grammatical evolution Evolutionary computation Agent-based models Natural language multimodal language Game-theoretic models

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：