检索结果-内蒙古大学图书馆

A semantic and emotion-based dual latent variable generation model for a dialogue system

CAAI Transactions on Intelligence technology 2023年第2期8卷 319-330页

作者： Ming Yan Xingrui Lou Chien Aun Chan Yan Wang Wei Jiang State Key Laboratory of Media Convergence and Communication Communication University of ChinaBeijingChina School of Information and Communications Engineering Communication University of ChinaBeijingChina Key Laboratory of Acoustic Visual Technology and Intelligent Control System Communication University of ChinaBeijingChina Department of Electrical and Electronic Engineering The University of MelbourneMelbourneVictoriaAustralia School of Data Science and Intelligent Media Communication University of ChinaBeijingChina

With the development of intelligent agents pursuing humanisation,artificial intelligence must consider emotion,the most basic spiritual need in human *** emotional dialogue systems usually use an external emotional dictionary to select appropriate emotional words to add to the response or concatenate emotional tags and semantic features in the decoding step to generate appropriate ***,selecting emotional words from a fixed emotional dictionary may result in loss of the diversity and consistency of the *** propose a semantic and emotion-based dual latent variable generation model(Dual-LVG)for dialogue systems,which is able to generate appropriate emotional responses without an emotional *** from previous work,the conditional variational autoencoder(CVAE)adopts the standard transformer ***,Dual-LVG regularises the CVAE latent space by introducing a dual latent space of semantics and *** content diversity and emotional accuracy of the generated responses are improved by learning emotion and semantic features ***,the average attention mechanism is adopted to better extract semantic features at the sequence level,and the semi-supervised attention mechanism is used in the decoding step to strengthen the fusion of emotional features of the *** results show that Dual-LVG can successfully achieve the effect of generating different content by controlling emotional factors.

关键词： conditional variational autoencoder dual latent space emotional responses latent variable generation

来源：评论

学校读者我要写书评

暂无评论

Perceptual Attribute Analysis of Objective acoustic Parameters of Musical Instrument Timbre

Perceptual Attribute Analysis of Objective Acoustic Paramete...

引用

2021 International Conference on Culture-Oriented Science and technology, ICCST 2021

作者： Liu, Jingyu Chen, Yuqu Ran, Can Huang, Yongzhan Jiang, Wei Ministry of Culture and Tourism Communication University of China Key Laboratory of Acoustic Visual Technology and Intelligent Control System Beijing China Communication University of China School of Information and Communication Engineering Beijing China

ISBN: (纸本)9781665442541

The timbre attributes are affected by multiple factors such as the time domain, frequency domain, time-frequency domain, and harmonic structure of the sound signal, and there is a certain degree of correlation and redundancy among the objective acoustic parameters. Analyzing the perception of the objective acoustic parameters of the timbre Attributes is of great significance to the study of timbre perception. In order to achieve the above goals, this paper constructs a timbre database of Chinese and Western musical monophonic instruments, and extracts 45 timbre objective acoustic parameters based on this database. through factor analysis of these acoustic parameters, it shows that the Information of 45 timbre objective acoustic parameters can be condensed into 6 factors, and each factor has a clear timbre perception attribute. Based on this result, we use the multi-dimensional scale analysis method to verify the six factors, and the verification results are basically consistent with the factor analysis results. The 6 factors constructed can explain the time-frequency domain distribution, structure and energy distribution of acoustic parameters, and provide a theoretical basis for constructing an interpretable model based on audio objective acoustic parameters. © 2021 IEEE.

关键词： Multivariant analysis

来源：评论

学校读者我要写书评

暂无评论

Architectural Color Image Scale Computing of Beijing Forbidden City

Architectural Color Image Scale Computing of Beijing Forbidd...

引用

2024 International Conference on Culture-Oriented Science and technology, CoST 2024

作者： Liu, Bowen Huang, Wenli Yu, Xiumeng Ma, Zongliu Guo, Ziyi Wang, Shuang Jiang, Wei Communication University of China State Key Laboratory of Media Convergence and Communication 100024 China Communication University of China Key Laboratory of Acoustic Visual Technology and Intelligent Control System 100024 China Communication University of China Beijing Key Laboratory of Modern Entertainment Technology 100024 China

ISBN: (纸本)9798350380347

The traditional color system of Beijing Forbidden City is comprehensive and complex. The research focuses on collecting color data from the Forbidden City, analyzing subjective and objective color attributes, and compute architectural color image scale. First this research used K-means algorithm to extract the theme color cards of Beijing Forbidden City. Subsequently, single colors were extracted using the idea of community detection, and matching colors were extracted based on the thought of association rule mining. Then this research extracted objective attributes of colors and designed experiments to quantify subjective attributes. Finally, the color subjective and objective data fitting was completed. This outcome is helpful for the digital preservation of traditional colors and the advancement of color culture inheritance practices. © 2024 IEEE.

关键词： Color computer graphics

来源：评论

学校读者我要写书评

暂无评论

Semantic Analysis and Modeling of the Color of Stage Costume - A Case Study of 'The Painting Journey'

Semantic Analysis and Modeling of the Color of Stage Costume...

引用

2024 International Conference on Culture-Oriented Science and technology, CoST 2024

作者： Huang, Wenli Liu, Bowen Sun, Fang Wang, Shuang Communication University of China State Key Laboratory of Media Convergence and Communication 100024 China Key Laboratory of Acoustic Visual Technology and Intelligent Control System Communication University of China 100024 China Beijing Key Laboratory of Modern Entertainment Technology Communication University of China 100024 China

ISBN: (纸本)9798350380347

The creation of Chinese dance dramas plays an important role in the dissemination of Chinese culture in the context of pluralistic unity. As one of the outstanding poetry dramas in the past two years, 'The Journey of a Legendary Landscape Painting' (JLLP) has rich national cultural connotations and aesthetic value in its stage costume colors. This article first studied the data extraction method of stage costume colors based on clustering and association rule mining, and constructed the color dataset for JLLP. On this basis, the color semantic mining and extraction including subjective and objective factors were conducted. Finally, combined with color semantics, the character personality of JLLP was further analyzed. The research results show that the color extraction method designed in this article can accurately preserve the color characteristics of stage costumes. In addition, the costume colors of JLLP play a good supporting role in shaping the character personality. © 2024 IEEE.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Source Separation of Piano Concertos Using Hybrid LSTM-Transformer Model

Source Separation of Piano Concertos Using Hybrid LSTM-Trans...

引用

2024 International Conference on Culture-Oriented Science and technology, CoST 2024

作者： Liu, JingYu He, Wei Zhou, Jingjing Jiang, Wei State Key Laboratory of Media Convergence and Communication Beijing China Key Laboratory of Acoustic Visual Technology and Intelligent Control System Ministry of Culture and Tourism Beijing China School of Information and Communication Engineering Communication University of China Beijing China

ISBN: (纸本)9798350380347

Music source separation, the process of extracting independent audio streams from a complex mix, has traditionally focused on isolating vocals, drums, bass, and other primary sources. This study tackles the more intricate task of separating the piano component from a piano concerto-a challenge compounded by the diverse range of instruments and the dynamic shifts in volume and timbre. Unlike traditional music separation tasks, the piano's distinct characteristics and its interaction with the orchestra demand a more nuanced *** address the scarcity of multi-track recordings for piano concertos, this research pioneers an artificial data synthesis strategy to create a robust training dataset. We introduce a novel hybrid deep learning model that integrates Long Short-Term Memory (LSTM) networks with Transformer architecture, capitalizing on their complementary strengths to distinguish piano melodies from the rich tapestry of orchestral sounds. Our experiments demonstrate that this hybrid approach significantly outperforms conventional methods, with an improvement of 3.18 dB in signal-to-distortion ratio. These results not only validate the efficacy of proposed method but also pave the way for innovative applications in classical music source separation. © 2024 IEEE.

关键词： Source separation

来源：评论

学校读者我要写书评

暂无评论

A Study of Color-emotion Image Set Construction and Feature Analysis

A Study of Color-emotion Image Set Construction and Feature ...

引用

International Conference on Computer and Information Science (ACIS)

作者： Wei Jiang Shuang Wang Yanan Su Jingyu Liu Key Laboratory of Acoustic Visual Technology and Intelligent Control System (Communication University of China)

This paper mainly studies the method of feature extraction of image set, and makes an in-depth analysis between objective features and subjective features. Firstly, a color-emotion image set was constructed with the presentation of an image set construction scheme facing to the research of audiovisual fusion information processing. Secondly, this paper improved the color dominate extraction algorithm and the membership function of cool-warm attribute to acquire the better corresponding to human visual perception. Thirdly, a subjective evaluation experiment was introduced to extract subjective features. Finally, on the basic of feature extraction, this paper makes an in-depth analysis with these features, which has some interesting findings.

关键词： Color Feature extraction Image color analysis Standards visualization Clustering algorithms Reliability

来源：评论

学校读者我要写书评

暂无评论

The Association Between Timbre of Musical Sound and Texture

The Association Between Timbre of Musical Sound and Texture

引用

International Conference on Computer and Information Science (ACIS)

作者： Wei Jiang Xiaoyi Zhang Jingyu Liu Key Laboratory of Acoustic Visual Technology and Intelligent Control System (Communication University of China)

This paper mainly studies the association between the timbre of music and the texture of images, and constructs the mathematical model of the association. Firstly, extract texture features, and system clustering and multidimensional scaling are carried out on the images in Brodatz texture database to select 18 texture images to be used for subjective evaluation experiment. Through the subjective evaluation experiment, the data of the timbre perceptual features and the matching relationship between timbre and texture are obtained. Based on this data, the Pearson correlation coefficient about matching (or mismatching) timbre-texture feature pairs is calculated respectively, the absolute value of the correlation coefficient peaked at 0.752, which verifies the strong association between them. Logistic, random forest and BP neural network are used to predict the matching relationship between texture and timbre, and prediction models with high accuracy were obtained. The precision of BP neural network reached 70%, which can better predict the matching relationship between texture and timbre.

关键词： Timbre Feature extraction Instruments Correlation coefficient Correlation Image color analysis

来源：评论

学校读者我要写书评

暂无评论

Research on visual Cognitive Model Modeling based on Design Psychology

Research on Visual Cognitive Model Modeling based on Design ...

引用

2022 International Conference on Culture-Oriented Science and technology, CoST 2022

作者： Hua, Tianyu Wang, Shuang Liu, Jingyu Jiang, Jian State Key Laboratory of Media Convergence and Communication Communication University of China China Key Laboratory of Acoustic Visual Technology and Intelligent Control System Ministry of Culture and Tourism China China China Digital Culture Group Co. Ltd China

ISBN: (数字)9781665462488

ISBN: (纸本)9781665462488

This article is based on the theoretical achievements of design psychology, takes graphic poster design as the research object, and combines experimental psychology methods with information processing technology to construct a visual cognitive model that can serve art design. This article firstly starts from the laws of formal beauty in design psychology, and screens the formal beauty features of posters. Secondly, a subjective evaluation experiment for the formal beauty characteristics of the poster materials was conducted, and correlation analysis and factor analysis on the processed experimental data were completed. Finally, this article uses a variety of machine learning algorithms to construct a visual cognitive prediction model. This article summarizes seven low-level and four high-level feature descriptors of the beauty of poster form, and constructs a prediction model from low-level features to high-level features. In addition, this article also quantifies the 'Balance' feature which has the highest word frequency in the low-level features, realizing the calculation of the balance degree of the poster image. © 2022 IEEE.

关键词： Machine learning

来源：评论

学校读者我要写书评

暂无评论

Research on Hybrid Path Planning Algorithm Based on Anti-Collision

Research on Hybrid Path Planning Algorithm Based on Anti-Col...

引用

2023 International Conference on Culture-Oriented Science and technology, CoST 2023

作者： Ren, Penghao Li, Mengnan Su, Zhibin Beijing Radio & Television Station Beijing100022 China Communication University of China Key Laboratory of Acoustic Visual Technology and Intelligent Control System Ministry of Culture and Tourism China Communication University of China Beijing Key Laboratory of Modern Entertainment Technology Beijing100024 China

ISBN: (纸本)9798350357998

In order to solve the problem of fast switching of special equipment in the cultural complex, the improved Moth-Flame Optimization algorithm (MFO) is combined with the improved Dynamic Window Approach (DWA) to realize the hybrid path planning of handling robots in different scenarios of cultural complexes in this paper. Specifically, the traditional Moth-Flame Optimization algorithm is improved and applied to the global path planning problem. On the basis of the planned global path, the intersection of dynamic obstacles with the global path is detected, and the improved Dynamic Window Approach is used for local obstacle avoidance in the section with collision risk, finally, the hybrid path planning in the complex environment of the cultural complex is realized. The simulation experimental results prove the effectiveness of the proposed algorithm. © 2023 IEEE.

关键词： Motion planning

来源：评论

学校读者我要写书评

暂无评论

EMG-based Interactive control Scheme for Stage Lighting

EMG-based Interactive Control Scheme for Stage Lighting

引用

2022 International Conference on Culture-Oriented Science and technology, CoST 2022

作者： Wang, Huiqin Li, Jiajun Ministry of Culture and Tourism Key Laboratory of Acoustic Visual Technology and Intelligent Contral System Beijing China Communication Univerity of China School of Information and Communication Engineering Beijing China

ISBN: (数字)9781665462488

ISBN: (纸本)9781665462488

Aiming at improving the low interactivity of conventional stage lighting control, a gesture-based interactive control scheme for stage lighting is proposed in this paper, which uses electromyogram (EMG) signals to recognize the performers' gestures and converts them into control signals to transform the stage lighting effects subsequently. Gesture recognition, it involves the acquisition, preprocessing, feature extraction, and classification of the EMG signal. Considering the real-time performance and accuracy among the common algorithms such as support vector machine (SVM), k-nearest neighbor (KNN), linear discriminant analysis (LDA), backpropagation (BP) neural network, KNN is adopted as the classification tool. The lighting effect between gestures and stage lights is designed and realized to ensure that stage lighting interactively transforms with gesture changes. The experiment results show the feasibility and convenience of the proposed control scheme. © 2022 IEEE.

关键词： Support vector machines

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：