检索结果-内蒙古大学图书馆

Multimodal Cross-Attention Mechanism-Based Algorithm for Elderly Behavior Monitoring and Recognition

Chinese Journal of Electronics 2025年第1期34卷 309-321页

作者： Hao Liu Zhiquan Feng Qingbei Guo School of Information Science and Engineering Unicersity of Jinan Shandong Provincial Key Laboratory of Network Based Intelligent Computing Unicersity of Jinan

In contrast to the general population, behavior recognition among the elderly poses increased specificity and difficulty, rendering the reliability and usability aspects of safety monitoring systems for the elderly more challenging. Hence, this study proposes a multi-modal perception-based solution for an elderly safety monitoring recognition system. The proposed approach introduces a recognition algorithm based on multi-modal cross-attention mechanism, innovatively incorporating complex information such as scene context and voice to achieve more accurate behavior recognition. By fusing four modalities, namely image, skeleton, sensor data, and audio, we further enhance the accuracy of recognition. Additionally, we introduce a novel human-robot interaction mode, where the system associates directly recognized intentions with robotic actions without explicit commands, delivering a more natural and efficient elderly assistance paradigm. This mode not only elevates the level of safety monitoring for the elderly but also facilitates a more natural and efficient caregiving approach. Experimental results demonstrate significant improvement in recognition accuracy for 11 typical elderly behaviors compared to existing methods.

关键词： Privacy Accuracy Image recognition Speech recognition Robot sensing systems Skeleton Safety Reliability Older adults Monitoring

来源：评论

学校读者我要写书评

暂无评论

Multi-View Transfer Clustering Algorithm Based on Gaussian Mixture Model

Multi-View Transfer Clustering Algorithm Based on Gaussian M...

引用

2024 International Conference on Fuzzy Theory and Its Applications, iFUZZY 2024

作者： Jiang, Yan Li, Xingchen Zhou, Jin Han, Shiyuan Du, Tao Yang, Cheng Liu, Bowen University of Jinan Shandong Provincial Key Laboratory of Network Based Intelligent Computing Jinan250022 China

ISBN: (纸本)9798350352788

It is well known that the Gaussian mixture model (GMM) is an exemplary model-based clustering approach that captures data distribution patterns to facilitate clustering. However, when it faces to multi-view clustering tasks, the classical GMM algorithm often encounters limitations in scalability. Multi-view clustering entails employing diverse views or feature sets to cluster data, thereby achieving comprehensive and accurate clustering outcomes. The classical GMM algorithm fails to fully exploit the correlated information across multiple views, resulting in a decrease in clustering accuracy. This paper proposes a new GMM-based trans-fer multi-view clustering algorithm named MT-GMM. This algorithm transfers valuable knowledge from other views to guide and enhance the clustering task of the current view, thereby improving the clustering performance specifically for the current view. Experimental results conducted on real-world datasets demonstrate that the proposed MT-GMM outperforms several other multi-view clustering methods, as it can effectively harness the complementary information between different views accurately capture the structures of data. © 2024 IEEE.

关键词： Clustering algorithms

来源：评论

学校读者我要写书评

暂无评论

Selective Depth Attention networks for Adaptive Multiscale Feature Representation

IEEE Transactions on Artificial Intelligence

引用

IEEE Transactions on Artificial Intelligence 2024年第10期5卷 5064-5074页

作者： Guo, Qingbei Wu, Xiao-Jun Xu, Tianyang Si, Tongzhen Hu, Cong Tian, Jinglan University of Jinan Shandong Provincial Key Laboratory of Network-based Intelligent Computing Jinan250022 China Jiangnan University School of Artificial Intelligence and Computer Science Wuxi214122 China

Existing multiscale methods lead to a risk of just increasing the receptive field sizes while neglecting small receptive fields. Thus, it is a challenging problem to effectively construct adaptive neural networks for recognizing various spatial-scale objects. To tackle this issue, we first introduce a new attention dimension, i.e., depth, in addition to existing attentions such as channel-attention, spatial-attention, branch-attention, and self-attention. We present a novel selective depth attention network to treat multiscale objects symmetrically in various vision tasks. Specifically, the blocks within each stage of neural networks, including convolutional neural networks (CNNs), e.g., ResNet, SENet, and Res2Net, and vision transformers (ViTs), e.g., PVTv2, output the hierarchical feature maps with the same resolution but different receptive field sizes. Based on this structural property, we design a depthwise building module, namely an selective depth attention (SDA) module, including a trunk branch and a SE-like attention branch. The block outputs of the trunk branch are fused to guide their depth attention allocation through the attention branch globally. According to the proposed attention mechanism, we dynamically select different depth features, which contributes to adaptively adjusting the receptive field sizes for the variable-sized input objects. Moreover, our method is orthogonal to multiscale networks and attention networks, so-called SDA-xNet. Extensive experiments demonstrate that the proposed SDA method significantly improves the original performance as a lightweight and efficient plug-in on numerous computer vision tasks, e.g., image classification, object detection, and instance segmentation. © 2020 IEEE.

关键词： Deep neural networks

来源：评论

学校读者我要写书评

暂无评论

Fusion of Time-Frequency Features in Contrastive Learning for Shipboard Wind Speed Correction

引用

Journal of Ocean University of China 2025年第2期24卷 377-386页

作者： SONG Jian HUANG Meng LI Xiang ZHANG Zhenqiang WANG Chunxiao ZHAO Zhigang Key Laboratory of Computing Power Network and Information Security Ministry of EducationShandong Computer Science Center(National Supercomputer Center in Jinan)Qilu University of Technology(Shandong Academy of Sciences)Jinan 250000China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer ScienceJinan 250000China

Accurate wind speed measurements on maritime vessels are crucial for weather forecasting,sea state prediction,and safe ***,vessel motion and challenging environmental conditions often affect measurement *** address this issue,this study proposes an innovative framework for correcting and predicting shipborne wind *** integrating a main network with a momentum updating network,the proposed framework effectively extracts features from the time and frequency domains,thereby allowing for precise adjustments and predictions of shipborne wind speed *** using real sensor data collected at the Qingdao Oceanographic Institute demonstrates that the proposed method outperforms existing approaches in single-and multi-step predictions compared to existing methods,achieving higher accuracy in wind speed *** proposed innovative approach offers a promising direction for future validation in more realistic maritime onboard scenarios.

关键词： time series prediction wind speed correction comparative learning shipborne sensor

来源：评论

学校读者我要写书评

暂无评论

Applications and potentials of machine learning in optoelectronic materials research:An overview and perspectives

引用

Chinese Physics B 2023年第12期32卷 108-128页

作者：张城洲付小倩 School of Information Science and Engineering University of JinanJinan 250022China Shandong Provincial Key Laboratory of Network based Intelligent Computing University of JinanJinan 250022China

Optoelectronic materials are essential for today's scientific and technological development,and machine learning provides new ideas and tools for their *** this paper,we first summarize the development history of optoelectronic materials and how materials informatics drives the innovation and progress of optoelectronic materials and ***,we introduce the development of machine learning and its general process in optoelectronic materials and describe the specific implementation *** focus on the cases of machine learning in several application scenarios of optoelectronic materials and devices,including the methods related to crystal structure,properties(defects,electronic structure)research,materials and devices optimization,material characterization,and process *** summarizing the algorithms and feature representations used in different studies,it is noted that prior knowledge can improve optoelectronic materials design,research,and decision-making ***,the prospect of machine learning applications in optoelectronic materials is discussed,along with current challenges and future *** paper comprehensively describes the application value of machine learning in optoelectronic materials research and aims to provide reference and guidance for the continuous development of this field.

关键词： optoelectronic materials devices machine learning prior knowledge

来源：评论

学校读者我要写书评

暂无评论

Lithological Facies Classification Using Attention-Based Gated Recurrent Unit

引用

Tsinghua Science and technology 2024年第4期29卷 1206-1218页

作者： Yuwen Liu Yulan Zhang Xingyuan Mao Xucheng Zhou Jingwen Chang Wenwei Wang Pan Wang Lianyong Qi College of Computer Science and Technology China University of Petroleum(East China)Qingdao 266580China Shandong Provincial University Laboratory for Protected Horticulture Weifang University of Science and TechnologyShouguang 262700China School of Mechanical Electrical and Information EngineeringShandong UniversityWeihai 264209China Shandong Provincial Key Laboratory of Network Based Intelligent Computing University of JinanJinan 250022China School of Modern Posts Nanjing University of Posts and TelecommunicationsNanjing 210023China

Lithological facies classification is a pivotal task in petroleum geology, underpinning reservoir characterization and influencing decision-making in exploration and production operations. Traditional classification methods, such as support vector machines and Gaussian process classifiers, often struggle with the complexity and nonlinearity of geological data, leading to suboptimal performance. Moreover, numerous prevalent approaches fail to adequately consider the inherent dependencies in the sequence of measurements from adjacent depths in a well. A novel approach leveraging an attention-based gated recurrent unit (AGRU) model is introduced in this paper to address these challenges. The AGRU model excels by exploiting the sequential nature of well-log data and capturing long-range dependencies through an attention mechanism. This model enables a flexible and context-dependent weighting of different parts of the sequence, enhancing the discernment of key features for classification. The proposed method was validated on two publicly available datasets. Results demonstrate a considerably improvement over traditional methods. Specifically, the AGRU model achieved superior performance metrics considering precision, recall, and F1-score.

关键词： attention mechanism facies classification GRU MLP(multilayer perceptron)

来源：评论

学校读者我要写书评

暂无评论

Deep-reinforcement-learning-based robot motion strategies for grabbing objects from human hands

引用

Virtual Reality & intelligent Hardware 2023年第5期5卷 407-421页

作者： Zeyuan CAI Zhiquan FENG Liran ZHOU Xiaohui YANG Tao XU School of Information Science and Engineering University of JinanJinan 250022China Shandong Provincial Key Laboratory of Network Based Intelligent Computing Jinan 250022China

Background Robot grasping encompasses a wide range of research areas;however, most studies have been focused on the grasping of only stationary objects in a scene;only a few studies on how to grasp objects from a user's hand have been conducted. In this paper, a robot grasping algorithm based on deep reinforcement learning (RGRL) is proposed. Methods The RGRL takes the relative positions of the robot and the object in a user's hand as input and outputs the best action of the robot in the current state. Thus, the proposed algorithm realizes the functions of autonomous path planning and grasping objects safely from the hands of users. A new method for improving the safety of human-robot cooperation is explored. To solve the problems of a low utilization rate and slow convergence of reinforcement learning algorithms, the RGRL is first trained in a simulation scene, and then, the model para-meters are applied to a real scene. To reduce the difference between the simulated and real scenes, domain randomization is applied to randomly change the positions and angles of objects in the simulated scenes at regular intervals, thereby improving the diversity of the training samples and robustness of the algorithm. Results The RGRL's effectiveness and accuracy are verified by evaluating it on both simulated and real scenes, and the results show that the RGRL can achieve an accuracy of more than 80% in both cases. Conclusions RGRL is a robot grasping algorithm that employs domain randomization and deep reinforcement learning for effective grasping in simulated and real scenes. However, it lacks flexibility in adapting to different grasping poses, prompting future research in achieving safe grasping for diverse user postures.

关键词： Robot grasping Deep reinforcement learning Domain randomization Human-to-robot handovers Human-machine collaboration

来源：评论

学校读者我要写书评

暂无评论

Design of a new kind of chemical experiment container with virtual reality fusion

引用

Virtual Reality & intelligent Hardware 2023年第4期5卷 317-337页

作者： Lurong YANG Zhiquan FENG Junhong MENG Department of Information Science and Engineering University of JinanJinan 250022China Shandong Provincial Key Laboratory of Network Based Intelligent Computing Jinan 250022China

Background At present,the teaching of experiments in primary and secondary schools is affected by cost and security *** research on virtual experiment platforms has alleviated these ***,the lack of real experimental equipment and use of a single channel to understand user intentions weaken these platforms operationally and degrade the naturalness of *** To solve these problems,we propose an intelligent experimental container structure and a situational awareness algorithm,both of which are verified and applied to a chemical experiment involving virtual-real ***,the acquired images are denoised in the visual channel using the maximum diffuse reflection chroma to remove ***,container situational awareness is realized by segmenting the image liquid level and establishing a relation-fitting ***,strategies for constructing complete behaviors and making priority comparisons among behaviors are adopted for information complementarity and independence,respectively.A multichannel intentional understanding model and an inter-active paradigm that integrates vision,hearing,and touch are *** The experimental results show that the accuracy of the intelligent container situation awareness proposed in this paper reaches 99%,and the accuracy of the proposed intention understanding algorithm reaches 94.7%.The test shows that the intelligent experimental system based on the new interaction paradigm also has better performance and a more realistic sense of operation experience in terms of experimental *** The results indicate that the proposed experimental container and algorithm can achieve a natural level of human-computer interaction in a virtual chemical experiment platform,enhance the user′s sense of operation,and achieve high levels of user satisfaction.

关键词： Multichannel intent fusion understanding Virtual-real fusion Natural interaction Remove image highlights Nonlinear curve fitting

来源：评论

学校读者我要写书评

暂无评论

A Novel Grades Prediction Method for Undergraduate Students by Learning Explicit Conditional Distribution

IEEE Transactions on Artificial Intelligence

引用

IEEE Transactions on Artificial Intelligence 2024年第9期5卷 4837-4848页

作者： Zhang, Na Liu, Ming Wang, Lin Liu, Shuangrong Sun, Runyuan Yang, Bo Zhu, Shenghui Li, Chengdong Yang, Cheng Cheng, Yuhu China University of Mining and Technology School of Information and Control Engineering Xuzhou221116 China Shandong Key Laboratory of Intelligent Buildings Technology Jinan250101 China University of Jinan Shandong Provincial Key Laboratory of Network Based Intelligent Computing Jinan250022 China Quan Cheng Laboratory Jinan250100 China Shandong Jianzhu University Shandong Key Laboratory of Intelligent Buildings Technology Jinan250101 China Shandong Jianzhu University School of Information and Electrical Engineering Jinan250101 China Ministry of Education Engineering Research Center of Intelligent Control for Underground Space Xuzhou221116 China

Educational data mining (EDM) offers an effective solution to predict students' course grades in the next term. Conventional grade prediction methods can be viewed as regressing an expectation of the probability distribution of the student's grade, typically called single-value grade prediction. The reliable prediction outcomes of these methods depend on the complete input information related to students. However, next-term grade prediction often encounters the challenge of incomplete input information due to the inaccessibility of future data and the privacy of data. In this scenario, single-value grade prediction struggles to assess students' academic status, as it may not be represented and assessed by relying on a singular expectation value. This limitation increases the risk of misjudgment, and may lead to errors in educational decision-making. Considering the challenge of collecting complete input information, we shift from traditional single-value predictions to forecasting the explicit probability distribution of the course grade. The probability distribution of the grade can assess the students' academic status by providing probabilities corresponding to all possible grade values rather than relying solely on an expectation value, which offers the foundation to support the educators' decision-making. In this article, the course grade distribution prediction (CGDP) model is proposed, aiming to estimate an explicit conditional probability distribution of course grades in the next term. This model can identify at-risk students, offering comprehensive decision-making information for educators and students. To ensure precise distribution predictions, a calibration method is also employed to improve the alignment between predicted and actual probabilities. Experimental results verify the effectiveness of the proposed model in early grade warning for undergraduates, based on real university data. © 2020 IEEE.

关键词： Probability distributions

来源：评论

学校读者我要写书评

暂无评论

Non-Destructive Judgment of Watermelon Ripeness Based on Multi-Feature Fusion of Image 20

Non-Destructive Judgment of Watermelon Ripeness Based on Mul...

引用

20th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, ICNC-FSKD 2024

作者： Shi, Hongbao Liu, Jun Huang, Yimei Li, Jinping School of Information Science and Engineering University of Jinan Shandong Provincial Key Laboratory of Network Based Intelligent Computing Jinan China

ISBN: (纸本)9798350356328

The nondestructive judgment of watermelon ripeness is a key issue in everyday life. Whether watermelons are ripe or not affects the interests of watermelon farmers and consumers. So far, acoustic, electrical, machine vision and other methods have been applied to the nondestructive judgment of agricultural product ripeness, but the equipment used in the lab, such as spectrometers and laser Doppler vibrometers, is expensive, difficult to carry, and has limited practical value in daily life. Based on practical experience, the ripeness of watermelons can be judged by observing specific physical characteristics, such as the rind's glossiness, texture, fuzz on the fruit stalk and navel. In this study, images of the watermelon's texture, fuzz and navel were captured using a smartphone. We utilized ResN et with an embedded Coordinate Attention mechanism and Swin-Transformer networks to independently analyze the ripeness of each feature. Then we combined the output prediction scores using post-fusion technology, with the highest weighted prediction score judging the final ripeness assessment. Our method achieved a 90.2% accuracy rate on the test set. The experiments demonstrate that a deep learning model utilizing multi-feature fusion of image data can reliably and accurately identify watermelon ripeness, even under varying image conditions. © 2024 IEEE.

关键词： Laser Doppler velocimeters

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：