检索结果-内蒙古大学图书馆

A Novel Brain-Inspired Hierarchical Perception-Association Circuit Based on Memristor Arrays

学校读者我要写书评

暂无评论

SSRN

SSRN 2023年

作者： Chen, Liangyu Wang, Xiaoping Chen, Zhanfei Yang, Chao Zeng, Zhigang School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Key Laboratory of Image Processing and Intelligent Control Education Ministry of China Wuhan430074 China Hubei Key Laboratory of Brain-inspired Intelligent Systems Wuhan430074 China

In the brain, primary sensory cells can efficiently perceive multimodal stimuli, and then associative memory cells perform an advanced bidirectional associative memory function with perceived information. Here, a brain-inspired hierarchical perception-association circuit based on memristor arrays is proposed. Firstly, a memristive reservoir computing circuit is designed to simulate a low-level perceptual function, which mainly comprises dynamic analog reservoirs, memristor arrays, and analog integrators, enabling efficient spatio-temporal information processing. Secondly, a spiking bidirectional associative memory memristive circuit, as the core of the whole circuit, is proposed to mimick a high-level associative function, which mainly consists of memristor arrays, current amplifiers, and leaky integrate-and-fire neuron circuits, implementing multimodal associative learning. The simulation results in LTspice show that the modified neuron circuit exhibits 66× improvement in energy efficiency, and the proposed circuit can precisely perform the letter association and vision-audio association tasks in a spiking fashion with an average firing energy consumption of 230 pJ/spike, which has a great potential to be embedded in mobile robotic platforms. © 2023, The Authors. All rights reserved.

关键词： Memristors

GraphMFT: A graph network based multimodal fusion technique for emotion recognition in conversation

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Li, Jiang Wang, Xiaoping Lv, Guoqing Zeng, Zhigang Wuhan430074 China Key Laboratory of Image Processing and Intelligent Control Ministry of Education Wuhan430074 China Hubei Key Laboratory of Brain-inspired Intelligent Systems Wuhan430074 China

Multimodal machine learning is an emerging area of research, which has received a great deal of scholarly attention in recent years. Up to now, there are few studies on multimodal Emotion Recognition in Conversation (ERC). Since Graph Neural Networks (GNNs) possess the powerful capacity of relational modeling, they have an inherent advantage in the field of multimodal learning. GNNs leverage the graph constructed from multimodal data to perform intra- and inter-modal information interaction, which effectively facilitates the integration and complementation of multimodal data. In this work, we propose a novel Graph network based Multimodal Fusion Technique (GraphMFT) for emotion recognition in conversation. Multimodal data can be modeled as a graph, where each data object is regarded as a node, and both intra- and inter-modal dependencies existing between data objects can be regarded as edges. GraphMFT utilizes multiple improved graph attention networks to capture intra-modal contextual information and inter-modal complementary information. In addition, the proposed GraphMFT attempts to address the challenges of existing graph-based multimodal conversational emotion recognition models such as MMGCN. Empirical results on two public multimodal datasets reveal that our model outperforms the State-Of-The-Art (SOTA) approaches with the accuracy of 67.90% and 61.30%. Copyright © 2022, The Authors. All rights reserved.

关键词： Emotion Recognition

GridSort: image-based Optical Bulk Material Sorting Using Convolutional LSTMs

学校读者我要写书评

暂无评论

IFAC-PapersOnLine 2023年第2期56卷 4620-4626页

作者： Marcel Reith-Braun Albert Bauer Maximilian Staab Florian Pfaff Georg Maier Robin Gruna Thomas Längle Jürgen Beyerer Harald Kruggel-Emden Uwe D. Hanebeck Intelligent Sensor-Actuator-Systems Laboratory Karlsruhe Institute of Technology 76131 Karlsruhe Germany Chair of Mechanical Process Engineering and Solids Processing Technische Universität Berlin 10587 Berlin Germany Fraunhofer Institute of Optronics System Technologies and Image Exploitation 76131 Karlsruhe Germany

Optical sorters separate particles of different classes by first detecting them while they are transported, e.g., on a conveyor belt, and subsequently bursting out particles of undesired classes using compressed air nozzles. Currently, the most promising results are achieved by predictive tracking, a multitarget tracking approach based on extracted midpoints from area-scan camera images that analyzes the particles’ motion and activates the nozzles accordingly. However, predictive tracking requires expert knowledge for setup and preceding object detection. Moreover, particle shapes are only considered implicitly, and the need to solve an association problem rises the computational complexity of the algorithm. In this paper, we present GridSort, an image-based approach that forecasts the scene at the nozzle array using a convolutional long short-term memory neural network and subsequently extracts nozzle activations, thus circumventing the aforementioned weaknesses. We show how GridSort can be trained in an unsupervised fashion and evaluate it using a coupled discrete element–computational fluid dynamics simulation of an optical sorter. We compare our method with predictive tracking in terms of sorting accuracy and demonstrate that it is an easy-to-apply alternative while achieving state-of-the-art results.

关键词： Monitoring of product quality and control performance Neural networks in process control Machine learning methods and applications Artificial intelligence in mining, minerals and metals Process monitoring and fault diagnosis

Spiking Neural Network for Intra-cortical Brain Signal Decoding

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Yang, Song Fu, Haotian Zhang, Herui Zhang, Peng Li, Wei Wu, Dongrui Key Laboratory of the Ministry of Education for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Hubei Key Laboratory of Brain-inspired Intelligent Systems Huazhong University of Science and Technology Wuhan430074 China Department of Biomedical Engineering College of Life Science and Technology Huazhong University of Science and Technology Wuhan430074 China

Decoding brain signals accurately and efficiently is crucial for intra-cortical brain-computer interfaces. Traditional decoding approaches based on neural activity vector features suffer from low accuracy, whereas deep learning based approaches have high computational cost. To improve both the decoding accuracy and efficiency, this paper proposes a spiking neural network (SNN) for effective and energy-efficient intra-cortical brain signal decoding. We also propose a feature fusion approach, which integrates the manually extracted neural activity vector features with those extracted by a deep neural network, to further improve the decoding accuracy. Experiments in decoding motor-related intra-cortical brain signals of two rhesus macaques demonstrated that our SNN model achieved higher accuracy than traditional artificial neural networks;more importantly, it was tens or hundreds of times more efficient. The SNN model is very suitable for high precision and low power applications like intracortical brain-computer interfaces. © 2025, CC BY.

关键词： Deep neural networks

Improving Accuracy of Optical Sorters Using Closed-Loop Control of Material Recirculation

学校读者我要写书评

暂无评论

Improving Accuracy of Optical Sorters Using Closed-Loop Cont...

American Control Conference (ACC)

作者： Jonathan Vieth Marcel Reith-Braun Albert Bauer Florian Pfaff Georg Maier Robin Gruna Thomas Längle Harald Kruggel-Emden Uwe D. Hanebeck Intelligent Sensor-Actuator-Systems Laboratory Karlsruhe Institute of Technology Karlsruhe Germany Intelligent Sensor-Actuator-Systems Laboratory (ISAS) Karlsruhe Institute of Technology Karlsruhe Germany Chair of Mechanical Process Engineering and Solids Processing (MVTA) Technical University of Berlin Berlin Germany Fraunhofer Institute of Optronics System Technologies and Image Exploitation (IOSB) Karlsruhe

Optical sorting is a key technology for the circular economy and is widely applied in the food, mineral, and recycling industries. Despite its widespread use, one typically resorts to expensive means of adjusting the accuracy, e.g., by reducing the mass flow or changing mechanical or software parameters, which typically requires manual tuning in a lengthy, iterative process. To circumvent these drawbacks, we propose a new layout for optical sorters along with a controller that allows re-feeding of controlled fractions of the sorted mass flows. To this end, we build a dynamic model of the sorter, analyze its static behavior, and show how material recirculation affects the sorting accuracy. Furthermore, we build a model predictive controller (MPC) employing the model and evaluate the closed-loop sorting system using a coupled discrete element–computational fluid dynamics (DEM–CFD) simulation, demonstrating improved accuracy.

关键词：

Hybrid Data-Free Knowledge Distillation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Tang, Jialiang Chen, Shuo Gong, Chen School of Computer Science and Engineering Nanjing University of Science and Technology China Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education China Jiangsu Key Laboratory of Image and Video Understanding for Social Security China Center for Advanced Intelligence Project RIKEN Japan Department of Automation Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University China

Data-free knowledge distillation aims to learn a compact student network from a pre-trained large teacher network without using the original training data of the teacher network. Existing collection-based and generation-based methods train student networks by collecting massive real examples and generating synthetic examples, respectively. However, they inevitably become weak in practical scenarios due to the difficulties in gathering or emulating sufficient real-world data. To solve this problem, we propose a novel method called Hybrid Data-Free Distillation (HiDFD), which leverages only a small amount of collected data as well as generates sufficient examples for training student networks. Our HiDFD comprises two primary modules, i.e., the teacher-guided generation and student distillation. The teacher-guided generation module guides a Generative Adversarial Network (GAN) by the teacher network to produce high-quality synthetic examples from very few real-world collected examples. Specifically, we design a feature integration mechanism to prevent the GAN from overfitting and facilitate the reliable representation learning from the teacher network. Meanwhile, we drive a category frequency smoothing technique via the teacher network to balance the generative training of each category. In the student distillation module, we explore a data inflation strategy to properly utilize a blend of real and synthetic data to train the student network via a classifier-sharing-based feature alignment technique. Intensive experiments across multiple benchmarks demonstrate that our HiDFD can achieve state-of-the-art performance using 120 times less collected data than existing methods. Code is available at https://***/tangjialiang97/HiDFD. Copyright © 2024, The Authors. All rights reserved.

关键词： Students

InferEM: Inferring the Speaker’s Intention for Empathetic Dialogue Generation

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Lv, Guoqing Li, Jiang Wang, Xiaoping Zeng, Zhigang The School of Artificial Intelligence and Automation The Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China The Hubei Key Laboratory of Brain-inspired Intelligent Systems Huazhong University of Science and Technology Wuhan430074 China

Current approaches to empathetic response generation typically encode the entire dialogue history directly and put the output into a decoder to generate friendly feedback. These methods focus on modelling contextual information but neglect capturing the direct intention of the speaker. We argue that the last utterance in the dialogue empirically conveys the intention of the speaker. Consequently, we propose a novel model named InferEM for empathetic response generation. We separately encode the last utterance and fuse it with the entire dialogue through the multi-head attention based intention fusion module to capture the speaker’s intention. Besides, we utilize previous utterances to predict the last utterance, which simulates human’s psychology to guess what the interlocutor may speak in advance. To balance the optimizing rates of the utterance prediction and response generation, a multitask learning strategy is designed for InferEM. Experimental results demonstrate the plausibility and validity of InferEM in improving empathetic expression. Copyright © 2022, The Authors. All rights reserved.

关键词： Encoding (symbols)

Difference in Uptake Pattern Heterogeneity and Reproducibility of Radiomics Features Between FAPI and FDG Pet/Ct Imaging of Tumors

学校读者我要写书评

暂无评论

Difference in Uptake Pattern Heterogeneity and Reproducibili...

IEEE International Symposium on Biomedical Imaging

作者： Tianmeng Xu Yanchao Huang Tingting Ang Shuilin Chu Peiyin Luo Shunfang Wang Yufeng Zhang Lijun Lu Ganghua Tang Wenbing Lv School of Information and Yunnan Key Laboratory of Intelligent Systems and Computing Yunnan University Kunming China Department of Nuclear Medicine Laboratory for Quality Control and Evaluation of Radiopharmaceuticals Nanfang Hospital Southern Medical University Guangzhou China School of Biomedical Engineering and Guangdong Provincial Key Laboratory of Medical Image Processing Southern Medical University Guangzhou China

ISBN: (数字)9798350313338

ISBN: (纸本)9798350313345

To investigate the difference in uptake pattern heterogeneity between fluorodeoxyglucose (FDG) and fibroblast activation protein inhibitor (FAPI) PET/CT and the reproducibility of radiomics features with respect to different calculation methods of standardized uptake value (SUV). 210 patients with various tumors were involved. Among the extracted 497 radiomics features, there are only 20 features that exhibited an ICC difference of more than 0.25 between the two tracers when using different SUV calculation methods, revealing the similar influence of SUV calculation methods. In contrast, the ICC values for most texture features were generally lower (0.22-0.39) between FDG and FAPI PET images, indicating a large difference in uptake pattern heterogeneity between the two tracers. Our results demonstrated that the influence of SUV calculation methods on the reproducibility of FDG and FAPI PET features is similar. The uptake pattern heterogeneity characterized by radiomics features between FDG and FAPI PET images is significantly different.

关键词： Proteins Protein engineering Inhibitors Fibroblasts Feature extraction Reproducibility of results Radiomics

MindEye-OmniAssist: A Gaze-Driven LLM-Enhanced Assistive Robot System for Implicit Intention Recognition and Task Execution

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Zhang, Zejia Yang, Bo Chen, Xinxing Shi, Weizhuang Wang, Haoyuan Luo, Wei Huang, Jian Hubei Key Laboratory of Brain-Inspired Intelligent Systems Huazhong University of Science and Technology Wuhan430074 China Key Laboratory of the Ministry of Education for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China State key laboratory of intelligent vehicle safety technology chongqing changan automobile co ltd Chongqing400023 China Science and technology innovation center China ship development and design centre Wuhan430060 China

A promising effective human-robot interaction in assistive robotic systems is gaze-based control. However, current gaze-based assistive systems mainly help users with basic grasping actions, offering limited support. Moreover, the restricted intent recognition capability constrains the assistive system’s ability to provide diverse assistance functions. In this paper, we propose an open implicit intention recognition framework powered by Large Language Model (LLM) and Vision Foundation Model (VFM), which can process gaze input and recognize user intents that are not confined to predefined or specific scenarios. Furthermore, we implement a gaze-driven LLM-enhanced assistive robot system (MindEye-OmniAssist) that recognizes user’s intentions through gaze and assists in completing task. To achieve this, the system utilizes open vocabulary object detector, intention recognition network and LLM to infer their full intentions. By integrating eye movement feedback and LLM, it generates action sequences to assist the user in completing tasks. Real-world experiments have been conducted for assistive tasks, and the system achieved an overall success rate of 41/55 across various undefined tasks. Preliminary results show that the proposed method holds the potential to provide a more user-friendly human-computer interaction interface and significantly enhance the versatility and effectiveness of assistive systems by supporting more complex and diverse task. Copyright © 2025, The Authors. All rights reserved.

关键词： Eye movements