检索结果-内蒙古大学图书馆

${\sf Img2Acoustic}$Img2Acoustic: A Cross-Modal Gesture Recognition Method Based on Few-Shot Learning

IEEE Transactions on Mobile Computing 2024年第3期24卷 1496-1512页

作者： Yongpan Zou Jianhao Weng Wenting Kuang Yang Jiao Victor C. M. Leung Kaishun Wu College of Computer Science and Software Engineering Shenzhen University Shenzhen China Faculty of Computer Science and Control Engineering Shenzhen University of Advanced Technology Shenzhen China Artificial Intelligence Research Institute Shenzhen MSU-BIT University Shenzhen China Information Hub Hong Kong University of Science and Technology Guangzhou China

Acoustic-based human gesture recognition (HGR) offers diverse applications due to the ubiquity of sensors and touch-free interaction. However, existing machine learning approaches require substantial training data, making the process time-consuming, costly, and labor-intensive. Recent studies have explored cross-modal methods to reduce the need for large training datasets in behavior recognition, but they typically rely on open-source datasets that closely align with the target domain, limiting flexibility and complicating data collection. In this paper, we propose ${\sf Img2Acoustic}$ , a novel cross-modal acoustic-based HGR approach that leverages models trained on open-source image datasets (i.e., EMNIST, Omniglot) to effectively recognize custom gestures detected via acoustic signals. Our model incorporates a task-aware attention layer (TAAL) and a task-aware local matching layer (TALML), enabling seamless transfer of knowledge from image datasets to acoustic gesture recognition. We implement ${\sf Img2Acoustic}$ on commercial devices and conduct comprehensive evaluations, demonstrating that our method not only delivers superior accuracy and robustness compared to existing approaches but also eliminates the need for extensive training data collection.

关键词： Training Gesture recognition Acoustics Data models Sensors Feature extraction Target recognition Mobile computing Image recognition Few shot learning

来源：评论

学校读者我要写书评

暂无评论

Towards robust neural networks via a global and monotonically decreasing robustness training strategy

引用

Frontiers of information Technology & Electronic engineering 2023年第10期24卷 1375-1389页

作者： Zhen LIANG Taoran WU Wanwei LIU Bai XUE Wenjing YANG Ji WANG Zhengbin PANG Institute for Quantum Information&State Key Laboratory of High Performance Computing National University of Defense TechnologyChangsha 410073China State Key Laboratory of Computer Science Institute of Software Chinese Academy of SciencesBeijing 100190China School of Computer Science and Technology University of Chinese Academy of SciencesBeijing 100190China College of Computer Science and Technology National University of Defense TechnologyChangsha 410073China Key Laboratory of Software Engineering for Complex Systems National University of Defense TechnologyChangsha 410073China

Robustness of deep neural networks(DNNs)has caused great concerns in the academic and industrial communities,especially in safety-critical *** of verifying whether the robustness property holds or not in certain neural networks,this paper focuses on training robust neural networks with respect to given ***-of-the-art training methods,interval bound propagation(IBP)and CROWN-IBP,perform well with respect to small perturbations,but their performance declines significantly in large perturbation cases,which is termed“drawdown risk”in this ***,drawdown risk refers to the phenomenon that IBPfamily training methods cannot provide expected robust neural networks in larger perturbation cases,as in smaller perturbation *** alleviate the unexpected drawdown risk,we propose a global and monotonically decreasing robustness training strategy that takes multiple perturbations into account during each training epoch(global robustness training),and the corresponding robustness losses are combined with monotonically decreasing weights(monotonically decreasing robustness training).With experimental demonstrations,our presented strategy maintains performance on small perturbations and the drawdown risk on large perturbations is alleviated to a great *** is also noteworthy that our training method achieves higher model accuracy than the original training methods,which means that our presented training strategy gives more balanced consideration to robustness and accuracy.

关键词： Robust neural networks Training method Drawdown risk Global robustness training Monotonically decreasing robustness

来源：评论

学校读者我要写书评

暂无评论

High-Fidelity and High-Efficiency Talking Portrait Synthesis With Detail-Aware Neural Radiance Fields

引用

IEEE Transactions on Visualization and computer Graphics 2024年 PP卷 PP-PP页

作者： Wang, Muyu Zhao, Sanyuan Dong, Xingping Shen, Jianbing Wuhan University School of Computer Science National Engineering Research Center for Multimedia Software Institute of Artificial Intelligence Hubei Key Laboratory of Multimedia and Network Communication Engineering Wuhan430072 China Beijing Institute of Technology School of Computer Science Beijing China University of Macau State Key Laboratory of Internet of Things for Smart City Department of Computer and Information Science China

In this paper, we propose a novel rendering framework based on neural radiance fields (NeRF) named HH-NeRF that can generate high-resolution audio-driven talking portrait videos with high fidelity and fast rendering. Specifically, our framework includes a detail-aware NeRF module and an efficient conditional super-resolution module. Firstly, a detail-aware NeRF is proposed to efficiently generate a high-fidelity low-resolution talking head, by using the encoded volume density estimation and audio-eye-aware color calculation. This module can capture natural eye blinks and high-frequency details, and maintain a similar rendering time as previous fast methods. Secondly, we present an efficient conditional super-resolution module on the dynamic scene to directly generate the high-resolution portrait with our low-resolution head. Incorporated with the prior information, such as depth map and audio features, our new proposed efficient conditional super resolution module can adopt a lightweight network to efficiently generate realistic and distinct high-resolution videos. Extensive experiments demonstrate that our method can generate more distinct and fidelity talking portraits on high resolution (900 × 900) videos compared to state-of-the-art methods. Our code is available at https://***/muyuWang/HHNeRF. © 1995-2012 IEEE.

关键词： Rendering (computer graphics)

来源：评论

学校读者我要写书评

暂无评论

Empowering Deaf Children with Sinhala Sign Language, Emotion Detection, and Sound Recognition

Empowering Deaf Children with Sinhala Sign Language, Emotion...

引用

Advancements in Computing (ICAC), International Conference on

作者： W.H.K Fernando P.L.D.N Perera M.I.N Fernando P.T.E.W Gunasekara Harinda Fernando Rivoni De Zoysa Department of Information Technology Sri Lanka Institute of Information Technology Malabe Sri Lanka Department of Computer System Engineering Sri Lanka Institute of Information Technology Malabe Sri Lanka Department of Computer Science Software Engineering Sri Lanka Institute of Information Technology Malabe Sri Lanka

This study describes a broad endeavor to use cutting-edge technologies to empower deaf primary school students in Sri Lanka. Three key elements make up the study: a sound recognition and classification system, an Android software for translating gestures in Sinhala Sign Language (SSL), and a mobile app for emotion recognition and text-tospeech in Sinhala. By promptly alerting caregivers to potential dangers, the sound recognition technology secures the security of deaf children at home, providing an invaluable layer of security. The Android software bridges the communication gap and improves family interactions by translating SSL gestures captured by the device's camera into textual representations. This promotes successful communication between deaf children and their parents. Convolutional Neural Networks (CNNs) are used in the mobile application to detect and understand emotions based on facial expressions. This enables non-verbal youngsters to communicate successfully through Sinhala textto-speech output with adaptive tone modulation. This research aims to build a caring and inclusive atmosphere, enabling increased independence and enhanced communication skills in deaf children by combining these advances. The suggested solutions could significantly improve the lives of deaf kids, providing them with opportunities for better learning, social interaction, and emotional health.

关键词：

来源：评论

学校读者我要写书评

暂无评论

PRAD: Unsupervised KPI Anomaly Detection by Joint Prediction and Reconstruction of Multivariate Time Series 19

PRAD: Unsupervised KPI Anomaly Detection by Joint Prediction...

引用

2022 IEEE SmartWorld, 19th IEEE International Conference on Ubiquitous Intelligence and Computing, 2022 IEEE International Conference on Autonomous and Trusted Vehicles Conference, 22nd IEEE International Conference on Scalable Computing and Communications, 2022 IEEE International Conference on Digital Twin, 8th IEEE International Conference on Privacy Computing and 2022 IEEE International Conference on Metaverse, SmartWorld/UIC/ATC/ScalCom/DigitalTwin/PriComp/Metaverse 2022

作者： Xiong, Zhiying Fan, Qilin Wang, Kai Li, Xiuhua Zhang, Xu Xiong, Qingyu Chongqing University School of Big Data and Software Engineering Chongqing China Chongqing University Chongqing Key Laboratory of Digital Cinema Art Theory and Technology Chongqing China Harbin Institute of Technology School of Computer Science and Technology Weihai China Harbin Institute of Technology Research Institute of Cyberspace Security Weihai China Haihe Laboratory of Information Technology Application Innovation Tianjin China University of Exeter Department of Computer Science Exeter United Kingdom

ISBN: (纸本)9798350346558

Detecting anomalies for key performance indicator (KPI) data is of paramount importance to ensure the quality and reliability of network services. However, building the anomaly detection system for KPI is challenging due to the scarcity of abnormal labels and highly dynamic or even unseen patterns. In this paper, we propose an unsupervised KPI anomaly detection framework named PRAD by jointly optimizing prediction-based and reconstruction-based modules. Specifically, PRAD employs two parallel graph attention networks (GATs) to learn metric-oriented and time-oriented relationships. A temporal convolutional attention network (TCAN) is used to capture complex long-term dependencies. Furthermore, to tackle the overfitting issue in the variational auto-encoder (VAE), PRAD designs a reconstruction-based module that combines VAE with a generative adversarial network (GAN). The experimental results on the two public datasets demonstrate that the proposed PRAD outperforms existing anomaly detection methods. © 2022 IEEE.

关键词： Anomaly detection

来源：评论

学校读者我要写书评

暂无评论

Individual Recognition Method of Radiation Source Based on Deep Subdomain Adaptation Network 22

Individual Recognition Method of Radiation Source Based on D...

引用

22nd IEEE International Conference on Communication Technology, ICCT 2022

作者： Tang, Zhen Zhang, Tao Yang, Xiaomeng Qian, Lei The Sixty- Third Research Institute National University of Defense Technology School of Computer and Software Nanjing University of Information Science and Technology Nanjing China The Sixty-Third Research Institute National University of Defense Technology Nanjing China The Sixty- Third Research Institute National University of Defense Technology School of Electronic and Information Engineering Nanjing University of Information Science and Technology Nanjing China

ISBN: (纸本)9781665470674

Aiming at the problem of the recognition accuracy degradation caused by the channel noise inconsistency between the signal of the radiation source to be identified and the trained radiation source dataset, this paper proposes an individual identification method of radiation sources based on subdomain adaptation. First, the radiation source signal is spliced into IQ images to generate a feature data set. Then the improved Resnet-50 network which has been pre-trained on the image set is utilised to extract the common characteristics of the source and target domains. Finally, the local maximum mean difference adaptive layer is added. By calculating the pseudo-labels in the target domain to match the conditional distribution distance, the difference in the characteristic distribution of sub-type radiation sources under different signal-to-noise ratio (SNR) can be reduced, and the model recognition accuracy can be improved. The experimental findings reveal that the proposed method greatly increases the accuracy of the individual radiation source identification technique based on the deep neural network. Under the condition that the SNR of the signal to be detected increases or falls by 4 dB compared to the training dataset, the identification accuracy of the approach suggested in this study improves by 11.4 percent and 12.7 percent respectively compared with the model Resnet-50. © 2022 IEEE.

关键词： Signal to noise ratio

来源：评论

学校读者我要写书评

暂无评论

Suggestion Mining from Opinionated Text of Big Social Media Data

引用

computers, Materials & Continua 2021年第9期68卷 3323-3338页

作者： Youseef Alotaibi Muhammad Noman Malik Huma Hayat Khan Anab Batool Saif ul Islam Abdulmajeed Alsufyani Saleh Alghamdi Department of Computer Science College of Computer and Information SystemsUmm Al-Qura UniversitySaudi Arabia Department of Computer Science Faculty of Engineering and Computer SciencesNational University of Modern LanguagesIslamabadPakistan Department of Software Engineering Faculty of Engineering and Computer SciencesNational University of Modern LanguagesIslamabadPakistan Department of Computer Sciences Institute of Space TechnologyIslamabadPakistan Department of Computer Science College of Computers and Information TechnologyTaif UniversityTaif21944Saudi Arabia Department of Information Technology College of Computers and Information TechnologyTaif UniversityTaifSaudi Arabia

:Social media data are rapidly increasing and constitute a source of user opinions and tips on a wide range of products and *** increasing availability of such big data on biased reviews and blogs creates challenges for customers and businesses in reviewing all content in their decision-making *** overcome this challenge,extracting suggestions from opinionated text is a possible *** this study,the characteristics of suggestions are analyzed and a suggestion mining extraction process is presented for classifying suggestive sentences from online customers’reviews.A classification using a word-embedding approach is used via the XGBoost *** two datasets used in this experiment relate to online hotel reviews and Microsoft Windows App Studio discussion reviews.F1,precision,recall,and accuracy scores are *** results demonstrated that the XGBoost classifier outperforms—with an accuracy of more than 80%.Moreover,the results revealed that suggestion keywords and phrases are the predominant features for suggestion ***,this study contributes to knowledge and practice by comparing feature extraction classifiers and identifying XGBoost as a better suggestion mining process for identifying online reviews.

关键词： Suggestion mining word embedding Naïve Bayes random forest XGBoost dataset

来源：评论

学校读者我要写书评

暂无评论

Transparency order versus confusion coefficient:a case study of NIST lightweight cryptography S‑Boxes

引用

Cybersecurity 2021年第1期4卷 541-560页

作者： Huizhong Li Guang Yang Jingdian Ming Yongbin Zhou Chengbin Jin Institute of Information Engineering Chinese Academy of SciencesBeijing 100093China School of Cyber Security University of Chinese Academy of SciencesBeijing 100049China School of Cyber Security Nanjing University of Science and TechnologyNanjing 210094China Department of Software Engineering and Software Evaluation Beijing Institute of Computer Technology and ApplicationBeijing 100039China

Side-channel resistance is nowadays widely accepted as a crucial factor in deciding the security assurance level of cryptographic *** most cases,non-linear components(e.g.S-Boxes)of cryptographic algorithms will be chosen as primary targets of side-channel attacks(SCAs).In order to measure side-channel resistance of S-Boxes,three theoretical metrics are proposed and they are reVisited transparency order(VTO),confusion coefficients variance(CCV),and minimum confusion coefficient(MCC),***,the practical effectiveness of these metrics remains still *** the 4-bit and 8-bit S-Boxes used in NIST Lightweight Cryptography candidates as concrete examples,this paper takes a comprehensive study of the applicability of these *** of all,we empirically investigate the relations among three metrics for targeted S-boxes,and find that CCV is almost linearly correlated with VTO,while MCC is inconsistent with the other ***,in order to verify which metric is more effective in which scenarios,we perform simulated and practical experiments on nine 4-bit S-Boxes under the nonprofiled attacks and profiled attacks,*** experiments show that for quantifying side-channel resistance of S-Boxes under non-profiled attacks,VTO and CCV are more reliable while MCC *** also obtain an interesting observation that none of these three metrics is suitable for measuring the resistance of S-Boxes against profiled ***,we try to verify whether these metrics can be applied to compare the resistance of S-Boxes with different ***,all of them are invalid in this scenario.

关键词： Side-channel attacks NIST lightweight cryptography S-Boxes Transparency order Confusion coefficient

来源：评论

学校读者我要写书评

暂无评论

WoKnack-A Professional Social Media Platform for Women Using Machine Learning Approach 3

WoKnack-A Professional Social Media Platform for Women Using...

引用

3rd International Conference on Advancements in Computing, ICAC 2021

作者： Shanmugarajah, Sutharshan Praisoody, Ashvini Uddin, Md Rakib Paskkaran, Vinojan De Silva, Hansi Tharmaseelan, Janani Thilakarathna, Thusithanjana Sri Lanka Institute of Information Technology Department of Computer Science and Software Engineering Malabe Sri Lanka Sri Lanka Institute of Information Technology Department of Information Systems Engineering Malabe Sri Lanka

ISBN: (纸本)9781665408622

Today's generation is heavily influenced by social media. However, most users decline to post their abilities on these platforms for a variety of reasons, including security, a lack of basic skills, and a lack of knowledge about the various skill sets. It's understandable that women face many security risks on these platforms. WoKnack is a professional social networking platform dedicated to women. This opens opportunities for women to demonstrate their abilities and teach other women. This paper targets onfunctionalities like registration limited to female users, skill categorization, post verification and privacy preservation. Facial image, identification document and Voice related gender verification done using machine learning approaches to identify thegender before registration. Accuracy of 91% gained during the process. Skills have been categorized using Natural language processing and post verification done based on these categories. Usage of the best accurate algorithm gives an accuracy of 94% during this process. In order to preserve the privacy of users Data anonymization, skill and location clustering have been added to the system. © 2021 IEEE.

关键词： Machine learning

来源：评论

学校读者我要写书评

暂无评论

Collaborative Multi-Agent Proximal Policy Based Resource Allocation in Clustered IoV Networks

Collaborative Multi-Agent Proximal Policy Based Resource All...

引用

Smart World Congress (SWC), IEEE

作者： Arif Raza Junfan Xiang Salabat Khan Shivanshu Shrivastava M. Wasim Abbas Ashraf Lu Wang College of Computer Science and Software Engineering Shenzhen University Shenzhen China College of Electronics and Information Engineering Shenzhen University Shenzhen China College of Computer and Information Engineering Qilu Institute of Technology Jinan China Department of Electrical and Electronics Engineering Rajiv Gandhi Institute of Petroleum Technology Amethi India School of Mathematics and Computer Science Hanjiang Normal University Shiyan China

ISBN: (数字)9798331520861

ISBN: (纸本)9798331520878

The Internet of Vehicles (IoV) necessitates efficient resource management to meet the growing demands for high data rates, low latency, and real-time communication in Intelligent Transportation Systems (ITS). This paper presents a novel multiagent reinforcement learning framework based on the Proximal Policy Optimization (PPO) algorithm for optimizing resource allocation in clusters of cells within IoV networks. The framework dynamically allocates transmission power and bandwidth across base stations, each acting as a collaborative agent. Extensive simulations demonstrate that the multi-agent PPO approach outperforms other reinforcement learning algorithms, including Soft Actor-Critic (SAC) and Advantage Actor-Critic (A2C), regarding throughput, power efficiency, dynamic bandwidth allocation, and overall network performance.

关键词： Base stations Heuristic algorithms Clustering algorithms Collaboration Reinforcement learning Bandwidth Resource management Vehicle dynamics Optimization Internet of Vehicles

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：