检索结果-内蒙古大学图书馆

Large-Scale Network Adaptive Situation Awareness Method in Spatio-Temporal Dimension 1

1st International Artificial intelligence Conference, IAIC 2023

作者： Zhang, Hongbin Xu, Ying Liu, Bin Zhao, Dongmei Bai, Yikang School of Information Science and Engineering Hebei University of Science and Technology Shijiazhuang050000 China Hebei Key Laboratory of Network and Information Security Hebei Normal University Hebei Shijiazhuang050024 China School of Economics and Management Hebei University of Science and Technology Shijiazhuang050000 China Research Center of Big Data and Social Computing Hebei University of Science Shijiazhuang China

ISBN: (数字)9789819713325

ISBN: (纸本)9789819713318

In large-scale networks, the state space is exploding and changing dynamically. This leads to difficulties in collecting and analyzing situational awareness data, so we construct an adaptive situational awareness model in spatio-temporal dimensions. In the spatial dimension, vulnerabilities’s threats are assessed through attack graphs combined with Shapley values. At the same time, vulnerability threats are dynamically quantified by updating the status node reachability probability in real time. In the temporal dimension, a game model is established by analyzing vulnerability attack graph nodes to dynamically adjust the observation frequency of high-risk vulnerabilities, focusing on the safety status characteristics of high-risk assets. Experimental results show that our proposal integrates the security features of both space and time dimensions. This method can better focus on high-risk vulnerabilities and accurately reflect the dynamic changes in the network security situation, ensuring timeliness and accuracy in network security detection. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024.

关键词： Network security

来源：评论

学校读者我要写书评

暂无评论

CroPrompt: Cross-task Interactive Prompting for Zero-shot Spoken Language Understanding

CroPrompt: Cross-task Interactive Prompting for Zero-shot Sp...

引用

2025 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2025

作者： Qin, Libo Wei, Fuxuan Chen, Qiguang Zhou, Jingxuan Huang, Shijue Si, Jiasheng Lu, Wenpeng Che, Wanxiang School of Computer Science and Engineering Central South University China Key Laboratory of Data Intelligence and Advanced Computing in Provincial Universities Soochow University China Research Center for Social Computing and Information Retrieval Harbin Institute of Technology China Harbin Institute of Technology Shenzhen China Key Laboratory of Computing Power Network and Information Security Ministry of Education Qilu University of Technology Shandong Academy of Sciences China

ISBN: (纸本)9798350368741

Slot filling and intent detection are two highly correlated tasks in spoken language understanding (SLU). Recent SLU research attempts to explore zero-shot prompting techniques in large language models to alleviate the data scarcity problem. Nevertheless, the existing prompting work ignores the cross-task interaction information for SLU, which leads to sub-optimal performance. To solve this problem, we present the pioneering work of Cross-task Interactive Prompting (CroPrompt) for SLU, which enables the model to interactively leverage the information exchange across the correlated tasks in SLU. Additionally, we further introduce a multi-task self-consistency mechanism to mitigate the error propagation caused by the intent information injection. We conduct extensive experiments on the standard SLU benchmark and the results reveal that CroPrompt consistently outperforms the existing prompting approaches. In addition, the multi-task self-consistency mechanism can effectively ease the error propagation issue, thereby enhancing the performance. We hope this work can inspire more research on cross-task prompting for SLU. © 2025 IEEE.

关键词：

来源：评论

学校读者我要写书评

暂无评论

How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider and MoE Transformers

arXiv

引用

arXiv 2024年

作者： Lu, Xin Zhao, Yanyan Qin, Bing Huo, Liangyu Yang, Qing Xu, Dongliang Research Center for Social Computing and Information Retrieval Harbin Institute of Technology China Science Technology Co. Ltd China

Pre-trained language models have been proven to possess strong base capabilities, which not only excel in in-distribution language modeling but also show powerful abilities in out-of-distribution language modeling, transfer learning and few-shot learning. Unlike existing work focusing on the influence of scale on base capabilities, our work examines the influence of architecture on those. Specifically, our concern is: How does architecture influence the base capabilities of pre-trained language models? In this work, we attempt to explain and reverse the decline in base capabilities caused by the architecture of FFN-Wider Transformers, seeking to provide some insights. Through analysis, we found the contribution ratio of Multi-Head Attention (a combination function) to pre-trained language modeling is a key factor affecting base capabilities. FFN-Wider Transformers reduce the contribution ratio of this combination function, leading to a decline in base capabilities. We confirmed this by experiments and proposed Combination Enhanced Architecture (CEA) to address the decline in base capabilities of such models. Significantly, we extended our explanation and CEA to Mixture of Experts (MoE) Transformers. We successfully achieved significant improvements in base capabilities on a 14B parameter MoE model, demonstrating the practical application value of our work. This also indicates that our analysis has a certain guiding significance for architecture analysis, architecture improvement and architecture design. Copyright © 2024, The Authors. All rights reserved.

关键词： Modeling languages

来源：评论

学校读者我要写书评

暂无评论

Adversarially Robust Deepfake Detection via Adversarial Feature Similarity Learning 30th

Adversarially Robust Deepfake Detection via Adversarial Fea...

引用

30th International Conference on MultiMedia Modeling, MMM 2024

作者： Khan, Sarwar Chen, Jun-Cheng Liao, Wen-Hung Chen, Chu-Song Research Center for Information Technology Innovation Academia Sinica Taipei Taiwan Social Networks Human-Centered Computing TIGP Academia Sinica Taipei Taiwan Computer Science National Chengchi University Taipei Taiwan Computer Science and Information Engineering National Taiwan University Taipei Taiwan

ISBN: (纸本)9783031533105

Deepfake technology has raised concerns about the authenticity of digital content, necessitating the development of effective detection methods. However, the widespread availability of deepfakes has given rise to a new challenge in the form of adversarial attacks. Adversaries can manipulate deepfake videos with small, imperceptible perturbations that can deceive the detection models into producing incorrect outputs. To tackle this critical issue, we introduce Adversarial Feature Similarity Learning (AFSL), which integrates three fundamental deep feature learning paradigms. By optimizing the similarity between samples and weight vectors, our approach aims to distinguish between real and fake instances. Additionally, we aim to maximize the similarity between both adversarially perturbed examples and unperturbed examples, regardless of their real or fake nature. Moreover, we introduce a regularization technique that maximizes the dissimilarity between real and fake samples, ensuring a clear separation between these two categories. With extensive experiments on popular deepfake datasets, including FaceForensics++, FaceShifter, and DeeperForensics, the proposed method outperforms other standard adversarial training-based defense methods significantly. This further demonstrates the effectiveness of our approach to protecting deepfake detectors from adversarial attacks. © 2024, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

How does architecture influence the base capabilities of pre-trained language models? a case study based on FFN-Wider and MoE transformers 24

How does architecture influence the base capabilities of pre...

引用

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Xin Lu Yanyan Zhao Bing Qin Liangyu Huo Qing Yang Dongliang Xu Research Center for Social Computing and Information Retrieval Harbin Institute of Technology Du Xiaoman (Beijing) Science Technology Co. Ltd.

ISBN: (纸本)9798331314385

关键词：

来源：评论

学校读者我要写书评

暂无评论

Trust and Risk Based on Access Control Model in social Internet of Things

引用

International Journal of Network Security 2023年第5期25卷 736-744页

作者： Zhang, Hongbin Liu, Jian Zhao, Dongmei Liu, Bin Wang, Yanmei Fan, Fan School of Information Science and Engineering Hebei University of Science and Technology Shijiazhuang050000 China Hebei Key Laboratory of Network and Information Security Hebei Normal University Shijiazhuang050024 China School of Economics and Management Hebei University of Science and Technology Shijiazhuang050000 China Research Center of Big Data and Social Computing Hebei University of Scienc and Technology Shijiazhuang050000 China Hebei Geological Worker’s University Shijiazhuang050000 China

Integrating social networks and the Internet of Things has formed an emerging field of social Internet of Things (IoT). Aiming to address the shortcomings of traditional TBAC (Trust based on Access Control) and ABAC (Attribute based on Access Control) in dynamic authorization and security, this paper proposes a hybrid access control model based on trust and risk for SIoT. The model supports social relationship-based trust assessment and risk prediction between SIoT nodes and integrates trust and risk values into SIoT security values through reasonable weight allocation. Furthermore, by simulating the safety requirements of different scenarios, it was verified that the model was efficient and more secure than the current models. © (2023). All Rights Reserved.

关键词： Authorization

来源：评论

学校读者我要写书评

暂无评论

OneBit: towards extremely low-bit large language models 24

OneBit: towards extremely low-bit large language models

引用

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Yuzhuang Xu Xu Han Zonghan Yang Shuo Wang Qingfu Zhu Zhiyuan Liu Weidong Liu Wanxiang Che Research Center for Social Computing and Information Retrieval Harbin Institute of Technology Harbin China Department of Computer Science & Technology Tsinghua University Beijing China

ISBN: (纸本)9798331314385

Model quantification uses low bit-width values to represent the weight matrices of existing models to be quantized, which is a promising approach to reduce both storage and computational overheads of deploying highly anticipated LLMs. However, current quantization methods suffer severe performance degradation when the bit-width is extremely reduced, and thus focus on utilizing 4-bit or 8-bit values to quantize models. This paper boldly quantizes the weight matrices of LLMs to 1-bit, paving the way for the extremely low bit-width deployment of LLMs. For this target, we introduce a 1-bit model compressing framework named OneBit, including a novel 1-bit parameter representation method to better quantize LLMs as well as an effective parameter initialization method based on matrix decomposition to improve the convergence speed of the quantization framework. Sufficient experimental results indicate that OneBit achieves good performance (at least 81% of the non-quantized performance on LLaMA models) with robust training processes when only using 1-bit weight matrices. Code and checkpoints are available at https://***/xuyuzhuang11/OneBit

关键词：

来源：评论

学校读者我要写书评

暂无评论

A Study on a Reduced Indicator System for the Network Security Situational Assessment Model

A Study on a Reduced Indicator System for the Network Securi...

引用

2023 International Conference on Networking and Network Applications, NaNA 2023

作者： Zhang, Hongbin Bai, Yikang Zhao, Dongmei Liu, Bin Xu, Ying Hebei Normal University Hebei Key Laboratory of Network and Information Security Shijiazhuang China Hebei University of Science and Technology School of Information Science and Engineering Shijiazhuang China School of Economics and Management Research Center of Big Data and Social Computing Shijiazhuang China

ISBN: (纸本)9798350327380

It is a challenge to monitor the network security state in a large-scale network environment because the selection of situation assessment indicators is overrun by massive observational information. To address this issue, this paper proposes a network security situational assessment model based on a reduced indicator system. The model categorises the characteristics of network assets and threats into endogenous situational factors and exogenous situational factors. By applying the multi-label extremely random tree algorithm to select the importance of network features, a reduced indicator system with independence and strong comprehensiveness is established. Additionally, the weights of the reduced indicator system are calculated using an improved analytical hierarchy process, which yields the evaluation results for network security situations. The experimental results show that the model improves the accuracy and timeliness of the situation assessment model, and the method can reflect the network situation in real time. © 2023 IEEE.

关键词： Network security

来源：评论

学校读者我要写书评

暂无评论

Portability and Scalability of OpenMP Offloading on State-of-the-Art Accelerators 38th

Portability and Scalability of OpenMP Offloading on State...

引用

38th International Conference on High Performance computing, ISC High Performance 2023

作者： Fridman, Yehonatan Tamir, Guy Oren, Gal Department of Computer Science Ben-Gurion University of the Negev Be’er Sheva Israel Department of Physics Nuclear Research Center - Negev Be’er Sheva Israel Scientific Computing Center Nuclear Research Center - Negev Be’er Sheva Israel Intel Corporation Santa Clara United States Department of Computer Science Technion - Israel Institute of Technology Haifa Israel

ISBN: (纸本)9783031408427

Over the last decade, most of the increase in computing power has been gained by advances in accelerated many-core architectures, mainly in the form of GPGPUs. While accelerators achieve phenomenal performances in various computing tasks, their utilization requires code adaptations and transformations. Thus, OpenMP, the most common standard for multi-threading in scientific computing applications, introduced offloading capabilities between host (CPUs) and accelerators since v4.0, with increasing support in the successive v4.5, v5.0, v5.1, and the latest v5.2 versions. Recently, two state-of-the-art GPUs – the intel Ponte Vecchio Max 1100 and the NVIDIA A100 GPUs – were released to the market, with the oneAPI and NVHPC compilers for offloading, correspondingly. In this work, we present early performance results of OpenMP offloading capabilities to these devices while specifically analyzing the portability of advanced directives (using SOLLVE’s OMPVV test suite) and the scalability of the hardware in representative scientific mini-app (the LULESH benchmark). Our results show that the coverage for version 4.5 is nearly complete in both latest NVHPC and oneAPI tools. However, we observed a lack of support in versions 5.0, 5.1, and 5.2, which is particularly noticeable when using NVHPC. From the performance perspective, we found that the PVC1100 and A100 are relatively comparable on the LULESH benchmark. While the A100 is slightly better due to faster memory bandwidth, the PVC1100 reaches the next problem size (4003 ) scalably due to the larger memory size. The results are available at: https://***/Scientific-computing-Lab-NRCN/Accel-OpenMP-Portability-Scalability. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Scalability

来源：评论

学校读者我要写书评

暂无评论

OneBit: Towards Extremely Low-bit Large Language Models

arXiv

引用

arXiv 2024年

作者： Xu, Yuzhuang Han, Xu Yang, Zonghan Wang, Shuo Zhu, Qingfu Liu, Zhiyuan Liu, Weidong Che, Wanxiang Research Center for Social Computing and Information Retrieval Harbin Institute of Technology Harbin China Department of Computer Science & Technology Tsinghua University Beijing China

关键词： Matrix algebra

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：