检索结果-内蒙古大学图书馆

IEEE International Conference on Performance, Computing and Communications (IPCCC)

作者： S. Yamagiwa K. Ferreira L.M. Campos K. Aoki M. Ono K. Wada M. Fukuda L. Sousa PDM&FC Lisboa Portugal Parallel and Distributed Computing Laboratory University of Tsukuba Tsukuba Ibaraki Japan Computing and Software Systems UW1-331 University of Washington Bothell Bothell WA USA IST/INESC Lisboa Portugal

Cluster computers have become the vehicle of choice to build high performance computing environments. To fully exploit the computing power of these environments, one must utilize high performance network and protocol technologies, since the communication patterns of parallel applications running on clusters require low latency and high throughput, not achievable by using off-the-shell network technologies. We have developed a technology to build high performance network equipment, called MaestroS. This paper describes the novel techniques used by Maestro2 to extract maximum performance from the physical medium and studies the impact of software-level parameters. The results obtained clearly show that Maestro2 is a promising technology, presenting very good results both in terms of latency and throughput. The results also show the large impact of software overhead in the overall performance of the system and validate the need for optimized communication libraries for high performance computing.

关键词： High performance computing Delay Throughput Vehicles Computer networks Concurrent computing Protocols Communications technology Application software Communication system software

来源：评论

学校读者我要写书评

暂无评论

Big data collaborative artificial intelligence and high-performance computing to drive physical design of fusion

Big data collaborative artificial intelligence and high-perf...

引用

2022 International Conference on Cloud Computing, Big Data Applications and software Engineering, CBASE 2022

作者： Liu, Pan Liu, Gongjie Liu, Jie Liu, Chencheng Xiong, Wenbin Tang, Zhangcun Zhou, Yinzhao Wang, Yonggang Yuan, Zhouming Beijng Paratera Technology Corp. Ltd Beijing100000 China National University of Defense Technology Science and Technology on Parallel and Distributed Processing Laboratory Changsha410073 China National University of Defense Technology Laboratory of Software Engineering for Complex Systems Changsha410073 China Central South University of Forestry and Technology Changsha410000 China Nuclear and Radiation Safety Center Mee Beijing100000 China University of Electronic Science and Technology of China Chengdu610000 China Tianfu Innovation Energy Establishment Chengdu610000 China

ISBN: (纸本)9798350396393

Controlled thermonuclear fusion has always been a dream pursued by mankind. However, the physical processes of controlled thermonuclear fusion are complex, requiring numerical simulations with high performance computing, and the amount of data generated by the physical processes on spatial, temporal and temperature scales is too large to be captured, managed, processed and collated in a reasonable time frame by mainstream software tools to achieve more aggressive fusion physical design. The data are too large to be captured, managed, processed, and collated into more aggressive targets for fusion physical design in a reasonable time by mainstream software tools. At the same time, the failure of fusion ignition can be caused by the distortion of various key physical quantities, and only by decomposing the process step by step and clarifying the changes of key physical quantities in the fusion physics process, can an effective mechanism be formed to prevent the distortion of key physical quantities from causing ignition failure in experimental physics. Big data in collaboration with artificial intelligence and high performance computing to drive the physical design of fusion is a novel avenue. By data acquisition with and pre-processing, this allows the creation of small sample libraries and deep learning. With supervised learning function convergence, incorporating solid/fluid computational methods, further network layering and cell expansion, the parameters of the physical model conforming to Lawson's criterion will become experimental physical parameters, and we find the new approach in Data capacity, Model combination approach, Type of material, Calculation speed, Optimisation of design iteration times, etc. are superior to the traditional approach. © 2022 IEEE.

关键词： Big data

来源：评论

学校读者我要写书评

暂无评论

sNPU: Trusted Execution Environments on Integrated NPUs

sNPU: Trusted Execution Environments on Integrated NPUs

引用

Annual International Symposium on Computer Architecture, ISCA

作者： Erhu Feng Dahu Feng Dong Du Yubin Xia Haibo Chen Institute of Parallel and Distributed Systems SEIEE Shanghai Jiao Tong University Department of Precision Instrument Tsinghua University Engineering Research Center for Domain-specific Operating Systems Ministry of Education China Key Laboratory of System Software (Chinese Academy of Sciences)

ISBN: (数字)9798350326581

ISBN: (纸本)9798350326598

Trusted execution environment (TEE) promises strong security guarantee with hardware extensions for security-sensitive tasks. Due to its numerous benefits, TEE has gained widespread adoption, and extended from CPU-only TEEs to FPGA and GPU TEE systems. However, existing TEE systems exhibit inadequate and inefficient support for an emerging (and significant) processing unit, NPU. For instance, commercial TEE systems resort to coarse-grained and static protection approaches for NPUs, resulting in notable performance degradation (10%–20%), limited (or no) multitasking capabilities, and suboptimal resource utilization. In this paper, we present a secure NPU architecture, known as sNPU, which aims to mitigate vulnerabilities inherent to the design of NPU architectures. First, sNPU proposes NPU Guarder to enhance the NPU’s access control. Second, sNPU defines new attack surfaces leveraging in-NPU structures like scratchpad and NoC, and designs NPU Isolator to guarantee the isolation of scratchpad and NoC routing. Third, our system introduces a trusted software module called NPU Monitor to minimize the software TCB. Our prototype, evaluated on FPGA, demonstrates that sNPU significantly mitigates the runtime costs associated with security checking (from upto 20% to 0%) while incurring less than 1% resource costs.

关键词： Costs Runtime Prototypes Computer architecture Routing software Resource management

来源：评论

学校读者我要写书评

暂无评论

Audio Visual Speech Recognition with Multimodal Recurrent Neural Networks

Audio Visual Speech Recognition with Multimodal Recurrent Ne...

引用

International Joint Conference on Neural Networks

作者： Weijiang Feng Naiyang Guan Yuan Li Xiang Zhang Zhigang Luo Institute of Software College of Computer National University of Defense Technology Changsha Hunan P.R. China 410073 Science and Technology on Parallel and Distributed Laboratory National University of Defense Technology Changsha Hunan P.R. China 410073

ISBN: (纸本)9781509061839

Studies on nowadays human-machine interface have demonstrated that visual information can enhance speech recognition accuracy especially in noisy environments. Deep learning has been widely used to tackle such audio visual speech recognition (AVSR) problem due to its astonishing achievements in both speech recognition and image recognition. Although existing deep learning models succeed to incorporate visual information into speech recognition, none of them simultaneously considers sequential characteristics of both audio and visual modalities. To overcome this deficiency, we proposed a multimodal recurrent neural network (multimodal RNN) model to take into account the sequential characteristics of both audio and visual modalities for AVSR. In particular, multimodal RNN includes three components, i.e., audio part, visual part, and fusion part, where the audio part and visual part capture the sequential characteristics of audio and visual modalities, respectively, and the fusion part combines the outputs of both modalities. Here we modelled the audio modality by using a LSTM RNN, and modelled the visual modality by using a convolutional neural network (CNN) plus a LSTM RNN, and combined both models by a multimodal layer in the fusion part. We validated the effectiveness of the proposed multimodal RNN model on a multi-speaker AVSR benchmark dataset termed AVletters. The experimental results show the performance improvements comparing to the known highest audio visual recognition accuracies on AVletters, and confirm the robustness of our multimodal RNN model.

关键词： Visualization Hidden Markov models Speech recognition Recurrent neural networks Feature extraction Logic gates Data models

来源：评论

学校读者我要写书评

暂无评论

Message from the program co-chairs

Proceedings - Fifth International Conference on Grid and Coo...

引用

Proceedings - Fifth International Conference on Grid and Cooperative Computing, GCC 2006 2006年 12-12页

作者： Xiao, Wong Buyya, Rajkumar Liu, Yunhao National Laboratory for Parallel and Distributed Processing Changsha China GRIDS Lab. Dept. of Computer Science and Software Engineering University of Melbourne Australia Dept. of Computer Science Hong Kong University of Science and Technology Hong Kong Hong Kong

来源：评论

学校读者我要写书评

暂无评论

Message from the program co-chairs

Proceedings - Fifth International Conference on Grid and Coo...

引用

Proceedings - Fifth International Conference on Grid and Cooperative Computing, GCC 2006 - Workshops 2006年 12-12页

作者： Nong, Xiao Buyya, Rajkumar Liu, Yunhao National Laboratory for Parallel and Distributed Processing Changsha China GRIDS Lab. Dept. of Computer Science and Software Engineering University of Melbourne Australia Dept. of Computer Science Hong Kong University of Science and Technology Hong Kong Hong Kong

来源：评论

学校读者我要写书评

暂无评论

Optimizing Batched Small Matrix Multiplication on Multi-core DSP Architecture

Optimizing Batched Small Matrix Multiplication on Multi-core...

引用

International Symposium on parallel and distributed Processing with Applications, ISPA

作者： Xiaohan Zuo Chunhua Xiao Qinglin Wang Chen Shi College of Computer Science Chongqing University China Key Laboratory of Dependable Service Computing in Cyber Physical Society Ministry of Education China National Key Laboratory of Parallel and Distributed Computing National University of Defense Technology Changsha China Laboratory of Digitizing Software for Frontier Equipment National University of Defense Technology Changsha China

ISBN: (数字)9798331509712

ISBN: (纸本)9798331509729

General Matrix Multiplication (GEMM) is a critical computational operation in scientific computing and machine learning domains. While traditional GEMM performs well on large matrices, it is inefficient in terms of data transfer and computation for small matrices. Many High-Performance Computing (HPC) tasks can be decomposed into large batches of small matrix multiplication operations. Multi-core Digital Signal Processors (DSPs) are commonly used to accelerate high-performance computing. We present a design for batched fusion small matrix multiplication (BFMM) tailored for multi-core DSP architecture. To address the inefficiencies and redundancy in storage and computational operations associated with batch small matrix multiplications, we designed several strategies. We design a matrix fusion concatenation strategy, an access coordination mechanism, and a mechanism for fragment aggregation. BFMM supports an efficient K-dimension multi-core parallelization strategy. The parameter constraint model makes BFMM highly portable. BFMM also includes a performance evaluation model that facilitates assessment and verification. Experimental results demonstrate that, compared to traditional GEMM (TGEMM) on multi-core DSP and traditional GEMM with concatenated data access (TGEMM Op), BFMM exhibits superior performance. For large batches of small matrices, our design achieves 1.21x to 18x higher performance than TGEMM Op on single-core DSP, while on multi-core DSP, it outperforms TGEMM Op by 1.14x to 18.1x.

关键词： Performance evaluation Scientific computing High performance computing Digital signal processors Redundancy Batch production systems Signal processing algorithms Computer architecture Machine learning Matrix decomposition

来源：评论

学校读者我要写书评

暂无评论

An Analysis on Matching Mechanisms and Token Pruning for Late-interaction Models

arXiv

引用

arXiv 2024年

作者： Liu, Qi Guo, Gang Mao, Jiaxin Dou, Zhicheng Wen, Ji-Rong Jiang, Hao Zhang, Xinyu Cao, Zhao Being Key Laboratory of Data Management and Analysis Methods Gaoling School of Artificial Intelligence Renmin University of China No.59 Zhongguancun Street Beijing100872 China Distributed and Parallel Software Lab Huawei Zhejiang No. 360 Jiangshu Road Hangzhou310056 China

With the development of pre-trained language models, the dense retrieval models have become promising alternatives to the traditional retrieval models that rely on exact match and sparse bag-of-words representations. Different from most dense retrieval models using a bi-encoder to encode each query or document into a dense vector, the recently proposed late-interaction multi-vector models (i.e., ColBERT and COIL) achieve state-of-the-art retrieval effectiveness by using all token embeddings to represent documents and queries and modeling their relevance with a sum-of-max operation. However, these fine-grained representations may cause unacceptable storage overhead for practical search systems. In this study, we systematically analyze the matching mechanism of these late-interaction models and show that the sum-of-max operation heavily relies on the co-occurrence signals and some important words in the document. Based on these findings, we then propose several simple document pruning methods to reduce the storage overhead and compare the effectiveness of different pruning methods on different late-interaction models. We also leverage query pruning methods to further reduce the retrieval latency. We conduct extensive experiments on both in-domain and out-domain datasets and show that some of the used pruning methods can significantly improve the efficiency of these late-interaction models without substantially hurting their retrieval effectiveness. © 2024, CC BY.

关键词： Efficiency

来源：评论

学校读者我要写书评

暂无评论

Excitement Surfeited Turns to Errors: Deep Learning Testing Framework Based on Excitable Neurons

arXiv

引用

arXiv 2022年

作者： Jin, Haibo Chen, Ruoxi Zheng, Haibin Chen, Jinyin Cheng, Yao Yu, Yue Liu, Xianglong College of Information Engineering Zhejiang University of Technology Hangzhou China Institute of Cyberspace Security Zhejiang University of Technology Hangzhou China Huawei International Singapore National Laboratory for Parallel and Distributed Processing College of Computer National University of Defense Technology Changsha China State Key Laboratory of Software Development Environment Beihang University Beijing China

Despite impressive capabilities and outstanding performance, deep neural networks (DNNs) have captured increasing public concern about their security problems, due to their frequently occurred erroneous behaviors. Therefore, it is necessary to conduct a systematical testing for DNNs before they are deployed to real-world applications. Existing testing methods have provided fine-grained metrics based on neuron coverage and proposed various approaches to improve such metrics. However, it has been gradually realized that a higher neuron coverage does not necessarily represent better capabilities in identifying defects that lead to errors. Besides, coverage-guided methods cannot hunt errors due to faulty training procedure. So the robustness improvement of DNNs via retraining by these testing examples are unsatisfactory. To address this challenge, we introduce the concept of excitable neurons based on Shapley value and design a novel white-box testing framework for DNNs, namely DeepSensor. It is motivated by our observation that neurons with larger responsibility towards model loss changes due to small perturbations are more likely related to incorrect corner cases due to potential defects. By maximizing the number of excitable neurons concerning various wrong behaviors of models, DeepSensor can generate testing examples that effectively trigger more errors due to adversarial inputs, polluted data and incomplete training. Extensive experiments implemented on both image classification models and speaker recognition models have demonstrated the superiority of DeepSensor. Compared with the state-of-the-art testing approaches, DeepSensor can find more test errors due to adversarial inputs (∼ ×1.2), polluted data (∼ ×5) and incompletely-trained DNNs (∼ ×1.3). Additionally, it can help DNNs build larger l2-norm robustness bound (∼ ×3) via retraining according to CLEVER's certification. We further provide interpretable proofs for effectiveness of DeepSensor via excitable neuro

关键词： Deep neural networks

来源：评论

学校读者我要写书评

暂无评论

Feature and Performance Comparison of FaaS Platforms

Feature and Performance Comparison of FaaS Platforms

引用

IEEE International Conference on software Engineering and Service Sciences (ICSESS)

作者： Penghui Ma Peichang Shi Guodong Yi National Key Laboratory of Parallel and Distributed Processing College of Computer Science National University of Defense Technology Changsha China Key Laboratory of Software Engineering for Complex Systems College of Computer Science National University of Defense Technology Changsha China Xiangjiang Lab Changsha China School of Advanced Interdisciplinary Studies Hunan University Of Technology and Business Changsha China

With serverless computing offering more efficient and cost-effective application deployment, the diversity of serverless platforms presents challenges to users, including platform lock-in and costly migration. Moreover, due to the black box nature of function computing, traditional performance benchmarking methods are not applicable, necessitating new studies. This article presents a detailed comparison of six major public cloud function computing platforms and introduces a benchmarking framework for function computing performance. This framework aims to help users make comprehensive comparisons and select the most suitable platform for their specific needs.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：