检索结果-内蒙古大学图书馆

iGniter: Interference-Aware GPU Resource Provisioning for Predictable DNN Inference in the Cloud

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Xu, Fei Xu, Jianian Chen, Jiabin Chen, Li Shang, Ruitao Zhou, Zhi Liu, Fangming The Shanghai Key Laboratory of Multidimensional Information Processing School of Computer Science and Technology East China Normal University 3663 N. Zhongshan Road Shanghai200062 China The School of Computing and Informatics University of Louisiana at Lafayette 301 East Lewis Street LafayetteLA70504 United States The Guangdong Key Laboratory of Big Data Analysis and Processing School of Computer Science and Engineering Sun Yat-sen University 132 E. Waihuan Road Guangzhou510006 China The National Engineering Research Center for Big Data Technology and System The Services Computing Technology and System Lab Cluster and Grid Computing Lab School of Computer Science and Technology Huazhong University of Science and Technology 1037 Luoyu Road Wuhan430074 China

GPUs are essential to accelerating the latency-sensitive deep neural network (DNN) inference workloads in cloud datacenters. To fully utilize GPU resources, spatial sharing of GPUs among co-located DNN inference workloads becomes increasingly compelling. However, GPU sharing inevitably brings severe performance interference among co-located inference workloads, as motivated by an empirical measurement study of DNN inference on EC2 GPU instances. While existing works on guaranteeing inference performance service level objectives (SLOs) focus on either temporal sharing of GPUs or reactive GPU resource scaling and inference migration techniques, how to proactively mitigate such severe performance interference has received comparatively little attention. In this paper, we propose iGniter, an interference-aware GPU resource provisioning framework for cost-efficiently achieving predictable DNN inference in the cloud. iGniter is comprised of two key components: (1) a lightweight DNN inference performance model, which leverages the system and workload metrics that are practically accessible to capture the performance interference;(2) A cost-efficient GPU resource provisioning strategy that jointly optimizes the GPU resource allocation and adaptive batching based on our inference performance model, with the aim of achieving predictable performance of DNN inference workloads. We implement a prototype of iGniter based on the NVIDIA Triton inference server hosted on EC2 GPU instances. Extensive prototype experiments on four representative DNN models and datasets demonstrate that iGniter can guarantee the performance SLOs of DNN inference workloads with practically acceptable runtime overhead, while saving the monetary cost by up to 25% in comparison to the state-of-the-art GPU resource provisioning strategies. Copyright © 2022, The Authors. All rights reserved.

关键词： Deep neural networks

3D-Printed Sub-Terahertz Lens for Manipulation of Deflective Quasi-Non-Diffractive OAM Waves

学校读者我要写书评

暂无评论

3D-Printed Sub-Terahertz Lens for Manipulation of Deflective...

Asia-Pacific Conference on Microwave

作者： Xiaoyuan He Li Deng Yang Yang Beijing Laboratory of Advanced Information Networks & Beijing Key Laboratory of Network System Architecture and Convergence Beijing University of Posts and Telecommunications Beijing China School of Electrical and Data Engineering Tech Lab University of Technology Sydney Australia

A 3D-printed sub-terahertz lens for manipulating quasi-non-diffractive orbital angular momentum (OAM) waves is proposed in this paper. The proposed lens comprises all-dielectric elements that impose desired phase profiles on the incident waves by varying their height. Based on the concept of the Bessel beam launchers and the beam deflectors, quasi-non-diffractive OAM waves with a pre-defined deflection angle can be produced by the proposed lens. For verification, two lenses were 3D printed for producing OAM waves with a non-diffractive depth of 55.58λ c (λ c is the free-space wavelength at 140 GHz). Measured by a terahertz imaging camera, the desired quasi-non-diffractive OAM waves were observed behind the proposed lenses with expected non-diffractive performance and a large deflection angle of up to 47°.

关键词： Microwave measurement Terahertz wave imaging Three-dimensional displays Wavelength measurement Extraterrestrial measurements Cameras Orbits

Predicting the dynamic process and model parameters of the vector optical solitons in birefringent fibers via the modified PINN

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Wu, Gang-Zhou Fang, Yin Wang, Yue-Yue Wu, Guo-Cheng Dai, Chao-Qing College of Optical Mechanical and Electrical Engineering Zhejiang A&F University Lin'an311300 China College of Math & Informat Science Data Recovery Key Lab Sichuan Province Neijiang Normal University Neijiang641100 China

A modified physics-informed neural network is used to predict the dynamics of optical pulses including one-soliton, two-soliton, and rogue wave based on the coupled nonlinear Schrödinger equation in birefringent fibers. At the same time, the elastic collision process of the mixed bright-dark soliton is predicted. Compared the predicted results with the exact solution, the modified physics-informed neural network method is proven to be effective to solve the coupled nonlinear Schrödinger equation. Moreover, the dispersion coefficients and nonlinearity coefficients of the coupled nonlinear Schrodinger equation can be learned by modified physics-informed neural network. This provides a reference for us to use deep learning methods to study the dynamic characteristics of solitons in optical fibers. Copyright © 2021, The Authors. All rights reserved.

关键词： Solitons

Exploring A CAM - Based Approach for Weakly Supervised Fire Detection Task

学校读者我要写书评

暂无评论

Exploring A CAM - Based Approach for Weakly Supervised Fire ...

IEEE International Conference on e-Business engineering (ICEBE)

作者： Lvlong Lai Jian Chen Huichou Huang Qingyao Wu School of Software Engineering South China University of Technology Guangzhou China Key Laboratory of Big Data and Intelligent Robot Ministry of Education City University of Hong Kong Hong Kong China Pazhou Lab Guangzhou China

ISBN: (纸本)9781665444194

Most existing works in fire detection literature use available detectors like Faster RCNN, SSD, YOLO, etc. to localize the fire in images. These approaches work well but require object-level annotation for training, which is created manually and is very expensive. In this paper, we explore the weakly supervised fire detection task (WSFD) in which only the image-level annotation is given. We propose an approach based on class activation map (CAM). The CAM-based approach firstly trains a deep neural network as the classifier for identifying fire and non-fire images. For a fire image in the inference stage, it uses the classifier to create a CAM and then further generates the bounding boxes according to the CAM. To evaluate the effectiveness of our approach, we collect and construct a benchmark dataset named WS-FireNet and conduct comprehensive experiments on it. The experiment results show that in a way the performance of our approach is satisfactory.

关键词： Training Deep learning Annotations IEEE Sections Conferences Neural networks Detectors

Simple and Deep Graph Convolutional Networks

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Chen, Ming Wei, Zhewei Huang, Zengfeng Ding, Bolin Li, Yaliang School of Information Renmin University of China China Gaoling School of Articial Intelligence Renmin University of China China Beijing Key Lab of Big Data Management and Analysis Methods China MOE Key Lab of Data Engineering and Knowledge Engineering China School of Data Science Fudan University China Alibaba Group

Graph convolutional networks (GCNs) are a powerful deep learning approach for graph-structured data. Recently, GCNs and subsequent variants have shown superior performance in various application areas on real-world datasets. Despite their success, most of the current GCN models are shallow, due to the over-smoothing problem. In this paper, we study the problem of designing and analyzing deep graph convolutional networks. We propose the GCNII, an extension of the vanilla GCN model with two simple yet effective techniques: Initial residual and Identity mapping. We provide theoretical and empirical evidence that the two techniques effectively relieves the problem of over-smoothing. Our experiments show that the deep GCNII model outperforms the state-of-the-art methods on various semi- and full-supervised tasks. Code is available at https://***/chennnM/GCNII. Copyright © 2020, The Authors. All rights reserved.

关键词： Convolutional neural networks

A Multi-Dimensional Assessment Model and Its Application in E-learning Courses of Computer Science 20

学校读者我要写书评

暂无评论

A Multi-Dimensional Assessment Model and Its Application in ...

21st Annual Conference of the Special Interest Group in Information Technology Education, SIGITE 2020

作者： Luo, Jiwen Lu, Feng Wang, Tao Key Lab. of Parallel and Distributed Computing College of Computer National University of Defense Technology Changsha China National Engineering Research Center for Big Data Technology and System Services Computing Technology and System Lab Cluster and Grid Computing Lab School of Computer Science and Technology Huazhong University of Science and Technology Wuhan China

ISBN: (纸本)9781450370455

Computer science is a practical discipline. It is always a great challenge to evaluate students' computer practice using computer-aided means for large scale students. We always need to address problems such as suspected plagiarism and deviation of the overall difficulty factor. In this paper, a multi-dimensional assessment model is designed for CS courses based on the detailed practice processing data in an E-learning system. The model comprehensively evaluates the students' learning process and results in three aspects of correctness, originality, and quality detection. Besides, the teacher can easily participate in the assessment according to their needs. The correctness is an essential requirement, and the originality is based on the clustering results of students' behaviors after clone detection to curb homework plagiarism. SonarQube is used to detect code quality and put forward higher requirements for codes. Manual participation intelligence has improved the flexibility and applicability of the model to a certain extent. We applied this model on the EduCoder online education platform and carried out a comprehensive analysis of 485 students in the Parallel Programming Principles and Practice Class of Huazhong University of Science and Technology. Experiment results confirm the distinction, rationality, and fairness of the model in assessing student performance. It not only gives students a credible, comprehensive score in large-scale online practical programming courses but also gives teachers and students corresponding suggestions based on the evaluation results. Furthermore, the model can be extended to other online education platforms. © 2020 ACM.

关键词： Students

Contrastive graph poisson networks: semi-supervised learning with extremely limited labels 21

学校读者我要写书评

暂无评论

Contrastive graph poisson networks: semi-supervised learning...

Proceedings of the 35th International Conference on Neural Information Processing Systems

作者： Sheng Wan Yibing Zhan Liu Liu Baosheng Yu Shirui Pan Chen Gong PCA Lab Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education and Jiangsu Key Lab of Image and Video Understanding for Social Security School of Computer Science and Engineering Nanjing University of Science and Technology and JD Explore Academy JD Explore Academy The University of Sydney Department of Data Science and AI Faculty of IT Monash University

ISBN: (纸本)9781713845393

Graph Neural Networks (GNNs) have achieved remarkable performance in the task of semi-supervised node classification. However, most existing GNN models require sufficient labeled data for effective network training. Their performance can be seriously degraded when labels are extremely limited. To address this issue, we propose a new framework termed Contrastive Graph Poisson Networks (CGPN) for node classification under extremely limited labeled data. Specifically, our CGPN derives from variational inference; integrates a newly designed Graph Poisson Network (GPN) to effectively propagate the limited labels to the entire graph and a normal GNN, such as Graph Attention Network, that fexibly guides the propagation of GPN; applies a contrastive objective to further exploit the supervision information from the learning process of GPN and GNN models. Essentially, our CGPN can enhance the learning performance of GNNs under extremely limited labels by contrastively propagating the limited labels to the entire graph. We conducted extensive experiments on different types of datasets to demonstrate the superiority of CGPN.

关键词：

GradSA: Gradient Sparsification and Accumulation for Communication-Efficient Distributed Deep Learning 15th

学校读者我要写书评

暂无评论

GradSA: Gradient Sparsification and Accumulation for Communi...

15th International Conference on Green, Pervasive, and Cloud Computing, GPC 2020

作者： Liu, Bo Jiang, Wenbin Zhao, Shaofeng Jin, Hai He, Bingsheng National Engineering Research Center for Big Data Technology and System Service Computing Technology and System Lab Cluster and Grid Computing Lab Huazhong University of Science and Technology Wuhan China Wuhan National Laboratory for Optoelectronics Key Laboratory of Information Storage System Engineering Research Center of Data Storage Systems and Technology Huazhong University of Science and Technology Wuhan China Library Henan University of Economics and Law Zhengzhou China Department of Computer Science School of Computing National University of Singapore Singapore Singapore

ISBN: (纸本)9783030642426

Large-scale distributed deep learning is of great importance in various applications. For distributed training, the inter-node gradient communication often becomes the performance bottleneck. Gradient sparsification has been proposed to reduce the communication overhead. However, the sparsification only arbitrarily selects a small fraction of gradients, while the efficiency of selection dimension has been overlooked. Furthermore, gradient staleness is inevitable after applying the sparsification which will ultimately lead to model divergence. In this paper, we propose a staleness-compensated sparse stochastic gradient descent algorithm, GradSA, to improve the training efficiency. Layer-level gradients are sparsified to reduce the communication overhead, which conform to the characteristics of the network structure, and historical accumulation of the approximated gradients is utilized to speed up convergence. We demonstrate the model convergence acceleration and the efficiency of our layer-level selection over existing state-of-the-art works, such as DGC, TernGrad, and 8-Bit quantization. © 2020, Springer Nature Switzerland AG.

关键词： Efficiency

Multi-Channel Masked Autoencoder and Comprehensive Evaluations for Reconstructing 12-Lead ECG from Arbitrary Single-Lead ECG

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Chen, Jiarong Wu, Wanqing Liu, Tong Hong, Shenda National Institute of Health Data Science Peking University Beijing100191 China School of Biomedical Engineering Sun Yat-sen University Guangdong Shenzhen518107 China Department of Micro/Nano Electronics and MoE Key Lab of Artificial Intelligence Shanghai Jiao Tong University Shanghai200240 China Tianjin Key Laboratory of lonic-Molecular Function of Cardiovascular Disease Department of Cardiology Tianjin Institute of Cardiology Second Hospital of Tianjin Medical University Tianjin300211 China Institute of Medical Technology Health Science Center of Peking University Beijing100191 China Institute for Artificial Intelligence Peking University Beijing100871 China

Electrocardiogram (ECG) has emerged as a widely accepted diagnostic instrument for cardiovascular diseases (CVD). The standard clinical 12-lead ECG configuration causes considerable inconvenience and discomfort, while wearable devices offers a more practical alternative. To reduce information gap between 12-lead ECG and single-lead ECG, this study proposes a multi-channel masked autoencoder (MCMA) for reconstructing 12-Lead ECG from arbitrary single-lead ECG, and a comprehensive evaluation benchmark, ECGGenEval, encompass the signal-level, feature-level, and diagnostic-level evaluations. MCMA can achieve the state-of-the-art performance. In the signal-level evaluation, the mean square errors of 0.0317 and 0.1034, Pearson correlation coefficients of 0.7885 and 0.7420. In the feature-level evaluation, the average standard deviation of the mean heart rate across the generated 12-lead ECG is 1.0481, the coefficient of variation is 1.58%, and the range is 3.2874. In the diagnostic-level evaluation, the average F1-score with two generated 12-lead ECG from different single-lead ECG are 0.8233 and 0.8410. © 2024, CC BY.

关键词： Mean square error