检索结果-内蒙古大学图书馆

SIMD Lossy Compression for Scientific Data

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Dube, Griffin Tian, Jiannan Di, Sheng Tao, Dingwen Calhoun, Jon C. Cappello, Franck Holcombe Department of Electrical and Computing Engineering Clemson University ClemsonSC29634 United States Department of Computer Science Washington State University PullmanWA99164 United States Argonne National Laboratory LemontIL60439 United States

Modern HPC applications produce increasingly large amounts of data, which limits the performance of current extreme-scale systems. Data reduction techniques, such as lossy compression, help to mitigate this issue by decreasing the size of data generated by these applications. SZ, a current state-of-the-art lossy compressor, is able to achieve high compression ratios, but the prediction/quantization methods used introduce dependencies which prevent parallelizing this step of the compression. Recent work proposes a parallel dual prediction/quantization algorithm for GPUs which removes these dependencies. However, some HPC systems and applications do not use GPUs, and could still benefit from the fine-grained parallelism of this method. Using the dual-quantization technique, we implement and optimize a SIMD vectorized CPU version of SZ, and create a heuristic for selecting the optimal block size and vector length. We also investigate the effect of non-zero block padding values to decrease the number of unpredictable values along compression block borders. We measure performance of vecSZ against an O3 optimized CPU version of SZ using dual-quantization, pSZ, as well as SZ-1.4. We evaluate our vectorized version, vecSZ, on the Intel Skylake and AMD Rome architectures using real-world scientific datasets. We find that applying alternative padding reduces the number of outliers by 100% for some configurations. Our implementation also results in up to 32% improvement in rate-distortion and up to 15× speedup over SZ-1.4, achieving a prediction and quantization bandwidth in excess of 3.4 GB/s. © 2022, CC BY.

关键词： Program processors

Enabling End-to-End Secure Federated Learning in Biomedical Research on Heterogeneous computing Environments with APPFLx

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Hoang, Trung-Hieu Fuhrman, Jordan Madduri, Ravi Li, Miao Chaturvedi, Pranshu Li, Zilinghan Kim, Kibaek Ryu, Minseok Chard, Ryan Huerta, E.A. Giger, Maryellen Department of Electrical and Computer Engineering Coordinated Science Laboratory University of Illinois at Urbana-Champaign Street UrbanaIL61801 United States University of Chicago ChicagoIL United States Data Science and Learning Division Argonne National Laboratory LemontIL United States Department of Computer Science University of Illinois at Urbana-Champaign Street UrbanaIL61801 United States School of Industrial and Systems Engineering Georgia Institute of Technology AtlantaGA United States School of Computing Augmented Intelligence Arizona State University TempeAZ United States

Facilitating large-scale, cross-institutional collaboration in biomedical machine learning projects requires a trustworthy and resilient federated learning (FL) environment to ensure that sensitive information such as protected health information is kept confidential. In this work, we introduce APPFLx, a low-code FL framework that enables the easy setup, configuration, and running of FL experiments across organizational and administrative boundaries while providing secure end-to-end communication, privacy-preserving functionality, and identity management. APPFLx is completely agnostic to the underlying computational infrastructure of participating clients. We demonstrate the capability of APPFLx as an easy-to-use framework for accelerating biomedical studies across institutions and healthcare systems while maintaining the protection of private medical data in two case studies: (1) predicting participant age from electrocardiogram (ECG) waveforms, and (2) detecting COVID-19 disease from chest radiographs. These experiments were performed securely across heterogeneous compute resources, including a mixture of on-premise high-performance computing and cloud computing, and highlight the role of federated learning in improving model generalizability and performance when aggregating data from multiple healthcare systems. Finally, we demonstrate that APPFLx serves as a convenient and easy-to-use framework for accelerating biomedical studies across institutions and healthcare system while maintaining the protection of private medical data. Copyright © 2023, The Authors. All rights reserved.

关键词： Privacy-preserving techniques

Resource Allocation and Workload Scheduling for Large-Scale Distributed Deep Learning: A Survey

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liang, Feng Zhang, Zhen Lu, Haifeng Li, Chengming Leung, Victor C.M. Guo, Yanyi Hu, Xiping Artificial Intelligence Research Institute Shenzhen MSU-BIT University 518107 China Guangdong-Hong Kong-Macao Joint Laboratory for Emotional Intelligence and Pervasive Computing Shenzhen MSU-BIT University 518107 China Gansu Provincial Key Laboratory of Wearable Computing School of Information Science and Engineering Lanzhou University 730000 China Department of Electrical and Computer Engineering The University of British Columbia V6T 1Z4 Canada Frontier Cross Disciplinary Research Institute Shenzhen MSU-BIT University China School of Mechanical and Electrical Engineering Beijing Institute of Technology China School of Medical Technology Beijing Institute of Technology 10081 China

With rapidly increasing distributed deep learning workloads in large-scale data centers, efficient distributed deep learning framework strategies for resource allocation and workload scheduling have become the key to high-performance deep learning. The large-scale environment with large volumes of datasets, models, and computational and communication resources raises various unique challenges for resource allocation and workload scheduling in distributed deep learning, such as scheduling complexity, resource and workload heterogeneity, and fault tolerance. To uncover these challenges and corresponding solutions, this survey reviews the literature, mainly from 2019 to 2024, on efficient resource allocation and workload scheduling strategies for large-scale distributed DL. We explore these strategies by focusing on various resource types, scheduling granularity levels, and performance goals during distributed training and inference processes. We highlight critical challenges for each topic and discuss key insights of existing technologies. To illustrate practical large-scale resource allocation and workload scheduling in real distributed deep learning scenarios, we use a case study of training large language models. This survey aims to encourage computer science, artificial intelligence, and communications researchers to understand recent advances and explore future research directions for efficient framework strategies for large-scale distributed deep learning. © 2024, CC BY.

关键词： Fault tolerance

A novel deep learning-based spider wasp optimization approach for enhancing brain tumor detection and physical therapy prediction

学校读者我要写书评

暂无评论

Computer Methods and Programs in Biomedicine Update

computer Methods and Programs in Biomedicine Update 2025年 7卷

作者： Daoud, Suleiman Nasayreh, Ahmad Nahar, Khalid M.O. Abedalaziz, Wlla k. Alayasreh, Salem M. Gharaibeh, Hasan Bashkami, Ayah Jaradat, Amer Jarrar, Sultan Al-Hawamdeh, Hammam Ezugwu, Absalom E. Zitar, Raed Abu Smerat, Aseel Snasel, Vaclav Abualigah, Laith Neurosurgery Department Faculty of Medicine Jordan University of Science and Technology Irbid 22110 Jordan Department of Information Technology and Computer Sciences Yarmouk University Irbid 211633 Jordan Artificial Intelligence and Data Innovation Office King Hussein Cancer Center Amman Jordan Department of Rehabilitation science Faculty of applied medical science Jordan University of Science and Technology King Abdullah University Hospital Irbid Jordan Department of Medical Laboratory Sciences Al Balqa Applied University Salt Jordan Unit for Data Science and Computing North-West University 11 Hofman Street Potchefstroom 2520 South Africa College of Engineering and Computing Liwa University Abu Dhabi United Arab Emirates Faculty of Educational Sciences Al-Ahliyya Amman University Amman 19328 Jordan Computer Technologies Engineering Mazaya University College Nasiriyah Iraq Faculty of Electrical Engineering and Computer Science VŠB-Technical University of Ostrava Poruba-Ostrava 70800 Czech Republic Computer Science Department Al al-Bayt University Mafraq 25113 Jordan

A brain tumor, one of the deadliest disorders, is characterized by the abnormal growth of synapses in the brain. Early detection can improve brain tumor diagnosis, and accurate diagnosis is essential for effective treatment. Researchers have developed several deep-learning classification methods to diagnose brain tumors. Moreover, these types of tumorscan significantly impair physical activity, presenting a broad spectrum of symptoms. As a result, each patient requires an individualized physical therapy treatment plan tailored to their specific needs. However, some challenges remain, including the need for a competent expert in classifying brain tumors using deep learning models, as well as the challenge of creating the most accurate deep learning model for brain tumor classification. To address these challenges, we present a highly accurate and efficient methodology based on advanced metaheuristic algorithms and deep learning. To identify different types of pediatric brain tumors, we specifically develop an optimal residual learning architecture. We also present the Spider Wasp Optimization (SWO) algorithm, which aims to improve performance by feature selection. The algorithm enhances the effectiveness of optimization by balancing the speed of convergence and diversity of solutions. We first convert the algorithm from continuous to binary, combine it with the K-Nearest Neighbor (KNN) algorithm for classification, and evaluate it on a dataset of brain MRI images collected from King Abdullah Hospital. Our analysis revealed that in terms of metrics such as accuracy, sensitivity, specificity, and f1-score, it outperformed other conventional algorithms. We demonstrate the overall effectiveness of the proposed model by using it to select the optimal features extracted from the Resnet50V2 model for pediatric brain tumor detection. We compared the proposed SWO+KNN model with other deep learning architectures such as MobileNetV2, Resnet50V2, and machine learning algorithms

关键词： Brain tumor Deep learning Feature selection Machine learning Metaheuristic optimization Pediatric Physical therapy Rehabilitation

JUMPING FLUID MODELS AND DELAY STABILITY OF MAX-WEIGHT DYNAMICS UNDER HEAVY-TAILED TRAFFIC

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Sharifnassab, Arsalan Tsitsiklis, John N. Department of Computing Science University of Alberta Edmonton Canada Laboratory for Information and Decision Systems Electrical Engineering and Computer Science Department MIT CambridgeMA02139 United States

We say that a random variable is light-tailed if moments of order 2 + ∈ are finite for some ∈ > 0;otherwise, we say that it is heavy-tailed. We study queueing networks that operate under the Max-Weight scheduling policy, for the case where some queues receive heavy-tailed and some receive light-tailed traffic. Queues with light-tailed arrivals are often delay stable (that is, expected queue sizes are uniformly bounded over time) but can also become delay unstable because of resource-sharing with other queues that receive heavy-tailed arrivals. Within this context, and for any given "tail exponents" of the input traffic, we develop a necessary and sufficient condition under which a queue is robustly delay stable, in terms of jumping fluid models—an extension of traditional fluid models that allows for jumps along coordinates associated with heavy-tailed flows. Our result elucidates the precise mechanism that leads to delay instability, through a coordination of multiple abnormally large arrivals at possibly different times and queues and settles an earlier open question on the sufficiency of a particular fluid-based criterion. Finally, we explore the power of Lyapunov functions in the study of delay stability. Copyright © 2021, The Authors. All rights reserved.

关键词： Lyapunov functions

Cracking the quantum scaling limit with machine learned electron densities

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Rackers, Joshua A. Tecot, Lucas Geiger, Mario Smidt, Tess E. Center For Computing Research Sandia National Laboratories Department Of Computer Science University Of California Los Angeles United States Institute Of Physics École Polytechnique Fédérale De Lausanne Computational Research Division Lawrence Berkeley National Laboratory Department Of Electrical Engineering And Computer Science Massachusetts Institute Of Technology United States

A long-standing goal of science is to accurately solve the Schrödinger equation for large molecular systems. The poor scaling of current quantum chemistry algorithms on classical computers imposes an effective limit of about a few dozen atoms for which we can calculate molecular electronic structure. We present a machine learning (ML) method to break through this scaling limit and make quantum chemistry calculations of very large systems possible. We show that Euclidean Neural Networks can be trained to predict the electron density with high fidelity from limited data. Learning the electron density allows us to train a machine learning model on small systems and make accurate predictions on large ones. We show that this ML electron density model can break through the quantum scaling limit and calculate the electron density of systems of thousands of atoms with quantum accuracy. © 2022, CC BY.

关键词： Electrons

Artificial Intelligence for science in Quantum, Atomistic, and Continuum Systems

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Zhang, Xuan Wang, Limei Helwig, Jacob Luo, Youzhi Fu, Cong Xie, Yaochen Liu, Meng Lin, Yuchao Xu, Zhao Yan, Keqiang Adams, Keir Weiler, Maurice Li, Xiner Fu, Tianfan Wang, Yucheng Strasser, Alex Yu, Haiyang Xie, YuQing Fu, Xiang Xu, Shenglong Liu, Yi Du, Yuanqi Saxton, Alexandra Ling, Hongyi Lawrence, Hannah Stärk, Hannes Gui, Shurui Edwards, Carl Gao, Nicholas Ladera, Adriana Wu, Tailin Hofgard, Elyssa F. Tehrani, Aria Mansouri Wang, Rui Daigavane, Ameya Bohde, Montgomery Kurtin, Jerry Huang, Qian Phung, Tuong Xu, Minkai Joshi, Chaitanya K. Mathis, Simon V. Azizzadenesheli, Kamyar Fang, Ada Aspuru-Guzik, Alán Bekkers, Erik Bronstein, Michael Zitnik, Marinka Anandkumar, Anima Ermon, Stefano Liò, Pietro Yu, Rose Günnemann, Stephan Leskovec, Jure Ji, Heng Sun, Jimeng Barzilay, Regina Jaakkola, Tommi Coley, Connor W. Qian, Xiaoning Qian, Xiaofeng Smidt, Tess Ji, Shuiwang Department of Computer Science & Engineering Texas A&M University College StationTX United States Department of Chemical Engineering Massachusetts Institute of Technology Cambridge United Kingdom AMLab University of Amsterdam Amsterdam Netherlands Department of Computer Science University of Illinois Urbana-Champaign UrbanaIL United States Department of Electrical & Computer Engineering Texas A&M University College StationTX United States Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology Cambridge United Kingdom Department of Materials Science & Engineering Texas A&M University College StationTX United States Department of Physics & Astronomy Texas A&M University College StationTX United States Department of Applied Mathematics & Statistics Stony Brook University Stony BrookNY United States Department of Computer Science Stony Brook University Stony BrookNY United States Department of Computer Science Cornell University IthacaNY United States Department of Computer Science Technical University of Munich München Germany Department of Computer Science Stanford University StanfordCA United States Department of Computer Science & Engineering University of California San Diego La Jolla CA United States Department of Computer Science & Technology University of Cambridge Cambridge United Kingdom Nvidia Santa ClaraCA United States Department of Chemistry and Chemical Biology Harvard University Cambridge United Kingdom Department of Chemistry University of Toronto Toronto Canada Department of Computer Science University of Toronto Toronto Canada Department of Computer Science University of Oxford Oxford United Kingdom Department of Biomedical Informatics Harvard University BostonMA United States Department of Computing & Mathematical Sciences California Institute of Technology PasadenaCA United States Computational Science Initiative Brookhaven National Laboratory UptonNY United States

Advances in artificial intelligence (AI) are fueling a new paradigm of discoveries in natural sciences. Today, AI has started to advance natural sciences by improving, accelerating, and enabling our understanding of natural phenomena at a wide range of spatial and temporal scales, giving rise to a new area of research known as AI for science (AI4science). Being an emerging research paradigm, AI4science is unique in that it is an enormous and highly interdisciplinary area. Thus, a unified and technical treatment of this field is needed yet challenging. This work aims to provide a technically thorough account of a subarea of AI4science;namely, AI for quantum, atomistic, and continuum systems. These areas aim at understanding the physical world from the subatomic (wavefunctions and electron density), atomic (molecules, proteins, materials, and interactions), to macro (fluids, climate, and subsurface) scales and form an important subarea of AI4science. A unique advantage of focusing on these areas is that they largely share a common set of challenges, thereby allowing a unified and foundational treatment. A key common challenge is how to capture physics first principles, especially symmetries, in natural systems by deep learning methods. We provide an in-depth yet intuitive account of techniques to achieve equivariance to symmetry transformations. We also discuss other common technical challenges, including explainability, out-of-distribution generalization, knowledge transfer with foundation and large language models, and uncertainty quantification. To facilitate learning and education, we provide categorized lists of resources that we found to be useful. We strive to be thorough and unified and hope this initial effort may trigger more community interests and efforts to further advance AI4science. Copyright © 2023, The Authors. All rights reserved.

关键词： Deep learning

Authentication of Vehicles and Road Side Units in Intelligent Transportation System

学校读者我要写书评

暂无评论

computers, Materials & Continua 2020年第7期64卷 359-371页

作者： Muhammad Waqas Shanshan Tu Sadaqat Ur Rehman Zahid Halim Sajid Anwar Ghulam Abbas Ziaul Haq Abbas Obaid Ur Rehman Beijing Key Laboratory of Trusted Computing Faculty of Information TechnologyBeijing University of TechnologyBeijing100124China Faculty of Computer Science&Engineering Ghulam Ishaq Khan Institute of Engineering Sciences&TechnologyTopi23460Pakistan Beijing Electro-Meahnical Engineering Institute Beijing100074China Faculty of Electrical Engineering Ghulam Ishaq Khan Institute of Engineering Sciences&TechnologyTopi23460Pakistan Department of Electrical Engineering Sarhad University of Science and Information TechnologyPeshawar25000Pakistan

Security threats to smart and autonomous vehicles cause potential consequences such as traffic accidents,economically damaging traffic jams,hijacking,motivating to wrong routes,and financial losses for businesses and *** and autonomous vehicles are connected wirelessly,which are more attracted for attackers due to the open nature of wireless *** of the problems is the rogue attack,in which the attacker pretends to be a legitimate user or access point by utilizing fake *** figure out the problem of a rogue attack,we propose a reinforcement learning algorithm to identify rogue nodes by exploiting the channel state information of the communication *** consider the communication link between vehicle-to-vehicle,and *** evaluate the performance of our proposed technique by measuring the rogue attack probability,false alarm rate(FAR),mis-detection rate(MDR),and utility function of a receiver based on the test threshold values of reinforcement learning *** results show that the FAR and MDR are decreased significantly by selecting an appropriate threshold value in order to improve the receiver’s utility.

关键词： Intelligent transportation system authentication rogue attack

Sliding Mode Control of the PUMA 560 Robot

学校读者我要写书评

暂无评论

Sliding Mode Control of the PUMA 560 Robot

International Conference on Control, Automation and Diagnosis (ICCAD)

作者： Arezki Fekik Ahmad Taher Azar Mohamed Lamine Hamida Hakim Denoun Dyhia Kais Sabrina Mohand Saidi Amar Bousbaine Nashwa Ahmad Kamal Ammar K. Al Mhdawi Chakib Ben Njima Department of Electrical Engineering University Akli Mohand Oulhadj-Bouria Bouira Algeria Electrical Engineering Advanced Technology Laboratory (LATAGE) Algeria Automated Systems & Soft Computing Lab (ASSCL) Prince Sultan University Riyadh Saudi Arabia College of Computer & Information Sciences Prince Sultan University Riyadh Saudi Arabia Faculty of Computers and Artificial Intelligence Benha University Egypt Department of Electrical Engineering L2CSP Laboratory Mouloud Mammeri University Algeria University of Derby College of Science and Engineering UK Faculty of Engineering Cairo University Giza Egypt Edge Hill University U.K University of Sousse Tunisia

The purpose of this article is to present the application of the sliding mode control and investigate its effectiveness when applied to a three-dimensional robotic manipulator model. The analysis is based on the application of the sliding mode control law for the PUMA 560 model, three degrees of freedom, through the development of a dynamic simulation model. The simulation results show the effectiveness of this proposed method for the automation of industrial applications, such as assembly, machining (deburring, trimming), and surface tracking (polishing). This technique provides a useful insight into the advantages of using sliding mode control laws in robotics applications.

关键词：