检索结果-内蒙古大学图书馆

Accelerating BERT inference with GPU-efficient exit prediction

Frontiers of Computer science 2024年第3期18卷 31-42页

作者： Lei LI Chengyu WANG Minghui QIU Cen CHEN Ming GAO Aoying ZHOU Shanghai Engineering Research Center of Big Data Management School of Data Science and EngineeringEast China Normal UniversityShanghai 200062China Alibaba Group Hangzhou 311121China KLATASDS-MOE School of StatisticsEast China Normal UniversityShanghai 200062China

BERT is a representative pre-trained language model that has drawn extensive attention for significant improvements in downstream Natural Language Processing(NLP)*** complex architecture and massive parameters bring BERT competitive performance but also result in slow speed at model inference *** speed up BERT inference,FastBERT realizes adaptive inference with an acceptable drop in accuracy based on knowledge distillation and the early-exit ***,many factors may limit the performance of FastBERT,such as the teacher classifier that is not knowledgeable enough,the batch size shrinkage and the redundant computation of student *** overcome these limitations,we propose a new BERT inference method with GPU-Efficient Exit Prediction(GEEP).GEEP leverages the shared exit loss to simplify the training process of FastBERT from two steps into only one step and makes the teacher classifier more knowledgeable by feeding diverse Transformer outputs to the teacher *** addition,the exit layer prediction technique is proposed to utilize a GPU hash table to handle the token-level exit layer distribution and to sort test samples by predicted exit *** this way,GEEP can avoid batch size shrinkage and redundant computation of student *** results on twelve public English and Chinese NLP datasets prove the effectiveness of the proposed *** source codes of GEEP will be released to the public upon paper acceptance.

关键词： BERT FastBERT inference acceleration model distillation early exit text classification

来源：评论

学校读者我要写书评

暂无评论

Mechanobiological cues to bone cells during early metastasis drive later osteolysis:A computational mechanoregulation framework prediction

引用

Mechanobiology in Medicine 2025年第1期3卷 87-96页

作者： Anneke S.K.Verbruggen Elan C.McCarthy Roisin M.Dwyer Laoise M.McNamara Mechanobiology and Medical Device Research Group(MMDRG) Biomedical EngineeringCollege of Science and EngineeringUniversity of GalwayIreland School of Medicine Lambe Institute for Translational ResearchUniversity of GalwayIreland

Bone cells contribute to tumour metastasis by producing biochemical factors that stimulate tumour cell homing and proliferation,but also by resorbing bone matrix(osteolysis)that releases further stimulatory factors for tumour growth in a vicious *** in the local mechanical environment of bone tissue occur during early metastasis,which might activate mechanobiological responses by resident bone cells(osteocytes)to activate resorption(osteoclasts)and thereby contribute to tumour *** objective of this study is to investigate whether bone osteolysis is driven by early changes in the bone mechanical environment during metastasis by(a)implementing subject-specific FE models of metastatic femora to predict the mechanical environment within bone tissue during early metastasis(3-weeks after tumour inoculation)and then(b)applying mechanoregulation theory to predict bone tissue remodelling as a function of the evolving mechanical environment within bone tissue during breast cancer-bone *** implemented a global resorption rate derived from an experimental model,but the mechanoregulation algorithm predicted localised bone loss in the greater trochanter region,the same region where osteolysis was prevalent after three weeks of metastasis development in the animal ***,the mechanical environment evolved in a similar manner to that reported in separate subject-specific finite element models of these same animals by 6 ***,we propose that early changes in the physical environment of bone tissue during metastasis may elicit mechanobiological cues for bone cells and activate later osteolytic bone destruction.

关键词： Bone Metastasis Finite element analysis Mechanobiology Computational modelling

来源：评论

学校读者我要写书评

暂无评论

Automatic extraction of lightweight and efficient neural network architecture of heavy convolutional architectures to predict microsatellite instability from hematoxylin and eosin histology in gastric cancer

引用

Neural Computing and Applications 2024年第25期36卷 15295-15321页

作者： Rostami, Habib Ashkpour, Maryam Behzadi-Khormouji, Hamed Mokhtari, Maral Khayati, Armin Keshavarz, Ahmad Talatian Azad, Saeed Tabesh, Yahya Computer Engineering Department Faculty of Intelligent Systems Engineering and Data Science Persian Gulf University Bushehr75168 Iran Artificial Intelligence and Intelligent Healthcare Lab Artificial Intelligence and Data Mining Research Group Faculty of Intelligent Systems Engineering and Data Science ICT Research Institute Persian Gulf University Bushehr75168 Iran Faculty of New Science and Technologies University of Tehran Tehran Iran Department of Computer Science Imec-IDLab University of Antwerp Sint-Pietersvliet 7 Antwerp2000 Belgium Shahid Faghihi Hospital Shiraz University of Medical Sciences Shiraz Iran Department of Computer Science Engineering and IT School of Electrical and Computer Engineering Shiraz University Shiraz Iran Electrical Engineering Department Faculty of Intelligent Systems Engineering and Data Science Persian Gulf University Bushehr75168 Iran IoT and Signal Processing Research Group Faculty of Intelligent Systems Engineering and Data Science ICT Research Institute Persian Gulf University Bushehr75168 Iran Department of Mathematical Sciences Sharif University of Technology Tehran Iran

Cancers have emerged as a significant concern due to their impact on public health and society. The examination and interpretation of tissue sections stained with Hematoxylin and Eosin (H&E) play a crucial role in disease assessment, particularly in cases like gastric cancer. Microsatellite instability (MSI) is suggested to contribute to the carcinogenesis of specific gastrointestinal tumors. However, due to the nonspecific morphology observed in H&E-stained tissue sections, MSI determination often requires costly evaluations through various molecular studies and immunohistochemistry methods in specialized molecular pathology laboratories. Despite the high cost, international guidelines recommend MSI testing for gastrointestinal cancers. Thus, there is a pressing need for a new diagnostic modality with lower costs and widespread applicability for MSI detection. This study aims to detect MSI directly from H&E histology slides in gastric cancer, providing a cost-effective alternative. The performance of well-known deep convolutional neural networks (DCNNs) and a proposed architecture are compared. Medical image datasets are typically smaller than benchmark datasets like ImageNet, necessitating the use of off-the-shelf DCNN architectures developed for large datasets through techniques such as transfer learning. Designing an architecture proportional to a custom dataset can be tedious and may not yield desirable results. In this work, we propose an automatic method to extract a lightweight and efficient architecture from a given heavy architecture (e.g., well-known off-the-shelf DCNNs) proportional to a specific dataset. To predict MSI instability, we extracted the MicroNet architecture from the Xception network using the proposed method and compared its performance with other well-known architectures. The models were trained using tiles extracted from whole-slide images, and two evaluation strategies, tile-based and whole-slide image (WSI)-based, were employed and comp

关键词： Network architecture

来源：评论

学校读者我要写书评

暂无评论

A Review of Predictive and Contrastive Self-supervised Learning for Medical Images

引用

Machine Intelligence research 2023年第4期20卷 483-513页

作者： Wei-Chien Wang Euijoon Ahn Dagan Feng Jinman Kim Biomedical and Multimedia Information Technology(BMIT)Research Group School of Computer ScienceThe University of SydneySydneyNSW2006Australia College of Science and Engineering James Cook UniversityCairnsQLD4811Australia

Over the last decade, supervised deep learning on manually annotated big data has been progressing significantly on computer vision tasks. But, the application of deep learning in medical image analysis is limited by the scarcity of high-quality annotated medical imaging data. An emerging solution is self-supervised learning (SSL), among which contrastive SSL is the most successful approach to rivalling or outperforming supervised learning. This review investigates several state-of-the-art contrastive SSL algorithms originally on natural images as well as their adaptations for medical images, and concludes by discussing recent advances, current limitations, and future directions in applying contrastive SSL in the medical domain.

关键词： Self-supervised learning(SSL) contrastive learning deep learning medical image analysis computer vision

来源：评论

学校读者我要写书评

暂无评论

Unsupervised machine learning approach for tailoring educational content to individual student weaknesses

引用

High-Confidence Computing 2024年第4期4卷 91-104页

作者： Shabab Intishar Rahman Shadman Ahmed Tasnim Akter Fariha Ammar Mohammad Muhammad Nayeem Mubasshirul Haque Sriram Chellappan Jannatun Noor Department of Computer Science and Engineering BRAC UniversityDhaka 1212Bangladesh Department of Computer Science and Engineering University of South FloridaFL 33620USA Computing for Sustainability and Social Good(C2SG)Research Group Department of Computer Science and EngineeringSchool of Data and SciencesBRAC UniversityDhaka 1212Bangladesh

By analyzing data gathered through Online Learning(OL)systems,data mining can be used to unearth hidden relationships between topics and trends in student ***,in this paper,we show how data mining techniques such as clustering and association rule algorithms can be used on historical data to develop a unique recommendation system *** our implementation,we utilize historical data to generate association rules specifically for student test marks below a threshold of 60%.By focusing on marks below this threshold,we aim to identify and establish associations based on the patterns of weakness observed in the past ***,we leverage K-means clustering to provide instructors with visual representations of the generated *** strategy aids instructors in better comprehending the information and associations produced by the *** clustering helps visualize and organize the data in a way that makes it easier for instructors to analyze and gain insights,enabling them to support the verification of the relationship between *** can be a useful tool to deliver better feedback to students as well as provide better insights to instructors when developing their *** paper further shows a prototype implementation of the above-mentioned concepts to gain opinions and insights about the usability and viability of the proposed system.

关键词： Recommendation system Clustering F-P growth Apriori Associative pattern E-learning sphere Online learning

来源：评论

学校读者我要写书评

暂无评论

Antimicrobial Metal and Metal Oxide Nanoparticles in Bone Tissue Repair

引用

biomedical Materials and Devices 2024年第2期2卷 918-941页

作者： Shineh, Ghazal Mobaraki, Mohammadmahdi Afzali, Elham Alakija, Femi Velisdeh, Zeinab Jabbari Mills, David K. School of Biomedical Engineering University of Sydney Biomaterial Group Faculty of Biomedical Engineering (Center of Excellence) Amirkabir University of Technology Pharmaceutics Research Center Institute of Neuropharmacology Kerman University of Medical Sciences Molecular Science and Nanotechnology Louisiana Tech University School of Biological Sciences and the Center for Biomedical Engineering and Rehabilitation Science Louisiana Tech University

After the implantation of dental implants or orthopedic device, there is a “race for the surface,” a competitive battle between bacteria and host cells for the occupation of the implant surface. Various antibacterial and antibiotic agents have been developed to assist host tissue cells in winning this battle. However, these agents come with drawbacks, such as the potential to generate antibiotic resistance. Metal and metal oxide nanoparticles (NPs) have demonstrated their versatility, functioning as effective antimicrobial coatings, and flexible biomaterials with both osteoconductive and osteoinductive characteristics. In this review article will focus on the basics of implant infection and biofilm formation, followed by a discussion of antibiotic resistance, which favors bacteria, and strategies to reduce antibiotic resistance. Metal and metal oxide NPs and their expanding role in dental and orthopedic therapeutics will be discussed comprehensively. The article will focus on the potential for using metal and metal oxide NPs that integrate antimicrobial properties with osteoinductive/osteoconductive characteristics. Current advances and developments in the application of metal NPs will occupy the bulk of this review, which will conclude with a discussion of the challenges associated with metal and metal oxide NPs. © The Author(s), under exclusive licence to Springer science+Business Media, LLC 2024.

关键词： Antibacterial nanoparticles Antibiotic resistance Antimicrobial Biofilm Bone repair Dental and orthopedic biomaterials Infection Nanoparticles

来源：评论

学校读者我要写书评

暂无评论

Intelligent Assistant for Multivariant Analysis 26

Intelligent Assistant for Multivariant Analysis

引用

26th International Conference of the Catalan Association for Artificial Intelligence, CCIA 2024

作者： Angerri, Xavier Delgado, Oscar Gibert, Karina Knowledge Engineering and Machine Learning Group Intelligent Data Science and Artificial Intelligence Research Center Universtitat Politècnica de Catalunya Spain

ISBN: (纸本)9781643685434

When a Knowledge Discovery from data (KDD) (Fayyad, Piatetsky-Shapiro, & Smyth, 1996) process is being applied to get knowledge, several methods could be used (Gibert, et al., 2018). A simple and fast way to obtain preliminary insights from data before using KDD models is by generating a basic descriptive analysis. It is one of the most popular ways to describe experimental data and should be the beginning of all data projects. Nevertheless some of the main knowledge that can be extracted in a descriptive analysis is hidden due to underlying multivariate structures which could be elicited through multivariate analysis techniques. Moreover, the domain expert is key for a proper interpretation of descriptive results. At the same time, there is a lack of automatic reporting techniques that can report and help in the interpretation of complex patterns and the use of advanced multivariate techniques. This paper shows the tool developed to generate automatic interpretation of Multiple Correspondence Analysis (MCA) and Principal Components Analysis (PCA) by using RMarkdown. This tool generates a Word document which contains the automatic interpretation of the results, built on the basis of regular expressions ellaborating over the R analytical outputs (either numerical or graphical results). The proposal is being applied with some real data, like INSESS database on social vulnerabilities of the Catalan population. In conclusion, the developed tool contributes to facilitate the factorial methods results, avoiding the misinterpretation of the results and the involuntary skipping of conclusions due to the large amount of knowledge that can be extracted from a complete factorial analysis. Also, this software enables non-expert users to read multivariate analysis results in a friendly way. Moreover, this tool saves time in the interpretation step and is a basis to support the expert to start the report with the results, even the output of the software could become the report or

关键词： automatic interpretation Automatic reporting explainability

来源：评论

学校读者我要写书评

暂无评论

Drawing Order Diagrams Through Two-Dimension Extension

引用

Journal of Graph Algorithms and Applications 2023年第9期27卷 783-802页

作者： Dürrschnabel, Dominik Hanika, Tom Stumme, Gerd Knowledge & Data Engineering Group Research Center for Information System Design & Department of Electrical Engineering and Computer Science University of Kassel Germany Institute of Computer Science University of Hildesheim Germany Berlin School of Library and Information Science Humboldt-Universität zu Berlin Germany

Ordinal real-world data such as concept hierarchies, ontologies, genealogies, or task dependencies in scheduling often has the property to not only contain pairwise comparable, but also incomparable elements. Order diagrams provide an important tool for understanding and thus discovering knowledge in such data. Easily readable drawings of such order diagrams are hard to come by, even for small ordered sets. Many attempts were made to transfer classical graph drawing approaches to order diagrams. Although these methods produce satisfying results for some ordered sets, they unfortunately perform poorly in general. In this work, we present the novel algorithm DimDraw to decompose an ordered set (e.g., a concept hierarchy) in linear orders and to produce a corresponding order diagram. This algorithm is based on a relation between the dimension of an ordered set and the bipartiteness of its transitive incompatibility graph. To evaluate the quality of the algorithm, a user study was conducted where generated drawings were compared with ones from state-of-the-art drawing algorithms. © 2023 Brown University. All rights reserved.

关键词： Set theory

来源：评论

学校读者我要写书评

暂无评论

From Clustering to Intelligent Decision Support System: An Application to 3D Printing 26

From Clustering to Intelligent Decision Support System: An A...

引用

26th International Conference of the Catalan Association for Artificial Intelligence, CCIA 2024

作者： Karna, Ashutosh Gibert, Karina Knowledge Engineering and Machine Learning Group Intelligent Data Science and Artificial Intelligence Research Centre Universitat Politècnica de Catalunya Barcelona Spain

ISBN: (纸本)9781643685434

This study focuses on developing an intelligent decision support system (IDSS) that helps a human operator make data-driven decisions. To put IDSS in production, it is necessary to develop two additional components: one oriented to recognize the cluster of new data and the other a knowledge-based resulting from the interpretation of clusters and further association of actions to each cluster, constituting a knowledge base with the alerts and recommendations associated to every profile. Bootstrap-CURE technique is used to handle the initial component, whereas a meta-clustering framework is suggested for interpreting the clusters and providing recommendations. A detailed strategy is presented for handling a print job, examining patterns, and executing actions through IDSS, thus improving predictive accuracy and operational efficiency. Two distinct machine learning models were developed, one to detect the operational mode and another to choose the best meta-cluster for the type of printing jobs and detained steps are provided for implementing the recommendations. © 2024 The Authors.

关键词： Printing presses

来源：评论

学校读者我要写书评

暂无评论

Using analytic hierarchy process to evaluate deep learning for infrared target recognition

引用

Multimedia Tools and Applications 2024年第38期83卷 86229-86245页

作者： Xu, Laixiang Cao, Bingxu Wei, Xinhong Li, Bei Su, Jingfeng Ning, Shiyuan Zhao, Junmin School of Computer and Data Science Henan University of Urban Construction Pingdingshan467036 China School of Information Engineering Luohe Vocational Technology College Henan University of Technology Luohe Institute of Technology Luohe462000 China School of Computer and Data Science Innovation Laboratory of Smart Traffic and Big Data Development of Hainan Province Pingdingshan467036 China School of Computer and Data Science Research Center of Smart City and Big Data Engineering of Henan Province Henan University of Urban Construction Pingdingshan467036 China Department of Software Information China Electronics Technology Group Corporation 36-th Research Institute Jiaxing314033 China School of Computer and Data Science Research Center of Smart City and Big Data Engineering of Henan Province Research Center of Intelligent Campus Application Engineering of Henan Province Innovation Laboratory of Smart Traffic and Big Data Development of Hainan Province Henan University of Urban Construction Pingdingshan467036 China

In order to promote the evaluation performance of deep learning infrared automatic target recognition (ATR) algorithms in the complex environment of air-to-air missile research, we proposed an analytic hierarchy process (AHP) evaluation system consisting of the target recognition ability, the generalization recognition ability, the anti-interference ability, the background suppression ability, and the cost metrics ability. According to detailed quantitative analysis and experimental results, we establish probability evaluation models and get their probability values. Compared with traditional evaluation systems, our proposed method implementation is showing high reliability. Similar superior performances are also achieved, such as quick, comprehensive, and scientific. Through the above research, the key technology of deep learning performance evaluation in automatic target recognition has been broken through, which provides some basis and guidance for the analysis of infrared imaging-guided weapon systems. © The Author(s), under exclusive licence to Springer science+Business Media, LLC, part of Springer Nature 2024.

关键词： Infrared imaging

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：