检索结果-内蒙古大学图书馆

Exploring Contextualized Embeddings for C++ Code Search and Algorithms Classification

学校读者我要写书评

暂无评论

Exploring Contextualized Embeddings for C++ Code Search and ...

International Youth Conference on Radio Electronics, Electrical and Power Engineering (REEPE)

作者： Robert R. Khazhiev Darya A. Skvortsova Sergey N. Golubev Lev R. Barabanshchikov Industrial Logistic Department Bauman Moscow State Technical University Moscow Russian Federation Dept. of Information Processing and Management Systems Bauman Moscow State Technical University Moscow Russian Federation Institute of Applied Computer Science ITMO University Saint-Petersburg Russian Federation

ISBN: (数字)9798331531836

ISBN: (纸本)9798331531843

Contextualized embeddings of words (such as BLOOM and BERT) outperform static embeddings (such as Word2vec, Fasttext, and GloVe) for many natural language processing tasks. In this article, an exploration is conducted of the use of contextualized embeddings for the purposes of searching for C++ code and classifying the algorithms that are utilized. Furthermore, a novel approach is proposed for reducing the dimensionality of the resulting embeddings, leveraging a multilayer perceptron trained with Multi Similarity Loss. The experiments performed for the methods of multilabel classification of algorithms and for the code similarity search show that the proposed method not only effectively reduces the dimension of embeddings, but also increases their representativeness.

关键词： Measurement Power engineering Codes Source coding Large language models C++ languages Multi label classification Multilayer perceptrons Natural language processing

Application of binary classification of magnetic resonance therapy images to detect the threat of the disease due to COVID-19 3

学校读者我要写书评

暂无评论

Application of binary classification of magnetic resonance t...

3rd IEEE KhPI Week on Advanced Technology, KhPI Week 2022

作者： Zalevska, Olga Vanin, Volodymyr Sydogenko, Julia Finogenov, Oleksii Demydenko, Olga Yablonskyi, Petro Ladogubets, Tetyana Oliinyk, Yurii Miroshnichenko, Ivan National Technical University of Ukraine 'Igor Sikorsky Kyiv Polytechnic Institute' Department of Automation of Power Processes and Systems Engineering Kyiv Ukraine National Technical University of Ukraine 'Igor Sikorsky Kyiv Polytechnic Institute' Department of Descriptive Geometry Engineering and Computer Graphics Kyiv Ukraine National Technical University of Ukraine 'Igor Sikorsky Kyiv Polytechnic Institute' Department of Computer-Aided Science and Data Processing Systems Kyiv Ukraine National Technical University of Ukraine 'Igor Sikorsky Kyiv Polytechnic Institute' The Department of Theory Practice and Translation of English Kyiv Ukraine National Technical University of Ukraine 'Igor Sikorsky Kyiv Polytechnic Institute' Deprtament of Applied Mathematics Kyiv Ukraine

ISBN: (数字)9798350399202

ISBN: (纸本)9798350399202

The paper considers the use of a neural network for the binary classification of magnetic resonance imaging images to establish a possible disease of COVID-19. processing of input data and their reduction to one format is provided, and neural network software for binary classification is developed and its training based on about 60,000 open patient images. The using of developed software is universal for medical doctors or ordinary Internet users and does not require additional training. © 2022 IEEE.

关键词： Magnetic resonance imaging

Evaluating the Performance to Detecting Topic Shift of Large Language Models: A Study

学校读者我要写书评

暂无评论

Evaluating the Performance to Detecting Topic Shift of Large...

6th International Conference on Intelligent Computing and Signal processing (ICSP)

作者： Pingfang Tian Deting Liu Department of Computer Science and Technology Wuhan University of Science and Technology Wuhan China The Key Laboratory of the Rich Media Knowledge Organisation and Service of Digital Publishing Content Institute of Scientific and Technical Information of China Beijing China Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System Wuhan China Big Data Science and Engineering Research Institute Wuhan University of Science and Technology Wuhan China

ISBN: (数字)9798350376548

ISBN: (纸本)9798350376555

Topic shift detection aims to identify whether there is a change in the current topic of conversation or if a change is needed. The study found previous work did not evaluate the performance of large language models like ChatGPT on the task of topic shift. Therefore, this paper's main task and innovation lie in analyzing ChatGPT's performance on topic shift detection. To provide a more comprehensive evaluation, we conducted topic shift detection tasks on ChatGPT from three aspects: single utterances, adjacent utterances, and contextual levels. Additionally, to gauge the performance of large language models, we conducted experiments on multiple small-scale models and compared the results of the two models. Experimental results on the publicly available English TIAGE dataset showed that small-scale models exhibited lower recall in all three aspects, while ChatGPT performed better in the recall. This suggests that compared to small-scale models, large models are more capable of accurately detecting topic shifts. However, large models also exhibited lower precision, indicating that while ChatGPT can recognize content differences in utterances, its judgment on whether these different contents belong to the same topic is poor.

关键词： Technological innovation Large language models Oral communication Signal processing Chatbots Context modeling

DAMPER: A Dual-Stage Medical Report Generation Framework with Coarse-Grained MeSH Alignment and Fine-Grained Hypergraph Matching

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Huang, Xiaofei Chen, Wenting Liu, Jie Lu, Qisheng Luo, Xiaoling Shen, Linlin Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Shenzhen China Department of Electrical Engineering City University of Hong Kong Kowloon Hong Kong National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China Guangdong Provincial Key Laboratory of Intelligent Information Processing China

Medical report generation is crucial for clinical diagnosis and patient management, summarizing diagnoses and recommendations based on medical imaging. However, existing work often overlook the clinical pipeline involved in report writing, where physicians typically conduct an initial quick review followed by a detailed examination. Moreover, current alignment methods may lead to misaligned relationships. To address these issues, we propose DAMPER, a dual-stage framework for medical report generation that mimics the clinical pipeline of report writing in two stages. In the first stage, a MeSH-Guided Coarse-Grained Alignment (MCG) stage that aligns chest X-ray (CXR) image features with medical subject headings (MeSH) features to generate a rough keyphrase representation of the overall impression. In the second stage, a Hypergraph-Enhanced Fine-Grained Alignment (HFG) stage that constructs hypergraphs for image patches and report annotations, modeling high-order relationships within each modality and performing hypergraph matching to capture semantic correlations between image regions and textual phrases. Finally,the coarse-grained visual features, generated MeSH representations, and visual hypergraph features are fed into a report decoder to produce the final medical report. Extensive experiments on public datasets demonstrate the effectiveness of DAMPER in generating comprehensive and accurate medical reports, outperforming state-of-the-art methods across various evaluation metrics. Copyright © 2024, The Authors. All rights reserved.

关键词： Coarse-grained modeling

Unsupervised View-Invariant Human Posture Representation

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Sardari, Faegheh Ommer, Björn Mirmehdi, Majid Department of Computer Science University of Bristol Bristol United Kingdom Heidelberg Collaboratory for Image Processing IWR Heidelberg University Heidelberg Germany

Most recent view-invariant action recognition and performance assessment approaches rely on a large amount of annotated 3D skeleton data to extract view-invariant features. However, acquiring 3D skeleton data can be cumbersome, if not impractical, in in-the-wild scenarios. To overcome this problem, we present a novel unsupervised approach that learns to extract view-invariant 3D human pose representation from a 2D image without using 3D joint data. Our model is trained by exploiting the intrinsic view-invariant properties of human pose between simultaneous frames from different viewpoints and their equivariant properties between augmented frames from the same viewpoint. We evaluate the learned view-invariant pose representations for two downstream tasks. We perform comparative experiments that show improvements on the state-of-the-art unsupervised cross-view action classification accuracy on NTU RGB+D by a significant margin, on both RGB and depth images. We also show the efficiency of transferring the learned representations from NTU RGB+D to obtain the first ever unsupervised cross-view and cross-subject rank correlation results on the multi-view human movement quality dataset, QMAR, and marginally improve on the-state-of-the-art supervised results for this dataset. We also carry out ablation studies to examine the contributions of the different components of our proposed network. © 2021, CC BY.

关键词： Spatio-temporal data

ESM all-atom: multi-scale protein language model for unified molecular modeling 24

学校读者我要写书评

暂无评论

ESM all-atom: multi-scale protein language model for unified...

Proceedings of the 41st International Conference on Machine Learning

作者： Kangjie Zheng Siyu Long Tianyu Lu Junwei Yang Xinyu Dai Ming Zhang Zaiqing Nie Wei-Ying Ma Hao Zhou School of Computer Science National Key Laboratory for Multimedia Information Processing Peking University-Anker Embodied AI Lab Peking University Beijing China School of Artificial Intelligence National Key Laboratory for Novel Software Technology Nanjing University Department of Computer Science Tsinghua University Institute for AI Industry Research (AIR) Tsinghua University and PharMolix Inc. Institute for AI Industry Research (AIR) Tsinghua University

Protein language models have demonstrated significant potential in the field of protein engineering. However, current protein language models primarily operate at the residue scale, which limits their ability to provide information at the atom level. This limitation prevents us from fully exploiting the capabilities of protein language models for applications involving both proteins and small molecules. In this paper, we propose ESMAA (ESM All-Atom), a novel approach that enables atom-scale and residue-scale unified molecular modeling. ESM-AA achieves this by pretraining on multi-scale code-switch protein sequences and utilizing a multi-scale position encoding to capture relationships among residues and atoms. Experimental results indicate that ESM-AA surpasses previous methods in protein-molecule tasks, demonstrating the full utilization of protein language models. Further investigations reveal that through unified molecular modeling, ESM-AA not only gains molecular knowledge but also retains its understanding of proteins.

关键词：

JCCS-PFGM: A Novel Circle-Supervision based Poisson Flow Generative Model for Multiphase CECT Progressive Low-Dose Reconstruction with Joint Condition

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Ge, Rongjun He, Yuting Xia, Cong Chen, Yang Zhang, Daoqiang Wang, Ge College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics Nanjing China Department of Biomedical Engineering Rensselaer Polytechnic Institute TroyNY United States Laboratory of Image Science and Technology School of Computer Science and Engineering Southeast University Nanjing China Jiangsu Key Laboratory of Molecular and Functional Imaging Department of Radiology Zhongda Hospital Medical School of Southeast University Nanjing China

Multiphase contrast-enhanced computed tomography (CECT) scan is clinically significant to demonstrate the anatomy at different phases. In practice, such a multiphase CECT scan inherently takes longer time and deposits much more radiation dose into a patient body than a regular CT scan, and reduction of the radiation dose typically compromise the CECT image quality and its diagnostic value. With Joint Condition and Circle-Supervision, here we propose a novel Poisson Flow Generative Model (JCCS-PFGM) to promote the progressive low-dose reconstruction for multiphase CECT. JCCS-PFGM is characterized by the following three aspects: 1) a progressive low-dose reconstruction scheme to leverages the imaging consistency and radiocontrast evolution along former-latter phases, so that enormously reduces the radiation dose needs and improve the reconstruction effect, even for the latter-phase scanning with extremely low dose;2) a circle-supervision strategy embedded in PFGM to enhance the refactoring capabilities of normalized poisson field learned from the perturbed space to the specified CT image space, so that boosts the explicit reconstruction for noise reduction;3) a joint condition mechanism to explore correlation between former phases and current phase, so that extracts the complementary information for current noisy CECT and guides the reverse process of diffusion jointly with multiphase condition for optimal recovery of clinically relevant structures. Our extensive experiments are performed on a clinical dataset consisting of 11436 images. The results show that our JCCS-PFGM achieves promising PSNR up to 46.3dB, SSIM up to 98.5%, and MAE down to 9.67 HU averagely on phases I, II and III, in quantitative evaluations, as well as gains high-quality readable visualizations in qualitative assessments. All of these findings reveal our method a great potential to be adapted for clinical CECT scans at a much-reduced radiation dose. Copyright © 2023, The Authors. All rights rese

关键词： computerized tomography

Handcrafted Histological Transformer (H2T): Unsupervised Representation of Whole Slide images

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Vu, Quoc Dang Rajpoot, Kashif Raza, Shan E. Ahmed Rajpoot, Nasir The Tissue Image Analytics Centre Department of Computer Science University of Warwick United Kingdom The School of Computer Science University of Birmingham United Kingdom The Alan Turing Institute London United Kingdom The Department of Pathology University Hospitals Coventry & Warwickshire United Kingdom

Diagnostic, prognostic and therapeutic decisionmaking of cancer in pathology clinics can now be carried out based on analysis of multi-gigapixel tissue images, also known as whole-slide images (WSIs). Recently, deep convolutional neural networks (CNNs) have been proposed to derive unsupervised WSI representations;these are attractive as they rely less on expert annotation which is cumbersome. However, a major trade-off is that higher predictive power generally comes at the cost of interpretability, posing a challenge to their clinical use where transparency in decision-making is generally expected. To address this challenge, we present a handcrafted framework based on deep CNN for constructing holistic WSI-level representations. Building on recent findings about the internal working of the Transformer in the domain of natural language processing, we break down its processes and handcraft them into a more transparent framework that we term as the Handcrafted Histological Transformer or H2T. Based on our experiments involving various datasets consisting of a total of 10,042 WSIs, the results demonstrate that H2T based holistic WSI-level representations offer competitive performance compared to recent state-of-the-art methods and can be readily utilized for various downstream analysis tasks. Finally, our results demonstrate that the H2T framework can be up to 14 times faster than the Transformer models. © 2022, CC BY-NC-SA.

关键词： Pathology

Deep Learning Methods for Ship Classification: From Visible to Infrared images 5

学校读者我要写书评

暂无评论

Deep Learning Methods for Ship Classification: From Visible ...

5th International Conference on Robotics, Intelligent Control and Artificial Intelligence, RICAI 2023

作者： Liu, Tianci Qin, Hengjia Zhan, Zhuo Liu, Yunpeng Shenyang Institute of Automation Chinese Academy of Sciences Shenyang110016 China Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences Shenyang110169 China University of Chinese Academy of Sciences Beijing100049 China Chinese Academy of Sciences Key Laboratory of Opto-Electronic Information Processing Shenyang110016 China Key Laboratory of Image Understanding and Computer Vision Liaoning Province Shenyang110016 China The Third Military Representative Office of the Air Force Equipment Department in Shenyang Region Liaoning Province Shenyang110027 China

ISBN: (纸本)9798350357950

Deep learning methods have achieved excellent performances on visual tasks of target recognition and classification. The rapid development of autonomous seafaring vessels comes up with the requirement to recognize other maritime ships day and night. However, the recognition of ships based on the deep neural networks may not always access the results as expectation when the ships are under the nighttime environment. To this issue, we consider the ship recognition task under the deep learning framework with paired visible images and infrared images. In this article, we propose an end-to-end convolutional network based on visible images and infrared images of the autonomous seafaring vessels. To demonstrate the effectiveness of our model, we choose the V AIS dataset to test the performance of classifying the maritime ships. Experimental results show that the proposed network outperforms the state-of-the-art methods based on the V AIS database. © 2023 IEEE.

关键词： deep learning infrared images neural network Ship recognition