检索结果-内蒙古大学图书馆

Improving VTE Identification through Language Models from Radiology Reports: A Comparative Study of Mamba, Phi-3 Mini, and BERT

学校读者我要写书评

暂无评论

Improving VTE Identification through Language Models from Ra...

2024 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2024

作者： Deng, Jamie Wu, Yusen Yesha, Yelena Nguyen, Phuong University of Miami Department of Computer Science MiamiFL United States University of Miami Frost Institute for Data Science and Computing MiamiFL United States University of Miami Department of Radiology MiamiFL United States

ISBN: (纸本)9798350386226

Venous thromboembolism (VTE) is a critical cardio-vascular condition, encompassing deep vein thrombosis (DVT) and pulmonary embolism (PE). Accurate and timely identification of VTE is essential for effective medical care. This study builds upon our previous work, which addressed VTE detection using deep learning methods for DVT and a hybrid approach combining deep learning and rule-based classification for PE. Our earlier approaches, while effective, had two major limitations: they were complex and required expert involvement for feature engineering of the rule set. To overcome these challenges, we utilize the Mamba architecture-based classifier. This model achieves remarkable results, with a 97% accuracy and F1 score on the DVT dataset and a 98% accuracy and F1 score on the PE dataset. In contrast to the previous hybrid method on PE identification, the Mamba classifier eliminates the need for hand-engineered rules, significantly reducing model complexity while maintaining comparable performance. Additionally, we evaluated a lightweight Large Language Model (LLM), Phi-3 Mini, in detecting VTE. While this model delivers competitive results, outperforming the baseline BERT models, it proves to be computationally intensive due to its larger parameter set. Our evaluation shows that the Mamba-based model demonstrates superior performance and efficiency in VTE identification, offering an effective solution to the limitations of previous approaches. © 2024 IEEE.

关键词： Deep learning

Prompt Engineering for Curriculum Design

学校读者我要写书评

暂无评论

Prompt Engineering for Curriculum Design

Educational Technology (ICET), IEEE International Conference on

作者： Jonathan Leung Zhiqi Shen College of Computing and Data Science Nanyang Technological University Singapore Singapore

ISBN: (数字)9798350376944

ISBN: (纸本)9798350376951

Large Language Models (LLMs) have recently demonstrated successes in a broad range of areas that require language understanding and generation. The design of course curricula is a key part of the educational process, as it helps students understand expectations and learning goals, and teachers to maintain consistency when conducting the course. Thus, there would be benefits if educators could leverage the capabilities of LLMs. The first benefit is the potential for improving course content, which would lead to better learning outcomes for students. Secondly, educators can save time by having an LLM assist in creating course material or assessments. However, many methods of using LLMs in specific applications fine-tune LLMs, which requires task-specific data as well as technical knowledge to perform the fine-tuning. In this work we use Prompt Engineering, a set of methods that aims to improve generated responses from LLMs by altering the input prompt to the LLM. Often, however, advice for designing prompts is very broad, such as "be concise". We utilize prompt patterns to create and propose three reusable, specific, and customizable prompts that can be used to assist in the design of a course syllabus, lesson material, and assessment questions. The use of prompt patterns additionally aims to produce reliable and consistent results from LLMs.

关键词： Knowledge engineering Visualization Image synthesis Large language models Educational technology Chatbots Prompt engineering Reliability

Improved Particle Approximation Error for Mean Field Neural Networks

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Nitanda, Atsushi Singapore College of Computing and Data Science Nanyang Technological University Singapore

Mean-field Langevin dynamics (MFLD) minimizes an entropy-regularized nonlinear convex functional defined over the space of probability distributions. MFLD has gained attention due to its connection with noisy gradient descent for mean-field two-layer neural networks. Unlike standard Langevin dynamics, the nonlinearity of the objective functional induces particle interactions, necessitating multiple particles to approximate the dynamics in a finite-particle setting. Recent works (Chen et al., 2022;Suzuki et al., 2023b) have demonstrated the uniform-in-time propagation of chaos for MFLD, showing that the gap between the particle system and its mean-field limit uniformly shrinks over time as the number of particles increases. In this work, we improve the dependence on logarithmic Sobolev inequality (LSI) constants in their particle approximation errors which can exponentially deteriorate with the regularization coefficient. Specifically, we establish an LSI-constant-free particle approximation error concerning the objective gap by leveraging the problem structure in risk minimization. As the application, we demonstrate improved convergence of MFLD, sampling guarantee for the mean-field stationary distribution, and uniform-in-time Wasserstein propagation of chaos in terms of particle complexity. Copyright © 2024, The Authors. All rights reserved.

关键词： Multilayer neural networks

Enhancing Phishing Website Detection with Machine Learning Algorithms

学校读者我要写书评

暂无评论

Enhancing Phishing Website Detection with Machine Learning A...

International Symposium on Digital Forensic and Security (ISDFS)

作者： Weijie Pang Ayrton Joseph DiPina Ashar Neyaz School of Computing & Data Science Wentworth Institute of Technology Boston MA USA

ISBN: (数字)9798331509934

ISBN: (纸本)9798331509941

This paper examines the impact of feature selection on phishing website detection using machine learning techniques. We utilize the UCI Phishing Website dataset, which consists of 11,055 instances and 30 features with no missing values. Our results show that the random forest outperforms logistic regression, achieving an accuracy of 97.11%. By analyzing feature importance, we optimize the model by removing detrimental features, further improving accuracy to 97.74%. This study highlights the effectiveness of the random forest in phishing detection and underscores the importance of feature selection in enhancing model performance.

关键词： Logistic regression Analytical models Accuracy Machine learning algorithms Phishing Digital forensics Feature extraction Security Random forests

SparX: A Sparse Cross-Layer Connection Mechanism for Hierarchical Vision Mamba and Transformer Networks

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Lou, Meng Fu, Yunxiang Yu, Yizhou School of Computing and Data Science The University of Hong Kong Hong Kong

Due to the capability of dynamic state space models (SSMs) in capturing long-range dependencies with linear-time computational complexity, Mamba has shown notable performance in NLP tasks. This has inspired the rapid development of Mamba-based vision models, resulting in promising results in visual recognition tasks. However, such models are not capable of distilling features across layers through feature aggregation, interaction, and selection. Moreover, existing cross-layer feature aggregation methods designed for CNNs or ViTs are not practical in Mamba-based models due to high computational costs. Therefore, this paper aims to introduce an efficient cross-layer feature aggregation mechanism for vision backbone networks. Inspired by the Retinal Ganglion Cells (RGCs) in the human visual system, we propose a new sparse cross-layer connection mechanism termed SparX to effectively improve cross-layer feature interaction and reuse. Specifically, we build two different types of network layers: ganglion layers and normal layers. The former has higher connectivity and complexity, enabling multi-layer feature aggregation and interaction in an input-dependent manner. In contrast, the latter has lower connectivity and complexity. By interleaving these two types of layers, we design a new family of vision backbone networks with sparsely cross-connected layers, achieving an excellent trade-off among model size, computational cost, memory cost, and accuracy in comparison to its counterparts. For instance, with fewer parameters, SparX-Mamba-T improves the top-1 accuracy of VMamba-T from 82.5% to 83.5%, while SparX-Swin-T achieves a 1.3% increase in top-1 accuracy compared to Swin-T. Extensive experimental results demonstrate that our new connection mechanism possesses both superior performance and generalization capabilities on various vision tasks. Code is publicly available at https://***/LMMMEng/SparX. © 2024, CC BY.

关键词： State space methods

Intelligent Blocking and Prevention of SARS-CoV-2 Based on Evolutionary Reinforcement Learning 13

学校读者我要写书评

暂无评论

Intelligent Blocking and Prevention of SARS-CoV-2 Based on E...

13th IEEE Congress on Evolutionary Computation, CEC 2024

作者： He, Chengwei Hong, Huaping Ma, Lijia Zhu, Qingling Bai, Yuan College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China Shenzhen University National Engineering Laboratory for Big Data System Computing Technology Shenzhen518060 China

ISBN: (纸本)9798350308365

In recent years, the global repercussions of SARS-CoV-2 and its variants have posed significant challenges to various areas, including the economic order, transportation, healthcare, and education, and the mitigation and prevention of SARS-CoV-2 and other infectious diseases have received much attention. This paper tries to develop a rational and effective intervention strategy in response to the dynamic evolution of the SARS-CoV-2 epidemic. To address this issue, we first use the SEIR model to analyze the population distribution under the SARS-CoV-2 epidemic, and then integrate a deep Q-neural network (DQN) to reflect an economic quantification model contextualized within the SARS-CoV-2 scenario. Next, we propose an evolutionary deep reinforcement learning to generate an optimal and adaptive intervention strategy, by optimizing the weight sequence of the DQN. The experimental results show the effectiveness of the proposed method in maximizing economic benefits, while ensuring the uninterrupted functionality of medical institutions. Importantly, the learned intervention strategy exhibits the applicability to other infectious diseases. © 2024 IEEE.

关键词： Deep reinforcement learning

Who Responded to Whom: The Joint Effects of Latent Topics and Discourse in Conversation Structure 10

学校读者我要写书评

暂无评论

Who Responded to Whom: The Joint Effects of Latent Topics an...

10th SIGHAN Workshop on Chinese Language Processing, SIGHAN 2024

作者： Ji, Lu Chen, Lei Li, Jing Wei, Zhongyu Zhang, Qi Huang, Xuanjing School of Computer Science Fudan University China School of Data Science Fudan University China Department of Computing The Hong Kong Polytechnic University Hong Kong Research Institute of Intelligent and Complex Systems Fudan University China

ISBN: (纸本)9798891761551

Vast amount of online conversations are produced on a daily basis, resulting in a pressing need to automatic conversation understanding. As a basis to structure a discussion, we identify the responding relations in the conversation discourse, which link response utterances to their initiations. To figure out who responded to whom, here we explore how the consistency of topic contents and dependency of discourse roles indicate such interactions, whereas most prior work ignore the effects of latent factors underlying word occurrences. We propose a neural model to learn latent topics and discourse in word distributions, and predict pairwise initiation-response links via exploiting topic consistency and discourse dependency. Experimental results on both English and Chinese conversations show that our model significantly outperforms the previous state of the arts. © 2024 Association for Computational Linguistics

关键词： Computational linguistics

ASE: PRACTICAL ACOUSTIC SPEED ESTIMATION BEYOND DOPPLER VIA SOUND DIFFUSION FIELD

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Lyu, Sheng Wu, Chenshu School of Computing and Data Science The University of Hong Kong Hong Kong

Passive human speed estimation plays a critical role in acoustic sensing. Despite extensive study, existing systems, however, suffer from various limitations: First, previous acoustic speed estimation exploits Doppler Frequency Shifts (DFS) created by moving targets and relies on microphone arrays, making them only capable of sensing the radial speed within a constrained distance. Second, the channel measurement rate proves inadequate to estimate high moving speeds. To overcome these issues, we present ASE, an accurate and robust Acoustic Speed Estimation system on a single commodity microphone. We model the sound propagation from a unique perspective of the acoustic diffusion field, and infer the speed from the acoustic spatial distribution, a completely different way of thinking about speed estimation beyond prior DFS-based approaches. We then propose a novel Orthogonal Time-Delayed Multiplexing (OTDM) scheme for acoustic channel estimation at a high rate that was previously infeasible, making it possible to estimate high speeds. We further develop novel techniques for motion detection and signal enhancement to deliver a robust and practical system. We implement and evaluate ASE through extensive real-world experiments. Our results show that ASE reliably tracks walking speed, independently of target location and direction, with a mean error of 0.13 m/s, a reduction of 2.5x from DFS, and a detection rate of 97.4% for large coverage, e.g., free walking in a 4m × 4m room. We believe ASE pushes acoustic speed estimation beyond the conventional DFS-based paradigm and will inspire exciting research in acoustic sensing. © 2024, CC BY.

关键词： Channel estimation

SegMAN: Omni-scale Context Modeling with State Space Models and Local Attention for Semantic Segmentation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Fu, Yunxiang Lou, Meng Yu, Yizhou School of Computing and Data Science The University of Hong Kong Hong Kong

High-quality semantic segmentation relies on three key capabilities: global context modeling, local detail encoding, and multi-scale feature extraction. However, recent methods struggle to possess all these capabilities simultaneously. Hence, we aim to empower segmentation networks to simultaneously carry out efficient global context modeling, high-quality local detail encoding, and rich multi-scale feature representation for varying input resolutions. In this paper, we introduce SegMAN, a novel linear-time model comprising a hybrid feature encoder dubbed SegMAN Encoder, and a decoder based on state space models. Specifically, the SegMAN Encoder synergistically integrates sliding local attention with dynamic state space models, enabling highly efficient global context modeling while preserving fine-grained local details. Meanwhile, the MMSCopE module in our decoder enhances multi-scale context feature extraction and adaptively scales with the input resolution. We comprehensively evaluate SegMAN on three challenging datasets: ADE20K, Cityscapes, and COCO-Stuff. For instance, SegMAN-B achieves 52.6% mIoU on ADE20K, outperforming SegNeXt-L by 1.6% mIoU while reducing computational complexity by over 15% GFLOPs. On Cityscapes, SegMAN-B attains 83.8% mIoU, surpassing SegFormer-B3 by 2.1% mIoU with approximately half the GFLOPs. Similarly, SegMAN-B improves upon VWFormerB3 by 1.6% mIoU with lower GFLOPs on the COCO-Stuff dataset. Our code is available at https://***/yunxiangfu2001/SegMAN © 2024, CC BY.

关键词： Semantic Segmentation