检索结果-内蒙古大学图书馆

Segment Together: A Versatile Paradigm for Semi-Supervised Medical Image Segmentation

IEEE Transactions on Medical Imaging 2025年 PP卷 PP页

作者： Zeng, Qingjie Xie, Yutong Lu, Zilin Lu, Mengkang Wu, Yicheng Xia, Yong Northwestern Polytechnical University National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology School of Computer Science and Engineering Xi’an710072 China The University of Adelaide Australian Institute for Machine Learning AdelaideSA5000 Australia Monash University Faculty of Information Technology Department of Data Science and AI Australia

The scarcity of annotations has become a significant obstacle in training powerful deep-learning models for medical image segmentation, limiting their clinical application. To overcome this, semi-supervised learning that leverages abundant unlabeled data is highly desirable to enhance model training. However, most existing works still focus on specific medical tasks and underestimate the potential of learning across diverse tasks and datasets. In this paper, we propose a Versatile Semi-supervised framework (VerSemi) to present a new perspective that integrates various SSL tasks into a unified model with an extensive label space, exploiting more unlabeled data for semi-supervised medical image segmentation. Specifically, we introduce a dynamic task-prompted design to segment various targets from different datasets. Next, this unified model is used to identify the foreground regions from all labeled data, capturing cross-dataset semantics. Particularly, we create a synthetic task with a CutMix strategy to augment foreground targets within the expanded label space. To effectively utilize unlabeled data, we introduce a consistency constraint that aligns aggregated predictions from various tasks with those from the synthetic task, further guiding the model to accurately segment foreground regions during training. We evaluated our VerSemi framework against seven established SSL methods on four public benchmarking datasets. Our results suggest that VerSemi consistently outperforms all competing methods, beating the second-best method with a 2.69% average Dice gain on four datasets and setting a new state of the art for semi-supervised medical image segmentation. Code is available at https://***/maxwell0027/VerSemi. © 1982-2012 IEEE.

关键词： Self-supervised learning

来源：评论

学校读者我要写书评

暂无评论

Probabilistic Decomposed Linear Dynamical Systems for Robust Discovery of Latent Neural Dynamics

arXiv

引用

arXiv 2024年

作者： Chen, Yenho Mudrik, Noga Johnsen, Kyle A. Alagapan, Sankaraleengam Charles, Adam S. Rozell, Christopher J. Machine Learning Center Georgia Institute of Technology United States School of Electrical and Computer Engineering Georgia Institute of Technology United States Coulter Dept. of Biomedical Engineering Emory University Georgia Institute of Technology United States Department of Biomedical Engineering Mathematical Institute for Data Science Center for Imaging Science Kavli Neuroscience Discovery Institute Johns Hopkins University United States

Time-varying linear state-space models are powerful tools for obtaining mathematically interpretable representations of neural signals. For example, switching and decomposed models describe complex systems using latent variables that evolve according to simple locally linear dynamics. However, existing methods for latent variable estimation are not robust to dynamical noise and system nonlinearity due to noise-sensitive inference procedures and limited model formulations. This can lead to inconsistent results on signals with similar dynamics, limiting the model’s ability to provide scientific insight. In this work, we address these limitations and propose a probabilistic approach to latent variable estimation in decomposed models that improves robustness against dynamical noise. Additionally, we introduce an extended latent dynamics model to improve robustness against system nonlinearities. We evaluate our approach on several synthetic dynamical systems, including an empirically-derived brain-computer interface experiment, and demonstrate more accurate latent variable inference in nonlinear systems with diverse noise conditions. Furthermore, we apply our method to a real-world clinical neurophysiology dataset, illustrating the ability to identify interpretable and coherent structure where previous models cannot. © 2024, CC BY-SA.

关键词： State space methods

来源：评论

学校读者我要写书评

暂无评论

Robust Autonomous Vehicle Pursuit without Expert Steering Labels

arXiv

引用

arXiv 2023年

作者： Pan, Jiaxin Zhou, Changyao Gladkova, Mariia Khan, Qadeer Cremers, Daniel The Technical University of Munich TUM Germany Munich Center for Machine Learning MCML Germany The University of Oxford United Kingdom The Munich Data Science Institute Germany

In this work, we present a learning method for both lateral and longitudinal motion control of an ego-vehicle for the task of vehicle pursuit. The car being controlled does not have a pre-defined route, rather it reactively adapts to follow a target vehicle while maintaining a safety distance. To train our model, we do not rely on steering labels recorded from an expert driver, but effectively leverage a classical controller as an offline label generation tool. In addition, we account for the errors in the predicted control values, which can lead to a loss of tracking and catastrophic crashes of the controlled vehicle. To this end, we propose an effective data augmentation approach, which allows to train a network that is capable of handling different views of the target vehicle. During the pursuit, the target vehicle is firstly localized using a Convolutional Neural Network. The network takes a single RGB image along with cars’ velocities and estimates target vehicle’s pose with respect to the ego-vehicle. This information is then fed to a Multi-Layer Perceptron, which regresses the control commands for the ego-vehicle, namely throttle and steering angle. We extensively validate our approach using the CARLA simulator on a wide range of terrains. Our method demonstrates real-time performance, robustness to different scenarios including unseen trajectories and high route completion. Project page containing code and multimedia can be publicly accessed here: https://***/Autonomous-Vehicle-Pursuit/. Copyright © 2023, The Authors. All rights reserved.

关键词： Autonomous vehicles

来源：评论

学校读者我要写书评

暂无评论

How robust is randomized blind deconvolution via nuclear norm minimization against adversarial noise?

arXiv

引用

arXiv 2023年

作者： Kostin, Julia Krahmer, Felix Stöger, Dominik Technical University of Munich Department of Mathematics Germany Munich Center for Machine Learning Germany Technical University of Munich Munich Data Science Institute Germany Germany

In this paper, we study the problem of recovering two unknown signals from their convolution, which is commonly referred to as blind deconvolution. Reformulation of blind deconvolution as a low-rank recovery problem has led to multiple theoretical recovery guarantees in the past decade due to the success of the nuclear norm minimization heuristic. In particular, in the absence of noise, exact recovery has been established for sufficiently incoherent signals contained in lower-dimensional subspaces. However, if the convolution is corrupted by additive bounded noise, the stability of the recovery problem remains much less understood. In particular, existing reconstruction bounds involve large dimension factors and therefore fail to explain the empirical evidence for dimension-independent robustness of nuclear norm minimization. Recently, theoretical evidence has emerged for ill-posed behavior of low-rank matrix recovery for sufficiently small noise levels. In this work, we develop improved recovery guarantees for blind deconvolution with adversarial noise which exhibit square-root scaling in the noise level. Hence, our results are consistent with existing counterexamples which speak against linear scaling in the noise level as demonstrated for related low-rank matrix recovery problems. Copyright © 2023, The Authors. All rights reserved.

关键词： Recovery

来源：评论

学校读者我要写书评

暂无评论

Ethical and methodological challenges in building morally informed AI systems

引用

AI and Ethics 2022年第2期3卷 553-566页

作者： Hagendorff, Thilo Danks, David Cluster of Excellence “Machine Learning: New Perspectives for Science” University of Tuebingen Tuebingen Germany Halicioğlu Data Science Institute University of California San Diego USA

Recent progress in large language models has led to applications that can (at least) simulate possession of full moral agency due to their capacity to report context-sensitive moral assessments in open-domain conversations. However, automating moral decision-making faces several methodological as well as ethical challenges. They arise in the fields of bias mitigation, missing ground truth for moral “correctness”, effects of bounded ethicality in machines, changes in moral norms over time, risks of using morally informed AI systems as actual advice, as well as societal implications an increasing importance of algorithmic moral decision-making would have. This paper comments on all these challenges and provides critical considerations for future research on full artificial moral agency. Importantly, some of the adduced challenges can be met by more careful technology design, but others necessarily require engagement with core problems of meta-ethics.

关键词：

来源：评论

学校读者我要写书评

暂无评论

A Two-Stage Minimum Cost Multicut Approach to Self-supervised Multiple Person Tracking 15th

A Two-Stage Minimum Cost Multicut Approach to Self-supervise...

引用

15th Asian Conference on Computer Vision, ACCV 2020

作者： Ho, Kalun Kardoost, Amirhossein Pfreundt, Franz-Josef Keuper, Janis Keuper, Margret Fraunhofer Center Machine Learning Sankt Augustin Germany CC-HPC Fraunhofer ITWM Kaiserslautern Germany Data and Web Science Group University of Mannheim Mannheim Germany Institute for Machine Learning and Analytics Offenburg University Offenburg Germany

ISBN: (纸本)9783030695316

Multiple Object Tracking (MOT) is a long-standing task in computer vision. Current approaches based on the tracking by detection paradigm either require some sort of domain knowledge or supervision to associate data correctly into tracks. In this work, we present a self-supervised multiple object tracking approach based on visual features and minimum cost lifted multicuts. Our method is based on straight-forward spatio-temporal cues that can be extracted from neighboring frames in an image sequences without supervision. Clustering based on these cues enables us to learn the required appearance invariances for the tracking task at hand and train an AutoEncoder to generate suitable latent representations. Thus, the resulting latent representations can serve as robust appearance cues for tracking even over large temporal distances where no reliable spatio-temporal features can be extracted. We show that, despite being trained without using the provided annotations, our model provides competitive results on the challenging MOT Benchmark for pedestrian tracking. © 2021, Springer Nature Switzerland AG.

关键词： Computer vision

来源：评论

学校读者我要写书评

暂无评论

Uncertainty mapping and probabilistic tractography using Simulation-based Inference in diffusion MRI: A comparison with classical Bayes

引用

Medical Image Analysis 2025年 103卷 103580页

作者： Manzano-Patrón, J.P. Deistler, Michael Schröder, Cornelius Kypraios, Theodore Gonçalves, Pedro J. Macke, Jakob H. Sotiropoulos, Stamatios N. Sir Peter Mansfield Imaging Centre School of Medicine University of Nottingham United Kingdom Machine Learning in Science Excellence Cluster Machine Learning University of Tübingen & Tübingen AI Center Germany School of Mathematical Sciences University of Nottingham United Kingdom Belgium Department of Computer Science and Department of Electrical Engineering KU Leuven Belgium Department Empirical Inference Max Planck Institute for Intelligent Systems Tübingen Germany

Simulation-Based Inference (SBI) has recently emerged as a powerful framework for Bayesian inference: Neural networks are trained on simulations from a forward model, and learn to rapidly estimate posterior distributions. We here present an SBI framework for parametric spherical deconvolution of diffusion MRI data of the brain. We demonstrate its utility for estimating white matter fibre orientations, mapping uncertainty of voxel-based estimates and performing probabilistic tractography by spatially propagating fibre orientation uncertainty. We conduct an extensive comparison against established Bayesian methods based on Markov-Chain Monte-Carlo (MCMC) and find that: a) in-silico training can lead to calibrated SBI networks with accurate parameter estimates and uncertainty mapping for both single- and multi-shell diffusion MRI, b) SBI allows amortised inference of the posterior distribution of model parameters given unseen observations, which is orders of magnitude faster than MCMC, c) SBI-based tractography yields reconstructions that have a high level of agreement with their MCMC-based counterparts, equal to or higher than scan-rescan reproducibility of estimates. We further demonstrate how SBI design considerations (such as dealing with noise, defining priors and handling model selection) can affect performance, allowing us to identify optimal practices. Taken together, our results show that SBI provides a powerful alternative to classical Bayesian inference approaches for fast and accurate model estimation and uncertainty mapping in MRI. © 2025 The Authors

关键词： Monte Carlo methods

来源：评论

学校读者我要写书评

暂无评论

Optimal bounds for ℓp sensitivity sampling via ℓ2 augmentation 24

Optimal bounds for ℓp sensitivity sampling via ℓ2 augmenta...

引用

Proceedings of the 41st International Conference on machine learning

作者： Alexander Munteanu Simon Omlor Dortmund Data Science Center Faculties of Statistics and Computer Science TU Dortmund University Dortmund Germany Faculty of Statistics TU Dortmund University Dortmund Germany and Lamarr-Institute for Machine Learning and Artificial Intelligence Dortmund Germany

data subsampling is one of the most natural methods to approximate a massively large data set by a small representative proxy. In particular, sensitivity sampling received a lot of attention, which samples points proportional to an individual importance measure called sensitivity. This framework reduces in very general settings the size of data to roughly the VC dimension d times the total sensitivity S while providing strong (1±ε) guarantees on the quality of approximation. The recent work of Woodruff & Yasuda (2023c) improved substantially over the general $\tilde O(\varepsilon^{-2}\mathfrak Sd)$ bound for the important problem of ℓp subspace embeddings to $\tilde O(\varepsilon^{-2}\mathfrak S^{2/p})$ for p ∈ [1, 2]. Their result was subsumed by an earlier $\tilde O(\varepsilon^{-2}\mathfrak Sd^{1-p/2})$ bound which was implicitly given in the work of Chen & Derezinski (2021). We show that their result is tight when sampling according to plain ℓp sensitivities. We observe that by augmenting the ℓp sensitivities by ℓ2 sensitivities, we obtain better bounds improving over the aforementioned results to optimal linear $\tilde O(\varepsilon^{-2}(\mathfrak S+d)) = \tilde O(\varepsilon^{-2}d)$ sampling complexity for all p ∈ [1, 2]. In particular, this resolves an open question of Woodruff & Yasuda (2023c) in the affirmative for p ∈ [1, 2] and brings sensitivity subsampling into the regime that was previously only known to be possible using Lewis weights (Cohen & Peng, 2015). As an application of our main result, we also obtain an Õ(ε-2µd) sensitivity sampling bound for logistic regression, where µ is a natural complexity measure for this problem. This improves over the previous Õ (ε-2µ2d) bound of Mai et al. (2021) which was based on Lewis weights subsampling.

关键词：

来源：评论

学校读者我要写书评

暂无评论

On the Effectiveness of Heterogeneous Ensemble Methods for Re-Identification

On the Effectiveness of Heterogeneous Ensemble Methods for R...

引用

International Conference on machine learning and Applications (ICMLA)

作者： Simon Klüttermann Jérôme Rutinowski Frederik Polachowski Anh Nguyen Britta Grimme Moritz Roidl Emmanuel Müller TU Dortmund University Dortmund Germany Lamarr Institute for Machine Learning and Artificial Intelligence Dortmund Germany Paderborn University Paderborn Germany Research Center Trustworthy Data Science and Security Dortmund Germany

ISBN: (数字)9798350374889

ISBN: (纸本)9798350374896

In this contribution, we introduce a novel ensemble method for the re-identification of industrial entities, using images of chipwood pallets and galvanized metal plates as dataset examples. Our algorithms replace commonly used, complex siamese neural networks with an ensemble of simplified, rudimentary models, providing wider applicability, especially in hardware-restricted scenarios. Each ensemble sub-model uses different types of extracted features of the given data as its input, allowing for the creation of effective ensembles in a fraction of the training duration needed for more complex state-of-the-art models. We reach state-of-the-art performance at our task, with a Rank-1 accuracy of over 77% and a Rank-10 accuracy of over 99%, and introduce five distinct feature extraction approaches, and study their combination using different ensemble methods.

关键词： Training Accuracy Neural networks Metals Feature extraction Silicon Ensemble learning Security Reliability Pallets

来源：评论

学校读者我要写书评

暂无评论

The Sharpness Disparity Principle in Transformers for Accelerating Language Model Pre-Training

arXiv

引用

arXiv 2025年

作者： Wang, Jinbo Wang, Mingze Zhou, Zhanpeng Yan, Junchi Weinan, E. Wu, Lei School of Mathematical Sciences Peking University China Center for Machine Learning Research Peking University China Sch. of Computer Science Sch. of Artificial Intelligence Shanghai Jiao Tong University China AI for Science Institute Beijing China

Transformers consist of diverse building blocks, such as embedding layers, normalization layers, self-attention mechanisms, and point-wise feedforward networks. Thus, understanding the differences and interactions among these blocks is important. In this paper, we uncover a clear sharpness disparity across these blocks, which emerges early in training and intriguingly persists throughout the training process. Motivated by this finding, we propose Blockwise learning Rate (LR), a strategy that tailors the LR to each block’s sharpness, accelerating large language model (LLM) pre-training. By integrating Blockwise LR into AdamW, we consistently achieve lower terminal loss and nearly 2× speedup compared to vanilla AdamW. We demonstrate this acceleration across GPT-2 and LLaMA, with model sizes ranging from 0.12B to 1.1B and datasets of OpenWebText and MiniPile. Finally, we incorporate Blockwise LR into Adam-mini (Zhang et al., 2024c), a recently proposed memory-efficient variant of Adam, achieving a combined 2× speedup and 2× memory saving. These results underscore the potential of exploiting the sharpness disparity to improve LLM training. Copyright © 2025, The Authors. All rights reserved.

关键词： Modeling languages

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：