检索结果-内蒙古大学图书馆

IEEE Transactions on Audio, Speech and Language processing 2025年 33卷 2045-2058页

作者： Yiming Zhang Xuenan Xu Ruoyi Du Haohe Liu Yuan Dong Zheng-Hua Tan Wenwu Wang Zhanyu Ma Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing China Department of Computer Science and Engineering Shanghai Jiao Tong University Shanghai China Centre for Vision Speech and Signal Processing University of Surrey Guildford U.K. Department of Electronic Systems Aalborg University Aalborg Denmark

In traditional audio captioning methods, a model is usually trained in a fully supervised manner using a human-annotated dataset containing audio-text pairs and then evaluated on the test set from the same dataset. Such methods have two limitations. First, these methods are often data-hungry and require time-consuming and expensive human annotations to obtain audio-text pairs. Second, these models often suffer from performance degradation in cross-domain scenarios, i.e., when the input audio comes from a different domain than the training set, and this issue has received little attention. To address these issues, we propose a new zero-shot method for audio captioning. Our method is built on the contrastive language-audio pre-training (CLAP) model. During training, the model reconstructs the ground-truth caption using the CLAP text encoder. In the inference stage, the model generates text descriptions from the CLAP audio embeddings of given audio inputs. To enhance the ability of the model in transitioning from text-to-text generation to audio-to-text generation, we propose to use the mixed-augmentations-based soft prompt to learn more robust latent representations, leveraging instance replacement and embedding augmentation. Additionally, we introduce the retrieval-based acoustic-aware hard prompt to improve the cross-domain performance of the model by employing the domain-agnostic label information of sound events. Extensive experiments on AudioCaps and Clotho benchmarks show the effectiveness of our proposed method, which outperforms other zero-shot audio captioning approaches for in-domain scenarios and outperforms the compared methods for cross-domain scenarios, underscoring the generalization ability of our method.

关键词： Training Decoding Semantics Data models Acoustics Electronic mail Benchmark testing Transformers Robustness Perturbation methods

来源：评论

学校读者我要写书评

暂无评论

A Parallel Read-Write Circuit With Fast Amplitude-Adaptive Matching Scheme to Memristor Crossbar Array

引用

IEEE Transactions on Circuits and systems I: Regular Papers 2025年

作者： Jiang, Ningye Jiang, Mingxuan Huang, Haoen Yang, Le Huang, Yi Zeng, Zhigang Huazhong University of Science and Technology School of Artificial Intelligence and Automation Key Laboratory of Image Information Processing and Intelligent Control Ministry of Education of China Wuhan430074 China Wuhan Institute of Technology School of Electrical and Information Engineering Wuhan430205 China University of Massachusetts Amherst Department of Electrical and Computer Engineering AmherstMA01003 United States

Memristor crossbar array (MCA) is a computing-in-memory (CIM) module for computational acceleration. However, conventional read-write (R-W) circuits for MCA rely heavily on external components and have shortcoming in long writing times. To address these issues, we propose a parallel R-W circuit with a fast amplitude-adaptive matching (AAM) scheme. The fast AAM scheme is designed to accelerate time of writing memristors in MCA by adaptively adjusting the writing voltage to match an optimal amplitude. The architecture of parallel R-W circuit are outlined with the implementation of R-W processes. The design principles of parallel R-W unit, fast AAM unit, and associated control logic are described for analyzing their functions within the circuit. By integrating the parallel R-W circuit with MCA, a computing block is leveraged in a neural network for classification tasks. The experimental results demonstrate that the neural network with multiple computing blocks maintains high accuracy across various datasets (over 80%). Furthermore, the proposed AAM scheme achieves an average 54% reduction in writing time compared to that one without AAM scheme. Compared to the pulse-width scheme, the parallel R-W circuit exhibits an average 3.05× speedup in adjusting a 5×5 MCA, and the speedup efficiency is higher as the increases of MCA size. © 2025 IEEE.

关键词： Memristors

来源：评论

学校读者我要写书评

暂无评论

Implications of neuroimaging findings in addiction

引用

Psychoradiology 2023年第1期3卷 18-23页

作者： Xinwen Wen Lirong Yue Zhe Du Linling Li Yuanqiang Zhu Dahua Yu Kai Yuan School of Life Science and Technology Xidian UniversityXi’an 710126China School of Biomedical Engineering Medical SchoolShenzhen UniversityShenzhen 518060China Guangdong Provincial Key Laboratory of Biomedical Measurements and Ultrasound Imaging Shenzhen UniversityShenzhen 518060China Department of Radiology Xijing HospitalFourth Military Medical UniversityXi’an 710032China Inner Mongolia Key Laboratory of Pattern Recognition and Intelligent Image Processing School of Information EngineeringInner Mongolia University of Science and TechnologyBaotou 014010China Engineering Research Center of Molecular and Neuro Imaging Ministry of Education Xidian UniversityXi’an 710126China Xi’an Key Laboratory of Intelligent Sensing and Regulation of trans-Scale Life Information School of Life Science and TechnologyXidian UniversityXi’an 710126China

Addiction is a chronic and often relapsing brain disorder characterized by drug abuse and withdrawal symptoms and compulsive drug seeking(Koob and Volkow,2010)when access to the drug is *** leads to structural and fun... 详细信息

关键词： motivation finding seeking

来源：评论

学校读者我要写书评

暂无评论

Self-Supervised Plant Phenotyping by Combining Domain Adaptation with 3D Plant Model Simulations: Application to Wheat Leaf Counting at Seedling Stage

引用

Plant Phenomics 2023年第2期5卷 226-238页

作者： Yinglun Li Xiaohai Zhan Shouyang Liu Hao Lu Ruibo Jiang Wei Guo Scott Chapman Yufeng Ge Benoit de Solan Yanfeng Ding Frédéric Baret Plant Phenomics Research Centre Academy for Advanced Interdisciplinary StudiesJiangsu Collaborative Innovation Center for Modern Crop ProductionNanjing Agricultural UniversityNanjingChina Key Laboratory of Image Processing and Intelligent Control School of Artificial Intelligence and AutomationHuazhong University of Science and TechnologyWuhanChina Graduate School of Agricultural and Life Sciences The University of Tokyo1-1-1 Midori-choNishitokyo CityTokyoJapan School of Agriculture and Food Sciences The University of QueenslandSt.LuciaQueensland 4072Australia Department of Biological Systems Engineering University of Nebraska-LincolnLincolnNebraska 68583United States INRAE Avignon UniversitéUMR EMMAHUMT CAPTE228route de l’aérodrome-CS 4050984914 Avignon Cedex 9France ARVALIS Institut du Végétal 3 Rue Joseph et Marie Hackin75116 ParisFrance

The number of leaves at a given time is important to characterize plant growth and *** this work,we developed a high-throughput method to count the number of leaves by detecting leaf tips in RGB *** digital plant phenotyping platform was used to simulate a large and diverse dataset of RGB images and corresponding leaf tip labels of wheat plants at seedling stages(150,000 images with over 2 million labels).The realism of the images was then improved using domain adaptation methods before training deep learning *** results demonstrate the efficiency of the proposed method evaluated on a diverse test dataset,collecting measurements from 5 countries obtained under different environments,growth stages,and lighting conditions with different cameras(450 images with over 2,162 labels).Among the 6 combinations of deep learning models and domain adaptation techniques,the Faster-RCNN model with cycle-consistent generative adversarial network adaptation technique provided the best performance(R^(2)=0.94,root mean square error=8.7).Complementary studies show that it is essential to simulate images with sufficient realism(background,leaf texture,and lighting conditions)before applying domain adaptation ***,the spatial resolution should be better than 0.6 mm per pixel to identify leaf *** method is claimed to be self-supervised since no manual labeling is required for model *** self-supervised phenotyping approach developed here offers great potential for addressing a wide range of plant phenotyping *** trained networks are available at https://***/YinglunLi/Wheat-leaf-tip-detection.

关键词： Wheat seedling Plant

来源：评论

学校读者我要写书评

暂无评论

Constraining Depth Map Geometry for Multi-View Stereo: A Dual-Depth Approach with Saddle-shaped Depth Cells

arXiv

引用

arXiv 2023年

作者： Ye, Xinyi Zhao, Weiyue Liu, Tianqi Huang, Zihao Cao, Zhiguo Li, Xin Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Department of Computer Science University of Albany AlbanyNY12222 United States

Learning-based multi-view stereo (MVS) methods deal with predicting accurate depth maps to achieve an accurate and complete 3D representation. Despite the excellent performance, existing methods ignore the fact that a suitable depth geometry is also critical in MVS. In this paper, we demonstrate that different depth geometries have significant performance gaps, even using the same depth prediction error. Therefore, we introduce an ideal depth geometry composed of Saddle-Shaped Cells, whose predicted depth map oscillates upward and downward around the ground-truth surface, rather than maintaining a continuous and smooth depth plane. To achieve it, we develop a coarse-to-fine framework called Dual-MVSNet (DMVSNet), which can produce an oscillating depth plane. Technically, we predict two depth values for each pixel (Dual-Depth), and propose a novel loss function and a checkerboard-shaped selecting strategy to constrain the predicted depth geometry. Compared to existing methods,DMVSNet achieves a high rank on the DTU benchmark and obtains the top performance on challenging scenes of Tanks and Temples, demonstrating its strong performance and generalization ability. Our method also points to a new research direction for considering depth geometry in MVS. Copyright © 2023, The Authors. All rights reserved.

关键词： Geometry

来源：评论

学校读者我要写书评

暂无评论

Fast Full-frame Video Stabilization with Iterative Optimization

arXiv

引用

arXiv 2023年

作者： Zhao, Weiyue Li, Xin Peng, Zhan Luo, Xianrui Ye, Xinyi Lu, Hao Cao, Zhiguo Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Department of Computer Science University of Albany AlbanyNY12222 United States

Video stabilization refers to the problem of transforming a shaky video into a visually pleasing one. The question of how to strike a good trade-off between visual quality and computational speed has remained one of the open challenges in video stabilization. Inspired by the analogy between wobbly frames and jigsaw puzzles, we propose an iterative optimization-based learning approach using synthetic datasets for video stabilization, which consists of two interacting submodules: motion trajectory smoothing and full-frame outpainting. First, we develop a two-level (coarse-to-fine) stabilizing algorithm based on the probabilistic flow field. The confidence map associated with the estimated optical flow is exploited to guide the search for shared regions through backpropagation. Second, we take a divide-and-conquer approach and propose a novel multiframe fusion strategy to render full-frame stabilized views. An important new insight brought about by our iterative optimization approach is that the target video can be interpreted as the fixed point of nonlinear mapping for video stabilization. We formulate video stabilization as a problem of minimizing the amount of jerkiness in motion trajectories, which guarantees convergence with the help of fixed-point theory. Extensive experimental results are reported to demonstrate the superiority of the proposed approach in terms of computational speed and visual quality. The code will be available on GitHub. Copyright © 2023, The Authors. All rights reserved.

关键词： Iterative methods

来源：评论

学校读者我要写书评

暂无评论

Find Beauty in the Rare: Contrastive Composition Feature Clustering for Nontrivial Cropping Box Regression

arXiv

引用

arXiv 2023年

作者： Pan, Zhiyu Chen, Yinpeng Zhang, Jiale Lu, Hao Cao, Zhiguo Zhong, Weicai Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology China Huawei CBG Consumer Cloud Service Search Product & Big Data Platform Department China

Automatic image cropping algorithms aim to recompose images like human-being photographers by generating the cropping boxes with improved composition quality. Cropping box regression approaches learn the beauty of composition from annotated cropping boxes. However, the bias of annotations leads to quasi-trivial recomposing results, which has an obvious tendency to the average location of training samples. The crux of this predicament is that the task is naively treated as a box regression problem, where rare samples might be dominated by normal samples, and the composition patterns of rare samples are not well exploited. Observing that similar composition patterns tend to be shared by the cropping boundaries annotated nearly, we argue to find the beauty of composition from the rare samples by clustering the samples with similar cropping boundary annotations, i.e., similar composition patterns. We propose a novel Contrastive Composition Clustering (C2C) to regularize the composition features by contrasting dynamically established similar and dissimilar pairs. In this way, common composition patterns of multiple images can be better summarized, which especially benefits the rare samples and endows our model with better generalizability to render nontrivial results. Extensive experimental results show the superiority of our model compared with prior arts. We also illustrate the philosophy of our design with an interesting analytical visualization. Copyright © 2023, The Authors. All rights reserved.

关键词： image enhancement

来源：评论

学校读者我要写书评

暂无评论

A novel dataset and a two-stage mitosis nuclei detection method based on hybrid anchor branch

arXiv

引用

arXiv 2023年

作者： Wang, Huadeng Xu, Hao Li, Bingbing Pan, Xipeng Zeng, Lingqi Lan, Rushi Luo, Xiaonan School of Computer Science and Information Security Guilin University of Electronic Technology Guilin541004 China Guangxi Key Laboratory of Image and Graphic Intelligent Processing Guilin541004 China Department of Pathology Ganzhou Municipal Hospital Ganzhou341000 China

Mitosis detection is one of the challenging problems in computational pathology, and mitotic count is an important index of cancer grading for pathologists. However, current counts of mitotic nuclei rely on pathologists looking microscopically at the number of mitotic nuclei in hot spots, which is subjective and time-consuming. In this paper, we propose a two-stage cascaded network, named FoCasNet, for mitosis detection. In the first stage, a detection network named Mdet is proposed to detect as many mitoses as possible. In the second stage, a classification network Mclass is proposed to refine the results of the first stage. In addition, the attention mechanism, normalization method, and hybrid anchor branch classification subnet are introduced to improve the overall detection performance. Our method achieves the current highest F1-score of 0.888 on the public dataset ICPR 2012. We also evaluated our method on the GZMH dataset released by our research team for the first time and reached the highest F1-score of 0.563, which is also better than multiple classic detection networks widely used at present. It confirmed the effectiveness and generalization of our method. The code will be available at: https://***/antifen/mitosis-nuclei-detection. Copyright © 2023, The Authors. All rights reserved.

关键词： Grading

来源：评论

学校读者我要写书评

暂无评论

Coordinated Guiding Vector Field Design for Ordering-Flexible Multi-Robot Surface Navigation

arXiv

引用

arXiv 2024年

作者： Hu, Bin-Bin Zhang, Hai-Tao Yao, Weijia Sun, Zhiyong Cao, Ming The School of Artificial Intelligence and Automation The Engineering Research Center of Autonomous Intelligent Unmanned Systems The Key Laboratory of Image Processing and Intelligent Control The State Key Lab of Digital Manufacturing Equipment and Technology Huazhong University of Science and Technology Wuhan430074 China The School of Robotics Hunan University Hunan410082 China The Institute of Engineering and Technology University of Groningen Groningen9747 AG Netherlands Department of Electrical Engineering Eindhoven University of Technology Netherlands

We design a distributed coordinated guiding vector field (CGVF) for a group of robots to achieve ordering-flexible motion coordination while maneuvering on a desired two-dimensional (2D) surface. The CGVF is characterized by three terms, i.e., a convergence term to drive the robots to converge to the desired surface, a propagation term to provide a traversing direction for maneuvering on the desired surface, and a coordinated term to achieve the surface motion coordination with an arbitrary ordering of the robotic group. By setting the surface parameters as additional virtual coordinates, the proposed approach eliminates potential singularity of the CGVF and enables both the global convergence to the desired surface and the maneuvering on the surface from all possible initial conditions. The ordering-flexible surface motion coordination is realized by each robot to share with its neighbors only two virtual coordinates, i.e. that of a given target and that of its own, which reduces the communication and computation cost in multi-robot surface navigation. Finally, the effectiveness of the CGVF is substantiated by extensive numerical simulations. Copyright © 2024, The Authors. All rights reserved.

关键词： Navigation

来源：评论

学校读者我要写书评

暂无评论

Analyzing Cognitive Patterns in Gifted Children Using MRI and Morphometric Similarity Networks

Analyzing Cognitive Patterns in Gifted Children Using MRI an...

引用

18th International Joint Conference on Biomedical Engineering systems and Technologies, BIOSTEC 2025

作者： Han, Shuning Duan, Feng Vilaseca, Gemma Vilaró, Núria Caiafa, Cesar F. Sun, Zhe Solé-Casals, Jordi Data and Signal Processing Research Group University of Vic-Central University of Catalonia Vic Catalonia Spain Image Processing Research Group RIKEN Center for Advanced Photonics RIKEN Saitama Wako-Shi Japan Tianjin Key Laboratory of Brain Science and Intelligent Rehabilitation Nankai University Tianjin China Psychological Department Oms and Prat school Fundació Catalunya- La Pedrera Catalonia Manresa Spain Oms Foundation Catalonia Manresa Spain Instituto Argentino de Radioastronomıa-CCT La Plata CONICET / CIC-PBA / UNLP Argentina Faculty of Health Data Science Juntendo University Chiba Urayasu Japan Department of Psychiatry University of Cambridge Cambridge United Kingdom

Advances in non-invasive neuroimaging, such as structural magnetic resonance imaging (sMRI), have en abled the construction of structural brain networks (SBNs), allowing in vivo mapping of anatomical connec tions. This study investigates brain network structural differences linked to different intelligence levels in children by individual morphometric similarity networks (MSNs) derived from sMRI data. Through group and individual-level analyses, we aim to uncover key topological features associated with cognitive perfor mance and to identify a suitable connection density for SBN analysis. Connection density strongly affects global and nodal topological features, with a range of p = 0.05 to 0.15 recommended for stable and optimal results. Gifted individuals exhibit stronger intra-hemispheric and intra-modular connectivity, a more balanced distribution of left-to-right intra-hemispheric connections, and lower mean versatility, supporting efficient and stable cognitive processing. Moreover, anatomical modularity analyses based on von Economo indicate that higher cognitive performance is linked to enhanced connectivity in specific areas (such as secondary sensory area, motor to association area and secondary sensory to limbic area), alongside selective reduction in cer tain modular connections (such as motor to insular area, association to secondary sensory area and motor to secondary sensory area). Furthermore, topological features, including participation coefficient and local effi ciency, are linked to cognitive performance. These findings provide valuable insights into the SBNs underlying cognitive levels in children. © 2025 by SCITEPRESS– Science and Technology Publications, Lda.

关键词： Brain mapping

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：