检索结果-内蒙古大学图书馆

Dense Pixel-to-Pixel Harmonization via Continuous image Representation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Chen, Jianqi Zhang, Yilan Zou, Zhengxia Chen, keyan Shi, Zhenwei Image Processing Center School of Astronautics Beihang University Beijing100191 China State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing100191 China Shanghai Artificial Intelligence Laboratory Shanghai200232 China Department of Guidance Navigation and Control School of Astronautics Beihang University Beijing100191 China

High-resolution (HR) image harmonization is of great significance in real-world applications such as image synthesis and image editing. However, due to the high memory costs, existing dense pixel-to-pixel harmonization methods are mainly focusing on processing low-resolution (LR) images. Some recent works resort to combining with color-to-color transformations but are either limited to certain resolutions or heavily depend on hand-crafted image filters. In this work, we explore leveraging the implicit neural representation (INR) and propose a novel image Harmonization method based on Implicit neural Networks (HINet), which to the best of our knowledge, is the first dense pixel-to-pixel method applicable to HR images without any handcrafted filter design. Inspired by the Retinex theory, we decouple the MLPs into two parts to respectively capture the content and environment of composite images. A Low-Resolution image Prior (LRIP) network is designed to alleviate the Boundary Inconsistency problem, and we also propose new designs for the training and inference process. Extensive experiments have demonstrated the effectiveness of our method compared with state-of-the-art methods. Furthermore, some interesting and practical applications of the proposed method are explored. Our code is available at https://***/WindVChen/INR-Harmonization. Copyright © 2023, The Authors. All rights reserved.

关键词： Pixels

6-DOF grasp planning of manipulator combined with self-supervised learning

学校读者我要写书评

暂无评论

6-DOF grasp planning of manipulator combined with self-super...

第33届中国控制与决策会议

作者： Zhenyu Ren Gang Peng Jin Yang Hao Wang School of Artificial Intelligence and Automation Huazhong University of Science and Technology Key Laboratory of Image Processing and Intelligent Control Ministry of Education

To realize a robust robotic grasping system for unknown objects in an unstructured environment,large amounts of grasp data and 3D model data for the object are *** reduce the time cost of data acquisition and labeling and increase the rate of successful grasps,we developed a self-supervised learning mechanism to control grasp tasks performed by ***,a manipulator automatically collects the point cloud for the objects from multiple perspectives to increase the efficiency of data *** complete point cloud for the objects is obtained by utilizing the hand-eye vision of the manipulator,and the TSDF ***,the point cloud data for the objects is used to generate a series of six-degrees-of-freedom grasp poses,and the force-closure decision algorithm is used to add the grasp quality label to each grasp pose to realize the automatic labeling of grasp ***,the point cloud in the gripper closing area corresponding to each grasp pose is obtained;it is then used to train the grasp-quality classification model for the *** results of performing actual grasping experiments demonstrate that the proposed self-supervised learning method can increase the rate of successful grasps for the manipulator.

关键词： Manipulator Grasping Self-Supervised Learning 3D Reconstruction

T-TIME: Test-Time Information Maximization Ensemble for Plug-and-Play BCIs

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Li, Siyang Wang, Ziwei Luo, Hanbin Ding, Lieyun Wu, Dongrui Ministry of Education Key Laboratory of Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Shenzhen Huazhong University of Science and Technology Research Institute Shenzhen China Henan Key Laboratory of Brain Science and Brain Computer Interface Technology School of Electrical and Information Engineering Zhengzhou University China School of Civil and Hydraulic Engineering Huazhong University of Science and Technology Wuhan430074 China

Objective: An electroencephalogram (EEG)-based brain-computer interface (BCI) enables direct communication between the human brain and a computer. Due to individual differences and non-stationarity of EEG signals, such BCIs usually require a subject-specific calibration session before each use, which is time-consuming and user-unfriendly. Transfer learning (TL) has been proposed to shorten or eliminate this calibration, but existing TL approaches mainly consider offline settings, where all unlabeled EEG trials from the new user are available. Methods: This paper proposes Test-Time Information Maximization Ensemble (T-TIME) to accommodate the most challenging online TL scenario, where unlabeled EEG data from the new user arrive in a stream, and immediate classification is performed. T-TIME initializes multiple classifiers from the aligned source data. When an unlabeled test EEG trial arrives, T-TIME first predicts its labels using ensemble learning, and then updates each classifier by conditional entropy minimization and adaptive marginal distribution regularization. Our code is publicized. Results: Extensive experiments on three public motor imagery based BCI datasets demonstrated that T-TIME outperformed about 20 classical and state-of-the-art TL approaches. Significance: To our knowledge, this is the first work on test time adaptation for calibration-free EEG-based BCIs, making plug-and-play BCIs possible. © 2024, CC BY.

关键词： Calibration

Uncertainty-Aware Multi-Parametric Magnetic Resonance image Information Fusion for 3D Object Segmentation

学校读者我要写书评

暂无评论

Uncertainty-Aware Multi-Parametric Magnetic Resonance Image ...

IEEE International Symposium on Biomedical Imaging

作者： Cheng Li Yousuf Babiker M. Osman Weijian Huang Zhenzhen Xue Hua Han Hairong Zheng Shanshan Wang Paul C. Lauterbur Research Center for Biomedical Imaging Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen Guangdong China University of Chinese Academy of Sciences Beijing China Guangdong Provincial Key Laboratory of Artificial Intelligence in Medical Image Analysis and Application Guangdong China

Multi-parametric magnetic resonance (MR) imaging is an indispensable tool in the clinic. Automatic volume-of-interest segmentation based on multi-parametric MR imaging is crucial for computer-aided disease diagnosis, treatment planning, and prognosis monitoring. Despite the extensive studies conducted in deep learning-based medical image analysis, further investigations are still required to effectively exploit the information provided by different imaging parameters. How to fuse the information is a key question in this field. Here, we propose an uncertainty-aware multi-parametric MR image feature fusion method to fully exploit the information for enhanced 3D image segmentation. Uncertainties in the independent predictions of individual modalities are utilized to guide the fusion of multi-modal image features. Extensive experiments on two datasets, one for brain tissue segmentation and the other for abdominal multi-organ segmentation, have been conducted, and our proposed method achieves better segmentation performance when compared to existing models.

关键词：

Revisiting Few-Shot Learning from a Causal Perspective

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Lin, Guoliang Xu, Yongheng Lai, Hanjiang Yin, Jian School of Computer Science and Engineering Sun Yat-Sen University China Guangdong Key Laboratory of Big Data Analysis and Processing Guangzhou China School of Artificial Intelligence Sun Yat-Sen University China

Few-shot learning with N-way K-shot scheme is an open challenge in machine learning. Many metric-based approaches have been proposed to tackle this problem, e.g., the Matching Networks and CLIP-Adapter. Despite that these approaches have shown significant progress, the mechanism of why these methods succeed has not been well explored. In this paper, we try to interpret these metric-based few-shot learning methods via causal mechanism. We show that the existing approaches can be viewed as specific forms of front-door adjustment, which can alleviate the effect of spurious correlations and thus learn the causality. This causal interpretation could provide us a new perspective to better understand these existing metric-based methods. Further, based on this causal interpretation, we simply introduce two causal methods for metric-based few-shot learning, which considers not only the relationship between examples but also the diversity of representations. Experimental results demonstrate the superiority of our proposed methods in few-shot classification on various benchmark datasets. Code is available in https://***/lingl1024/causalFewShot. Copyright © 2022, The Authors. All rights reserved.

关键词： Machine learning

Sliding Mode Control for Quadrotor-Slung Load Transportation System with State Constraints*

学校读者我要写书评

暂无评论

Sliding Mode Control for Quadrotor-Slung Load Transportation...

IEEE International Conference on Cyborg and Bionic Systems (CBS)

作者： Feng Ding Chong Sun Yong Ai Jian Huang School of Computer Science South-Central Minzu University Hubei Provincial Engineering Research Center for Intelligent Management of Manufacturing Enterprises Wuhan Hubei China Key Laboratory of Image Processing and Intelligent Control School of Artificial Intelligence and automation Huazhong University of Science and Technology Wuhan Hubei China

Quadrotor-slung load transportation is an important way to transport goods, but the swing of the load bring a great deal of challenges to the stability of the system. In this paper, a barrier Lyapunov function based sliding mode controller is proposed to limit the load swing, which also satisfies the speed limitation of the quadrotor. An inner-outer loop control strategy is proposed, where the outer one is the virtual position controller which guarantees the stability of the quadrotor while eliminating the load swing, and the inner one is the attitude controller which driver the actual force to the position controller to ensure the effectiveness of the system. Specifically, the dynamics of quadrotor-slung load transportation system is reconstructed as a cascade form. Then, a barrier Lyapunov function based sliding mode controller is designed to ensure the trajectory tracking errors uniformly bounded with state constraints valid. Finally, comparative simulation results illustrate the effectiveness of the proposed method.

关键词： Attitude control Trajectory tracking Simulation Force Dynamics Transportation Stability analysis

MetaEarth: A Generative Foundation Model for Global-scale Remote Sensing image Generation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Yu, Zhiping Liu, Chenyang Liu, Liqin Shi, Zhenwei Zou, Zhengxia The Image Processing Center School of Astronautics Beihang University Beijing100191 China The State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing100191 China The Shanghai Artificial Intelligence Laboratory Shanghai200232 China Shen Yuan Honors College Beihang University Beijing100191 China The Department of Guidance Navigation and Control School of Astronautics Beihang University Beijing100191 China

The recent advancement of generative foundational models has ushered in a new era of image generation in the realm of natural images, revolutionizing art design, entertainment, environment simulation, and beyond. Despite producing high-quality samples, existing methods are constrained to generating images of scenes at a limited scale. In this paper, we present MetaEarth - a generative foundation model that breaks the barrier by scaling image generation to a global level, exploring the creation of worldwide, multi-resolution, unbounded, and virtually limitless remote sensing images. In MetaEarth, we propose a resolution-guided self-cascading generative framework, which enables the generating of images at any region with a wide range of geographical resolutions. To achieve unbounded and arbitrary-sized image generation, we design a novel noise sampling strategy for denoising diffusion models by analyzing the generation conditions and initial noise. To train MetaEarth, we construct a large dataset comprising multi-resolution optical remote sensing images with geographical information. Experiments have demonstrated the powerful capabilities of our method in generating global-scale images. Additionally, the MetaEarth serves as a data engine that can provide high-quality and rich training data for downstream tasks. Our model opens up new possibilities for constructing generative world models by simulating Earth’s visuals from an innovative overhead perspective. © 2024, CC BY.

关键词： Generative adversarial networks

Multiscale Low-Frequency Memory Network for Improved Feature Extraction in Convolutional Neural Networks

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wu, Fuzhi Wu, Jiasong Kong, Youyong Yang, Chunfeng Yang, Guanyu Shu, Huazhong Carrault, Guy Senhadji, Lotfi Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications Southeast University Bangladesh Laboratoire Traitement du Signal et de l'Image Univ Rennes France Centre de Recherche en Information Biomédicale Sino-français CRIBs France Jiangsu Provincial Joint International Research Laboratory of Medical Information Processing Southeast University Bangladesh

Deep learning and Convolutional Neural Networks (CNNs) have driven major transformations in diverse research areas. However, their limitations in handling low-frequency information present obstacles in certain tasks like interpreting global structures or managing smooth transition images. Despite the promising performance of transformer structures in numerous tasks, their intricate optimization complexities highlight the persistent need for refined CNN enhancements using limited resources. Responding to these complexities, we introduce a novel framework, the Multiscale Low-Frequency Memory (MLFM) Network, with the goal to harness the full potential of CNNs while keeping their complexity unchanged. The MLFM efficiently preserves low-frequency information, enhancing performance in targeted computer vision tasks. Central to our MLFM is the Low-Frequency Memory Unit (LFMU), which stores various low-frequency data and forms a parallel channel to the core network. A key advantage of MLFM is its seamless compatibility with various prevalent networks, requiring no alterations to their original core structure. Testing on imageNet demonstrated substantial accuracy improvements in multiple 2D CNNs, including ResNet, MobileNet, EfficientNet, and ConvNeXt. Furthermore, we showcase MLFM's versatility beyond traditional image classification by successfully integrating it into image-to-image translation tasks, specifically in semantic segmentation networks like FCN and U-Net. In conclusion, our work signifies a pivotal stride in the journey of optimizing the efficacy and efficiency of CNNs with limited resources. This research builds upon the existing CNN foundations and paves the way for future advancements in computer vision. Our codes are available at https://***/AlphaWuSeu/MLFM. © 2024, CC BY-NC-ND.

关键词： Computer vision

More than Encoder: Introducing Transformer Decoder to Upsample

学校读者我要写书评

暂无评论

More than Encoder: Introducing Transformer Decoder to Upsamp...

2022 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2022

作者： Li, Yijiang Cai, Wentian Gao, Ying Li, Chengming Hu, Xiping South China University of Technology School of Computer Science and Engineering Guangzhou China Guangdong Prov. Key Laboratory of Artificial Intelligence in Medical Image Analysis and Application Guangdong Provincial People's Hospital Guangdong Academy of Medical Sciences Guangzhou China Sun Yat-sen University School of Intelligent Systems Engineering Shenzhen China Beijing Institute of Technology School of Medical Technology Beijing China

ISBN: (纸本)9781665468190

Medical image segmentation methods downsample images for feature extraction and then upsample them to restore resolution for pixel-level predictions. In such schema, upsample technique is vital in restoring information for better performance. However, existing upsample techniques leverage little information from downsampling paths. The local and detailed feature from the shallower layer such as boundary and tissue texture is crucial in segmentation, especially medical image segmentation. To this end, we propose a novel upsample approach for medical image segmentation, Window Attention Upsample (WAU), which upsamples features conditioned on local and detailed features from downsampling path in local windows by introducing attention decoders of Transformer. WAU could serve as a general upsample method and be incorporated into any segmentation model that possesses lateral connections. We first propose the Attention Upsample which consists of Attention Decoder (AD) and bilinear upsample. AD leverages pixel-level attention to model longrange dependency and global information for a better upsample. Bilinear upsample is introduced as the residual connection to complement the upsampled features. Moreover, considering the extensive memory and computation cost of pixel-level attention, we further design a window attention scheme to restrict attention computation in local windows instead of the global range. We evaluate our method (WAU) on classic UNet structure with lateral connections and achieve state-of-the-art performance on Medical Segmentation Decathlon (MSD) Brain and Automatic Cardiac Diagnosis Challenge (ACDC) datasets. We also validate the effectiveness of our method on multiple classic architectures and achieve consistent improvement. © 2022 IEEE.

关键词： Diagnosis