检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Wang, Yonghui Zhou, Wengang Feng, Hao Li, Houqiang The CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System Department of Electronic Engineering and Information Science University of Science and Technology of China Hefei230027 China Institute of Artificial Intelligence Hefei Comprehensive National Science Center China

Over the past few years, the advancement of Multimodal Large Language Models (MLLMs) has captured the wide interest of researchers, leading to numerous innovations to enhance MLLMs’ comprehension. In this paper, we present AdaptVision, a multimodal large language model specifically designed to dynamically process input images at varying resolutions. We hypothesize that the requisite number of visual tokens for the model is contingent upon both the resolution and content of the input image. Generally, natural images with a lower information density can be effectively interpreted by the model using fewer visual tokens at reduced resolutions. In contrast, images containing textual content, such as documents with rich text, necessitate a higher number of visual tokens for accurate text interpretation due to their higher information density. Building on this insight, we devise a dynamic image partitioning module that adjusts the number of visual tokens according to the size and aspect ratio of images. This method mitigates distortion effects that arise from resizing images to a uniform resolution and dynamically optimizing the visual tokens input to the LLMs. Our model is capable of processing images with resolutions up to 1008 × 1008. Extensive experiments across various datasets demonstrate that our method achieves impressive performance in handling vision-language tasks in both natural and text-related scenes. The source code and dataset are now publicly available at https://***/harrytea/AdaptVision. Copyright © 2024, The Authors. All rights reserved.

关键词： Modeling languages

来源：评论

学校读者我要写书评

暂无评论

Continual Semantic Segmentation via Mask-Based Class Rebalancing

Continual Semantic Segmentation via Mask-Based Class Rebalan...

引用

IEEE International Conference on Multimedia and Expo (ICME)

作者： Yongjie Guo Siya Chen Hongjian You Key Laboratory of Technology in Geo-Spatial Information Processing and Application System Aerospace Information Research Institute Chinese Academy of Sciences Beijing China School of Electronic Electrical and Communication Engineering University of Chinese Academy of Sciences Beijing China

ISBN: (数字)9798350390155

ISBN: (纸本)9798350390162

Continual semantic segmentation (CSS) has risen as a popular field, which aims to acquire new skills constantly without forgetting past knowledge catastrophically. In CSS, we identify that there is a severe imbalance between new classes and old classes, leading to the classifier weight toward new classes. In this paper, we deal with the continual semantic segmentation problem from the class imbalance perspective via mask-based class rebalancing, avoiding the model suffering from catastrophic forgetting. More specifically, the mask-based class rebalancing depends on a mask to combine resampling with reweighting ingenuously, which mitigates the classifier bias toward new classes. Besides, we also propose a frequency knowledge distillation, leveraging multiple frequency components information to maintain the feature representation space for old classes. We demonstrate the effectiveness of our approach with an extensive evaluation of the Pascal-VOC 2012 and ADE20K datasets, significantly outperforming the state-of-the-art method.

关键词： Semantic segmentation Semantics

来源：评论

学校读者我要写书评

暂无评论

Global Homography Motion Compensation for Versatile Video Coding

Global Homography Motion Compensation for Versatile Video Co...

引用

IEEE Visual Communications and Image processing (VCIP)

作者： Yao Li Zhuoyuan Li Li Li Dong Liu Houqiang Li CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei China

ISBN: (纸本)9781665475938

In Versatile Video Coding (VVC), local affine motion compensation (LAMC) is adopted to handle complex motions, such as rotation and zooming. However, it is inefficient to use LAMC to handle the global motion due to the following two reasons. First, the use of LAMC may lead to some extra bit cost on the affine motion model parameters. Second, the precision of LAMC is restricted by the MV precision of the control points. Therefore, in this paper, we propose a global homography motion compensation (GHMC) framework to better characterize the global motion. For each coding block, an extra mode is added to perform motion compensation based on an 8-parameter global homography motion model. In addition, an extrapolation scheme is designed to derive the parameters from reference frames to save the bit cost for signaling them. The proposed framework is implemented into the VVC reference software VTM-6.0. Experimental results show that, on average, 0.69% and 0.66% BD-rate reduction is achieved under Low Delay P and Low Delay B configurations, respectively, for sequences with rich complex global motions.

关键词： Video coding Extrapolation Adaptation models Costs Image coding Visual communication Motion compensation

来源：评论

学校读者我要写书评

暂无评论

Light Field Compression Based on Implicit Neural Representation

Light Field Compression Based on Implicit Neural Representat...

引用

Picture Coding Symposium, PCS

作者： Henan Wang Hanxin Zhu Zhibo Chen CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei China

ISBN: (纸本)9781665492584

Light field, as a new data representation format in multimedia, has the ability to capture both intensity and direction of light rays. However, the additional angular information also brings a large volume of data. Classical coding methods are not effective to describe the relationship between different views, leading to redundancy left. To address this problem, we propose a novel light field compression scheme based on implicit neural representation to reduce redundancies between views. We store the information of a light field image implicitly in an neural network and adopt model compression methods to further compress the implicit representation. Extensive experiments have demonstrated the effectiveness of our proposed method, which achieves comparable rate-distortion performance as well as superior perceptual quality over traditional methods.

关键词： Image coding Redundancy Pipelines Neural networks Rate-distortion Light fields Encoding

来源：评论

学校读者我要写书评

暂无评论

The application of the alternate descent conditional gradient method in tomographic SAR off-grid imaging

The application of the alternate descent conditional gradien...

引用

IET International Radar Conference (IRC 2023)

作者： Mingxiao Shao Cikang Su Zhe Zhang Bingchen Zhang Key Laboratory of Technology in Geo-spatial Information Processing and Application System Chinese Academy of Sciences Beijing People's Republic of China Suzhou Key Laboratory of Microwave Imaging Processing and Application Technology and Suzhou Aerospace Information Research Institute Suzhou Jiangsu People's Republic of China

ISBN: (数字)9781837240982

Compressed sensing (CS) technology has been applied to topographic synthetic aperture radar (TomoSAR) imaging due to the sparsity of elevation signals. The traditional CS algorithms discretize the elevation into many grids and assume that the scatterers are located on grids, therefore, the accuracy of the traditional CS algorithms is limited by the off-grid effect. Although there are currently methods to address the off-grid effect, such as atomic norm minimization (ANM), its application is limited by the baseline distribution form of TomoSAR, which only applies to uniformly observed scenarios. Alternating Descent Conditional Gradient (ADCG) has been applied in many fields as a gridless imaging algorithm. In this paper, we apply ADCG to TomoSAR imaging for the first time, achieving the reconstruction of non-uniform baseline observation scenes. The effectiveness of ADCG in TomoSAR imaging was verified by comparing it with iterative soft thresholding (IST) and orthogonal matching pursuit (OMP) through simulation experiments.

关键词：

来源：评论

学校读者我要写书评

暂无评论

AGSPNet: A framework for parcel-scale crop fine-grained semantic change detection from UAV high-resolution imagery with agricultural geographic scene constraints

arXiv

引用

arXiv 2024年

作者： Li, Shaochun Wang, Yanjun Cai, Hengfan Deng, Lina Lin, Yunhao Hunan Provincial Key Laboratory of Geo-Information Engineering in Surveying Mapping and Remote Sensing Hunan University of Science and Technology Xiangtan411201 China National-local Joint Engineering Laboratory of Geo-spatial Information Technology Hunan University of Science and Technology Xiangtan411201 China School of Earth Sciences and Spatial Information Engineering Hunan University of Science and Technology Xiangtan411201 China

Real-time and accurate information on fine-grained changes in crop cultivation is of great significance for crop growth monitoring, yield prediction and agricultural structure adjustment. Aiming at the problems of serious spectral confusion in visible high-resolution unmanned aerial vehicle (UAV) images of different phases, interference of large complex background and "salt-and-pepper" noise by existing semantic change detection (SCD) algorithms, in order to effectively extract deep image features of crops and meet the demand of agricultural practical engineering applications, this paper designs and proposes an agricultural geographic scene and parcel-scale constrained SCD framework for crops (AGSPNet). AGSPNet framework contains three parts: agricultural geographic scene (AGS) division module, parcel edge extraction module and crop SCD module: (1) AGS division module uses multi-source open geographic data products to delineate AGS with relatively consistent geographic element conditions by analyzing the rule of agricultural territorial differentiation. (2) The parcel edge extraction module uses a bi-directional cascade network (BDCN) and a designed edge optimization model to obtain comprehensive AGS farm parcels. (3) The SCD module uses a designed criss-cross-attention network (CCNet) with pseudo-Siamese structure and change feature discrimination module for extracting semantic features and change features of AGS crops, outputting accurate pixel-level semantic change maps, and then fusing the parcel extraction results with the semantic change maps to finally obtain parcel-scale fine-grained SCD results of crops. Meanwhile, we produce and introduce an UAV image SCD dataset (CSCD) dedicated to agricultural monitoring, encompassing multiple semantic variation types of crops in complex geographical scene. We conduct comparative experiments and accuracy evaluations in two test areas of this dataset, and the results show that the crop SCD results of AGSPNet consistently

关键词： Crops

来源：评论

学校读者我要写书评

暂无评论

On-orbit geometric rectification for micro-satellite based on Lightweight feature database

On-orbit geometric rectification for micro-satellite based o...

引用

IEEE International Symposium on geoscience and Remote Sensing (IGARSS)

作者： Linhui Wang Yuming Xiang Feng Wang Yuxin Hu Hongjian You Key Laboratory of Technology in Geo-Spatial Information Processing and Application System Aerospace Information Research Institute Chinese Academy of Sciences School of Electronics Electrical and Communication Engineering University of Chinese Academy of Sciences

On-orbit processing is becoming more prevalent due to its ability to efficiently exploit satellite resources. On-orbit geometric rectification improves positioning accuracy for follow-up tasks such as object detection or geometric calibration, while avoiding heavy burden on downlinking bandwidth and time delay. However, existing rectification methods faces some challenges. The hardware resources onboard satellites are restricted, and geographic positioning is often inaccurate. In this article, we propose a novel method designed for on-orbit rectification. The proposed method introduces a two-step registration framework to overcome large initial offsets and also a feature-compressing strategy to reduce the storage space of reference patches. Quantitative and practical experiments demonstrate that the proposed method performs well in terms of storage space, time efficiency as well as registration accuracy.

关键词：

来源：评论

学校读者我要写书评

暂无评论

SC$^{2}$2-PCR++: Rethinking the Generation and Selection for Efficient and Robust Point Cloud Registration

引用

IEEE Transactions on Pattern Analysis and Machine Intelligence 2023年第10期45卷 12358-12376页

作者： Zhi Chen Kun Sun Fan Yang Lin Guo Wenbing Tao National Key Laboratory of Science and Technology on Multi-spectral Information Processing School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan Hubei China Hubei Key Laboratory of Intelligent Geo-Information Processing School of Computer Science China University of Geosciences Wuhan Hubei China

Outlier removal is a critical part of feature-based point cloud registration. In this article, we revisit the model generation and selection of the classic RANSAC approach for fast and robust point cloud registration. For the model generation, we propose a second-order spatial compatibility (SC $^spatial$ ) measure to compute the similarity between correspondences. It takes into account global compatibility instead of local consistency, allowing for more distinctive clustering between inliers and outliers at an early stage. The proposed measure promises to find a certain number of outlier-free consensus sets using fewer samplings, making the model generation more efficient. For the model selection, we propose a new Feature and spatial consistency constrained Truncated Chamfer Distance (FS-TCD) metric for evaluating the generated models. It considers the alignment quality, the feature matching properness, and the spatial consistency constraint simultaneously, enabling the correct model to be selected even when the inlier rate of the putative correspondence set is extremely low. Extensive experiments are carried out to investigate the performance of our method. In addition, we also experimentally prove that the proposed SC $^spatial$ measure and the FS-TCD metric are general and can be easily plugged into deep learning based frameworks.

关键词： Measurement Computational modeling Estimation Point cloud compression Three-dimensional displays Deep learning Pipelines

来源：评论

学校读者我要写书评

暂无评论

StyleAM: Perception-Oriented Unsupervised Domain Adaption for Non-reference Image Quality Assessment

arXiv

引用

arXiv 2022年

作者： Lu, Yiting Li, Xin Liu, Jianzhao Chen, Zhibo The CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Deep neural networks (DNNs) have shown great potential in non-reference image quality assessment (NR-IQA). However, the annotation of NR-IQA is labor-intensive and time-consuming, which severely limits their application especially for authentic images. To relieve the dependence on quality annotation, some works have applied unsupervised domain adaptation (UDA) to NR-IQA. However, the above methods ignore that the alignment space used in classification is suboptimal, since the space is not elaborately designed for perception. To solve this challenge, we propose an effective perception-oriented unsupervised domain adaptation method StyleAM for NR-IQA, which transfers sufficient knowledge from label-rich source domain data to label-free target domain images via Style Alignment and Mixup. Specifically, we find a more compact and reliable space i.e., feature style space for perception-oriented UDA based on an interesting/amazing observation, that the feature style (i.e., the mean and variance) of the deep layer in DNNs is exactly associated with the quality score in NR-IQA. Therefore, we propose to align the source and target domains in a more perceptual-oriented space i.e., the feature style space, to reduce the intervention from other quality-irrelevant feature factors. Furthermore, to increase the consistency between quality score and its feature style, we also propose a novel feature augmentation strategy Style Mixup, which mixes the feature styles (i.e., the mean and variance) before the last layer of DNNs together with mixing their labels. Extensive experimental results on two typical cross-domain settings (i.e., synthetic to authentic, and multiple distortions to one distortion) have demonstrated the effectiveness of our proposed StyleAM on NR-IQA. Copyright © 2022, The Authors. All rights reserved.

关键词： Alignment

来源：评论

学校读者我要写书评

暂无评论

Remote Sensing Image Matching and Localization Method Based on the MySQL Multi-Feature Control Point Database

Remote Sensing Image Matching and Localization Method Based ...

引用

International Conference on Image, Vision and Computing (ICIVC)

作者： Zhao Zilu Wang Feng You Hongjian Li Peifeng Zhang Tingtao Aerospace Information Research Institute Chinese Academy of Sciences Beijing China Key Laboratory of Technology in Geo-Spatial Information Processing and Application System Beijing China School of Electronic Electrical and Communication Engineering University of Chinese Academy of Sciences Beijing China

ISBN: (数字)9798350385991

ISBN: (纸本)9798350386004

With the increase in the number of remote sensing satellites and imaging modes, the amount of data for acquiring remote sensing images has greatly increased. Effectively and stably performing geometric positioning on remote sensing images is the foundation of remote sensing applications. This paper proposes a remote sensing image matching and positioning method based on a multi-feature control point database in MySQL. Firstly, a feature control point database in MySQL is constructed based on multiple feature methods. Subsequently, the target image is matched from coarse to fine using region features and point features in the feature control point database. Experimental results show that, on three target remote sensing images, the coarse-to-fine matching method based on MySQL multi-feature database can achieve good geometric positioning effects, with a positioning accuracy of around 0.5 pixels.

关键词： Location awareness Accuracy Satellites Databases Image matching Imaging Sensors Remote sensing

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：