检索结果-内蒙古大学图书馆

Vision-Language Consistency Guided Multi-modal Prompt Learning for Blind AI Generated Image Quality Assessment

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Fu, Jun Zhou, Wei Jiang, Qiuping Liu, Hantao Zhai, Guangtao The CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China The School of Computer Science and Informatics Cardiff University CardiffCF24 4AG United Kingdom The School of Information Science and Engineering Ningbo University Ningbo315211 China The Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai200240 China

Recently, textual prompt tuning has shown inspirational performance in adapting Contrastive Language-Image Pre-training (CLIP) models to natural image quality assessment. However, such uni-modal prompt learning method only tunes the language branch of CLIP models. This is not enough for adapting CLIP models to AI generated image quality assessment (AGIQA) since AGIs visually differ from natural images. In addition, the consistency between AGIs and user input text prompts, which correlates with the perceptual quality of AGIs, is not investigated to guide AGIQA. In this letter, we propose vision-language consistency guided multi-modal prompt learning for blind AGIQA, dubbed CLIP-AGIQA. Specifically, we introduce learnable textual and visual prompts in language and vision branches of CLIP models, respectively. Moreover, we design a text-to-image alignment quality prediction task, whose learned vision-language consistency knowledge is used to guide the optimization of the above multi-modal prompts. Experimental results on two public AGIQA datasets demonstrate that the proposed method outperforms state-of-the-art quality assessment models. The source code is available at https://***/JunFu1995/CLIP-AGIQA. © 2024, CC BY-NC-ND.

关键词： Learning systems

A comprehensive framework for seasonal controls of leaf abscission and productivity in evergreen broadleaved tropical and subtropical forests

学校读者我要写书评

暂无评论

The Innovation 2021年第4期2卷 27-34页

作者： Xueqin Yang Jianping Wu Xiuzhi Chen Philippe Ciais Fabienne Maignan Wenping Yuan Shilong Piao Song Yang Fanxi Gong Yongxian Su Yuhang Dai Liyang Liu Haicheng Zhang Damien Bonal Hui Liu Guixing Chen Haibo Lu Shengbiao Wu Lei Fan Pierre Gentine SJoseph Wright Guangdong Province Key Laboratory for Climate Change and Natural Disaster Studies School of Atmospheric SciencesSun Yat-sen University&Southern Marine Science and Engineering Guangdong Laboratory(Zhuhai)Zhuhai 519082China Key Lab of Guangdong for Utilization of Remote Sensing and Geographical Information System Guangdong Open Laboratory of Geospatial Information Technology and ApplicationGuangzhou Institute of GeographyGuangdong Academy of SciencesGuangzhou 510070China Laboratoire des Sciences du Climat et de l’Environnement IPSLCEA-CNRS-UVSQUniversite Paris-Saclay91191 Gif sur YvetteFrance Sino-French Institute for Earth System Science College of Urban and Environmental SciencesPeking UniversityBeijing 100871China College of Earth Sciences Chengdu University of TechnologyChengdu 610000China College of Forestry and Landscape Architecture South China Agricultural UniversityGuangzhou 510000China Department of Geoscience Environment&SocietyUniversite Libre de BruxellesBruxellesBelgium INRA UMR“Ecologie et Ecophysiologie Forestieres”Universite de Lorraine-INRA54280 ChampenouxFrance South China Botanical Garden Chinese Academy of SciencesGuangzhou 510650China School of Biological Sciences The University of Hong KongPokfulamHong Kong Chongqing Jinfo Mountain Karst Ecosystem National Observation and Research Station School of Geographical SciencesSouthwest UniversityChongqing 400715China Department of Earth&Environmental Engineering Columbia UniversityNew YorkNY 10027USA Smithsonian Tropical Research Institute Apartado 0843-03092BalboaPanama

Relationships among productivity,leaf phenology,and seasonal variation in moisture and light availability are poorly understood for evergreen broadleaved tropical/subtropical forests,which contribute 25% of terrestrial *** the one hand,as moisture availability declines,trees shed leaves to reduce transpiration and the risk of hydraulic *** the other hand,increases in light availability promote the replacement of senescent leaves to increase ***,we provide a comprehensive framework that relates the seasonality of climate,leaf abscission,and leaf productivity across the evergreen broadleaved tropical/subtropical forest *** seasonal correlation between rainfall and light availability varies from strongly negative to strongly positive across the tropics and maps onto the seasonal correlation between litterfall mass and productivity for 68 *** rainfall and light covary positively,litterfall and productivity also covary positively and are always greater in the wetter sunnier *** rainfall and light covary negatively,litterfall and productivity are always greater in the drier and sunnier season if moisture supplies remain adequate;otherwise productivity is smaller in the drier sunnier *** framework will improve the representation of tropical/subtropical forests in Earth system models and suggests how phenology and productivity will change as climate change alters the seasonality of cloud cover and rainfall across tropical/subtropical forests.

关键词： tropical forest leaf abscission and productivity plant adaptive strategy climate and phenology regime climatic driver

学校读者我要写书评

暂无评论

IEEE International Conference on Multimedia and Expo (ICME)

作者： Xiaoke Zhu Danyang Li Xiaopan Chen Fumin Qi Fan Zhang Xiao-Yuan Jing School of Computer and Information Engineering Henan University Kaifeng China Henan Engineering Research Center of Intelligent Technology and Application Henan University Kaifeng China Department of System Operation National Supercomuting Center in Shenzhen Shenzhen China Henan Key Laboratory of Big Data Analysis and Processing Henan University Kaifeng China School of Computer Science Wuhan University Wuhan China

ISBN: (数字)9798350390155

ISBN: (纸本)9798350390162

Facial image based kinship verification aims to decide whether there exists kinship between the given facial images. In practice, the cross-generation differences will cause adverse effects on kinship verification, which limits the performance. Therefore, how to mine the implied similarity from facial images with large cross-generation divergence is an important problem in kinship verification, which has not yet been well studied. In view of this, we propose a Similarity Mining via Implicit matching pattern LEarning (SMILE) approach for kinship verification. Specifically, SMILE mainly consists of two modules, including a Semi-coupled Multi-pattern Similarity Learning (SMSL) module and a Cross-Generation Feature Normalization (CGFN) module. The SMSL module is designed to learn multiple semi-coupled matching patterns for mining the implicit facial similarity information from different perspectives. The CGFN module aims to reduce the divergence between facial images of parent and child. Extensive experiments demonstrate that the proposed approach outperforms the existing state-of-the-art methods.

关键词： Pattern matching Similarity learning

The resolution ability and velocity determination the resolution ability and velocity determination in translational variant bistatic SAR

学校读者我要写书评

暂无评论

Yuhang Xuebao/Journal of Astronautics 2009年第4期30卷 1609-1614页

作者： Qiu, Xiao-Lan Hu, Dong-Hui Ding, Chi-Biao Key Laboratory of Technology in Geo-spatial Information Processing and Application System Institute of Electronics Chinese Academy of Sciences Beijing 100190 China Institute of Electronics Chinese Academy of Sciences Beijing 100190 China Graduate University Chinese Academy of Sciences Beijing 100190 China

Ground resolution is very important to SAR images. This paper studied the resolution ability of translational variant bistatic SAR for the designing of proper bistatic configurations. It firstly analyzed the range ground resolution and its relationship with locations using the gradient method. Then it deduced out the azimuth resolution formula and described the calculating method. Finally, simulation results are given and some hints for velocity determination in 'space-air' configuration is also addressed.

关键词： Synthetic aperture radar

Video-based point cloud compression artifact removal

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Akhtar, Anique Gao, Wen Li, Li Li, Zhu Jia, Wei Liu, Shan Department of Computer Science and Electrical Engineering University of Missouri-Kansas City Kansas CityMO64110 United States Tencent America 661 Bryant St. Palo AltoCA94301 United States Department of Computer Science and Electrical Engineering University of Missouri-Kansas City Kansas CityMO64110 United States CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

—Photo-realistic point cloud capture and transmission are the fundamental enablers for immersive visual communication. The coding process of dynamic point clouds, especially video-based point cloud compression (V-PCC) developed by the MPEG standardization group, is now delivering state-of-the-art performance in compression efficiency. V-PCC is based on the projection of the point cloud patches to 2D planes and encoding the sequence as 2D texture and geometry patch sequences. However, the resulting quantization errors from coding can introduce compression artifacts, which can be very unpleasant for the quality of experience (QoE). In this work, we developed a novel out-of-the-loop point cloud geometry artifact removal solution that can significantly improve reconstruction quality without additional bandwidth cost. Our novel framework consists of a point cloud sampling scheme, an artifact removal network, and an aggregation scheme. The point cloud sampling scheme employs a cube-based neighborhood patch extraction to divide the point cloud into patches. The geometry artifact removal network then processes these patches to obtain artifact-removed patches. The artifact-removed patches are then merged together using an aggregation scheme to obtain the final artifact-removed point cloud. We employ 3D deep convolutional feature learning for geometry artifact removal that jointly recovers both the quantization direction and the quantization noise level by exploiting projection and quantization prior. The simulation results demonstrate that the proposed method is highly effective and can considerably improve the quality of the reconstructed point cloud. Copyright © 2021, The Authors. All rights reserved.

关键词： Geometry

Camouflaged Object Detection via Context-aware Cross-level Fusion

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Chen, Geng Liu, Si-Jie Sun, Yu-Jia Ji, Ge-Peng Wu, Ya-Feng Zhou, Tao Northwestern Polytechnical University Xi’an710072 China National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology School of Computer Science and Engineering China Data Processing Center School of Power and Energy China Key Laboratory of System Control and Information Processing Ministry of Education Shanghai200240 China School of Computer Science and Engineering Nanjing University of Science and Technology Nanjing210094 China School of Computer Science Inner Mongolia University Hohhot010021 China Artificial Intelligence Institute School of Computer Science Wuhan University Wuhan430072 China

Camouflaged object detection (COD) aims to identify the objects that conceal themselves in natural scenes. Accurate COD suffers from a number of challenges associated with low boundary contrast and the large variation of object appearances, e.g., object size and shape. To address these challenges, we propose a novel Context-aware Cross-level Fusion Network (C2F-Net), which fuses context-aware cross-level features for accurately identifying camouflaged objects. Specifically, we compute informative attention coefficients from multi-level features with our Attention-induced Cross-level Fusion Module (ACFM), which further integrates the features under the guidance of attention coefficients. We then propose a Dual-branch Global Context Module (DGCM) to refine the fused features for informative feature representations by exploiting rich global context information. Multiple ACFMs and DGCMs are integrated in a cascaded manner for generating a coarse prediction from high-level features. The coarse prediction acts as an attention map to refine the low-level features before passing them to our Camouflage Inference Module (CIM) to generate the final prediction. We perform extensive experiments on three widely used benchmark datasets and compare C2F-Net with state-of-the-art (SOTA) models. The results show that C2F-Net is an effective COD model and outperforms SOTA models remarkably. Further, an evaluation on polyp segmentation datasets demonstrates the promising potentials of our C2F-Net in COD downstream applications. Our code is publicly available at: https://***/Ben57882/C2FNet-TSCVT. Copyright © 2022, The Authors. All rights reserved.

关键词： Object detection

MSight: An Edge-Cloud Infrastructure-based Perception system for Connected Automated Vehicles

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Zhang, Rusheng Meng, Depu Shen, Shengyin Zou, Zhengxia Li, Houqiang Liu, Henry X. The Department of Civil and Environmental Engineering University of Michigan Ann ArborMI48109 United States The University of Michigan Transportation Research Institude 2901 Baxer Rd Ann ArborMI48109 United States The Department of Guidance Navigation and Control School of Astronautics Beihang University Beijing100191 China The CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System Department of Electronic Engineering and Information Science University of Science and Technology of China Hefei China Mcity University of Michigan Ann ArborMI48109 United States

As vehicular communication and networking technologies continue to advance, infrastructure-based roadside perception emerges as a pivotal tool for connected automated vehicle (CAV) applications. Due to their elevated positioning, roadside sensors, including cameras and lidars, often enjoy unobstructed views with diminished object occlusion. This provides them a distinct advantage over onboard perception, enabling more robust and accurate detection of road objects. This paper presents MSight, a cutting-edge roadside perception system specifically designed for CAVs. MSight offers real-time vehicle detection, localization, tracking, and short-term trajectory prediction. Evaluations underscore the system’s capability to uphold lane-level accuracy with minimal latency, revealing a range of potential applications to enhance CAV safety and efficiency. Presently, MSight operates 24/7 at a two-lane roundabout in the City of Ann Arbor, Michigan. Copyright © 2023, The Authors. All rights reserved.

关键词： Roadsides

Research on Integrated Deployment Method of Digital Earth Thematic application Model

学校读者我要写书评

暂无评论

IOP Conference Series: Earth and Environmental Science 2020年第1期502卷

作者： Zhao Danpu Tai Xianqing Ma Zhijie Key Laboratory of Technology in Geospatial Information Processing and Application System Institute of Elec-tronics Chinese Academy of Sciences Beijing 100190 China Research Center of Intelligent City and Intelligent Transportation CAS R&D Center for Internet of Things Wuxi 214135 China

Nowadays, the digital earth not only relates to the technologies of surveying and mapping geography, but also includes the analysis and cross-application of various scientific data related to geographic information. It requires a computing environment and management for the corresponding thematic application models which supports the online analysis on the digital earth. So we proposed an integrated deployment method for digital earth thematic application models based on container cloud, which provides a flexible and scalable information integration and analysis architecture for digital earth. Firstly, a Docker image building module is designed to facilitate the user to quickly build the application model into a image. Then the Docker technology is used to implement the containerization of the application model to provide a stable running environment for the application model. Finally, the Kubernetes is used to dynamically manage the cluster resources to realize rapid expansion of computing resources. In addition, the HDFS is deployed, and the image files and various scientific data respectively store with Hbase and Apache file systems. It can ensure the read and write speed of the application model and the related data and log files. It also used zabbix framework to manage the monitoring index of the container cloud cluster to ensure the execution effect of the application model. Through the tests of typical application model, it is verified that the method can integrated deploy and apply the cross-domain, hetero-architecture, multi-version and multi-class application models on the digital earth.

关键词：

NTIRE 2020 Challenge on Image and Video Deblurring

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Seungjun, Nah Sanghyun, Son Radu, Timofte Kyoung Mu, Lee Tseng, Yu Xu, Yu-Syuan Chiang, Cheng-Ming Tsai, Yi-Min Brehm, Stephan Scherer, Sebastian Xu, Dejia Chu, Yihao Sun, Qingyan Jiang, Jiaqin Duan, Lunhao Yao, Jian Purohit, Kuldeep Suin, Maitreya Rajagopalan, A.N. Ito, Yuichi Hrishikesh, P.S. Puthussery, Densen Akhil, K.A. Jiji, C.V. Kim, Guisik Deepa, P.L. Xiong, Zhiwei Huang, Jie Liu, Dong Kim, Sangmin Nam, Hyungjoon Kim, Jisu Jeong, Jechang Huang, Shihua Fan, Yuchen Yu, Jiahui Yu, Haichao Huang, Thomas S. Zhou, Ya Li, Xin Liu, Sen Chen, Zhibo Dutta, Saikat Das, Sourya Dipta Garg, Shivam Sprague, Daniel Patel, Bhrij Huck, Thomas Department of ECE ASRI SNU Korea Republic of Computer Vision Lab ETH Zurich Switzerland MediaTek Inc University of Augsburg Chair for Multimedia Computing and Computer Vision Lab Germany Peking University China Beijing University of Posts and Telecommunications China Beijing Jiaotong University China Wuhan University China Indian Institute of Technology Madras India Vermilion College of Engineering Trivandrum India CVML Chung-Ang University Korea Republic of APJ Abdul Kalam Technological University India University of Science and Technology of China China Image Communication Signal Processing Laboratory Hanyang University Korea Republic of Southern University of Science and Technology China University of Illinois at Urbana-Champaign United States CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China China IIT Madra Jadavpur University India University of Texas Austin United States Duke University Computer Science Department United States

Motion blur is one of the most common degradation artifacts in dynamic scene photography. This paper reviews the NTIRE 2020 Challenge on Image and Video Deblurring. In this challenge, we present the evaluation results from 3 competition tracks as well as the proposed solutions. Track 1 aims to develop single-image deblurring methods focusing on restoration quality. On Track 2, the image deblurring methods are executed on a mobile platform to find the balance of the running speed and the restoration accuracy. Track 3 targets developing video deblurring methods that exploit the temporal relation between input frames. In each competition, there were 163, 135, and 102 registered participants and in the final testing phase, 9, 4, and 7 teams competed. The winning methods demonstrate the state-of-the-art performance on image and video deblurring tasks. Copyright © 2020, The Authors. All rights reserved.

关键词： Image enhancement