检索结果-内蒙古大学图书馆

arXiv 2020年

作者： Wolanin, Aleksandra Camps-Valls, Gustau Gómez-Chova, Luis Mateo-García, Gonzalo van der Tol, Christiaan Zhang, Yongguang Guanter, Luis Section 1.4 Remote Sensing GFZ German Research Centre for Geosciences Helmholtz-Centre Potsdam Germany Image Processing Laboratory Universitat de València València Spain Faculty of ITC University of Twente Enschede Netherlands Jiangsu Provincial Key Laboratory of Geographic Information Science and Technology International Institute for Earth System Sciences Nanjing University Nanjing210023 China

Satellite remote sensing has been widely used in the last decades for agricultural applications, both for assessing vegetation condition and for subsequent yield prediction. Existing remote sensing-based methods to estimate gross primary productivity (GPP), which is an important variable to indicate crop photosynthetic function and stress, typically rely on empirical or semi-empirical approaches, which tend to over-simplify photosynthetic mechanisms. In this work, we take advantage of all parallel developments in mechanistic photosynthesis modeling and satellite data availability for an advanced monitoring of crop productivity. In particular, we combine process-based modeling with the soil-canopy energy balance radiative transfer model (SCOPE) with Sentinel-2 and Landsat 8 optical remote sensing data and machine learning methods in order to estimate crop GPP. With this approach, we by-pass the need for an intermediate step to retrieve the set of vegetation biophysical parameters needed to accurately model photosynthesis, while still accounting for the complex processes of the original physically-based model. Several implementations of the machine learning models are tested and validated using simulated and flux tower-based GPP data. Our final neural network model is able to estimate GPP at the tested flux tower sites with r2 of 0.92 and RMSE of 1.38 gC d−1 m−2, which outperforms empirical models based on vegetation indices. The first test of applicability of this model to Landsat 8 data showed good results (r2 of 0.82 and RMSE of 1.97 gC d−1 m−2), which suggests that our approach can be further applied to other sensors. Modeling and testing is restricted to C3 crops in this study, but can be extended to C4 crops by producing a new training dataset with SCOPE that accounts for the different photosynthetic pathways. Our model successfully estimates GPP across a variety of C3 crop types and environmental conditions even though it does not use any local information from

关键词： Photosynthesis

来源：评论

学校读者我要写书评

暂无评论

Dual-Source CBCT for Larger Longitudinal Coverage: System Design and image Reconstruction

Dual-Source CBCT for Larger Longitudinal Coverage: System De...

引用

Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)

作者： Xusheng Zhang Tianling Lyu Yijie Shi Xinyun Zhong Zhan Wu Yan Xi Shijie Wang Yang Chen Wentao Zhu School of Software Southeast University Nanjing China Zhejiang Lab Hangzhou China Laboratory of Image Science and Technology the School of Computer Science and Engineering Southeast University Nanjing China First-Imaging Tech. Shanghai China Jiangsu Provincial Joint International Research Laboratory of Medical Information Processing the Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications Southeast University Nanjing China

ISBN: (数字)9798350371499

ISBN: (纸本)9798350371505

The application of CBCT systems in intraoperative environments has become increasingly common, but concurrent CBCT systems are unsuitable for situations that require a large longitudinal imaging FoV, such as orthopedics. To increase longitudinal coverage, we developed a dual-source CBCT (DS-CBCT) system in which two ray sources are symmetrically placed along the central plane. After further analyzing its geometric characteristics, we propose an analytical reconstruction algorithm termed DT-FDK specialized for DS-CBCT, which combines cone-beam rebinning and two rays with smaller cone angles among the four conjugate rays to further suppress cone beam artifacts. The system design and reconstruction algorithm are tested on both simulated and real-scanned data. Results show that the DS-CBCT can expand the effective imaging volume by 37.1% compared to single-source CBCT systems. The reconstructed images by DT-FDK also show improved image quality compared to traditional reconstruction algorithms.

关键词： image quality Orthopedic surgery Imaging Reconstruction algorithms Engineering in medicine and biology image reconstruction System analysis and design

来源：评论

学校读者我要写书评

暂无评论

Multiscale Low-Frequency Memory Network for Improved Feature Extraction in Convolutional Neural Networks

arXiv

引用

arXiv 2024年

作者： Wu, Fuzhi Wu, Jiasong Kong, Youyong Yang, Chunfeng Yang, Guanyu Shu, Huazhong Carrault, Guy Senhadji, Lotfi Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications Southeast University Bangladesh Laboratoire Traitement du Signal et de l'Image Univ Rennes France Centre de Recherche en Information Biomédicale Sino-français CRIBs France Jiangsu Provincial Joint International Research Laboratory of Medical Information Processing Southeast University Bangladesh

Deep learning and Convolutional Neural Networks (CNNs) have driven major transformations in diverse research areas. However, their limitations in handling low-frequency information present obstacles in certain tasks like interpreting global structures or managing smooth transition images. Despite the promising performance of transformer structures in numerous tasks, their intricate optimization complexities highlight the persistent need for refined CNN enhancements using limited resources. Responding to these complexities, we introduce a novel framework, the Multiscale Low-Frequency Memory (MLFM) Network, with the goal to harness the full potential of CNNs while keeping their complexity unchanged. The MLFM efficiently preserves low-frequency information, enhancing performance in targeted computer vision tasks. Central to our MLFM is the Low-Frequency Memory Unit (LFMU), which stores various low-frequency data and forms a parallel channel to the core network. A key advantage of MLFM is its seamless compatibility with various prevalent networks, requiring no alterations to their original core structure. Testing on imageNet demonstrated substantial accuracy improvements in multiple 2D CNNs, including ResNet, MobileNet, EfficientNet, and ConvNeXt. Furthermore, we showcase MLFM's versatility beyond traditional image classification by successfully integrating it into image-to-image translation tasks, specifically in semantic segmentation networks like FCN and U-Net. In conclusion, our work signifies a pivotal stride in the journey of optimizing the efficacy and efficiency of CNNs with limited resources. This research builds upon the existing CNN foundations and paves the way for future advancements in computer vision. Our codes are available at https://***/AlphaWuSeu/MLFM. © 2024, CC BY-NC-ND.

关键词： Computer vision

来源：评论

学校读者我要写书评

暂无评论

Lightweight Real-time Semantic Segmentation Network with Efficient Transformer and CNN

arXiv

引用

arXiv 2023年

作者： Xu, Guoan Li, Juncheng Gao, Guangwei Lu, Huimin Yang, Jian Yue, Dong The Institute of Advanced Technology Nanjing University of Posts and Telecommunications Nanjing210023 China The Provincial Key Laboratory for Computer Information Processing Technology Soochow University Suzhou215006 China The School of Communication and Information Engineering Shanghai University Shanghai200444 China Jiangsu Key Laboratory of Image and Video Understanding for Social Safety Nanjing University of Science and Technology Nanjing210049 China The Kyushu Institute of Technology Kitakyushu804-8550 Japan The School of Computer Science and Technology Nanjing University of Science and Technology Nanjing210049 China

In the past decade, convolutional neural networks (CNNs) have shown prominence for semantic segmentation. Although CNN models have very impressive performance, the ability to capture global representation is still insufficient, which results in suboptimal results. Recently, Transformer achieved huge success in NLP tasks, demonstrating its advantages in modeling long-range dependency. Recently, Transformer has also attracted tremendous attention from computer vision researchers who reformulate the image processing tasks as a sequence-to-sequence prediction but resulted in deteriorating local feature details. In this work, we propose a lightweight real-time semantic segmentation network called LETNet. LETNet combines a U-shaped CNN with Transformer effectively in a capsule embedding style to compensate for respective deficiencies. Meanwhile, the elaborately designed Lightweight Dilated Bottleneck (LDB) module and Feature Enhancement (FE) module cultivate a positive impact on training from scratch simultaneously. Extensive experiments performed on challenging datasets demonstrate that LETNet achieves superior performances in accuracy and efficiency balance. Specifically, It only contains 0.95M parameters and 13.6G FLOPs but yields 72.8% mIoU at 120 FPS on the Cityscapes test set and 70.5% mIoU at 250 FPS on the CamVid test dataset using a single RTX 3090 GPU. Source code will be available at https://***/IVIPLab/LETNet. Copyright © 2023, The Authors. All rights reserved.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

Heterogeneous two-Stream Network with Hierarchical Feature Prefusion for Multispectral Pan-Sharpening

Heterogeneous two-Stream Network with Hierarchical Feature P...

引用

IEEE International Conference on Acoustics, Speech and Signal processing

作者： Dong Wang Yunpeng Bai Bendu Bai Chanyue Wu Ying Li National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology School of Computer Science Northwestern Polytechnical University Xi'an China School of Communication and Information Engineering Xi’an University of Posts and Telecommunications Xi'an China National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology Shaanxi Provincial Key Laboratory of Speech & Image Information Processing Northwestern Polytechnical University Xi'an China

ISBN: (纸本)9781728176055;9781728176062

Multispectral (MS) pan-sharpening aims at producing a high spatial resolution (HR) MS image by fusing a single-band HR panchromatic (PAN) image and a corresponding MS image with low spatial resolution. In this paper, we propose a heterogeneous two-stream network (HTSNet) with hierarchical feature prefusion for MS pan-sharpening. The HTSNet employs a heterogeneous group of spatial and spectral streams for spatial and spectral information extraction, respectively. The spatial stream utilizes a 2D CNN for spatial information extraction from the PAN images, and the spectral stream obtains spectral feature cubes from the MS images by a 3D CNN. At the same time, a prefusion module is introduced to prefuse the spatial details with spectral information and transfer information between different streams, which can enhance later processing. In the experiment, the Gaofen-2 satellite dataset is utilized to compare the proposed method with the state-of-the-art MS pan-sharpening methods. Experimental results demonstrate the superiority of our HTSNet in terms of visual effect and quantitative qualities.

关键词： Satellites Three-dimensional displays Fuses Streaming media Signal processing Information retrieval Visual effects

来源：评论

学校读者我要写书评

暂无评论

EWT: Efficient Wavelet-Transformer for Single image Denoising

arXiv

引用

arXiv 2023年

作者： Li, Juncheng Cheng, Bodong Chen, Ying Gao, Guangwei Zeng, Tieyong The School of Communication & Information Engineering Shanghai University Shanghai China Jiangsu Key Laboratory of Image and Video Understanding for Social Safety Nanjing University of Science and Technology Nanjing China The School of Computer Science and Technology Xidian University Xian China The Department of Cyberspace Security Beijing Electronic Science & Technology Institute Beijing China The Institute of Advanced Technology Nanjing University of Posts and Telecommunications Nanjing China The Provincial Key Laboratory for Computer Information Processing Technology Soochow University Suzhou China The Department of Mathematics The Chinese University of Hong Kong New Territories Hong Kong

Transformer-based image denoising methods have achieved encouraging results in the past year. However, it must uses linear operations to model long-range dependencies, which greatly increases model inference time and consumes GPU storage space. Compared with convolutional neural network-based methods, current Transformer-based image denoising methods cannot achieve a balance between performance improvement and resource consumption. In this paper, we propose an Efficient Wavelet Transformer (EWT) for image denoising. Specifically, we use Discrete Wavelet Transform (DWT) and Inverse Wavelet Transform (IWT) for downsampling and upsampling, respectively. This method can fully preserve the image features while reducing the image resolution, thereby greatly reducing the device resource consumption of the Transformer model. Furthermore, we propose a novel Dual-stream Feature Extraction Block (DFEB) to extract image features at different levels, which can further reduce model inference time and GPU memory usage. Experiments show that our method speeds up the original Transformer by more than 80%, reduces GPU memory usage by more than 60%, and achieves excellent denoising results. All code will be public. © 2023, CC BY.

关键词： image denoising

来源：评论

学校读者我要写书评

暂无评论

FST-Net: Facial Soft Tissue Landmark Localization on 3dMD Scans Using Feature Fusion and Local Coordinate Regression

FST-Net: Facial Soft Tissue Landmark Localization on 3dMD Sc...

引用

IEEE International Symposium on Biomedical Imaging

作者： Zhidong He Han Bao Mingzhang Chen Jiasong Wu Luwei Liu Lotfi Senhadji Huazhong Shu Bin Yan Laboratory of Image Science and Technology Southeast University Nanjing China Jiangsu Provincial Joint International Research Laboratory of Medical Information Processing Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Ministry of Education) Southeast University Nanjing China Department of Orthodontics The Affiliated Stomatological Hospital of Nanjing Medical University Nanjing China Centre de Recherche en Information Biomédicale Sino-Français Rennes France INSERM LTSI-UMR 1099 Univ-Rennes Rennes France

ISBN: (数字)9798350313338

ISBN: (纸本)9798350313345

Landmark localization of facial soft tissue (FST) is a basic step in 3D morphometric analysis of human face. However, there are few studies on landmark localization of 3D scan images based on deep learning. The methods based on 2D images cannot be directly applied due to the non-Euclidean data structure. In this paper, we propose an end-to-end learning framework to automatically localize 28 landmarks on 3dMD scans, called FST-Net. Our method extracts features from texture images and mesh models. New texture mappings for 3dMD scans are generated by projection to fuse texture and structure features. A dual-branch network integrating transformers is applied to predict the landmark heatmaps from coarse to fine. A local coordinate regression module based on probabilistic distance and heatmap predictions is proposed to compute the landmark coordinates. We collect and annotate 297 3dMD face scans from the clinic to evaluate our model. Experiments show that the average localization error of the model is 1.204mm (the clinically acceptable precision range is 1.5 mm), and the correct landmark detection rate equals to 70.89%. Our model outperforms the current state-of-the-art deep learning methods for landmark localization on the mesh model.

关键词： Location awareness Deep learning Heating systems Three-dimensional displays Accuracy Computational modeling Biological tissues

来源：评论

学校读者我要写书评

暂无评论

CTCNet: A CNN-Transformer Cooperation Network for Face image Super-Resolution

arXiv

引用

arXiv 2022年

作者： Gao, Guangwei Xu, Zixiang Li, Juncheng Yang, Jian Zeng, Tieyong Qi, Guo-Jun The Institute of Advanced Technology Nanjing University of Posts and Telecommunications Nanjing China The Provincial Key Laboratory for Computer Information Processing Technology Soochow University Suzhou China The School of Communication & Information Engineering Shanghai University Shanghai China Jiangsu Key Laboratory of Image and Video Understanding for Social Safety Nanjing University of Science and Technology Nanjing China The School of Computer Science and Technology Nanjing University of Science and Technology Nanjing China The Center for Mathematical Artificial Intelligence Department of Mathematics The Chinese University of Hong Kong Hong Kong Research Center for Industries of the Future School of Engineering Westlake University OPPO Research Seattle United States

Recently, deep convolution neural networks (CNNs) steered face super-resolution methods have achieved great progress in restoring degraded facial details by joint training with facial priors. However, these methods have some obvious limitations. On the one hand, multi-task joint learning requires additional marking on the dataset, and the introduced prior network will significantly increase the computational cost of the model. On the other hand, the limited receptive field of CNN will reduce the fidelity and naturalness of the reconstructed facial images, resulting in suboptimal reconstructed images. In this work, we propose an efficient CNN-Transformer Cooperation Network (CTCNet) for face super-resolution tasks, which uses the multi-scale connected encoder-decoder architecture as the backbone. Specifically, we first devise a novel Local-Global Feature Cooperation Module (LGCM), which is composed of a Facial Structure Attention Unit (FSAU) and a Transformer block, to promote the consistency of local facial detail and global facial structure restoration simultaneously. Then, we design an efficient Feature Refinement Module (FRM) to enhance the encoded features. Finally, to further improve the restoration of fine facial details, we present a Multi-scale Feature Fusion Unit (MFFU) to adaptively fuse the features from different stages in the encoder procedure. Extensive evaluations on various datasets have assessed that the proposed CTCNet can outperform other state-of-the-art methods significantly. Source code will be available at https://***/IVIPLab/CTCNet. Copyright © 2022, The Authors. All rights reserved.

关键词： Restoration

来源：评论

学校读者我要写书评

暂无评论

Tigc-Net: Transformer-Improved Graph Convolution Network for Spatio-Temporal Prediction

SSRN

引用

SSRN 2022年

作者： Chen, Kai Yang, Chunfeng Zhou, Zhengyuan Liu, Yao Ji, Tianjiao Sun, Weiya Chen, Yang School of Cyber Science and Engineering Southeast University Nanjing210096 China Key Laboratory of Computer Network and Information Integration Southeast University Ministry of Education Nanjing210096 China The College of Software Engineering Southeast University Nanjing210096 China Laboratory of Image Science and Technology The School of Computer Science and Engineering Southeast University Nanjing210096 China Jiangsu Key Laboratory of Molecular and Functional Imaging Department of Radiology Zhongda Hospital Southeast University Nanjing210009 China Jiangsu Provincial Joint International Research Laboratory of Medical Information Processing School of Computer Science and Engineering Southeast University Nanjing210096 China NHC Key Laboratory of Medical Virology and Viral Diseases National Institute for Viral Disease Control and Prevention Chinese Center for Disease Control and Prevention Beijing China Beijing Institute of Tracking and Communication Technology Beijing100094 China

Modeling spatio-temporal sequences is an important topic yet challenging for existing neural networks. Most of the current spatio-temporal sequence prediction methods usually capture features separately in temporal and spatial dimensions or employ multiple mutually independent local spatio-temporal graphs to represent a spatio-temporal sequence. The first kind of method mentioned above is difficult to mine the complex spatio-temporal correlations, while the other is limited for the accuracy of long-term predictions. To handle these issues, this paper proposes a Transformer-Improved Graph Convolution Network for spatio-temporal prediction. Specifically, the temporal location encoding method is exploited to derive the spatio-temporal characteristics of the sequence utilizing a spatio-temporal feature fusion network. In addition, a spatio-temporal attention network is developed to enhance the spatio-temporal correlation of the sequence, and the dynamic spatial features of sequence are further extracted through the adaptive graph convolution network. A private dataset and a public dataset are employed to demonstrate the performance of the proposed TIGC-Net. The qualitative and quantitative results show that the proposed TIGC-Net can extract dynamic spatiotemporal properties more effectively, enhance the spatio-temporal correlation of sequences and improve the prediction accuracy compared with four stateof-the-art. © 2022, The Authors. All rights reserved.

关键词： Convolution

来源：评论

学校读者我要写书评

暂无评论

Cross-receptive Focused Inference Network for Lightweight image Super-Resolution

arXiv

引用

arXiv 2022年

作者： Li, Wenjie Li, Juncheng Gao, Guangwei Deng, Weihong Zhou, Jiantao Yang, Jian Qi, Guo-Jun The Intelligent Visual Information Perception Laboratory Institute of Advanced Technology Nanjing University of Posts and Telecommunications Nanjing210046 China The Provincial Key Laboratory for Computer Information Processing Technology Soochow University Suzhou215006 China The School of Communication and Information Engineering Shanghai University Shanghai200444 China Jiangsu Key Laboratory of Image and Video Understanding for Social Safety Nanjing University of Science and Technology Nanjing210094 China The Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing100876 China The State Key Laboratory of Internet of Things for Smart City Department of Computer and Information Science Faculty of Science and Technology University of Macau 999078 China The School of Computer Science and Technology Nanjing University of Science and Technology Nanjing210094 China The Research Center for Industries of the Future The School of Engineering Westlake University Hangzhou310024 China OPPO Research SeattleWA98101 United States

Recently, Transformer-based methods have shown impressive performance in single image super-resolution (SISR) tasks due to the ability of global feature extraction. However, the capabilities of Transformers that need to incorporate contextual information to extract features dynamically are neglected. To address this issue, we propose a lightweight Cross-receptive Focused Inference Network (CFIN) that consists of a cascade of CT Blocks mixed with CNN and Transformer. Specifically, in the CT block, we first propose a CNN-based Cross-Scale Information Aggregation Module (CIAM) to enable the model to better focus on potentially helpful information to improve the efficiency of the Transformer phase. Then, we design a novel Cross-receptive Field Guided Transformer (CFGT) to enable the selection of contextual information required for reconstruction by using a modulated convolutional kernel that understands the current semantic information and exploits the information interaction within different self-attention. Extensive experiments have shown that our proposed CFIN can effectively reconstruct images using contextual information, and it can strike a good balance between computational cost and model performance as an efficient model. Source codes will be available at https://***/IVIPLab/CFIN. Copyright © 2022, The Authors. All rights reserved.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：