检索结果-内蒙古大学图书馆

Air Pollution Monitoring By Integrating Local and Global Information in Self-Adaptive Multiscale Transform Domain

IEEE Transactions on Multimedia 2025年

作者： Gu, Ke Liu, Yuchen Liu, Hongyan Liu, Bo Qiao, Junfei Lin, Weisi Zhang, Wenjun Beijing University of Technology School of Information Science and Technology Engineering Research Center of Intelligent Perception and Autonomous Control of Ministry of Education Beijing Laboratory of Smart Environmental Protection Beijing Key Laboratory of Computational Intelligence and Intelligent System Beijing Artificial Intelligence Institute Beijing100124 China Massey University School of Mathematical and Computational Sciences New Zealand Nanyang Technological University College of Computing and Data Science Singapore Shanghai Jiao Tong University Institute of Image Communication and Information Processing Shanghai China

As the deadliest form of pollution, air pollution had a prolonged severe damage to the human health and life safety of nearly 99% of the world's population. Facing to the problem that billions of tons of pollutants discharged into the air per year by industrial activities, this paper proposed a novel image-based air pollution monitor (IAPM) by incorporating local and global information in the self-adaptive multiscale transform domain, so as to achieve the timely and effective leakage detection of typical air pollutants from a single image. To be specific, this paper first developed a screen-shaped module according to two significant findings in visual neuroscience, which include the high sensitivity of human eyes to horizontal and vertical stimuli and the center-surround inhibition, by designing and fusing the square module, horizontal strip module and vertical strip module parallelly for simulating the behaviour of human eyes to extract local features. Second, the learnable weights and proportional mapping were applied to incorporate the screen-shaped module and lightweight vision transformer as backbone, towards more richly exploiting and fusing local and global information just as the way a brain perceives external stimuli. Third, a new self-adaptive multiscale transform domain method was devised based on two motivations from the visual characteristics of multiscale perception and the brain characteristics of self-adaptive domain transform to modify the backbone by using the operations of pooling and pointwise convolution. Extensive experiments implemented on the datasets of carbon particulate matters and ethylene leakage confirmed the superior monitoring performance of the proposed IAPM model beyond the state-of-the-art (SOTA) peers by an accuracy gain of about 4%. Furthermore, the proposed IAPM model only required 0.089 GFLOPs and 0.15 million model parameters, remarkably outperforming SOTA competitors in computational efficiency and storage resources. © 1999-2

关键词： Information leakage

来源：评论

学校读者我要写书评

暂无评论

Design of three-dimensional gesture recognition and motion tracking human-computer intelligent interaction system based on PAJ7620

Design of three-dimensional gesture recognition and motion t...

引用

2021 International Conference on Information Technology and Intelligent Control, CITIC 2021

作者： Wang, Jian-Liang Wei, Ye Li, Yang Meng, Yuan Li, Ming-Yu Xu, Jiang-Yan Jiao, Wan-Ming Ban, Lan Liu, Jun-Pei Zhang, Hong-Feng Zhang, Wei Wang, Li-Na Luo, Fu-Chen Wang, Yu-Duo Tianjin College University of Science and Technology Beijing Tianjin China Civil Aviation University of China Tianjin Key Laboratory of Intelligent Signal and Image Processing Tianjin China Tianjin Normal University Tianjin Key Laboratory of Wireless Mobile Communication and Radio Energy Transmission Tianjin China Binhai College Nankai University Tianjin China Tianjin Tianshi College Tianjin China

With the increasing degree of informatization and intelligence in modern society, human-computer interaction technology has become one of the commonly used scientific and technological achievements. "Gesture" can be used as inputing image information, and make more intuitive and convenient for perception of user interface. To a certain extent, it can complete the intelligent interaction function between human and computer. The design is a human-computer intelligent interaction system for 3D gesture recognition and motion tracking based on gesture sensor PAJ7620. STM32 chip is used as the main control unit to recognize accurately, analyze and process different gestures collected by the gesture sensor, and control the OLED screen to display the gesture information. It can further drive the carrier to take corresponding actions and realize the intelligent human-computer interaction recognition of gestures. The experimental test results show that the recognition rate is lose to 100% when the distance is within 10cm. © 2021 Institute of Physics Publishing. All rights reserved.

关键词： Gesture recognition

来源：评论

学校读者我要写书评

暂无评论

image Aligning and Stitching Based on Multilayer Mesh Deformation 16th

Image Aligning and Stitching Based on Multilayer Mesh Deform...

引用

16th International Forum on Digital TV and Wireless Multimedia communication, IFTC 2019

作者： Xie, Mingfu Zhou, Jun Gu, Xiao Yang, Hua Shanghai Key Laboratory of Multi Media Processing and Transmissions Shanghai Jiaotong University Shanghai China Institute of Image Communication and Network Engineering Shanghai Jiaotong University Shanghai China

ISBN: (纸本)9789811533402

This paper aims to solve the problem of strong disparity in image stitching. By studying current mesh deformation methods based on single grid, we propose an image stitching framework based on multilayer mesh deformation for aligning regions in different layer. With development of image depth perception and semantic segmentation technology, we can get layering maps of images or photos expediently. We introduce images representation with layers and get layer corresponding by using depth or disparity information for large parallax scenarios. Registration of each layer is carried out independently. To ensure the integrity of layer synthesis results, we apply deformation with translation and scaling compensation between different layers before blending. The experiment demonstrates that our method can adequately utilize the prior information in layering maps to decouple 2D transformation between different layers, finally achieve outstanding aligning performance in all layers and naturalness in complete stitching result. © 2020, Springer Nature Singapore Pte Ltd.

关键词： Multilayers

来源：评论

学校读者我要写书评

暂无评论

FULL-LENGTH-BODY CBCT IMAGING IN UPRIGHT POSITION WITH ROBOTIC-ARM SYSTEM: A SIMULATION STUDY

arXiv

引用

arXiv 2023年

作者： Lin, Tong Lyu, Tianling Wu, Zhan Xi, Yan Zhu, Wentao Chen, Yang Laboratory of Image Science and Technology Southeast University Nanjing China Research Center of Augmented Intelligence Zhejiang Lab Hangzhou China Shanghai First-Imaging Tech Shanghai China Jiangsu Provincial Joint International Research Laboratory of Medical Information Processing Southeast University Nanjing China Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications Southeast University Nanjing China

Upright position CT scans make it possible for full-length-body imaging at conditions more relevant to daily situations, but the substantial weight of the upright CT scanners increases the risks to floor’s stability and patients’ safety. Robotic-arm CBCT systems are supposed to be a better solution for this task, but such systems still face challenges including long scanning time and low reconstruction quality. To address the above challenges, this paper proposes a novel method to calculate optimal scanning pitch based on data completeness analysis, which can complete the whole-body scan in the shortest time without a significant decline in image quality. Besides, an FDK-style reconstruction method based on normalized projections is proposed to obtain fast image reconstruction. Extensive experiments prove the effectiveness of the proposed optimal scanning trajectory. Qualitative and quantitative comparisons with FDK and iterative algorithms show that the proposed reconstruction method can obtain high imaging quality with reasonable computation costs. The method proposed in this paper is expected to promote the application of robotic-arm CBCT systems in orthopedic functional analysis. © 2023, CC BY-NC-SA.

关键词： Robotic arms

来源：评论

学校读者我要写书评

暂无评论

Slnspeech: Solving Extended Speech Separation Problem with the Help of Sign Language

SSRN

引用

SSRN 2023年

作者： Wu, Jiasong Li, Xuan Li, Taotao Meng, Fanman Kong, Youyong Yang, Guanyu Senhadji, Lotfi Shu, Huazhong Laboratory of Image Science and Technology Key Laboratory of Computer Network and Information Integration Southeast University Ministry of Education Nanjing210096 China Jiangsu Provincial Joint International Research Laboratory of Medical Information Processing Southeast University Nanjing210096 China Univ Rennes INSERM LTSI - UMR 1099 RennesF-35000 France Univ Rennes INSERM RennesF-35000 France

Previous audio-visual speech separation methods use the synchronization of the speaker's facial movement and speech in the video to supervise the speech separation in a self-supervised way. In this paper, we propose a model to solve the speech separation problem assisted by both face and sign language, which we call the extended speech separation problem. We design a general deep learning network for learning the combination of three modalities, audio, face, and sign language information, for better solving the speech separation problem. To train the model, we introduce a large-scale dataset named the Sign Language News Speech (SLNSpeech) dataset in which three modalities of audio, face, and sign language coexist. Experiment results show that the proposed model has better performance and robustness than the usual audio-visual system. Besides, sign language modality can also be used alone to supervise speech separation task, and the introduction of sign language is helpful for hearing-impaired people to learn and communicate. Last, our model is a general speech separation framework and can achieve very competitive separation performance on two open-source audio-visual datasets. The code is available at https://***/iveveive/SLNSpeech. © 2023, The Authors. All rights reserved.

关键词： Audition

来源：评论

学校读者我要写书评

暂无评论

Few-Shot Class-Incremental Learning with Prior Knowledge

arXiv

引用

arXiv 2024年

作者： Jiang, Wenhao Li, Duo Hu, Menghan Zhai, Guangtao Yang, Xiaokang Zhang, Xiao-Ping Shanghai Key Laboratory of Multidimensional Information Processing School of Communication and Electronic Engineering East China Normal University Shanghai200241 China Kargobot of DiDi Shanghai201210 China Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai200240 China Tsinghua Berkeley Shenzhen Institute Shenzhen China Department of Electrical Computer and Biomedical Engineering Toronto Metropolitan University ONM5B 2K3 Canada

To tackle the issues of catastrophic forgetting and overfitting in few-shot class-incremental learning (FSCIL), previous work has primarily concentrated on preserving the memory of old knowledge during the incremental phase. The role of pre-trained model in shaping the effectiveness of incremental learning is frequently underestimated in these studies. Therefore, to enhance the generalization ability of the pre-trained model, we propose Learning with Prior Knowledge (LwPK) by introducing nearly free prior knowledge from a few unlabeled data of subsequent incremental classes. We cluster unlabeled incremental class samples to produce pseudo-labels, then jointly train these with labeled base class samples, effectively allocating embedding space for both old and new class data. Experimental results indicate that LwPK effectively enhances the model resilience against catastrophic forgetting, with theoretical analysis based on empirical risk minimization and class distance measurement corroborating its operational principles. The source code of LwPK is publicly available at: https://***/StevenJ308/LwPK. Copyright © 2024, The Authors. All rights reserved.

关键词： Risk assessment

来源：评论

学校读者我要写书评

暂无评论

Uncertainty-aware Sampling for Long-tailed Semi-supervised Learning

arXiv

引用

arXiv 2024年

作者： Yang, Kuo Li, Duo Hu, Menghan Zhai, Guangtao Yang, Xiaokang Zhang, Xiao-Ping The Shanghai Key Laboratory of Multidimensional Information Processing School of Communication and Electronic Engineering East China Normal University Shanghai200241 China The Kargobot of DiDi Shanghai201210 China The Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai200240 China Tsinghua Berkeley Shenzhen Institute Shenzhen China The Department of Electrical Computer and Biomedical Engineering Toronto Metropolitan University ONM5B 2K3 Canada

For semi-supervised learning with imbalance classes, the long-tailed distribution of data will increase the model prediction bias toward dominant classes, undermining performance on less frequent classes. Existing methods also face challenges in ensuring the selection of sufficiently reliable pseudo-labels for model training and there is a lack of mechanisms to adjust the selection of more reliable pseudo-labels based on different training stages. To mitigate this issue, we introduce uncertainty into the modeling process for pseudo-label sampling, taking into account that the model performance on the tailed classes varies over different training stages. For example, at the early stage of model training, the limited predictive accuracy of model results in a higher rate of uncertain pseudo-labels. To counter this, we propose an Uncertainty-Aware Dynamic Threshold Selection (UDTS) approach. This approach allows the model to perceive the uncertainty of pseudo-labels at different training stages, thereby adaptively adjusting the selection thresholds for different classes. Compared to other methods such as the baseline method FixMatch, UDTS achieves an increase in accuracy of at least approximately 5.26%, 1.75%, 9.96%, and 1.28% on the natural scene image datasets CIFAR10-LT, CIFAR100-LT, STL-10-LT, and the medical image dataset TissueMNIST, respectively. The source code of UDTS is publicly available at: https://***/yangk/UDTS. Copyright © 2024, The Authors. All rights reserved.

关键词： Uncertainty analysis

来源：评论

学校读者我要写书评

暂无评论

Retinex based flicker-free low-light video enhancement 1

引用

2nd Chinese Conference on Pattern Recognition and Computer Vision, PRCV 2019

作者： Tu, Juanjuan Gan, Zongliang Liu, Feng Jiangsu Provincial Key Lab of Image Processing and Image Communication Nanjing University of Posts and Telecommunications Nanjing210003 China

ISBN: (数字)9783030317232

ISBN: (纸本)9783030317225

Videos captured in low light environment tend to be poor visual effect. To get better visual experience, a video enhancement algorithm based on improved center-surrounded Retinex and optical flow is proposed in this paper, which contains intra-frame brightness enhancement and inter-frame brightness continuity. In intra-frame brightness enhancement, reflection of each frame is estimated by adjusting the illumination using a weight factor, so that bright illumination is compressed to obtain a reflection with approximately uniform illumination. Then logarithmic image processing subtraction (LIPS) is adopted to enhance its contrast. To maintain inter-frame brightness continuity, the background and brightness changes of adjacent frames are measured using optical flow and just noticeable difference (JND) threshold, respectively. If the background and average brightness change little, their reflection brightness is almost the same, so LIPS parameter of previous frame is applied to current frame. Otherwise, current frame will be updated by calculating its own parameter. Experimental results demonstrate that proposed algorithm performs well in brightness continuity and detail enhancement. © Springer Nature Switzerland AG 2019.

关键词： Luminance

来源：评论

学校读者我要写书评

暂无评论

3D EAGAN: 3D edge-aware attention generative adversarial network for prostate segmentation in transrectal ultrasound images

arXiv

引用

arXiv 2023年

作者： Liu, Mengqing Shao, Xiao Jiang, Liping Wu, Kaizhi School of Information Engineering Nanchang Hangkong University Jiangxi Nanchang China School of Computer Science Nanjing University of Information Science and Technology Jiangsu Nanjing China The First Affiliated Hospital of Nanchang University Nanchang University Jiangxi Nanchang China Key Laboratory of Jiangxi Province for Image Processing and Pattern Recognition Nanchang Hangkong University Nanchang China

Background: Segment prostates from transrectal ultrasound (TRUS) images plays an essential role in the diagnosis and treatment of prostate cancer. However, traditional segmentation methods are time-consuming and laborious. To address this issue, there is an urgent need to develop computer algorithms that can automatically segment prostates from TRUS images, which makes it become the direction and form of future development. Purpose: Automatic prostate segmentation in TRUS images has always been a challenging problem, since prostates in TRUS images have ambiguous boundaries and inhomogeneous intensity distribution. Although many prostate segmentation methods have been proposed, they still need to be improved due to the lack of sensibility to edge information. Consequently, the objective of this study is to devise a highly effective prostate segmentation method that overcomes these limitations and achieves accurate segmentation of prostates in TRUS images. Methods: A 3D edge-aware attention generative adversarial network (3D EAGAN)-based prostate segmentation method is proposed in this paper, which consists of an edge-aware segmentation network (EASNet) that performs the prostate segmentation and a discriminator network that distinguishes predicted prostates from real prostates. The proposed EASNet is composed of an encoder-decoder-based U-Net backbone network, a detail compensation module, four 3D spatial and channel attention modules, an edge enhance module, and a global feature extractor. The detail compensation module is proposed to compensate for the loss of detailed information caused by the down-sampling process of the encoder. The features of the detail compensation module are selectively enhanced by the 3D spatial and channel attention module. Furthermore, an edge enhance module is proposed to guide shallow layers in the EASNet to focus on contour and edge information in prostates. Finally, features from shallow layers and hierarchical features from the decod

关键词： Generative adversarial networks

来源：评论

学校读者我要写书评

暂无评论

Lightweight Real-time Semantic Segmentation Network with Efficient Transformer and CNN

arXiv

引用

arXiv 2023年

作者： Xu, Guoan Li, Juncheng Gao, Guangwei Lu, Huimin Yang, Jian Yue, Dong The Institute of Advanced Technology Nanjing University of Posts and Telecommunications Nanjing210023 China The Provincial Key Laboratory for Computer Information Processing Technology Soochow University Suzhou215006 China The School of Communication and Information Engineering Shanghai University Shanghai200444 China Jiangsu Key Laboratory of Image and Video Understanding for Social Safety Nanjing University of Science and Technology Nanjing210049 China The Kyushu Institute of Technology Kitakyushu804-8550 Japan The School of Computer Science and Technology Nanjing University of Science and Technology Nanjing210049 China

In the past decade, convolutional neural networks (CNNs) have shown prominence for semantic segmentation. Although CNN models have very impressive performance, the ability to capture global representation is still insufficient, which results in suboptimal results. Recently, Transformer achieved huge success in NLP tasks, demonstrating its advantages in modeling long-range dependency. Recently, Transformer has also attracted tremendous attention from computer vision researchers who reformulate the image processing tasks as a sequence-to-sequence prediction but resulted in deteriorating local feature details. In this work, we propose a lightweight real-time semantic segmentation network called LETNet. LETNet combines a U-shaped CNN with Transformer effectively in a capsule embedding style to compensate for respective deficiencies. Meanwhile, the elaborately designed Lightweight Dilated Bottleneck (LDB) module and Feature Enhancement (FE) module cultivate a positive impact on training from scratch simultaneously. Extensive experiments performed on challenging datasets demonstrate that LETNet achieves superior performances in accuracy and efficiency balance. Specifically, It only contains 0.95M parameters and 13.6G FLOPs but yields 72.8% mIoU at 120 FPS on the Cityscapes test set and 70.5% mIoU at 250 FPS on the CamVid test dataset using a single RTX 3090 GPU. Source code will be available at https://***/IVIPLab/LETNet. Copyright © 2023, The Authors. All rights reserved.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：