检索结果-内蒙古大学图书馆

32nd British Machine Vision Conference, BMVC 2021

作者： Yu, Jiaqi Yang, Jinhai Yang, Hua Zhai, Guangtao Institute of Image Communication and Network Engineering Shanghai Jiao Tong University ChinaShanghai Key Lab of Digital Media Processing and Transmission Shanghai ChinaMoE Key Lab of Artificial Intelligence AI Institute Shanghai Jiao Tong University China

Detecting interaction groups is an essential task for understanding human behaviours and social activities. However, it is still challenging to identify social interactions and the resulting crowd groups using purely visual cues, especially from single images. Prior works either require additional statistics, such as interpersonal angles and kinaesthetic information, or simply deduce the group memberships with the similarity of individual actions. In this paper, we present the Psychology-inspired Relation Network (PRN) to comprehensively understand the static social scenes and effectively model the interaction relations between individuals. More concretely, stimulated by recent advances in social psychology, we first predict the keypoint heatmap from an image with the human bounding boxes as the visual representations of the key factors determining interaction groups: distance, orientation and postural openness. We then incorporate the personal and mutual influences together to compute the interaction strength matrix via self-attention, and finally utilise a perception to convert this matrix into dyadic interaction probability. Moreover, we devise two loss functions, the dyad loss to optimise the dyadic interaction probability and the group loss to enhance the distinguishability among different social groups. To evaluate the performance of PRN, we introduce a novel dataset containing various scenes with different crowd densities, by merging representative databases and relabeling the group labels. Our method achieves outstanding results on the proposed dataset. © 2021. The copyright of this document resides with its authors.

关键词： Computer vision

来源：评论

学校读者我要写书评

暂无评论

Spatial-Temporal Constrained Pseudo-labeling for Unsupervised Person Re-identification via GCN Inference 18th

Spatial-Temporal Constrained Pseudo-labeling for Unsupervis...

引用

18th International Forum of Digital Multimedia communication, IFTC 2021

作者： Ling, Sen Yang, Hua Liu, Chuang Chen, Lin Zhao, Hongtian The Institute of Image Communication and Network Engineering Department of Electronic Engineering Shanghai Jiao Tong University Shanghai China Shanghai Key Laboratory of Digital Media Processing and Transmission Shanghai Jiao Tong University Shanghai China MoE Key Lab of Artificial Intelligence AI Institute Shanghai Jiao Tong University Shanghai China

ISBN: (纸本)9789811922657

Most existing unsupervised person re-identification (Re-ID) methods primarily depend on the cluster distance, and merely exploit the available source labeled data to assign pseudo labels for the unannotated data. Whereas, the cluster distance usually fails to adapt to different datasets due to the domain gap. Besides, learning exclusively from the source data can not generate accurate pseudo labels for the lack of the target data information. To address this problem, we propose to exploit the spatial-temporal constraints to facilitate the pseudo label generation process. Specifically, graphs for the labeled source data are constructed and the graph convolution network (GCN) is used to learn graph embeddings. Based on these graph embeddings, the likelihood of linkages between graph nodes is estimated and utilized to assign pseudo labels for the unlabeled data. Then, with the pseudo labels, a smoothed spatial-temporal probability distribution model is generated to amend the likelihood of linkages between graph nodes as well as correct the visual similarity scores for person Re-ID. Finally, we optimize the pseudo label assignment, feature extraction networks, and spatial-temporal model alternatively and iteratively to improve the person Re-ID performance. Comprehensive experiments demonstrate that the proposed method outperforms state-of-the-art methods. © 2022, Springer Nature Singapore Pte Ltd.

关键词： Graph theory

来源：评论

学校读者我要写书评

暂无评论

Decoding Sleep: Microphone-Based Snoring Analysis using Embedded Machine Learning for Obstructive Sleep Apnea Detection

Decoding Sleep: Microphone-Based Snoring Analysis using Embe...

引用

International Conference on Biosignals, images and Instrumentation (ICBSII)

作者： Delpha Jacob Priyanka Kokil Subramanian S Jayanthi Thiruvengadam Department of Biomedical Engineering College of Engineering and Technology SRM Institute of Science and Technology Chennai Department of Electronics and Communication Engineering Advanced Signal and Image Processing (ASIP) Lab Indian Institute of Information Technology Design and Manufacturing Chennai Department of Respiratory Medicine SRM Medical College Hospital and Research Centre Kattankulathur Tamil Nadu India

ISBN: (数字)9798350350951

ISBN: (纸本)9798350350968

Snoring, a recurring habit often disregarded within the Indian community, can signal a grave underlying issue of Obstructive Sleep Apnea (OSA). OSA is a severe sleep disorder characterized by recurrent interruptions in breathing for more than 10 seconds during sleep, typically due to partial or complete airway obstructions. Neglecting OSA can lead to a range of significant health risks, including increased likelihood of occupational accidents, motor vehicle accidents, heightened susceptibility to severe depression, cardiac and cerebrovascular diseases, and reduced life expectancy. The main objective of the study is to detect snoring while at sleep and also to classify it as normal snoring and OSA snoring. Arduino nano 33 BLE sense is used to capture the snore signal, it houses a built-in MP34DT05 sensor. The sensor has a signal-to-noise ratio of 64dB and sensitivity of - 26dBFS ± 3dB. This captures the sound signal of the individual, it is further processed to extract the Mel-filter bank energy features, Mel Frequency Cepstral Coefficients and Spectrogram features. The features are further used to build a model and the same is trained using edge impulse to classify the signal. The dataset is divided into training, testing, and validation sets, with 80% of the data allocated to training, 20% to testing, and an additional 20% within the training data set aside for validation purposes. The results for the two class classification (snoring and non snoring) indicate that the spectrogram-based approach achieved an accuracy rate of 96.9%, while the other two methods yielded accuracy rates of 93.8%. The accuracy for three class classification (normal, snoring and OSA snoring) using the Embedded Machine Learning (EML) approach is 88%. The proposed study demonstrates enhanced accuracy in identifying OSA by snoring compared to previous research. This autonomous system can facilitate the detection of OSA through the analysis of snoring patterns, subsequently alerting the subjec

关键词： Training Performance evaluation Accuracy Embedded systems Training data Machine learning Feature extraction

来源：评论

学校读者我要写书评

暂无评论

Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Models

arXiv

引用

arXiv 2023年

作者： Sun, Wei Wen, Wen Min, Xiongkuo Lan, Long Zhai, Guangtao Ma, Kede The Institute of Image Communication and Information Processing Shanghai Jiao Tong University Shanghai200240 China The Department of Computer Science City University of Hong Kong Kowloon Hong Kong The Institute for Quantum Information State Key Laboratory of High Performance Computing College of Computer Science and Technology National University of Defense Technology Changsha410073 China The Institute of Image Communication and Information Processing The MoE Key Lab of Artificial Intelligence AI Institute Shanghai Jiao Tong University Shanghai200240 China The Department of Computer Science The Shenzhen Research Institute City University of Hong Kong Kowloon Hong Kong

Blind video quality assessment (BVQA) plays an indispensable role in monitoring and improving the end-users’ viewing experience in various real-world video-enabled media applications. As an experimental field, the improvements of BVQA models have been measured primarily on a few human-rated VQA datasets. Thus, it is crucial to gain a better understanding of existing VQA datasets in order to properly evaluate the current progress in BVQA. Towards this goal, we conduct a first-of-its-kind computational analysis of VQA datasets via designing minimalistic BVQA models. By minimalistic, we restrict our family of BVQA models to build only upon basic blocks: a video preprocessor (for aggressive spatiotemporal downsampling), a spatial quality analyzer, an optional temporal quality analyzer, and a quality regressor, all with the simplest possible instantiations. By comparing the quality prediction performance of different model variants on eight VQA datasets with realistic distortions, we find that nearly all datasets suffer from the easy dataset problem of varying severity, some of which even admit blind image quality assessment (BIQA) solutions. We additionally justify our claims by comparing our model generalization capabilities on these VQA datasets, and by ablating a dizzying set of BVQA design choices related to the basic building blocks. Our results cast doubt on the current progress in BVQA, and meanwhile shed light on good practices of constructing next-generation VQA datasets and models. Code is available at https://***/sunwei925/***. Copyright © 2023, The Authors. All rights reserved.

关键词： Deep neural networks

来源：评论

学校读者我要写书评

暂无评论

Mask-Guided Transformer for Human-Object Interaction Detection

Mask-Guided Transformer for Human-Object Interaction Detecti...

引用

IEEE Visual communications and image processing (VCIP)

作者： Daocheng Ying Hua Yang Jun Sun Shanghai Key Lab of Digital Media Processing and Transmission Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai China MoE Key Lab of Artificial Intelligence AI Institute Shanghai Jiao Tong University China

ISBN: (纸本)9781665475938

Human-object interaction (HOI) detection is a meaningful research topic on human activity understanding. Recent works have made significant progress by focusing on efficient triplet matching and leveraging image-wide features based on encoder-decoder architecture. However, the ability to gather relevant contextual information about human is limited and different sub-tasks in HOI detection are not differentiated by specific decoupling in previous methods. To this end, we propose a new transformer-based method for HOI detection, namely, Mask-Guided Transformer (MGT). Our model, which is composed of five parallel decoders with a shared encoder, not only emphasizes interactive regions by applying body features, but also disentangles the prediction of instance and interaction. We achieve a favorable result at 63.3 mAP on the well-known HOI detection dataset V-COCO.

关键词： Visual communication image processing Focusing Predictive models Transformers Decoding

来源：评论

学校读者我要写书评

暂无评论

Dual-Mode iterative denoiser: Tackling the weak label for anomaly detection

Dual-Mode iterative denoiser: Tackling the weak label for an...

引用

International Conference on Pattern Recognition

作者： Shuheng Lin Hua Yang Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai key lab of digital media processing and transmission Shanghai China

Crowd anomaly detection suffers from limited training data under weak supervision. In this paper, we propose a dual-mode iterative denoiser to tackle the weak label challenge for anomaly detection. First, we use a convolution autoencoder (CAE) in image space to act as a cluster for grouping similar video clips, where the spatial-temporal similarity helps the cluster metric to represent the reconstruction error. Then we use the graph convolution neural network (GCN) to explore the temporal correlation and the feature similarity between video clips within different rough labels, where the classifier can be constantly updated in the label denoising process. Without specific image-level labels, our model can predict the clip-level anomaly probabilities for videos. Extensive experiment results on two public datasets show that our approach performs favorably against the state-of-the-art methods.

关键词： Training Convolution Noise reduction Neural networks Training data Predictive models Pattern recognition

来源：评论

学校读者我要写书评

暂无评论

Crowd Counting Via Multi-Level Regression With Latent Gaussian Maps

Crowd Counting Via Multi-Level Regression With Latent Gaussi...

引用

IEEE International Conference on Acoustics, Speech and Signal processing

作者： Yukang Gao Hua Yang Institution of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai China Shanghai key lab of digital media processing and transmission Shanghai China

Crowd counting still confronts two primary challenges: limited ability to deal with cross density levels caused by fixed density maps and lack of fine-grained or coarse-grained guidance for density estimation. In this paper, a novel end-to-end crowd counting framework via multi-level regression with latent Gaussian maps is proposed, which is consisted of GaussianNet, EstimateNet and Discriminator. GaussianNet is composed of masked Gaussian convolutional blocks and vanillia convolutional layers, to generate latent Gaussian maps adaptively for various density levels. The latent Gaussian maps are then treated as the ground truth density maps for EstimateNet, which outputs density estimations and follows the principle of adversarial learning with Discriminator. Moreover, multi-level losses are combined for density map regression guidance. Extensive experiments on the major public datasets outperform state-of-the-art ones, illustrating the superior validity of the proposed framework.

关键词： Training Convolution Conferences Estimation Acoustics Bayes methods Task analysis

来源：评论

学校读者我要写书评

暂无评论

Attentive Semantic Exploring for Manipulated Face Detection

Attentive Semantic Exploring for Manipulated Face Detection

引用

IEEE International Conference on Acoustics, Speech and Signal processing

作者： Zehao Chen Hua Yang Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai China Shanghai Key Lab of Digital Media Processing and Transmission Shanghai China

Face manipulation methods develop rapidly in recent years, whose potential risk to society accounts for the emerging of researches on detection methods. However, due to the diversity of manipulation methods and the high quality of fake images, detection methods suffer from a lack of generalization ability. To solve the problem, we find that segmenting images into semantic fragments could be effective, as discriminative defects and distortions are closely related to such fragments. Besides, to highlight discriminative regions in fragments and to measure contribution to the final prediction of each fragment is efficient for the improvement of generalization ability. Therefore, we propose a novel manipulated face detection method based on Multilevel Facial Semantic Segmentation and Cascade Attention Mechanism. To evaluate our method, we reconstruct two datasets: GGFI and FFMI, and also collect two open-source datasets. Experiments on four datasets verify the advantages of our approach against other state-of-the-arts, especially its generalization ability.

关键词： image segmentation Semantics Diversity methods Feature extraction Face detection Distortion measurement Speech processing

来源：评论

学校读者我要写书评

暂无评论

Retinex based flicker-free low-light video enhancement 1

引用

2nd Chinese Conference on Pattern Recognition and Computer Vision, PRCV 2019

作者： Tu, Juanjuan Gan, Zongliang Liu, Feng Jiangsu Provincial Key Lab of Image Processing and Image Communication Nanjing University of Posts and Telecommunications Nanjing210003 China

ISBN: (数字)9783030317232

ISBN: (纸本)9783030317225

Videos captured in low light environment tend to be poor visual effect. To get better visual experience, a video enhancement algorithm based on improved center-surrounded Retinex and optical flow is proposed in this paper, which contains intra-frame brightness enhancement and inter-frame brightness continuity. In intra-frame brightness enhancement, reflection of each frame is estimated by adjusting the illumination using a weight factor, so that bright illumination is compressed to obtain a reflection with approximately uniform illumination. Then logarithmic image processing subtraction (LIPS) is adopted to enhance its contrast. To maintain inter-frame brightness continuity, the background and brightness changes of adjacent frames are measured using optical flow and just noticeable difference (JND) threshold, respectively. If the background and average brightness change little, their reflection brightness is almost the same, so LIPS parameter of previous frame is applied to current frame. Otherwise, current frame will be updated by calculating its own parameter. Experimental results demonstrate that proposed algorithm performs well in brightness continuity and detail enhancement. © Springer Nature Switzerland AG 2019.

关键词： Luminance

来源：评论

学校读者我要写书评

暂无评论

Understanding the Robustness of 3D Object Detection with Bird'View Representations in Autonomous Driving

Understanding the Robustness of 3D Object Detection with Bir...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Zijian Zhu Yichi Zhang Hai Chen Yinpeng Dong Shu Zhao Wenbo Ding Jiachen Zhong Shibao Zheng Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Dept. of Comp. Sci. and Tech. THBI Lab Institute for AI Tsinghua University BNRist Center Zhongguancun Laboratory Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education Information Materials and Intelligent Sensing Laboratory of Anhui Province School of Computer Science and Technology Anhui University SAIC Motor AI Lab

3D object detection is an essential perception task in autonomous driving to understand the environments. The Bird's-Eye-View (BEV) representations have significantly improved the performance of 3D detectors with camera inputs on popular benchmarks. However, there still lacks a systematic understanding of the robustness of these vision-dependent BEV models, which is closely related to the safety of autonomous driving systems. In this paper, we evaluate the natural and adversarial robustness of various representative models under extensive settings, to fully understand their behaviors influenced by explicit BEV features compared with those without BEV. In addition to the classic settings, we propose a 3D consistent patch attack by applying adversarial patches in the 3D space to guarantee the spatiotemporal consistency, which is more realistic for the scenario of autonomous driving. With substantial experiments, we draw several findings: 1) BEV models tend to be more stable than previous methods under different natural conditions and common corruptions due to the expressive spatial representations; 2) BEV models are more vulnerable to adversarial noises, mainly caused by the redundant BEV features; 3) Camera-LiDARfusion models have superior performance under different settings with multi-modal inputs, but BEV fusion model is still vulnerable to adversarial noises of both point cloud and image. These findings alert the safety issue in the applications of BEV detectors and could facilitate the development of more robust models.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：