检索结果-内蒙古大学图书馆

Classification of gothic and baroque architectural elements

学校读者我要写书评

暂无评论

Classification of gothic and baroque architectural elements

International Conference on Systems, Signals and Image Processing, IWSSIP

作者： Gayane Shalunts Yll Haxhimusa Robert Sablatnig Institute of Computer Aided Automation Computer Vision Laboratory University of Technology Vienna Austria Institute of Computer Graphics and Algorithms Pattern Recognition and Image Processing Lab University of Technology Vienna Austria

Architectural elements are the components and details of buildings. Their unique set, combination, design, construction technique form the architectural style of buildings. Building facade classification by architectural styles is viewed as a task of classifying separate architectural structural elements. In the scope of building facade architectural style classification the current paper targets the problem of classification of Gothic and Baroque architectural elements called tracery, pediment and balustrade. Since certain gradient directions dominate on the shape of each architectural element, discrimination between dominating gradients means classification of architectural elements and thus architectural styles. We use local features to describe gradient directions. Our approach is based on clustering and learning of local features and yields a high classification rate.

关键词： Shape Three dimensional displays Visualization computer vision Histograms Windows

Video Test-Time Adaptation for Action Recognition

学校读者我要写书评

暂无评论

Video Test-Time Adaptation for Action Recognition

Conference on computer vision and Pattern Recognition (CVPR)

作者： Wei Lin Muhammad Jehanzeb Mirza Mateusz Kozinski Horst Possegger Hilde Kuehne Horst Bischof Institute for Computer Graphics and Vision Graz University of Technology Austria Christian Doppler Laboratory for Semantic 3D Computer Vision Christian Doppler Laboratory for Embedded Machine Learning Goethe University Frankfurt Germany MIT-IBM Watson AI Lab

Although action recognition systems can achieve top performance when evaluated on in-distribution test points, they are vulnerable to unanticipated distribution shifts in test data. However, test-time adaptation of video action recognition models against common distribution shifts has so far not been demonstrated. We propose to address this problem with an approach tailored to spatio-temporal models that is capable of adaptation on a single video sample at a step. It consists in a feature distribution alignment technique that aligns online estimates of test set statistics towards the training statistics. We further enforce prediction consistency over temporally augmented views of the same test video sample. Evaluations on three benchmark action recognition datasets show that our proposed technique is architecture-agnostic and able to significantly boost the performance on both, the state of the art convolutional architecture TANet and the Video Swin Transformer. Our proposed method demonstrates a substantial performance gain over existing test-time adaptation approaches in both evaluations of a single distribution shift and the challenging case of random distribution shifts. Code will be available at https://***/wlin-at/ViTTA.

关键词：

Neural human video rendering by learning dynamic textures and rendering-to-video translation

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Liu, Lingjie Xu, Weipeng Habermann, Marc Zollhöfer, Michael Bernard, Florian Kim, Hyeongwoo Wang, Wenping Theobalt, Christian The Department of Computer Science The University of Hong Kong Hong Kong The Graphics Vision and Video Group Max Planck Institute for Informatics Saarbrücken66123 Germany The Department of Computer Science Computer Graphics Laboratory Stanford University CA94305 United States

Synthesizing realistic videos of humans using neural networks has been a popular alternative to the conventional graphics-based rendering pipeline due to its high efficiency. Existing works typically formulate this as an image-to-image translation problem in 2D screen space, which leads to artifacts such as over-smoothing, missing body parts, and temporal instability of fine-scale detail, such as pose-dependent wrinkles in the clothing. In this paper, we propose a novel human video synthesis method that approaches these limiting factors by explicitly disentangling the learning of time-coherent fine-scale details from the embedding of the human in 2D screen space. More specifically, our method relies on the combination of two convolutional neural networks (CNNs). Given the pose information, the first CNN predicts a dynamic texture map that contains time-coherent high-frequency details, and the second CNN conditions the generation of the final video on the temporally coherent output of the first CNN. We demonstrate several applications of our approach, such as human reenactment and novel view synthesis from monocular video, where we show significant improvement over the state of the art both qualitatively and quantitatively. Copyright © 2020, The Authors. All rights reserved.

关键词： Convolutional neural networks

MATE: Masked Autoencoders are Online 3D Test-Time Learners

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Mirza, M. Jehanzeb Shin, Inkyu Lin, Wei Schriebl, Andreas Sun, Kunyang Choe, Jaesung Possegger, Horst Kozinski, Mateusz Kweon, In So Yoon, Kuk-Jin Bischof, Horst Institute for Computer Graphics and Vision Graz University of Technology Austria Christian Doppler Laboratory for Embedded Machine Learning Korea Republic of Southeast University China

Our MATE is the first Test-Time-Training (TTT) method designed for 3D data, which makes deep networks trained for point cloud classification robust to distribution shifts occurring in test data. Like existing TTT methods from the 2D image domain, MATE also leverages test data for adaptation. Its test-time objective is that of a Masked Autoencoder: a large portion of each test point cloud is removed before it is fed to the network, tasked with reconstructing the full point cloud. Once the network is updated, it is used to classify the point cloud. We test MATE on several 3D object classification datasets and show that it significantly improves robustness of deep networks to several types of corruptions commonly occurring in 3D point clouds. We show that MATE is very efficient in terms of the fraction of points it needs for the adaptation. It can effectively adapt given as few as 5% of tokens of each test sample, making it extremely lightweight. Our experiments show that MATE also achieves competitive performance by adapting sparsely on the test data, which further reduces its computational overhead, making it ideal for real-time applications. © 2022, CC BY.

关键词： Classification (of information)

Sit Back and Relax: Learning to Drive Incrementally in All Weather Conditions

学校读者我要写书评

暂无评论

Sit Back and Relax: Learning to Drive Incrementally in All W...

IEEE Symposium on Intelligent Vehicle

作者： Stefan Leitner M. Jehanzeb Mirza Wei Lin Jakub Micorek Marc Masana Mateusz Kozinski Horst Possegger Horst Bischof Institute for Computer Graphics and Vision Graz University of Technology Austria Christian Doppler Laboratory for Embedded Machine Learning Christian Doppler Laboratory for Semantic 3D Computer Vision Silicon Austria Labs TU Graz - SAL Dependable Embedded Systems Lab

In autonomous driving scenarios, current object detection models show strong performance when tested in clear weather. However, their performance deteriorates significantly when tested in degrading weather conditions. In addition, even when adapted to perform robustly in a sequence of different weather conditions, they are often unable to perform well in all of them and suffer from catastrophic forgetting. To efficiently mitigate forgetting, we propose Domain-Incremental Learning through Activation Matching (DILAM), which employs unsupervised feature alignment to adapt only the affine parameters of a clear weather pre-trained network to different weather conditions. We propose to store these affine parameters as a memory bank for each weather condition and plug-in their weather-specific parameters during driving (i.e. test time) when the respective weather conditions are encountered. Our memory bank is extremely lightweight, since affine parameters account for less than 2% of a typical object detector. Furthermore, contrary to previous domain-incremental learning approaches, we do not require the weather label when testing and propose to automatically infer the weather condition by a majority voting linear classifier.

关键词：

CycDA: Unsupervised Cycle Domain Adaptation to Learn from Image to Video

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Lin, Wei Kukleva, Anna Sun, Kunyang Possegger, Horst Kuehne, Hilde Bischof, Horst Institute of Computer Graphics and Vision Graz University of Technology Austria Max-Planck-Institute for Informatics Germany Southeast University China Goethe University Frankfurt Germany Christian Doppler Laboratory for Semantic 3D Computer Vision

Although action recognition has achieved impressive results over recent years, both collection and annotation of video training data are still time-consuming and cost intensive. Therefore, image-to-video adaptation has been proposed to exploit labeling-free web image source for adapting on unlabeled target videos. This poses two major challenges: (1) spatial domain shift between web images and video frames;(2) modality gap between image and video data. To address these challenges, we propose Cycle Domain Adaptation (CycDA), a cycle-based approach for unsupervised image-to-video domain adaptation. We leverage the joint spatial information in images and videos on the one hand and, on the other hand, train an independent spatio-temporal model to bridge the modality gap. We alternate between the spatial and spatio-temporal learning with knowledge transfer between the two in each cycle. We evaluate our approach on benchmark datasets for image-to-video as well as for mixed-source domain adaptation achieving state-of-the-art results and demonstrating the benefits of our cyclic adaptation. Code is available at https://***/wlin-at/CycDA. Copyright © 2022, The Authors. All rights reserved.

关键词： Knowledge management

Video Test-Time Adaptation for Action Recognition

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Lin, Wei Mirza, Muhammad Jehanzeb Kozinski, Mateusz Possegger, Horst Kuehne, Hilde Bischof, Horst Institute for Computer Graphics and Vision Graz University of Technology Austria Christian Doppler Laboratory for Semantic 3D Computer Vision Christian Doppler Laboratory for Embedded Machine Learning Goethe University Frankfurt Germany MIT-IBM Watson AI Lab United States

关键词： Benchmarking

A Multi-Armed Bandits Learning-Based Approach to Service Caching in Edge Computing Environment 30th

学校读者我要写书评

暂无评论

A Multi-Armed Bandits Learning-Based Approach to Service Ca...

30th International Conference on Web Services, ICWS 2023

作者： Li, Jinpeng Zhao, Jiale Chen, Peng Xia, Yunni Li, Fan Li, Yin Zeng, Feng Liu, Hui School of Computer Chongqing University Chongqing400030 China School of Computer and Software Engineering Xihua University Chengdu610039 China Key Laboratory of Fundamental Synthetic Vision Graphics and Image Science for National Defense Sichuan University Chengdu610065 China Guangzhou Institute of Software Application Technology Guangzhou510990 China Limited Shenzhen518129 China School of Computer Science and Technology Beijing Institute of Technology Beijing100083 China

ISBN: (纸本)9783031448355

Mobile edge computing (MEC) is a newly emerging concept that provides significant local computing power and reduces end-to-end latency. In MEC environments, caching frequently accessed services on edge servers effectively reduces latency and improves system responsiveness. An ongoing research topic in such a cachable MEC context is to design novel algorithms for yielding high-quality caching decision that guarantee high user-perceived quality-of-service (QoS) and high system responsiveness of delivery of cached content with the difference of caching capacities of edge servers and diversified content popularity appropriately addressed. In this article, we propose a multi-armed bandits learning-based method busing a Thompson sampling for generating caching decisions. We introduce a genetic multi-armed bandits algorithm (GMAB), which synthesizes the genetic algorithm (GA) and multi-armed bandits (MAB), for optimizing caching effectiveness with timing and space constraints. The experiment results show that GMAB outperforms traditional methods in terms of multiple aspects. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Genetic algorithms

Convected activation profiles and the measurement of visual motion

学校读者我要写书评

暂无评论

Convected activation profiles and the measurement of visual ...

Conference on computer vision and Pattern Recognition (CVPR)

作者： A.M. Waxman J. Wu F. Bergholm Laboratory for Sensory Robotics College of Engineering Boston University Boston MA USA Computer Vision and Graphics Laboratory Department of Numerical Analysis and Computing Science Royal Institute of Technology Stockholm Sweden

A method is developed for the measurement of short-range visual motion in image sequences, making use of the motion of image features such as edges and points. Each feature generates a Gaussian activation profile in a spatiotemporal neighborhood of specified scale around the feature itself; this profile is then convected with motion of the feature. The authors show that image velocity estimates can be obtained from such dynamic activation profiles using a modification of familiar gradient techniques. The resulting estimators can be formulated in terms of simple ratios of spatiotemporal filters (i.e. receptive fields) convolved with image feature maps. A family of activation profiles of varying scale must be utilized to cover a range of possible image velocities. They suggest a characteristic speed normalization of the estimate obtained from each filter in order to decide which estimate is to be accepted. They formulate the velocity estimators for dynamic edges in 1-D and 2-D image sequences, as well as that for dynamic feature points in 2-D image sequences.< >

关键词： Motion measurement Image sequences Motion analysis Filters Laboratories computer vision Robot sensing systems Educational institutions computer graphics Numerical analysis