检索结果-内蒙古大学图书馆

Traceable and Authenticable Image Tagging for Fake News Detection

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Meng, Ruohan Zhou, Zhili Cui, Qi Lam, Kwok-Yan Kot, Alex School of Computer and Software Nanjing University of Information Science and Technology China Institute of Artificial Intelligence and Blockchain Guangzhou University China Computer Science and Engineering Nanyang Technological University Singapore Lab Nanyang Technological University Singapore Centre for Computer Vision and Deep Learning University of Windsor Canada

To prevent fake news images from misleading the public, it is desirable not only to verify the authenticity of news images but also to trace the source of fake news, so as to provide a complete forensic chain for reliable fake news detection. To simultaneously achieve the goals of authenticity verification and source tracing, we propose a traceable and authenticable image tagging approach that is based on a design of Decoupled Invertible Neural Network (DINN). The designed DINN can simultaneously embed the dual-tags, i.e., authenticable tag and traceable tag, into each news image before publishing, and then separately extract them for authenticity verification and source tracing. Moreover, to improve the accuracy of dual-tags extraction, we design a parallel Feature Aware Projection Model (FAPM) to help the DINN preserve essential tag information. In addition, we define a Distance Metric-Guided Module (DMGM) that learns asymmetric one-class representations to enable the dual-tags to achieve different robustness performances under malicious manipulations. Extensive experiments, on diverse datasets and unseen manipulations, demonstrate that the proposed tagging approach achieves excellent performance in the aspects of both authenticity verification and source tracing for reliable fake news detection and outperforms the prior works. Copyright © 2022, The Authors. All rights reserved.

关键词： Image annotation

SkyCam: A dataset of sky images and their irradiance values

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Ntavelis, Evangelos Remund, Jan Schmid, Philipp Robotics & Deep Learning CSEM SA Computer Vision Lab ETH Zurich Alpnach Switzerland Energy & Climate Meteotest Bern Switzerland Industry 4.0 & Machine Learning CSEM SA Alpnach Switzerland

Recent advances in computer vision and deep Learning have enabled astonishing results in a variety of fields and applications. Motivated by this success, the SkyCam Dataset aims to enable image-based deep Learning solutions for short-term, precise prediction of solar radiation on a local level. For the span of a year, three different cameras in three topographically different locations in Switzerland are acquiring images of the sky every 10 seconds. Thirteen high resolution images with different exposure times are captured and used to create an additional HDR image. The images are paired with highly precise irradiance values gathered from a high-accuracy pyranometer. © 2021, CC BY-NC-SA.

关键词： deep learning

Multi-Modal Multi-Action Video Recognition

学校读者我要写书评

暂无评论

Multi-Modal Multi-Action Video Recognition

International Conference on computer vision (ICCV)

作者： Zhensheng Shi Ju Liang Qianqian Li Haiyong Zheng Zhaorui Gu Junyu Dong Bing Zheng Frontiers Science Center for Deep Ocean Multispheres and Earth System Ocean University of China Underwater Vision Lab Ocean University of China College of Computer Science and Technology Ocean University of China Sanya Oceanographic Institution Ocean University of China

ISBN: (纸本)9781665428132

Multi-action video recognition is much more challenging due to the requirement to recognize multiple actions co-occurring simultaneously or sequentially. Modeling multi-action relations is beneficial and crucial to understand videos with multiple actions, and actions in a video are usually presented in multiple modalities. In this paper, we propose a novel multi-action relation model for videos, by leveraging both relational graph convolutional networks (GCNs) and video multi-modality. We first build multi-modal GCNs to explore modality-aware multi-action relations, fed by modality-specific action representation as node features, i.e., spatiotemporal features learned by 3D convolutional neural network (CNN), audio and textual embeddings queried from respective feature lexicons. We then joint both multi-modal CNN-GCN models and multi-modal feature representations for learning better relational action predictions. Ablation study, multi-action relation visualization, and boosts analysis, all show efficacy of our multi-modal multi-action relation modeling. Also our method achieves state-of-the-art performance on large-scale multi-action M-MiT benchmark. Our code is made publicly available at https://***/zhenglab/multi-action-video.

关键词： Convolutional codes Visualization Analytical models computer vision Three-dimensional displays Computational modeling Benchmark testing

A Survey of the Self Supervised Learning Mechanisms for vision Transformers

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Khan, Asifullah Sohail, Anabia Fiaz, Mustansar Hassan, Mehdi Afridi, Tariq Habib Marwat, Sibghat Ullah Munir, Farzeen Ali, Safdar Naseem, Hannan Zaheer, Muhammad Zaigham Ali, Kamran Sultana, Tangina Tanoli, Ziaurrehman Akhter, Naeem Pattern Recognition Lab DCIS PIEAS Nilore Islamabad45650 Pakistan PIEAS Nilore Islamabad45650 Pakistan Deep Learning Lab Center for Mathematical Sciences PIEAS Nilore Islamabad45650 Pakistan Center of Secure Cyber-Physical Security Systems Khalifa University Abu Dhabi United Arab Emirates IBM Research United States Department of Computer Science Air University Islamabad Pakistan Department of Computer Science and Engineering Kyung Hee University Global Campus 1732 Gyeonggi-do Yongin17104 Korea Republic of Department of Electrical Engineering and Automation Aalto University Finland Finnish Center of Artificial Center Finland Faculty of Engineering and Green Technology Universiti Tunku Abdul Rahman Malaysia Computer Vision Department Mohamed Bin Zayed University of Artificial Intelligence United Arab Emirates Karachi Pakistan Department of Electronics and Communication Engineering Hajee Mohammad Danesh Science and Technology University Bangladesh HiLIFE University of Helsinki Finland

vision Transformers (ViTs) have recently demonstrated remarkable performance in computer vision tasks. However, their parameter-intensive nature and reliance on large amounts of data for effective performance have shifted the focus from traditional human-annotated labels to unsupervised learning and pretraining strategies that uncover hidden structures within the data. In response to this challenge, self-supervised learning (SSL) has emerged as a promising paradigm. SSL leverages inherent relationships within the data itself as a form of supervision, eliminating the need for manual labeling and offering a more scalable and resource-efficient alternative for model training. Given these advantages, it is imperative to explore the integration of SSL techniques with ViTs, particularly in scenarios with limited labeled data. Inspired by this evolving trend, this survey aims to systematically review SSL mechanisms tailored for ViTs. We propose a comprehensive taxonomy to classify SSL techniques based on their representations and pre-training tasks. Additionally, we discuss the motivations behind SSL, review prominent pre-training tasks, and highlight advancements and challenges in this field. Furthermore, we conduct a comparative analysis of various SSL methods designed for ViTs, evaluating their strengths, limitations, and applicability to different scenarios. Copyright © 2024, The Authors. All rights reserved.

关键词： Self-supervised learning

A Review of Generalized Zero-Shot Learning Methods

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Pourpanah, Farhad Abdar, Moloud Luo, Yuxuan Zhou, Xinlei Wang, Ran Lim, Chee Peng Wang, Xi-Zhao Jonathan Wu, Q.M. The Centre for Computer Vision and Deep Learning Department of Electrical and Computer Engineering University of Windsor WindsorONN9B 3P4 Canada Deakin University Australia The Department of Computer Science City University of Hong Kong Hong Kong The College of Mathematics and Statistics Shenzhen Key Lab. of Advanced Machine Learning and Applications Shenzhen University Shenzhen518060 China The College of Computer Science and Software Engineering Guangdong Key Lab. of Intelligent Information Processing Shenzhen University Shenzhen518060 China

Generalized zero-shot learning (GZSL) aims to train a model for classifying data samples under the condition that some output classes are unknown during supervised learning. To address this challenging task, GZSL leverages semantic information of the seen (source) and unseen (target) classes to bridge the gap between both seen and unseen classes. Since its introduction, many GZSL models have been formulated. In this review paper, we present a comprehensive review on GZSL. Firstly, we provide an overview of GZSL including the problems and challenges. Then, we introduce a hierarchical categorization for the GZSL methods and discuss the representative methods in each category. In addition, we discuss the available benchmark data sets and applications of GZSL, along with a discussion on the research gaps and directions for future investigations. Copyright © 2020, The Authors. All rights reserved.

关键词： Zero-shot learning

Hyperspectral Image Analysis for Writer Identification using deep Learning

学校读者我要写书评

暂无评论

Hyperspectral Image Analysis for Writer Identification using...

Proceedings of the Digital Image Computing: Technqiues and Applications (DICTA)

作者： Ammad Ul Islam Muhammad Jaleed Khan Khurram Khurshid Faisal Shafait Artificial Intelligence and Computer Vision (iVision) Lab Institute of Space Technology (IST) Islamabad Pakistan School of Electrical Engineering and Computer Science (SEECS) National University of Sciences and Technology (NUST) Islamabad Pakistan Deep Learning Laboratory National Center of Artificial Intelligence (NCAI) Islamabad Pakistan

Handwriting is a behavioral characteristic of human beings that is one of the common idiosyncrasies utilized for litigation purposes. Writer identification is commonly used for forensic examination of questioned and specimen documents. Recent advancements in imaging and machine learning technologies have empowered the development of automated, intelligent and robust writer identification methods. Most of the existing methods based on human defined features and color imaging have limited performance in terms of accuracy and robustness. However, rich spectral information content obtained from hyperspectral imaging (HSI) and suitable spatio-spectral features extracted using deep learning can significantly enhance the performance of writer identification in terms of accuracy and robustness. In this paper, we propose a novel writer identification method in which spectral responses of text pixels in a hyperspectral document image are extracted and are fed to a Convolutional Neural Network (CNN) for writer classification. Different CNN architectures, hyperparameters, spatio-spectral formats, train-test ratios and inks are used to evaluate the performance of the proposed system on the UWA Writing Inks Hyperspectral Images (WIHSI) database and to select the most suitable set of parameters for writer identification. The findings of this work have opened a new arena in forensic document analysis for writer identification using HSI and deep learning.

关键词： Hyperspectral imaging Feature extraction Ink Text analysis Forensics deep learning Databases

NTIRE 2022 Challenge on Stereo Image Super-Resolution: Methods and Results

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Guo, Yulan Wang, Longguang Wang, Yingqian Li, Juncheng Gu, Shuhang Timofte, Radu Chen, Liangyu Chu, Xiaojie Yu, Wenqing Jin, Kai Wei, Zeqiang Guo, Sha Yang, Angulia Zhou, Xiuzhuang Guo, Guodong Xiao, Huaxin Yan, Shen Liu, Yuxiang Cai, Hanxiao Dai, Bin Peng, Feiyue Cao, Pu Nie, Yang Yang, Lu Song, Qing Hu, Xiaotao Xu, Jun Xu, Mai Jing, Junpeng Deng, Xin Xing, Qunliang Qiao, Minglang Guan, Zhenyu Guo, Wenlong Peng, Chenxu Chen, Zan Chen, Junyang Li, Hao Chen, Junbin Li, Weijie Yang, Zhijing Li, Gen Li, Aijin Sun, Lei Zhang, Dafeng Liu, Shizhuo Zhang, Jiangtao Qu, Yanyun Yang, Hao-Hsiang Huang, Zhi-Kai Chen, Wei-Ting Chang, Hua-En Kuo, Sy-Yen Liang, Qiaohui Lin, Jianxin Wang, Yijun Yin, Lianying Zhang, Rongju Zhao, Wei Xiao, Peng Xu, Rongjian Zhang, Zhilu Zuo, Wangmeng Guo, Hansheng Gao, Guangwei Zeng, Tieyong Kim, Joohyeok Kim, HyeonA Park, Eunpil Sim, Jae-Young Pi, Huicheng Zhang, Shunli Zhai, Jucai Zeng, Pengcheng Liu, Yang Ma, Chihao Huang, Yulin Chen, Junying National University of Defense Technology China The Chinese University of Hong Kong Hong Kong The University of Sydney Australia University of Würzburg ETH Zürich Switzerland MEGVII Technology China Peking University China Bigo Technology Pte. Ltd Singapore Smart Healthcare Innovation Lab Beijing University of Posts and Telecommunications China School of Artificial Intelligence Beijing University of Posts and Telecommunications China Head of Institute of Deep Learning Baidu Research College of Systems Engineering National University of Defense Technology China College of Liberal Arts and Sciences National University of Defense Technology China Pattern Recognition and Intelligent Vision Lab Beijing University of Posts and Telecommunications China College of Computer Science Nankai University Tianjin China School of Statistics and Data Science Nankai University Tianjin Singapore Beihang University China Zhejiang University of Technology China Guangdong University of Technology China Tencent OVBU SRC-B Xiamen University China Department of Electrical Engineering National Taiwan University Taiwan Graduate Institute of Electronics Engineering National Taiwan University Taiwan College of Computer Science and Electronic Engineering Hunan University China Harbin Institude of Technology China The Chinese University of Hong Kong Hong Kong Nanjing University of Posts and Telecommunications China Department of Electrical Engineering Ulsan National Institute of Science and Technology Korea Republic of Graduate School of Artificial Intelligence Ulsan National Institute of Science and Technology Korea Republic of Beijing Jiaotong University China City University of Hong Kong Hong Kong South China University of Technology China

In this paper, we summarize the 1st NTIRE challenge on stereo image super-resolution (restoration of rich details in a pair of low-resolution stereo images) with a focus on new solutions and results. This challenge has 1 track aiming at the stereo image super-resolution problem under a standard bicubic degradation. In total, 238 participants were successfully registered, and 21 teams competed in the final testing phase. Among those participants, 20 teams successfully submitted results with PSNR (RGB) scores better than the baseline. This challenge establishes a new benchmark for stereo image SR. Copyright © 2022, The Authors. All rights reserved.

关键词： Stereo image processing

ChaLearn looking at people: IsoGD and ConGD large-scale RGB-D gesture recognition

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Wan, Jun Lin, Chi Wen, Longyin Li, Yunan Miao, Qiguang Escalera, Sergio Anbarjafari, Gholamreza Guyon, Isabelle Guo, Guodong Li, Stan Z. National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing100190 China JD Finance Mountain ViewCA United States University of Southern California Los AngelesCA90089-0911 United States School of Computer Science and Technology Xidian University & Xi'an Key Laboratory of Big Data and Intelligent Vision 2nd South Taibai Road Xi'an710071 China Universitat de Barcelona Computer Vision Center Spain iCV Lab Institute of Technology University of Tartu Estonia Faculty of Engineering Hasan Kalyoncu University Gaziantep Turkey Institute of Digital Technologies Loughborough University London United Kingdom ChaLearn United States University Paris-Saclay France institute of Deep Learning Baidu Research National Engineering Laboratory for Deep Learning Technology and Application China

The ChaLearn large-scale gesture recognition challenge has been run twice in two workshops in conjunction with the International Conference on Pattern Recognition (ICPR) 2016 and International Conference on computer vision (ICCV) 2017, attracting more than 200 teams around the world. This challenge has two tracks, focusing on isolated and continuous gesture recognition, respectively. This paper describes the creation of both benchmark datasets and analyzes the advances in large-scale gesture recognition based on these two datasets. We discuss the challenges of collecting large-scale ground-truth annotations of gesture recognition, and provide a detailed analysis of the current state-of-the-art methods for large-scale isolated and continuous gesture recognition based on RGB-D video sequences. In addition to recognition rate and mean jaccard index (MJI) as evaluation metrics used in our previous challenges, we also introduce the corrected segmentation rate (CSR) metric to evaluate the performance of temporal segmentation for continuous gesture recognition. Furthermore, we propose a bidirectional long short-term memory (Bi-LSTM) baseline method, determining the video division points based on the skeleton points extracted by convolutional pose machine (CPM). Experiments demonstrate that the proposed Bi-LSTM outperforms the state-of-the-art methods with an absolute improvement of 8.1% (from 0.8917 to 0.9639) of CSR. Copyright © 2019, The Authors. All rights reserved.

关键词： Long short-term memory