检索结果-内蒙古大学图书馆

RayNet: Learning volumetric 3d reconstruction with ray potentials

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Paschalidou, Despoina Ulusoy, Ali Osman Schmitt, Carolin Van Gool, Luc Geiger, Andreas Autonomous Vision Group MPI for Intelligent Systems Tübingen Microsoft Computer Vision Lab ETH Zürich KU Leuven Computer Vision and Geometry Group ETH Zürich Max Planck ETH Center for Learning Systems

In this paper, we consider the problem of reconstructing a dense 3D model using images captured from different views. Recent methods based on convolutional neural networks (CNN) allow learning the entire task from data. However, they do not incorporate the physics of image formation such as perspective geometry and occlusion. Instead, classical approaches based on Markov Random Fields (MRF) with ray-potentials explicitly model these physical processes, but they cannot cope with large surface appearance variations across different viewpoints. In this paper, we propose RayNet, which combines the strengths of both frameworks. RayNet integrates a CNN that learns view-invariant feature representations with an MRF that explicitly encodes the physics of perspective projection and occlusion. We train RayNet end-to-end using empirical risk minimization. We thoroughly evaluate our approach on challenging real-world datasets and demonstrate its benefits over a piece-wise trained baseline, hand-crafted models as well as other learning-based approaches. Copyright © 2019, The Authors. All rights reserved.

关键词： Image reconstruction

vieCap4H-VLSP 2021: Vietnamese Image Captioning for Healthcare Domain using Swin Transformer and Attention-based LSTM

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Nguyen, Thanh Tin Nguyen, Long H. Pham, Nhat Truong Nguyen, Liu Tai Do, Van Huong Nguyen, Hai Nguyen, Ngoc Duy Human Computer Interaction Lab Sejong University Seoul Korea Republic of Faculty of Information Technology Ton Duc Thang University Ho Chi Minh City Viet Nam Division of Computational Mechatronics Institute for Computational Science Ton Duc Thang University Ho Chi Minh City Viet Nam Faculty of Electrical and Electronics Engineering Ton Duc Thang University Ho Chi Minh City Viet Nam ASICLAND Suwon Korea Republic of Khoury College of Computer Sciences Northeastern University Boston United States Institute for Intelligent Systems Research and Innovation Deakin University Victoria Australia

This study presents our approach on the automatic Vietnamese image captioning for healthcare domain in text processing tasks of Vietnamese Language and Speech Processing (VLSP) Challenge 2021, as shown in Figure 1. In recent years, image captioning often employs a convolutional neural network-based architecture as an encoder and a long short-term memory (LSTM) as a decoder to generate sentences. These models perform remarkably well in different datasets. Our proposed model also has an encoder and a decoder, but we instead use a Swin Transformer in the encoder, and a LSTM combined with an attention module in the decoder. The study presents our training experiments and techniques used during the competition. Our model achieves a BLEU4 score of 0.293 on the vietCap4H dataset, and the score is ranked the 3rd place on the private leaderboard. Our code can be found at https://***/JDdJm. © 2022, CC BY.

关键词： Long short-term memory

SoccerNet 2023 Challenges Results

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Cioppa, Anthony Giancola, Silvio Somers, Vladimir Magera, Floriane Zhou, Xin Mkhallati, Hassan Deliège, Adrien Held, Jan Hinojosa, Carlos Mansourian, Amir M. Miralles, Pierre Barnich, Olivier De Vleeschouwer, Christophe Alahi, Alexandre Ghanem, Bernard Van Droogenbroeck, Marc Kamal, Abdullah Maglo, Adrien Clapés, Albert Abdelaziz, Amr Xarles, Artur Orcesi, Astrid Scott, Atom Liu, Bin Lim, Byoungkwon Chen, Chen Deuser, Fabian Yan, Feng Yu, Fufu Shitrit, Gal Wang, Guanshuo Choi, Gyusik Kim, Hankyul Guo, Hao Fahrudin, Hasby Koguchi, Hidenari Ardö, Håkan Salah, Ibrahim Yerushalmy, Ido Muhammad, Iftikar Uchida, Ikuma Be'ery, Ishay Rabarisoa, Jaonary Lee, Jeongae Fu, Jiajun Yin, Jianqin Xu, Jinghang Nang, Jongho Denize, Julien Li, Junjie Zhang, Junpei Kim, Juntae Synowiec, Kamil Kobayashi, Kenji Zhang, Kexin Habel, Konrad Nakajima, Kota Jiao, Licheng Ma, Lin Wang, Lizhi Wang, Luping Li, Menglong Zhou, Mengying Nasr, Mohamed Abdelwahed, Mohamed Liashuha, Mykola Falaleev, Nikolay Oswald, Norbert Jia, Qiong Pham, Quoc-Cuong Song, Ran Hérault, Romain Peng, Rui Chen, Ruilong Liu, Ruixuan Baikulov, Ruslan Fukushima, Ryuto Escalera, Sergio Lee, Seungcheon Chen, Shimin Ding, Shouhong Someya, Taiga Moeslund, Thomas B. Li, Tianjiao Shen, Wei Zhang, Wei Li, Wei Dai, Wei Luo, Weixin Zhao, Wending Zhang, Wenjie Yang, Xinquan Ma, Yanbiao Joo, Yeeun Zeng, Yingsen Gan, Yiyang Zhu, Yongqiang Zhong, Yujie Ruan, Zheng Li, Zhiheng Huang, Zhijian Meng, Ziyu Belgium Saudi Arabia Sportradar Norway UCLouvain Belgium EPFL Switzerland EVS Broadcast Equipment Belgium Baidu Research United States Belgium Sharif University of Technology Iran Footovision France Zewail City of Science Technology and Innovation Egypt Université Paris-Saclay CEA France Universitat de Barcelona Spain Computer Vision Center Spain Nagoya University Japan Research Center for Applied Mathematics and Machine Intelligence Zhejiang Lab China AIBrain United States OPPO Research Institute China Germany Meituan China Tencent Youtu Lab China Amazon Prime Video Sport United States Sogang University Korea Republic of The University of Tokyo Japan Spiideo Sweden University of Tsukuba Japan School of Artificial Intelligence Beijing University of Posts and Telecommunications China Normandie Univ INSA Rouen LITIS France Shanghai Jiao Tong University China Key Laboratory of Intelligent Perception and Image Understanding The Ministry of Education Xidian University China NASK - National Research Institute Poland Robo Space China Tongji University China Sportlight Technology United Kingdom School of Control Science and Engineering Shandong University China lRomul Russia Aalborg University Denmark Turing AI Cultures GmbH Germany Information Systems Technology and Design Singapore University of Technology and Design Singapore Sun Yat-sen University China

The SoccerNet 2023 challenges were the third annual video understanding challenges organized by the SoccerNet team. For this third edition, the challenges were composed of seven vision-based tasks split into three main themes. The first theme, broadcast video understanding, is composed of three high-level tasks related to describing events occurring in the video broadcasts: (1) action spotting, focusing on retrieving all timestamps related to global actions in soccer, (2) ball action spotting, focusing on retrieving all timestamps related to the soccer ball change of state, and (3) dense video captioning, focusing on describing the broadcast with natural language and anchored timestamps. The second theme, field understanding, relates to the single task of (4) camera calibration, focusing on retrieving the intrinsic and extrinsic camera parameters from images. The third and last theme, player understanding, is composed of three low-level tasks related to extracting information about the players: (5) re-identification, focusing on retrieving the same players across multiple views, (6) multiple object tracking, focusing on tracking players and the ball through unedited video streams, and (7) jersey number recognition, focusing on recognizing the jersey number of players from tracklets. Compared to the previous editions of the SoccerNet challenges, tasks (2-3-7) are novel, including new annotations and data, task (4) was enhanced with more data and annotations, and task (6) now focuses on end-to-end approaches. More information on the tasks, challenges, and leader-boards are available on https://***. Baselines and development kits can be found on https://***/SoccerNet. © 2023, CC BY.

关键词： computer vision

UNION: An unreferenced metric for evaluating open-ended story generation

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Guan, Jian Huang, Minlie Department of Computer Science and Technology Institute for Artificial Intelligence State Key Lab of Intelligent Technology and Systems Beijing National Research Center for Information Science and Technology Tsinghua University Beijing100084 China

Despite the success of existing referenced metrics (e.g., BLEU and MoverScore), they correlate poorly with human judgments for open-ended text generation including story or dialog generation because of the notorious one-to-many issue: there are many plausible outputs for the same input, which may differ substantially in literal or semantics from the limited number of given references. To alleviate this issue, we propose UNION, a learnable UNreferenced metrIc for evaluating Open-eNded story generation, which measures the quality of a generated story without any reference. Built on top of BERT, UNION is trained to distinguish human-written stories from negative samples and recover the perturbation in negative stories. We propose an approach of constructing negative samples by mimicking the errors commonly observed in existing NLG models, including repeated plots, conflicting logic, and long-range incoherence. Experiments on two story datasets demonstrate that UNION is a reliable measure for evaluating the quality of generated stories, which correlates better with human judgments and is more generalizable than existing state-of-the-art metrics. Copyright © 2020, The Authors. All rights reserved.

关键词： Semantics

CoTK: An open-source toolkit for fast development and fair evaluation of text generation

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Huang, Fei Wan, Dazhen Shao, Zhihong Ke, Pei Guan, Jian Niu, Yilin Zhu, Xiaoyan Huang, Minlie Institute for Artificial Intelligence State Key Lab of Intelligent Technology and Systems Beijing National Research Center for Information Science and Technology Department of Computer Science and Technology Tsinghua University Beijing100084 China

In text generation evaluation, many practical issues, such as inconsistent experimental settings and metric implementations, are often ignored but lead to unfair evaluation and untenable conclusions. We present CoTK, an open-source toolkit aiming to support fast development and fair evaluation of text generation. In model development, CoTK helps handle the cumbersome issues, such as data processing, metric implementation, and reproduction. It standardizes the development steps and reduces human errors which may lead to inconsistent experimental settings. In model evaluation, CoTK provides implementation for many commonly used metrics and benchmark models across different experimental settings. As a unique feature, CoTK can signify when and which metric cannot be fairly compared. We demonstrate that it is convenient to use CoTK for model development and evaluation, particularly across different experimental settings. Copyright © 2020, The Authors. All rights reserved.

关键词： Cell proliferation

A Mobile Robot Hand-Arm Teleoperation System by vision and IMU

学校读者我要写书评

暂无评论

A Mobile Robot Hand-Arm Teleoperation System by Vision and I...

2020 IEEE/RSJ International Conference on intelligent Robots and systems (IROS)

作者： Shuang Li Jiaxi Jiang Philipp Ruppel Hongzhuo Liang Xiaojian Ma Norman Hendrich Fuchun Sun Jianwei Zhang TAMS (Technical Aspects of Multimodal Systems) Universität Hamburg RWTH Aachen University Center for Vision Cognition Learning and Autonomy University of California Los Angeles Beijing National Research Center for Information Science and Technology (BNRist) State Key Lab on Intelligent Technology and Systems Tsinghua University

ISBN: (数字)9781728162126

ISBN: (纸本)9781728162133

In this paper, we present a multimodal mobile teleoperation system that consists of a novel vision-based hand pose regression network (Transteleop) and an IMU (inertial measurement units)-based arm tracking method. Transteleop observes the human hand through a low-cost depth camera and generates not only joint angles but also depth images of paired robot hand poses through an image-to-image translation process. A keypoint-based reconstruction loss explores the resemblance in appearance and anatomy between human and robotic hands and enriches the local features of reconstructed images. A wearable camera holder enables simultaneous hand-arm control and facilitates the mobility of the whole teleoperation system. Network evaluation results on a test dataset and a variety of complex manipulation tasks that go beyond simple pick-and-place operations show the efficiency and stability of our multimodal teleoperation system.

关键词： Measurement units Machine vision Robot vision systems Cameras Mobile robots Task analysis Image reconstruction

Open-world Weakly-Supervised Object Localization

学校读者我要写书评

暂无评论

Pattern Recognition 2026年 169卷

作者： Jinheng Xie Zhaochuan Luo Rouyi Li Yawen Huang Haozhe Liu Yuexiang Li Yefeng Zheng Yang Zhang Linlin Shen Mike Zheng Shou Computer Vision Institute School of Artificial Intelligence Shenzhen University Shenzhen 518060 China Guangdong Provincial Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen 518060 China The Jarvis Research Center Tencent YouTu Lab Shenzhen 518057 China National University of Singapore Singapore 639798 Singapore Shenzhen Power Supply Bureau Co. Ltd. ShenZhen 518000 China

While remarkable success has been achieved in weakly supervised object localization (WSOL), current frameworks are not capable of locating objects of novel categories in open-world settings. To address this issue, we are the first to introduce a new weakly supervised object localization task called Open-world Weakly Supervised Object Localization ( OWSOL ). During training, all labeled data comes from known categories and, both known and novel categories exist in the unlabeled data. To handle such data, we propose a novel paradigm of contrastive representation co-learning using both labeled and unlabeled data to perform Generalized Class Activation Mapping ( GCAM ) for object localization, without the requirement of bounding box annotation. As no class label is available for the unlabeled data, we conduct clustering over the full training set and design a novel multiple semantic centroids-driven contrastive loss for representation learning. We re-organize two widely used datasets, i.e., ImageNet-1K and iNatLoc500, and propose OpenImages150 to serve as evaluation benchmarks for OWSOL. Extensive experiments demonstrate that the proposed method can surpass all baselines by a large margin. We believe that this work can shift the close-set localization towards the open-world setting and serve as a foundation for subsequent works. The code and dataset are available at https://***/ryylcc/OWSOL .

关键词：

The quaternion-based anisotropic gradient for the color images 17

学校读者我要写书评

暂无评论

The quaternion-based anisotropic gradient for the color imag...

17th Image Processing: Algorithms and systems Conference, IPAS 2019

作者： Voronin, V. Zelensky, A. Agaian, S. Don State Technical University Lab. «Mathematical Methods of Image Processing and Computer Vision Intelligent Systems» Gagarina 1 Rostov on Don Russia Moscow State University of Technology"STANKIN" Moscow Russia CUNY College of Staten Island Dept. of Computer Science New York United States

Image gradient, as a preprocessing step is an essential tool in image processing in many research areas such as edge detection, segmentation, smoothing, inpainting, etc. In the present paper, we develop a new gradient by integrated the quaternion framework with LPA-ICI (local polynomial approximation - the intersection of confidence intervals) based on anisotropic gradient concepts for the color image processing applications. computer simulations on the Berkeley Segmentation Dataset show that the new quaternion anisotropic gradient exhibits fewer color artifacts compared to state-of-the-art techniques including well-knowledge gradient operators. © 2019, Society for Imaging Science and Technology.

关键词： Polynomial approximation

Feedback alfa-rooting algorithm for medical image enhancement 17

学校读者我要写书评

暂无评论

Feedback alfa-rooting algorithm for medical image enhancemen...

17th Image Processing: Algorithms and systems Conference, IPAS 2019

作者： Voronin, V. Zelensky, A. Agaian, S. Don State Technical University Lab. «Mathematical Methods of Image Processing and Computer Vision Intelligent Systems» Gagarina 1 Rostov on Don Russia Moscow State University of Technology "STANKIN" Moscow Russia CUNY/ College of Staten Island Dept. of Computer Science New York United States

This paper presents a new combined local and global transform domain-based feedback image enhancement algorithm for medical diagnosis, treatment, and clinical research. The basic idea in using local alfa-rooting method is to apply it to different disjoint blocks with different sizes. The block size and alfa-rooting parameters driven through optimization using the Agaian's cost function (image enhancement non-reference quality measure). The presented new approach allows enhancing MRI and CT images with uneven lighting and brightness gradient by preserving the local image features/details. Extensive computer simulations (CS) on real medical images are offered to gage the presented method. CS shows that our method improves the contrast and enhances the details of the medical images effectively compared with the current state-of-art methods. © 2019, Society for Imaging Science and Technology.

关键词： Clinical research