检索结果-内蒙古大学图书馆

Privacy-protected object detection through trustworthy image fusion

学校读者我要写书评

暂无评论

Privacy-protected object detection through trustworthy image...

作者： Zhang, Chao Zhang, Jinmei Yun, Lijun Zhang, Jun Su, Junbo Yunnan Key Laboratory of Optoelectronic Information Technology Yunnan Normal University Kunming China School of Physics and Electronic Information Yunnan Normal University Kunming China Engineering Research Center of Computer Vision and Intelligent Control Technology Department of Education of Yunnan Province Yunnan Normal University Kunming China Kunming Institute of Physics Ordnance Science and Research Academy of China Kunming China

The neural network-based technologies have emerged as a potent method for image fusion, object detection, and other computer vision tasks as the rapid development of deep learning. Multi-band infrared images, in particular, capture a more extensive range of radiation details and information compared to conventional single-band infrared images. Consequently, the fusion of multi-band infrared images can provide more features for object detection. However, it is crucial to consider that infrared images may contain sensitive information, potentially leading to privacy concerns. Ensuring datasets privacy protection plays a crucial role in the fusion and tracking process. To address both the need for improved detection performance and the necessity for privacy protection in the infrared environment, we proposed a procedure for object detection based on multi-band infrared image datasets and utilized the transfer learning technique to migrate knowledge learned from external infrared data to internal infrared data, thereby training the infrared image fusion model and detection model. The procedure consists of several steps: (1) data preprocessing of multi-band infrared images, (2) multi-band infrared image fusion, and (3) object detection. Standard evaluation metrics for image fusion and object detection ensure the authenticity of the experiments. The comprehensive validation experiments demonstrate the effectiveness of the proposed procedure in object detection tasks. Furthermore, the transfer learning can train our datasets and update the model without exposing the original data. This aspect of transfer learning is particularly beneficial for maintaining the privacy of multi-band infrared images during the fusion and detection processes. © 2024 John Wiley & Sons Ltd.

关键词： Object detection

LiDAR-based drone navigation with reinforcement learning

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Miera, Pawel Szolc, Hubert Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Al. Mickiewicza 30 Krakow30-059 Poland

Reinforcement learning is of increasing importance in the field of robot control and simulation plays a key role in this process. In the unmanned aerial vehicles (UAVs, drones), there is also an increase in the number of published scientific papers involving this approach. In this work, an autonomous drone control system was prepared to fly forward (according to its coordinates system) and pass the trees encountered in the forest based on the data from a rotating LiDAR sensor. The Proximal Policy Optimization (PPO) algorithm, an example of reinforcement learning (RL), was used to prepare it. A custom simulator in the Python language was developed for this purpose. The Gazebo environment, integrated with the Robot Operating System (ROS), was also used to test the resulting control algorithm. Finally, the prepared solution was implemented in the Nvidia Jetson Nano eGPU and verified in the real tests scenarios. During them, the drone successfully completed the set task and was able to repeatably avoid trees and fly through the forest. © 2023, CC BY.

关键词： Robot Operating System

Deep Learning-Enabled ISAC-OTFS Pre-equalization Design for Aerial-Terrestrial Networks

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wang, Weihao Guo, Jing Wang, Siqiang Wang, Xinyi Yuan, Weijie Fei, Zesong the School of Information and Electronics Beijing Institute of Technology Beijing100081 China the School of System Design and Intelligent Manufacturing The Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen518055 China

Orthogonal time frequency space (OTFS) modulation has been viewed as a promising technique for integrated sensing and communication (ISAC) systems and aerial-terrestrial networks, due to its delay-Doppler domain transmission property and strong Doppler-resistance capability. However, it also suffers from high processing complexity at the receiver. In this work, we propose a novel pre-equalization based ISAC-OTFS transmission framework, where the terrestrial base station (BS) executes pre-equalization based on its estimated channel state information (CSI). In particular, the mean square error of OTFS symbol demodulation and Cramér-Rao lower bound of sensing parameter estimation are derived, and their weighted sum is utilized as the metric for optimizing the pre-equalization matrix. To address the formulated problem while taking the time-varying CSI into consideration, a deep learning enabled channel prediction-based pre-equalization framework is proposed, where a parameter-level channel prediction module is utilized to decouple OTFS channel parameters, and a low-dimensional prediction network is leveraged to correct outdated CSI. A CSI processing module is then used to initialize the input of the pre-equalization module. Finally, a residual-structured deep neural network is cascaded to execute pre-equalization. Simulation results show that under the proposed framework, the demodulation complexity at the receiver as well as the pilot overhead for channel estimation, are significantly reduced, while the symbol detection performance approaches those of conventional minimum mean square error equalization and perfect CSI. Copyright © 2024, The Authors. All rights reserved.

关键词： Channel estimation

Analyzing Infrared Linescan Profiles of Steel Strips for Enhanced Cooling Pattern Prediction

学校读者我要写书评

暂无评论

Analyzing Infrared Linescan Profiles of Steel Strips for Enh...

IEEE Industry Applications Society Annual Meeting (IAS)

作者： Rubén Usamentiaga Adrian G. Gayo Francisco J. DelaCalle Dario G. Lema Stefano Sfarra Hai Zhang Department of Computer Science and Engineering University of Oviedo Gijón Asturias Spain Department of Industrial and Information Engineering and Economics (DIIIE) University of L'Aquila L'Aquila Italy Department of Electrical and Computer Engineering Computer Vision and Systems Laboratory (CVSL) Laval University Quebec Canada

ISBN: (数字)9798350372717

ISBN: (纸本)9798350372724

Real-time temperature information is crucial for optimizing cooling processes during steel strip rolling, ensuring the attainment of desired microstructural properties and surface quality at an optimal cooling rate. Infrared line scanners emerge as the preferred choice for temperature measurement in highspeed rolling operations, delivering temperature readings with high resolution and enabling the capture of detailed temperature profiles. By analyzing these profiles, cooling systems can be finely adjusted and precisely controlled to optimize the rolling operation. However, developing effective cooling strategies becomes challenging when dealing with temperature profiles comprising numerous discrete data points, often numbering in the thousands per profile. This study presents an innovative approach that integrates the detection of steel strip boundaries within temperature profiles and subsequent temperature pattern characterization using polynomial fitting. A significant advantage is demonstrated by leveraging the coefficients of Legendre polynomials, which provide a concise description of temperature profile shapes, facilitating straightforward approaches to cooling strategies. By integrating boundary detection with temperature characterization, the system enhances its ability to predict tailored cooling patterns, optimizing cooling efficiency, and enhancing product quality in the manufacturing process. Rigorous testing using both synthetic data and real-world applications in cold and hot rolling validates the proposed system's practical utility and reliability. These results underscore its potential to enhance efficiency and quality in industrial steel manufacturing operations.

关键词： Temperature measurement Temperature sensors Strips Cooling Shape Polynomials Real-time systems Steel Monitoring Testing

HairDiffusion: Vivid Multi-Colored Hair Editing via Latent Diffusion

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zeng, Yu Zhang, Yang Liu, Jiachen Shen, Linlin Deng, Kaijun He, Weizhao Wang, Jinbao Computer Vision Institute School of Computer Science & Software Engineering Shenzhen University China Shenzhen Institute of Artificial Intelligence and Robotics for Society China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China Guangdong Provincial Key Laboratory of Intelligent Information Processing China

Hair editing is a critical image synthesis task that aims to edit hair color and hairstyle using text descriptions or reference images, while preserving irrelevant attributes (e.g., identity, background, cloth). Many existing methods are based on StyleGAN to address this task. However, due to the limited spatial distribution of StyleGAN, it struggles with multiple hair color editing and facial preservation. Considering the advancements in diffusion models, we utilize Latent Diffusion Models (LDMs) for hairstyle editing. Our approach introduces Multi-stage Hairstyle Blend (MHB), effectively separating control of hair color and hairstyle in diffusion latent space. Additionally, we train a warping module to align the hair color with the target region. To further enhance multi-color hairstyle editing, we fine-tuned a CLIP model using a multi-color hairstyle dataset. Our method not only tackles the complexity of multi-color hairstyles but also addresses the challenge of preserving original colors during diffusion editing. Extensive experiments showcase the superiority of our method in editing multi-color hairstyles while preserving facial attributes given textual descriptions and reference images. © 2024, CC BY.

关键词： Color image processing

FoundationGrasp: Generalizable Task-Oriented Grasping with Foundation Models

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Tang, Chao Huang, Dehao Dong, Wenlong Xu, Ruinian Zhang, Hong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China Institute for Robotics and Intelligent Machines Georgia Institute of Technology Atlanta United States

Task-oriented grasping (TOG), which refers to synthesizing grasps on an object that are configurationally compatible with the downstream manipulation task, is the first milestone towards tool manipulation. Analogous to the activation of two brain regions responsible for semantic and geometric reasoning during cognitive processes, modeling the intricate relationship between objects, tasks, and grasps necessitates rich semantic and geometric prior knowledge about these elements. Existing methods typically restrict the prior knowledge to a closed-set scope, limiting their generalization to novel objects and tasks out of the training set. To address such a limitation, we propose FoundationGrasp, a foundation model-based TOG framework that leverages the open-ended knowledge from foundation models to learn generalizable TOG skills. Extensive experiments are conducted on the contributed Language and vision Augmented TaskGrasp (LaViA-TaskGrasp) dataset, demonstrating the superiority of FoundationGrasp over existing methods when generalizing to novel object instances, object classes, and tasks out of the training set. Furthermore, the effectiveness of FoundationGrasp is validated in real-robot grasping and manipulation experiments on a 7-DoF robotic arm. Our code, data, appendix, and video are publicly available at https://***/view/foundationgrasp. Copyright © 2024, The Authors. All rights reserved.

关键词： Robotic arms

HPPS: A Hierarchical Progressive Perception System for Luggage Trolley Detection and Localization at Airports

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Sun, Zhirui Zhang, Zhe Zhao, Jieting Ye, Hanjing Wang, Jiankun Shenzhen Key Laboratory of Robotics Perception and Intelligence Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China Jiaxing Research Institute Southern University of Science and Technology Jiaxing China Shenzhen Key Laboratory of Robotics and Computer Vision Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

The robotic autonomous luggage trolley collection system employs robots to gather and transport scattered luggage trolleys at airports. However, existing methods for detecting and locating these luggage trolleys often fail when they are not fully visible. To address this, we introduce the Hierarchical Progressive Perception System (HPPS), which enhances the detection and localization of luggage trolleys under partial occlusion. The HPPS processes the luggage trolley’s position (x, y) and orientation (θ) separately, which requires only RGB images for labeling and training, eliminating the need for 3D coordinates and alignment. The HPPS can accurately determine the position of the luggage trolley with just one well-detected keypoint and estimate the luggage trolley’s orientation when it is partially occluded. Once the luggage trolley’s initial pose is detected, HPPS updates this information continuously to refine its accuracy until the robot begins grasping. The experiments on detection and localization demonstrate that HPPS is more reliable under partial occlusion compared to existing methods. Its effectiveness and robustness have also been confirmed through practical tests in actual luggage trolley collection tasks. A website about this work is available at HPPS. Copyright © 2024, The Authors. All rights reserved.

关键词： robotics

Detail-Enhancing Framework for Reference-Based Image Super-Resolution

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wang, Zihan Xiong, Ziliang Tang, Hongying Yuan, Xiaobing Shanghai Institution of Micro-system and Information Technology University of Chinese Academy of Science China Computer Vision Laboratory Department of Electrical Engineering LiU Sweden School of Information Science and Technology Shanghai Tech University China

Recent years have witnessed the prosperity of reference-based image super-resolution (Ref-SR). By importing the high-resolution (HR) reference images into the single image super-resolution (SISR) approach, the ill-posed nature of this long-standing field has been alleviated with the assistance of texture transferred from reference images. Although the significant improvement in quantitative and qualitative results has verified the superiority of Ref-SR methods, the presence of misalignment before texture transfer indicates room for further performance improvement. Existing methods tend to neglect the significance of details in the context of comparison, therefore not fully leveraging the information contained within low-resolution (LR) images. In this paper, we propose a Detail-Enhancing Framework (DEF) for reference-based super-resolution, which introduces the diffusion model to generate and enhance the underlying detail in LR images. If corresponding parts are present in the reference image, our method can facilitate rigorous alignment. In cases where the reference image lacks corresponding parts, it ensures a fundamental improvement while avoiding the influence of the reference image. Extensive experiments demonstrate that our proposed method achieves superior visual results while maintaining comparable numerical outcomes. Copyright © 2024, The Authors. All rights reserved.

关键词： Textures

Efficient Object Rearrangement via Multi-view Fusion

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Huang, Dehao Tang, Chao Zhang, Hong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

The prospect of assistive robots aiding in object organization has always been compelling. In an image-goal setting, the robot rearranges the current scene to match the single image captured from the goal scene. The key to an image-goal rearrangement system is estimating the desired placement pose of each object based on the single goal image and observations from the current scene. In order to establish sufficient associations for accurate estimation, the system should observe an object from a viewpoint similar to that in the goal image. Existing image-goal rearrangement systems, due to their reliance on a fixed viewpoint for perception, often require redundant manipulations to randomly adjust an object’s pose for a better perspective. Addressing this inefficiency, we introduce a novel object rearrangement system that employs multi-view fusion. By observing the current scene from multiple viewpoints before manipulating objects, our approach can estimate a more accurate pose without redundant manipulation times. A standard visual localization pipeline at the object level is developed to capitalize on the advantages of multi-view observations. Simulation results demonstrate that the efficiency of our system outperforms existing single-view systems. The effectiveness of our system is further validated in a physical experiment. Copyright © 2023, The Authors. All rights reserved.

关键词：