Visual servoing was introduced in robotics nearly 4 decades ago. However until now, there are still only a handful of known examples of application of this technique in addressing real word robotics problems such as d...
详细信息
ISBN:
(纸本)9780769549835
Visual servoing was introduced in robotics nearly 4 decades ago. However until now, there are still only a handful of known examples of application of this technique in addressing real word robotics problems such as disaster response, assistance for elderly or handicapped people, etc. As the world is moving towards the use of robotics to improve quality of life, it is time to assess the challenges involved in applying visual servoing to solve real world problems. this paper presents an overview of these challenges, by asking the question what are the missing components for practical visual servoing? and by providing practical possible solutions for these components. Illustration of these challenges and our current practical solutions are given using our 7-DoFs Barrett WAM Arm.
this paper describes some simple but useful computervision techniques for human-robot interaction. First, an omnidirectional camera setting is described that can detect people in the surroundings of the robot, giving...
详细信息
ISBN:
(纸本)9789728865832
this paper describes some simple but useful computervision techniques for human-robot interaction. First, an omnidirectional camera setting is described that can detect people in the surroundings of the robot, giving their angular positions and a rough estimate of the distance. the device can be easily built with inexpensive components. Second, we comment on a color-based face detection technique that can alleviate skin-color false positives. third, a person tracking and recognition system is described. Finally, a simple head nod and shake detector is described, suitable for detecting affirmative/negative, approval/disapproval, understanding/disbelief head gestures.
We have developed a fully integrated, miniaturized embedded stereo vision system (MESVS-1) which fits into a tiny package of 5x5 cm and consumes very low power (700mA @ 3.3V). the system consists of two small profile ...
详细信息
ISBN:
(纸本)9780769531533
We have developed a fully integrated, miniaturized embedded stereo vision system (MESVS-1) which fits into a tiny package of 5x5 cm and consumes very low power (700mA @ 3.3V). the system consists of two small profile CMOS cameras, and a power efficient, dual-core embedded media processor, running at 600 MHz per core. the stereo-matching engine performs sub-sampling, rectification, pre-processing using rank transform, correlation-based matching using three levels of recursion, L/R consistency check and post-processing. We have proposed a novel and efficient post-processing algorithm that removes outliers due to low-texture regions and depth-discontinuities by combining the contributions from the variance map of the rectified image, disparity map, and the variance map of the disparity map. To further enhance the performance of the system, we have implemented a two staged pipelined-processing scheme that takes advantage of the dual-core architecture of the embedded processor, thereby achieving a processing speed of around 10fps for disparity maps.
Monitoring of populated indoor environments is crucial for the surveillance of public spaces like airports or embassies, where the behavior of people may be relevant in order to determine abnormal situations. In this ...
详细信息
Monitoring of populated indoor environments is crucial for the surveillance of public spaces like airports or embassies, where the behavior of people may be relevant in order to determine abnormal situations. In this paper, a surveillance system based on an integration of interactive and non-interactive heterogeneous sensors is described. As a difference with respect to traditional, pure vision-based systems, the proposed approach relies on Radio Frequency Identification (RFID) tags carried by people, multiple mobile robots (each one equipped with a laser range finder and an RFID reader), and fixed RGBD cameras. the main task of the system is to assess the presence and the position of people in the environment. this is obtained by suitably integrating data coming from heterogeneous sensors, including those mounted on board of mobile robots that are in charge of patrolling the environment. the robots also adapt their behavior according to the current situation, on the basis of a Prey-Predator scheme. Experimental results carried out both on real and on simulated data show the effectiveness of the approach. (C) 2014 Published by Elsevier B.V.
To realize the intelligent navigation and safe obstacle avoidance of the intelligent inspection robot in the complex environment of the 5G operation and maintenance centers, and build an accurate environment map, this...
详细信息
Measuring sound intensity is a complex and tedious task in industrial environments. Traditional manual methods can be costly, inaccurate, and potentially dangerous for workers. Integrating robotics and computervision...
详细信息
We propose a novel algorithm for stereo matching using a dynamical systems approach. the stereo correspondence problem is first formulated as an energy minimization problem. From the energy function, we derive a syste...
详细信息
ISBN:
(纸本)9789898111692
We propose a novel algorithm for stereo matching using a dynamical systems approach. the stereo correspondence problem is first formulated as an energy minimization problem. From the energy function, we derive a system of differential equations describing the corresponding dynamical system of interacting elements, which we solve using numerical integration. Optimization is introduced by means of a damping term and a noise term, an idea similar to simulated annealing. the algorithm is tested on the Middlebury stereo benchmark.
this article proposes a feature-rich, open hardware, open software inexpensive robot based on a Waveshare AlphaBot 2. the proposal uses a Raspberry Pi and a chrome plated light bulb as a mirror to produce a robot with...
详细信息
ISBN:
(纸本)9783030359904;9783030359898
this article proposes a feature-rich, open hardware, open software inexpensive robot based on a Waveshare AlphaBot 2. the proposal uses a Raspberry Pi and a chrome plated light bulb as a mirror to produce a robot with an omnidirectional vision (catadioptric) system. the system also tackles boot and network issues to allow for monitor-less programming and usage, thus further reducing usage costs. the OpenCV library is used for image processing and obstacles are identified based on their brightness and saturation in contrast to the ground. Our solution achieved acceptable framerates and near perfect object detection up to 1.5-m distances. the robot is usable for simple robotic demonstrations and educational purposes for its simplicity and flexibility.
In order to achieve the environmental information for the mobile robots during the autonomous navigation, an intelligent space is built firstly based on the Zigbee wireless sensor network system (WSNS) and the distrib...
详细信息
ISBN:
(纸本)9783642539329;9783642539312
In order to achieve the environmental information for the mobile robots during the autonomous navigation, an intelligent space is built firstly based on the Zigbee wireless sensor network system (WSNS) and the distributed vision system. After the environmental information for the mobile robots is achieved through the vision system in the built intelligent space, on the one hand, the static obstacles are segmented by using the Otsu threshold method and the mathematical morphology, and the environmental map of the mobile robot is built;on the other hand, the position and the direction of the mobile robot is achieved through the background difference, and the vision-based location for the mobile robot is realized. the experimental results of the environmental map building and the mobile robot location verify the validity of the proposed intelligent space and the image processing method for the map building and location.
Nowadays, the local visual perception research, applied to autonomous mobile robots, has succeeded in some important objectives, such as feasible obstacle detection and structure knowledge. this work relates the on-ro...
详细信息
ISBN:
(纸本)9789728865832
Nowadays, the local visual perception research, applied to autonomous mobile robots, has succeeded in some important objectives, such as feasible obstacle detection and structure knowledge. this work relates the on-robot visual perception and odometer system information withthe nonlinear mobile robot control system, consisting in a differential driven robot with a free rotating wheel. the description of the proposed algorithms can be considered as an interesting aspect of this report. It is developed an easily portable methodology to plan the goal achievement by using the visual data as an available source of positions. Moreover, the dynamic interactions of the robotic system arise from the knowledge of a set of experimental robot models that allow the development of model predictive control strategies based on the mobile robot platform PRIM available in the Laboratory of robotics and computervision. the meaningful contribution is the use of the local visual information as an occupancy grid where a local trajectory approaches the robot to the final desired configuration, while avoiding obstacle collisions. Hence, the research is focused on the experimental aspects. Finally, conclusions on the overall work are drawn.
暂无评论