In this paper we propose to use gesture recognition approaches to track a human hand in 3D space and, without the use of special clothing or markers, be able to accurately generate code for training an industrial robo...
详细信息
ISBN:
(纸本)9780819494351
In this paper we propose to use gesture recognition approaches to track a human hand in 3D space and, without the use of special clothing or markers, be able to accurately generate code for training an industrial robot to perform the same motion. The proposed hand tracking component includes three methods: a color-thresholding model, naive Bayes analysis and Support Vector Machine (SVM) to detect the human hand. Next, it performs stereo matching on the region where the hand was detected to find relative 3D coordinates. The list of coordinates returned is expectedly noisy due to the way the human hand can alter its apparent shape while moving, the inconsistencies in human motion and detection failures in the cluttered environment. Therefore, the system analyzes the list of coordinates to determine a path for the robot to move, by smoothing the data to reduce noise and looking for significant points used to determine the path the robot will ultimately take. The proposed system was applied to pairs of videos recording the motion of a human hand in a, real. environment to move the end-affector of a SCARA robot along the same path as the hand of the person in the video. The correctness of the robot motion was determined by observers indicating that motion of the robot appeared to match the motion of the video.
We present the development of a multi-stage automatic target recognition (MS-ATR) system for computervision in robotics. This paper discusses our work in optimizing the feature selection strategies of the MS-ATR syst...
详细信息
ISBN:
(纸本)9780819494351
We present the development of a multi-stage automatic target recognition (MS-ATR) system for computervision in robotics. This paper discusses our work in optimizing the feature selection strategies of the MS-ATR system. Past implementations have utilized Optimum Trade-off Maximum Average Correlation Height (OT-MACH) filtering as an initial feature selection method, and principal component analysis (PCA) as a feature extraction strategy before the classification stage. Recent work has been done in the implementation of a modified saliency algorithm as a feature selection method. Saliency is typically implemented as a "bottom-up" search process using visual sensory information such as color, intensity, and orientation to detect salient points in the imagery. It is a general saliency mapping algorithm that receives no input from the user on what is considered salient. We discuss here a modified saliency algorithm that accepts the guidance of target features in locating regions of interest (ROI). By introducing target related input parameters, saliency becomes more focused and task oriented. It is used as an initial stage for the fast ROI detection method. The ROIs are passed to the later stages for feature extraction and target identification process.
Most stereovision applications are binocular which uses information from a 2-camera array to perform stereo matching and compute the depth image. Trinocular stereovision with a 3-camera array has been proved to provid...
详细信息
This paper presents the analysis and derivation of the geometric relation between vanishing points and camera parameters of central catadioptric camera systems. These vanishing points correspond to the three mutually ...
详细信息
ISBN:
(纸本)9780819494351
This paper presents the analysis and derivation of the geometric relation between vanishing points and camera parameters of central catadioptric camera systems. These vanishing points correspond to the three mutually orthogonal directions of 3D real world coordinate system (i.e. X, Y and Z axes). Compared to vanishing points (VPs) in the perspective projection, the advantages of VPs under central catadioptric projection are that there are normally two vanishing points for each set of parallel lines, since lines are projected to conics in the catadioptric image plane. Also, their vanishing points are usually located inside the image frame. We show that knowledge of the VPs corresponding to XYZ axes from a single image can lead to simple derivation of both intrinsic and extrinsic parameters of the central catadioptric system. This derived novel theory is demonstrated and tested on both synthetic and real data with respect to noise sensitivity.
Hundreds of millions of people use hand-held devices frequently and control them by touching the screen with their fingers. If this method of operation is being used by people who are driving, the probability of death...
详细信息
ISBN:
(纸本)9780819494351
Hundreds of millions of people use hand-held devices frequently and control them by touching the screen with their fingers. If this method of operation is being used by people who are driving, the probability of deaths and accidents occurring substantially increases. With a non-contact control interface, people do not need to touch the screen. As a result, people will not need to pay as much attention to their phones and thus drive more safely than they would otherwise. This interface can be achieved with real-time stereovision. A novel Intensity Profile Shape-Matching Algorithm is able to obtain 3-D information from a pair of stereo images in real time. While this algorithm does have a trade-off between accuracy and processing speed, the result of this algorithm proves the accuracy is sufficient for the practical use of recognizing human poses and finger movement tracking. By choosing an interval of disparity, an object at a certain distance range can be segmented. In other words, we detect the object by its distance to the cameras. The advantage of this profile shape-matching algorithm is that detection of correspondences relies on the shape of profile and not on intensity values, which are subjected to lighting variations. Based on the resulting 3-D information, the movement of fingers in space from a specific distance can be determined. Finger location and movement can then be analyzed for non-contact control of hand-held devices.
Visual homing is a navigation method based on comparing a stored image of the goal location and the current image (current view) to determine how to navigate to the goal location. It is theorized that insects, such as...
详细信息
ISBN:
(纸本)9780819494351
Visual homing is a navigation method based on comparing a stored image of the goal location and the current image (current view) to determine how to navigate to the goal location. It is theorized that insects, such as ants and bees, employ visual homing methods to return to their nest [1]. Visual homing has been applied to autonomous robot platforms using two main approaches: holistic and feature-based. Both methods aim at determining distance and direction to the goal location. Navigational algorithms using Scale Invariant Feature Transforms (SIFT) have gained great popularity in the recent years due to the robustness of the feature operator. Churchill and Vardy [2] have developed a visual homing method using scale change information (Homing in Scale Space, HiSS) from SIFT. HiSS uses SIFT feature scale change information to determine distance between the robot and the goal location. Since the scale component is discrete with a small range of values [3], the result is a rough measurement with limited accuracy. We have developed a method that uses stereo data, resulting in better homing performance. Our approach utilizes a pan-tilt based stereo camera, which is used to build composite wide-field images. We use the wide-field images combined with stereo-data obtained from the stereo camera to extend the keypoint vector described in [3] to include a new parameter, depth (z). Using this info, our algorithm determines the distance and orientation from the robot to the goal location. We compare our method with HiSS in a set of indoor trials using a Pioneer 3-AT robot equipped with a BumbleBee2 stereo camera. We evaluate the performance of both methods using a set of performance measures described in this paper.
Mobile robots are those with the capability of moving in an environment. The controller of these robots needs to have the ability to do intelligent behaviours in an uncertain environment. Today fuzzy control of mobile...
详细信息
ISBN:
(纸本)9781479933433
Mobile robots are those with the capability of moving in an environment. The controller of these robots needs to have the ability to do intelligent behaviours in an uncertain environment. Today fuzzy control of mobile robots in non-structured environments is increasing. Many represented algorithms for mobile robot navigation don't manifest appropriate performance in dynamic environments. This article aims at designing and making an intelligence robot. This robot is able to detect a specified target and track it. Velocity and steering of this robot is controlled by the fuzzy logic. Robot velocity is adjusted according to its distance from the target. This article is expressed the features of this mobile robot including different mechanical and electronic infrastructures, fuzzy navigation and vision controller. Navigation system of this robot makes its fuzzy decisions only based on the machine visiontechniques and unlike many robots, it doesn't depend on sensor. It is concluded that robot with fuzzy navigation have 60% time saving than the non-fuzzy. The results obtained indicate its appropriate performance in order to navigate a target-oriented mobile robot in an undetermined and dynamic environment.
The proceedings contain 39 papers. The topics discussed include: software-based neural network assisted movement compensation for nanoresolution piezo actuators;traffic monitoring with distributed smart cameras;effici...
ISBN:
(纸本)9780819489487
The proceedings contain 39 papers. The topics discussed include: software-based neural network assisted movement compensation for nanoresolution piezo actuators;traffic monitoring with distributed smart cameras;efficient hybrid monocular-stereo approach to on-board video-based traffic sign detection and tracking;a general model and calibration method for spherical stereoscopic vision;an approach to stereo-point cloud registration using image homographies;hazardous sign detection for safety applications in traffic monitoring;red-light traffic enforcement at railway crossings;image projection clues for improved real-time vehicle tracking in tunnels;decentralized tracking of humans using a camera network;real-time detection of traffic events using smart cameras;vehicle tracking data for calibrating microscopic traffic simulation models;and detection of unknown targets from aerial camera and extraction of simple object fingerprints for the purpose of target reacquisition.
Mobile robots are those with the capability of moving in an environment. The controller of these robots needs to have the ability to do intelligent behaviours in an uncertain environment. Today fuzzy control of mobile...
详细信息
Mobile robots are those with the capability of moving in an environment. The controller of these robots needs to have the ability to do intelligent behaviours in an uncertain environment. Today fuzzy control of mobile robots in non-structured environments is increasing. Many represented algorithms for mobile robot navigation don't manifest appropriate performance in dynamic environments. This article aims at designing and making an intelligence robot. This robot is able to detect a specified target and track it. Velocity and steering of this robot is controlled by the fuzzy logic. Robot velocity is adjusted according to its distance from the target. This article is expressed the features of this mobile robot including different mechanical and electronic infrastructures, fuzzy navigation and vision controller. Navigation system of this robot makes its fuzzy decisions only based on the machine visiontechniques and unlike many robots, it doesn't depend on sensor. It is concluded that robot with fuzzy navigation have 60% time saving than the non-fuzzy. The results obtained indicate its appropriate performance in order to navigate a target-oriented mobile robot in an undetermined and dynamic environment.
Motion estimation is an open research field in control and robotic applications. Sensor fusion algorithms are generally used to achieve an accurate estimation of the vehicle motion by combining heterogeneous sensors m...
详细信息
ISBN:
(纸本)9781467363563
Motion estimation is an open research field in control and robotic applications. Sensor fusion algorithms are generally used to achieve an accurate estimation of the vehicle motion by combining heterogeneous sensors measurements with different statistical characteristics. In this paper, a new method that combines measurements provided by an inertial sensor and a vision system is presented. Compared to classical model-based techniques, the method relies on a Pareto optimization that trades off the statistical properties of the measurements. The proposed technique is evaluated with simulations in terms of computational requirements and estimation accuracy with respect to a classical Kalman filter approach. It is shown that the proposed method gives an improved estimation accuracy at the cost of a slightly increased computational complexity.
暂无评论