This paper introduces a method for pose-invariant facial affect analysis and a real-time system for facial affect analysis using this method. The method is centered on developing a feature vector that is more robust t...
详细信息
This paper introduces a method for pose-invariant facial affect analysis and a real-time system for facial affect analysis using this method. The method is centered on developing a feature vector that is more robust to rigid body movements while retaining information important to facial affect analysis. This feature vector is produced using thin-plate splines to extract affine transformations independently from nonlinear transformations quickly and efficiently. The affine portion can be used to describe the rigid body motion because planar motions in a perspective projection can be approximated by an affine transformation. Removing the affine portion and using the nonlinear portion of the thin-plate spline warping provides information on the nonlinear motion caused by facial affects. The real-time system developed using this method is composed of three main components: facial landmark tracking, feature vector extraction, and affect classification. The system processes streaming video in real-time. Testing was performed to examine the invariance to rotation as well as subject independence of the system. Finally, its application in real-world environments is discussed.
Driver distraction is recognized as a major factor in the cause of automobile accidents. Therefore, it is extremely important for an intelligent driver support system to be able to monitor the driver's attentive s...
详细信息
Driver distraction is recognized as a major factor in the cause of automobile accidents. Therefore, it is extremely important for an intelligent driver support system to be able to monitor the driver's attentive state. This paper proposes a system to monitor driver attention based on a variety of information sources. The LISA-Q test vehicle is used to synchronously capture video, audio, vehicle information, LASER RADAR information, and GPS information as input to the driver state evaluation. Information about the driver's facial affects, lane keeping, steering movements, and time headway are all extracted from the multimodal data streams and evaluated.
Lane Detection is a difficult problem because of the varying road conditions that one can encounter while driving. We propose a method for lane detection using steerable filters. Steerable filters provide robustness t...
详细信息
Lane Detection is a difficult problem because of the varying road conditions that one can encounter while driving. We propose a method for lane detection using steerable filters. Steerable filters provide robustness to lighting changes and shadows and perform well in picking out both circular reflector road markings as well as painted line road markings. The filter results are then processed to eliminate outliers based on the expected road geometry and used to update a road and vehicular model along with data taken internally from the vehicles. Results are shown for a 9000-frame image sequence that include varying lane markings, lighting conditions, showing, and occlusion by other vehicles.
We introduce a new type of intelligent vehicle test-bed that is enabling new research in the field. This new test-bed is designed to capture not just a portion of the vehicle surround, but rather the entire vehicle su...
详细信息
We introduce a new type of intelligent vehicle test-bed that is enabling new research in the field. This new test-bed is designed to capture not just a portion of the vehicle surround, but rather the entire vehicle surround as well as the vehicle interior and vehicle state for extended periods of time. This is accomplished using multiple modalities of sensor systems so that it conform a complete context of the vehicle. This allows new research to be performed in intelligent vehicle algorithm development and allows studies in driver behavior to be performed. We also show results from some of the research being performed using this test-bed.
vision based systems for "smart" airbag systems aim to give precise information about occupant pose and location. This information can be used to make intelligent airbag deployment decisions. This paper revi...
详细信息
vision based systems for "smart" airbag systems aim to give precise information about occupant pose and location. This information can be used to make intelligent airbag deployment decisions. This paper reviews both a stereo-based and long wave infrared-based system for "smart" airbag deployment. The algorithms are systematically evaluated through extensive real-time occupant tests. Data for both algorithms is simultaneously collected and evaluated for viability in an intelligent airbag system. Results of these experimental trials show the feasibility of each video based occupant position analysis system. Advantages and drawbacks of each method are discussed and potential solutions are suggested.
Recent innovations in real-time machine vision, distributed computing, software architectures, and encrypted high-speed networking are expanding the available technology for intelligent camera arrays on televiewing an...
详细信息
Recent innovations in real-time machine vision, distributed computing, software architectures, and encrypted high-speed networking are expanding the available technology for intelligent camera arrays on televiewing and interactive applications. In this paper we describe research aimed at the realization of a powerful televiewing system using arrays of omnidirectional cameras. The video arrays provide an interactive, real-time, multiresolution televiewing interface to multiple people including physical security and emergency response crews simultaneously. Security measures such as authentication and network encryption are implemented on multiple platforms. Fusion of high-resolution rectilinear image over the omnidirectional image is also carried out. computervision techniques based on motion analysis are used for detecting interesting events. The televiewing system is verified for the performance as well as physically tested on the Super Bowl 2003 event for crowd detection and traffic monitoring.
Detecting vehicles from a moving vehicle is an important task. In this paper a new vehicle detector is introduced. The new vehicle detector employs the use of the ubiquitous wheel. Every car has wheels; this wheel det...
详细信息
Detecting vehicles from a moving vehicle is an important task. In this paper a new vehicle detector is introduced. The new vehicle detector employs the use of the ubiquitous wheel. Every car has wheels; this wheel detector finds wheels and infers vehicle location from the wheel detection. Views from an omnidirectional camera are used to generate side view images. These images are processed using a difference of Gaussian filter bank. The responses from the filter bank are applied to a precomputed set of principle components. The principle component responses are compared against a Gaussian mixture model of wheels and Gaussian model roadbed. Wheel candidates are chosen and tracked. Initial experimental results along with analysis are shown.
Detecting and classifying vehicles using a stationary camera is an important task in intelligent transportation systems. A novel vehicle detector is introduced. The vehicle detector uses the most common feature among ...
详细信息
Detecting and classifying vehicles using a stationary camera is an important task in intelligent transportation systems. A novel vehicle detector is introduced. The vehicle detector uses the most common feature among all vehicles, the ubiquitous wheel. The vehicle detector finds wheels and infers vehicle location from background segmentation and wheel detection. Views from a rigid rectilinear camera are used. The images are convolved using a difference of Gaussian filterbank. The responses from the filterbank are applied to a precomputed set of principle components. The principle component responses are compared against a Gaussian mixture model of wheels and Gaussian mixture model of non-wheels. Wheel candidates are chosen and tracked. Any wheel tracked in the foreground is chosen as wheel. Initial experimental results along with analysis are included.
Robust detection of vehicle occupant posture is necessary for intelligent airbag deployment. This paper presents a vision-based method of estimating the size, posture and pose of the occupant. Utilizing raw reflectanc...
详细信息
Robust detection of vehicle occupant posture is necessary for intelligent airbag deployment. This paper presents a vision-based method of estimating the size, posture and pose of the occupant. Utilizing raw reflectance and stereo disparity images, this algorithm presents a mixed-mode approach to finding occupant features. Extensive experiments show the viability of this mixed-mode method in identifying the occupant's head location and suggest the feasibility of extending the analysis system to include detection of features such as occupant arms and foreign objects.
It is proposed a new method to compute, from the current unstructured view, a reference (desired) image for visual servoing. The approach, which is based on Cartesian specifications, is made without moving the robot t...
详细信息
暂无评论