Omni-directional cameras which give 360 degree panoramic view of the surroundings and have recently been used in many applications such as robotics, navigation and surveillance. This paper describes the application of...
详细信息
Omni-directional cameras which give 360 degree panoramic view of the surroundings and have recently been used in many applications such as robotics, navigation and surveillance. This paper describes the application of motion estimation on omni camera to perform surround analysis using an automobile mounted camera. The system detects and tracks the surrounding vehicles by compensating the ego-motion and detecting objects having independent motion. Prior knowledge about ego-motion and calibration is optimally combined with the information from the image gradients to get better motion compensation.
Robust human face analysis has been recognized as a crucial part in intelligent systems. In this paper, we present the development of a computational framework for robust detection, tracking, and pose estimation of fa...
详细信息
Robust human face analysis has been recognized as a crucial part in intelligent systems. In this paper, we present the development of a computational framework for robust detection, tracking, and pose estimation of faces captured by video arrays. We discuss the development of a multi-primitive skin-tone and edge-based detection module embedded in a tracking module for efficient and robust face detection and tracking. A continuous density HMM based pose estimation is developed for an accurate estimate of the face orientation motions. Experimental evaluations of these algorithms suggest the validity of the proposed framework and its computational modules.
This paper examines the feasibility of a multi-camera voxel based occupant posture estimation system. Several new considerations are made to allow this tested human body modeling system to work reliably in the passeng...
详细信息
This paper examines the feasibility of a multi-camera voxel based occupant posture estimation system. Several new considerations are made to allow this tested human body modeling system to work reliably in the passenger seat of a vehicle, including camera position, segmentation, and body modeling with voxel reconstructions all from a constrained 4 camera setup. To describe occupant posture, a partial human body model consisting of a head and torso is proposed. The accuracy of the estimation of this model is compared against ground-truth.
This work presents the use of multiple sensor modalities in order to perform traffic analysis for health monitoring of transportation infrastructure. In particular, testbeds containing video and seismic sensors giving...
详细信息
This work presents the use of multiple sensor modalities in order to perform traffic analysis for health monitoring of transportation infrastructure. In particular, testbeds containing video and seismic sensors giving complementary information about vehicles are described. computervision algorithms are used to detect and track the vehicles and extract their properties. This information is combined with the data from seismic sensors for robust classification of vehicles. Experimental results obtained with our testbeds are described.
This paper introduces a method for pose-invariant facial affect analysis and a real-time system for facial affect analysis using this method. The method is centered on developing a feature vector that is more robust t...
详细信息
This paper introduces a method for pose-invariant facial affect analysis and a real-time system for facial affect analysis using this method. The method is centered on developing a feature vector that is more robust to rigid body movements while retaining information important to facial affect analysis. This feature vector is produced using thin-plate splines to extract affine transformations independently from nonlinear transformations quickly and efficiently. The affine portion can be used to describe the rigid body motion because planar motions in a perspective projection can be approximated by an affine transformation. Removing the affine portion and using the nonlinear portion of the thin-plate spline warping provides information on the nonlinear motion caused by facial affects. The real-time system developed using this method is composed of three main components: facial landmark tracking, feature vector extraction, and affect classification. The system processes streaming video in real-time. Testing was performed to examine the invariance to rotation as well as subject independence of the system. Finally, its application in real-world environments is discussed.
Driver distraction is recognized as a major factor in the cause of automobile accidents. Therefore, it is extremely important for an intelligent driver support system to be able to monitor the driver's attentive s...
详细信息
Driver distraction is recognized as a major factor in the cause of automobile accidents. Therefore, it is extremely important for an intelligent driver support system to be able to monitor the driver's attentive state. This paper proposes a system to monitor driver attention based on a variety of information sources. The LISA-Q test vehicle is used to synchronously capture video, audio, vehicle information, LASER RADAR information, and GPS information as input to the driver state evaluation. Information about the driver's facial affects, lane keeping, steering movements, and time headway are all extracted from the multimodal data streams and evaluated.
Lane Detection is a difficult problem because of the varying road conditions that one can encounter while driving. We propose a method for lane detection using steerable filters. Steerable filters provide robustness t...
详细信息
Lane Detection is a difficult problem because of the varying road conditions that one can encounter while driving. We propose a method for lane detection using steerable filters. Steerable filters provide robustness to lighting changes and shadows and perform well in picking out both circular reflector road markings as well as painted line road markings. The filter results are then processed to eliminate outliers based on the expected road geometry and used to update a road and vehicular model along with data taken internally from the vehicles. Results are shown for a 9000-frame image sequence that include varying lane markings, lighting conditions, showing, and occlusion by other vehicles.
We introduce a new type of intelligent vehicle test-bed that is enabling new research in the field. This new test-bed is designed to capture not just a portion of the vehicle surround, but rather the entire vehicle su...
详细信息
We introduce a new type of intelligent vehicle test-bed that is enabling new research in the field. This new test-bed is designed to capture not just a portion of the vehicle surround, but rather the entire vehicle surround as well as the vehicle interior and vehicle state for extended periods of time. This is accomplished using multiple modalities of sensor systems so that it conform a complete context of the vehicle. This allows new research to be performed in intelligent vehicle algorithm development and allows studies in driver behavior to be performed. We also show results from some of the research being performed using this test-bed.
vision based systems for "smart" airbag systems aim to give precise information about occupant pose and location. This information can be used to make intelligent airbag deployment decisions. This paper revi...
详细信息
vision based systems for "smart" airbag systems aim to give precise information about occupant pose and location. This information can be used to make intelligent airbag deployment decisions. This paper reviews both a stereo-based and long wave infrared-based system for "smart" airbag deployment. The algorithms are systematically evaluated through extensive real-time occupant tests. Data for both algorithms is simultaneously collected and evaluated for viability in an intelligent airbag system. Results of these experimental trials show the feasibility of each video based occupant position analysis system. Advantages and drawbacks of each method are discussed and potential solutions are suggested.
Recent innovations in real-time machine vision, distributed computing, software architectures, and encrypted high-speed networking are expanding the available technology for intelligent camera arrays on televiewing an...
详细信息
Recent innovations in real-time machine vision, distributed computing, software architectures, and encrypted high-speed networking are expanding the available technology for intelligent camera arrays on televiewing and interactive applications. In this paper we describe research aimed at the realization of a powerful televiewing system using arrays of omnidirectional cameras. The video arrays provide an interactive, real-time, multiresolution televiewing interface to multiple people including physical security and emergency response crews simultaneously. Security measures such as authentication and network encryption are implemented on multiple platforms. Fusion of high-resolution rectilinear image over the omnidirectional image is also carried out. computervision techniques based on motion analysis are used for detecting interesting events. The televiewing system is verified for the performance as well as physically tested on the Super Bowl 2003 event for crowd detection and traffic monitoring.
暂无评论