We are interested in data fusion strategies for Intelligence, Surveillance, and Reconnaissance (ISR) missions. Advances in theory, algorithms, and computational power have made it possible to extract rich semantic inf...
详细信息
ISBN:
(纸本)9781628416145
We are interested in data fusion strategies for Intelligence, Surveillance, and Reconnaissance (ISR) missions. Advances in theory, algorithms, and computational power have made it possible to extract rich semantic information from a wide variety of sensors, but these advances have raised new challenges in fusing the data. For example, in developing fusion algorithms for moving target identification (MTI) applications, what is the best way to combine image data having different temporal frequencies, and how should we introduce contextual information acquired from monitoring cell phones or from human intelligence? In addressing these questions we have found that existing data fusion models do not readily facilitate comparison of fusion algorithms performing such complex information extraction, so we developed a new model that does. Here, we present the Spatial, Temporal, Algorithm, and Cognition (STAC) model. STAC allows for describing the progression of multi-sensor raw data through increasing levels of abstraction, and provides a way to easily compare fusion strategies. It provides for unambiguous description of how multi-sensor data are combined, the computational algorithms being used, and how scene understanding is ultimately achieved. In this paper, we describe and illustrate the STAC model, and compare it to other existing models.
Image segmentation, a key component in many Automatic Target Recognition (ATR) systems, has received considerable attention in the research community in recent years. A variety of segmentation approaches exist, and at...
详细信息
ISBN:
(纸本)0819449598
Image segmentation, a key component in many Automatic Target Recognition (ATR) systems, has received considerable attention in the research community in recent years. A variety of segmentation approaches exist, and attempts have been made to combine various approaches in order to find more robust solutions. In this paper, the authors describe an inference fusion architecture for combining individual segmentation concepts which results in improved performance over the individual algorithms. We consider segmentation algorithms with several disparate cost functions as experts with a narrowly defined set of goals. The information obtained from each expert is combined and weighted with available evidence using an agent based inference system, resulting in an adaptive, robust and highly flexible image segmentation. Results obtained by applying this approach will be presented.
High resolution LiDAR data is used to augment spectral data to improve resolution/accuracy. Digital elevation information, texture information, and spectral data are all combined into a single dataset and different cl...
详细信息
ISBN:
(纸本)9780819481740
High resolution LiDAR data is used to augment spectral data to improve resolution/accuracy. Digital elevation information, texture information, and spectral data are all combined into a single dataset and different clustering algorithms are used on the raster information and compared with clusters of spectral data alone. Long term goals of the work are to find efficient and effective methods of combining different data sets of varying resolution from different sources into a single dataset for analysis to improve data and classification resolution and accuracy.
An approach to fuse multiple images based on Dempster-Shafer evidential reasoning is proposed in this, article. Dempster-Shafer theory provides a complete framework for combining weak evidences from multiple sources. ...
详细信息
ISBN:
(纸本)0819449598
An approach to fuse multiple images based on Dempster-Shafer evidential reasoning is proposed in this, article. Dempster-Shafer theory provides a complete framework for combining weak evidences from multiple sources. Such situations typically arise in the image fusion problems, where a 'real scene' image has to be estimated from incomplete and unreliable observations. By converting images from their spatial domain into the evidential representations, decisions are made to aggregate evidences such that a fused image is generated. The proposed fusion approach is evaluated on a broad set of images and promising results are given.
The efficient and timely management of imagery captured in the battlefield requires methods capable of searching the voluminous databases and extracting highly symbolic concepts. When processing images, a semantic and...
详细信息
ISBN:
(纸本)9780819486387
The efficient and timely management of imagery captured in the battlefield requires methods capable of searching the voluminous databases and extracting highly symbolic concepts. When processing images, a semantic and definition gap exists between machine representations and the user's language. Based on matrix completion techniques, we present a fusion operator that fuses imagery and expert knowledge provided by user inputs during post analysis. Specifically, an information matrix is formed from imagery and a class map as labeled by an expert. From this matrix an image operator is derived for the extraction/prediction of information from future imagery. We will present results using this technique on single mode data.
Many image fusion systems involving passive sensors require the accurate registration of the sensor data prior to performing fusion. Since depth information is not readily available in such systems, all registration a...
详细信息
ISBN:
(纸本)9780819471659
Many image fusion systems involving passive sensors require the accurate registration of the sensor data prior to performing fusion. Since depth information is not readily available in such systems, all registration algorithms are intrinsically approximations based upon various assumption about the depth field. Although often overlooked, many registration algorithms can break down in certain situations and this may adversely affect the image fusion performance. In this paper, we discuss a framework for quantifying the accuracy and robustness of image registration algorithms which allows a more precise understanding of their shortcomings. In addition, some novel algorithms have been investigated that overcome some of these limitations. A second aspect of this work has considered the treatment of images from multiple sensors whose angular and spatial separation is large and where conventional registration algorithms break down (typically greater than a few degrees of separation). A range of novel approaches is reported which exploit the use of parallax to estimate depth information and reconstruct a geometrical model of the scene. The imagery can then be combined with this geometrical model to render a variety of useful representations of the data. These techniques (which we term Volume Registration) show great promise as a means of gathering and presenting 3D and 4D scene information for both military and civilian applications.
The emphasis of this paper is to design a Performance Evaluation Methodology for Data fusion-based Multiple Target Tracking Systems. Within this methodology the Performance Evaluation process is treated as a whole new...
详细信息
ISBN:
(纸本)0819449598
The emphasis of this paper is to design a Performance Evaluation Methodology for Data fusion-based Multiple Target Tracking Systems. Within this methodology the Performance Evaluation process is treated as a whole new fusion process. This has two major advantages - (1) Facilitates reusability of existing models and algorithms, and (2) Using standard frameworks and norms makes it easier for the tracking community to easily adopt it - thus giving this aspect of tracking a highly needed jumpstart. A case study implementation of this design methodology is presented. Three different Track-Truth Association strategies were implemented to study the effect of Track-Truth Association strategies on the performance metrics. The case study results conclusively show that the selection of the Track-Truth Association strategy should be done with reference to the scenario characteristics, the "mission" goals and the performance metrics to be evaluated.
We present results with large-scale neuroscience-inspired models for feature detection using multi-spectral visible/infrared satellite imagery. We describe a model using an artificial neural network architecture and l...
详细信息
ISBN:
(纸本)9780819486387
We present results with large-scale neuroscience-inspired models for feature detection using multi-spectral visible/infrared satellite imagery. We describe a model using an artificial neural network architecture and learning rules to build sparse scene representations over an adaptive dictionary, fusing spectral and spatial textural characteristics of the objects of interest. Our results with fast codes implemented on clusters of graphical processor units (GPUs) suggest that visual cortex models are a promising approach to practical pattern recognition problems in remote sensing, even for datasets using spectral bands not found in natural visual systems.
In this paper, a new family of approaches to fuse inconsistent knowledge sources is introduced in a standard logical setting. They combine two preference criteria to arbitrate between conflicting information: the mini...
详细信息
ISBN:
(纸本)0819462985
In this paper, a new family of approaches to fuse inconsistent knowledge sources is introduced in a standard logical setting. They combine two preference criteria to arbitrate between conflicting information: the minimization of falsified formulas and the minimization of the number of the different atoms that are involved in those formulas. Although these criteria exhibit a syntactical flavor, the approaches are semantically-defined.
We present a novel and innovative informationfusion and visualization framework for multi-source intelligence (multiINT) data using Spatial Voting (SV) and Data Modeling. We describe how different sources of informat...
详细信息
ISBN:
(纸本)9780819495471
We present a novel and innovative informationfusion and visualization framework for multi-source intelligence (multiINT) data using Spatial Voting (SV) and Data Modeling. We describe how different sources of information can be converted into numerical form for further processing downstream, followed by a short description of how this information can be fused using the SV grid. As an illustrative example, we show the modeling of cyberspace as cyber layers for the purpose of tracking cyber personas. Finally we describe a path ahead for creating interactive agile networks through defender customized Cyber-cubes for network configuration and attack visualization.
暂无评论