Framework for Large Streaming Data Analysis

Existing DoD Command and Control and Intelligence, Surveillance, and Reconnaissance (ISR) systems are proving inadequate to handle the proliferation of sensors and the corresponding increase in data. To address this shortfall, Sonalysts will design a reliable, scalable, modular, and pluggable middleware framework for managing large quantities of streaming data. We will use our knowledge and experience with data ingest, data analysis, and data distribution, our relationships with commercial broadcasters, and our extensive software tool kits to define a systems architecture design and engineering plan for a Robust Analysis and Processing of Large ISR Data Streams (RAPID) system. This solution will draw upon our research-grade Heuristic Intelligent Storage System (HISS), a pluggable and distributed, cross-disciplinary, intelligent, large stream data ingest, data mining, and storage system that is highly portable and configurable for a number of applications and domains that need to ingest and manage large data streams. Based upon a Service Oriented Architecture (SOA) and the"blackboard"paradigm, the proposed system will support highly complex workflows and large numbers of streaming data sources while conforming to established standards used by the DoD and the software industry.