SCIMITAR: Scalable stream-processing for sensor information brokering

Kurt Rohloff, Jeffrey Cleveland, Joseph Loyall, Timothy Blocher

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Current sensor collection capabilities produce an incredible amount of data that needs to be processed, analyzed, and distributed in a timely and efficient manner. Information Management (IM) services supporting a publish-subscribe and query paradigm can be a powerful general purpose approach to enabling this information exchange between decoupled and dynamic information producers and consumers. These IM services will only be of value, however, if they can support operations in a manner that is responsive to the sheer quantity and frequency of data produced by surveillance platforms. Cloud computing is the technology of choice for providing the resources and services needed to enable and mange large-scale distributed computation. To date, there has been little work to develop highly scalable, dynamic IM processing and dissemination services in a cloud computing environment. In this paper we discuss our design, implementation and evaluation of a prototype cloud-based information broker which is a critical component of a highly scalable, distributed IM System. The brokering prototype is designed using a distributed stream processing framework and is shown to scale nearly linearly with the number of computing nodes as information load and subscription quantity increases.

Original languageEnglish (US)
Title of host publicationProceedings - 2013 IEEE Military Communications Conference, MILCOM 2013
Pages1856-1861
Number of pages6
DOIs
StatePublished - 2013
Externally publishedYes
Event2013 IEEE Military Communications Conference, MILCOM 2013 - San Diego, CA, United States
Duration: Nov 18 2013Nov 20 2013

Publication series

NameProceedings - IEEE Military Communications Conference MILCOM

Other

Other2013 IEEE Military Communications Conference, MILCOM 2013
CountryUnited States
CitySan Diego, CA
Period11/18/1311/20/13

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering

Keywords

  • Cloud computing
  • Information brokering
  • Publish-subscribe
  • Sensor
  • Stream computing

Fingerprint Dive into the research topics of 'SCIMITAR: Scalable stream-processing for sensor information brokering'. Together they form a unique fingerprint.

Cite this