In-memory analysis of maritime data sets : a database system for efficiently processing very large data sets in maritime domain awareness and operational research / D.E. Schaub.: D68-6/211-2014E-PDF

"The present work develops an in-memory database system that enables efficient statistical calculations on extremely large sets of maritime data. The conventional approach of interspersing calculations with queries to relational databases incurs significant latencies when data retrieval patterns induce inefficient hard-disk operations. Mitigation through re-ordering data access is often feasible but at the expense of significant additional development involving practices in advanced computer programming. As random access of computer memory is several orders of magnitude faster than secondary storage access, it is highly desirable—when possible—to store databases exclusively in memory. Through bit-shifting, dynamic dictionary compression, and domain-specific data reduction techniques, the present work demonstrates a functional data storage and processing system capable of storing the entire Global Positional Warehouse in the memory of a personal computer. Data are made available to the user through a simple application programming interface that allows rapid development of efficient, large-scale statistical analysis programs"--Abstract, page i.

Permanent link to this Catalogue record:
publications.gc.ca/pub?id=9.879895&sl=0

Publication information
Department/Agency Canada. Defence R&D Canada.
Canada. Defence R&D Canada - Atlantic.
Title In-memory analysis of maritime data sets : a database system for efficiently processing very large data sets in maritime domain awareness and operational research / D.E. Schaub.
Variant title Database system for efficiently processing very large data sets in maritime domain awareness and operational research
Series title Technical memorandum ; DRDC Atlantic TM 2013-211
Publication type Series - View Master Record
Language [English]
Format Electronic
Electronic document
Note(s) "April 2014."
Includes bibliographical references (page 23).
Includes abstracts and summaries in English and French.
Publishing information Dartmouth NS : Defence Research and Development Canada - Atlantic, 2014.
©2014
Author / Contributor Schaub, D. E., author.
Description 1 online resource (viii, 24 pages, 2 unnumbered pages) : colour illustrations.
Catalogue number
  • D68-6/211-2014E-PDF
Subject terms Navigation
Data processing
Databases
Request alternate formats
To request an alternate format of a publication, complete the Government of Canada Publications email form. Use the form’s “question or comment” field to specify the requested publication.
Date modified: