In-memory analysis of maritime data sets : a database system for efficiently processing very large data sets in maritime domain awareness and operational research / D.E. Schaub. : D68-6/211-2014E-PDF

"The present work develops an in-memory database system that enables efficient statistical calculations on extremely large sets of maritime data. The conventional approach of interspersing calculations with queries to relational databases incurs significant latencies when data retrieval patterns induce inefficient hard-disk operations. Mitigation through re-ordering data access is often feasible but at the expense of significant additional development involving practices in advanced computer programming. As random access of computer memory is several orders of magnitude faster than secondary storage access, it is highly desirable—when possible—to store databases exclusively in memory. Through bit-shifting, dynamic dictionary compression, and domain-specific data reduction techniques, the present work demonstrates a functional data storage and processing system capable of storing the entire Global Positional Warehouse in the memory of a personal computer. Data are made available to the user through a simple application programming interface that allows rapid development of efficient, large-scale statistical analysis programs"--Abstract, page i.

Lien permanent pour cette publication :
publications.gc.ca/pub?id=9.879895&sl=1

• Format MARC XML
• Format MARC HTML

Demander des formats alternatifs