00000nam 2200000zi 4500 9.879895 CaOODSP 20240220154250 m o d f cr cn||||||||| 190930t20142014nsca ob f000 0 eng d CaOODSP eng rda CaOODSP eng eng fre D68-6/211-2014E-PDF Schaub, D. E., author. In-memory analysis of maritime data sets : a database system for efficiently processing very large data sets in maritime domain awareness and operational research / D.E. Schaub. Database system for efficiently processing very large data sets in maritime domain awareness and operational research Dartmouth NS : Defence Research and Development Canada - Atlantic, 2014. ©2014 1 online resource (viii, 24 pages, 2 unnumbered pages) : colour illustrations. text txt rdacontent computer c rdamedia online resource cr rdacarrier Technical memorandum ; DRDC Atlantic TM 2013-211 "April 2014." Includes bibliographical references (page 23). "The present work develops an in-memory database system that enables efficient statistical calculations on extremely large sets of maritime data. The conventional approach of interspersing calculations with queries to relational databases incurs significant latencies when data retrieval patterns induce inefficient hard-disk operations. Mitigation through re-ordering data access is often feasible but at the expense of significant additional development involving practices in advanced computer programming. As random access of computer memory is several orders of magnitude faster than secondary storage access, it is highly desirable—when possible—to store databases exclusively in memory. Through bit-shifting, dynamic dictionary compression, and domain-specific data reduction techniques, the present work demonstrates a functional data storage and processing system capable of storing the entire Global Positional Warehouse in the memory of a personal computer. Data are made available to the user through a simple application programming interface that allows rapid development of efficient, large-scale statistical analysis programs"--Abstract, page i. Includes abstracts and summaries in English and French. gccst Navigation gccst Data processing gccst Databases Defence R&D Canada. Defence R&D Canada - Atlantic. Technical memorandum (Defence R&D Canada) DRDC Atlantic TM 2013-211. (CaOODSP)9.820564 PDF 629 KB https://publications.gc.ca/collections/collection_2019/rddc-drdc/D68-6-211-2014-eng.pdf