Video Compression for Ocean Simulation Image Databases
Jul 12, 2017·
,,,,·
0 min read
Andreas Berres
Terece L. Turton
Mark Petersen
David H. Rogers
James P. Ahrens
Progression of video compression results for kinetic energy. From left to right: original quality, encoding only, completely usable (CRF=30), marginally acceptable (CRF=34), and maximal compression (CRF=51). Encoding alone and CRF=30 are nearly indistinguishable from the original, CRF=34 is more noticeable, and maximal compression washes out most features.Abstract
Climate research requires monitoring a large range of spatial and temporal scales to understand the climate system and potential future impacts. Climate simulations are now run with very high resolution (1–10 km gridcells) ocean, sea ice, and atmosphere components, and can easily produce petabytes of output. This overloads storage systems and hinders visualization and analysis. Image databases can decrease storage sizes from petabytes of simulation output down to several hundred gigabytes of images.\n
In this paper, we introduce video compression as a method to further decrease database sizes by 2–4 orders of magnitude. We compare compression and access speeds, compressed sizes, and compression quality over a range of settings. Quality is assessed through image quality metrics and expert feedback. Overall, we were able to show that video compression techniques provide an efficient means of storing image databases at a shareable size, while preserving image quality. This enables the wise use of available disk space, so scientists can more easily study the physical features of interest.
Type
Publication
In EnvirVis ‘17: Proceedings of the Workshop on Visualisation in Environmental Sciences