Data Compression Lab

Check the repository and documents from the Data Compression Lab

Documentation Online Laboratory Compression Lab Notebooks

Try out Data Compression for Weather & Climate

Lossy compression of weather and climate data carries risks. Exploring these risks yourself, exploring how different lossy compressors distort your data, and verifying how compression safeguards can make lossy compression safe are crucial for building an understanding of and trust in compression. The Online Laboratory for Data Compression in Climate Science and Meteorology provides several Jupyter notebooks that explore data compression and invite you to try out different compression methods with your own data to see their results for yourself.

The rational
Typically, trying out a new compressor requires arduous setup, including installation. With the Online Laboratory for Data Compression in Climate Science and Meteorology, trying out different compressors on your own data is just one click away and requires no setup. Within less than one minute, the Online Laboratory provides a Jupyter Lab environment that runs entirely in your web browser and comes with compression utilities and example Jupyter notebooks pre-installed.
Key features
Example datasets for compression, load your own GRIB / NetCDF / Zarr data, a wide range of scientific compressors, visualisation with earthkit-plots, and several examples to walk you through the typical compression workflow and compare different compressors
Models and platforms support
The compression laboratory notebooks can be run locally in your own Python environment, or in the Online Laboratory. The Online Laboratory can be accessed with any modern web browser, though compression is currently not supported for Safari - use Firefox or Chrome instead.