End-to-end examples

The following examples demonstrate the use of VirtualiZarr to create virtual datasets of various kinds.

V2 Examples

These examples use the VirtualiZarr 2.x API with obstore for cloud storage access:

1. Virtualizing GOES-16 satellite data (basic) - Virtualizes a GOES-16 file using a standard obstore. Use as a baseline for performance comparison.
2. Virtualizing GOES-16 satellite data with optimized store wrappers - Demonstrates using CachingReadableStore and SplittingReadableStore from obspec-utils to optimize metadata access when virtualizing remote HDF5/NetCDF files.

GOES-16 archive notebooks

This notebook accompanies the Old format, no problem!: Cloud-optimizing the GOES-16 archive as Virtual Zarr blog post, which virtualizes NOAA's entire 7-year GOES-16 archive into a single virtual Zarr datacube:

1. Ingesting the GOES-16 archive - End-to-end notebook building the virtual store from the netCDF archive.

V1 Examples

Note

The V1 examples listed here use a pre-2.0 release of VirtualiZarr.

1. Appending new daily NOAA SST data to Icechunk
2. Parallel reference generation using Coiled Functions
3. Serverless parallel reference generation using Lithops
4. MUR SST Virtual and Zarr Icechunk Store Generation using Lithops