https://earthmover.io/blog/cloud-native-dataloader
Cloud native data loaders for machine learning using Zarr and Xarray
Joe Hamman
March 14, 2024
“…how to efficiently train machine learning models where the inputs are multiple multi-dimensional arrays (a.k.a. tensors) stored in cloud storage. By efficiently, we mean that we’ll be optimizing for hardware utilization (e.g. GPU)…”