https://earthmover.io/blog/cloud-native-dataloader Cloud native data loaders for machine learning using Zarr and XarrayJoe HammanMarch 14, 2024 “…how to efficiently train machine learning models where the inputs are multiple multi-dimensional arrays (a.k.a.
What I Read: Nvidia, GPU gold rush
https://blog.johnluttig.com/p/nvidia-envy-understanding-the-gpu Nvidia Envy: understanding the GPU gold rushJohn LuttigNov 10, 2023 “In 2023, thousands of companies and countries begged Nvidia to purchase more GPUs. Can the exponential demand endure?”
What I Read: Distributed Training, Finetuning
https://sumanthrh.com/post/distributed-and-efficient-finetuning/ Everything about Distributed Training and Efficient FinetuningSumanth R HegdeLast updated on Oct 13, 2023 “practical guidelines and gotchas with multi-GPU and multi-node training”
What I Read: AI’s $200B Question
Follow the GPUs Perspective AI’s $200B QuestionBy David CahnPublished September 20, 2023 “GPU capacity is getting overbuilt. Long-term, this is good. Short-term, things could get messy.”