https://codeconfessions.substack.com/p/gpu-computing What Every Developer Should Know About GPU ComputingAbhinav UpadhyayOct 18, 2023 “GPUs have become incredibly important because of their pervasive use in deep learning. Today, it is essential for
What I Read: Distributed Training, Finetuning
https://sumanthrh.com/post/distributed-and-efficient-finetuning/ Everything about Distributed Training and Efficient FinetuningSumanth R HegdeLast updated on Oct 13, 2023 “practical guidelines and gotchas with multi-GPU and multi-node training”
What I Read: AI’s $200B Question
Follow the GPUs Perspective AI’s $200B QuestionBy David CahnPublished September 20, 2023 “GPU capacity is getting overbuilt. Long-term, this is good. Short-term, things could get messy.”