https://imbue.com/research/70b-infrastructure From bare metal to a 70B model: infrastructure set-up and scriptsThe Imbue TeamJune 25, 2024 “…we trained a 70B parameter model from scratch on our own infrastructure that outperformed
What I Read: New Chip, AI
https://www.quantamagazine.org/a-brain-inspired-chip-can-run-ai-with-far-less-energy-20221110/ New Chip Expands the Possibilities for AIAllison WhittenContributing WriterNovember 10, 2022 “An energy-efficient chip called NeuRRAM fixes an old design flaw to run large-scale AI algorithms on smaller devices,