https://imbue.com/research/70b-infrastructure From bare metal to a 70B model: infrastructure set-up and scriptsThe Imbue TeamJune 25, 2024 “…we trained a 70B parameter model from scratch on our own infrastructure that outperformed
What I Read: Researchers Build AI That Builds AI
https://www.quantamagazine.org/researchers-build-ai-that-builds-ai-20220125/ Researchers Build AI That Builds AIAnil AnanthaswamyJanuary 25, 2022“By using hypernetworks, researchers can now preemptively fine-tune artificial neural networks, saving some of the time and expense of training.”
What I Read: Difficulty of Graph Anonymisation
https://www.timlrx.com/blog/tracetogether-and-the-difficulty-of-graph-anonymisation Timothy Lin@timlrxxSunday, February 7, 2021TraceTogether and the Difficulty of Graph Anonymisation “The word “anonymised data” seems to convey a certain sense of certainty that user information cannot be back-derived.
What I Read: Switchback Tests and Randomized Experimentation Under Network Effects
https://medium.com/@DoorDash/switchback-tests-and-randomized-experimentation-under-network-effects-at-doordash-f1d938ab7c2a Switchback Tests and Randomized Experimentation Under Network Effects at DoorDashDoorDashFeb 14, 2018·12 min readDavid Kastelman, Data Scientist & Raghav Ramesh,Machine Learning Engineer “…given the systemic nature of many of