distributed computing – Andrew Fairless, Ph.D.

What I Read: bare metal to 70B

By Andrew Fairless on September 25, 2024July 8, 2024

https://imbue.com/research/70b-infrastructure From bare metal to a 70B model: infrastructure set-up and scriptsThe Imbue TeamJune 25, 2024 “…we trained a 70B parameter model from scratch on our own infrastructure that outperformedContinue readingWhat I Read: bare metal to 70B

What I Read: Command-line Tools, Faster

By Andrew Fairless on September 10, 2024June 29, 2024

https://adamdrake.com/command-line-tools-can-be-235x-faster-than-your-hadoop-cluster.html Command-line Tools can be 235x Faster than your Hadoop ClusterAdam Drake “One especially under-used approach for data processing is using standard shell tools and commands. The benefits of thisContinue readingWhat I Read: Command-line Tools, Faster

What I Read: Scaling to Multi-Terabyte Datasets

By Andrew Fairless on September 9, 2024June 29, 2024

Lessons Learned from Scaling to Multi-Terabyte Datasets v2thegreat, AliLessons Learned from Scaling to Multi-Terabyte DatasetsJune 19, 2024 “This post is meant to guide you through some of the lessons I’ve learnedContinue readingWhat I Read: Scaling to Multi-Terabyte Datasets

What I Read: Dask vs Vaex

By Andrew Fairless on July 12, 2021June 22, 2021

https://vaex.io/blog/dask-vs-vaex-a-qualitative-comparison Dask vs Vaex – a qualitative comparisonJovan VeljanoskiJune 15, 2021 “Vaex is flat out the fastest and most memory efficient Python DataFrame library out there…. There are still plentyContinue readingWhat I Read: Dask vs Vaex

What I Watch: Why Distributed Systems Are Hard

By Andrew Fairless on March 20, 2021March 7, 2021

https://youtu.be/w9GP7MNbaRc Why Distributed Systems Are HardJul 15, 2020InfoQ “Denise Yu covers a brief history of distributed computing, presents a survey of key academic contributions to distributed systems theory… and digsContinue readingWhat I Watch: Why Distributed Systems Are Hard

Tag: distributed computing