latency – Page 2 – Andrew Fairless, Ph.D.

What I Read: misleading GPU, CPU benchmarks

By Andrew Fairless on March 21, 2024February 5, 2024

https://pythonspeed.com/articles/gpu-vs-cpu/ Beware of misleading GPU vs CPU benchmarksItamar Turner-TrauringLast updated 17 Jan 2024, originally created 17 Jan 2024 “Unfortunately, while those speed-ups are impressive, they are also misleading. GPU-based librariesContinue readingWhat I Read: misleading GPU, CPU benchmarks

What I Read: vectorize wide PyTorch expressions

By Andrew Fairless on January 16, 2024November 7, 2023

https://probablymarcus.com/blocks/2023/10/19/vectorizing-wide-pytorch-expressions.html What happens when you vectorize wide PyTorch expressions?Marcus Lewis19 October 2023 “So we see that vectorization has three effects:It lets us keep the GPU busy even when inputs areContinue readingWhat I Read: vectorize wide PyTorch expressions

What I Read: Compiling NumPy

By Andrew Fairless on January 10, 2024November 7, 2023

https://pytorch.org/blog/compiling-numpy-code/ Compiling NumPy code into C++ or CUDA via torch.compileby Evgeni Burovski, Ralf Gommers and Mario LezcanoOctober 17, 2023 “This feature leverages PyTorch’s compiler to generate efficient fused vectorized codeContinue readingWhat I Read: Compiling NumPy

What I Read: Nvidia AI Supremacy Temporary

By Andrew Fairless on October 25, 2023October 5, 2023

https://petewarden.com/2023/09/10/why-nvidias-ai-supremacy-is-only-temporary/ Why Nvidia’s AI Supremacy is Only TemporarySeptember 10, 2023Pete Warden “…hopefully I’ve made a convincing case that there are strong structural reasons behind Nvidia’s success. Here’s how I seeContinue readingWhat I Read: Nvidia AI Supremacy Temporary

What I Read: speed up Python with Rust

By Andrew Fairless on August 24, 2023July 30, 2023

https://pythonspeed.com/articles/easiest-rust-python/ The easiest way to speed up Python with RustItamar Turner-Trauring7/9/23 8:00 PM “If you want to speed up some existing Python code, writing a compiled extension in Rust canContinue readingWhat I Read: speed up Python with Rust

What I Read: speed up Numba and NumPy

By Andrew Fairless on August 1, 2023June 15, 2023

https://pythonspeed.com/articles/speeding-up-numba/ Understanding CPUs can help speed up Numba and NumPy codeby Itamar Turner-TrauringLast updated 08 Jun 2023, originally created 07 Jun 2023 “In practice, your initial Numba code may beContinue readingWhat I Read: speed up Numba and NumPy

What I Read: smaller LLMs, more tokens

By Andrew Fairless on May 31, 2023May 1, 2023

https://www.harmdevries.com/post/model-size-vs-compute-overhead/ Go smol or go homeWhy we should train smaller LLMs on more tokensHarm de VriesApr 13, 2023 “However, for most use cases you should not train a compute-optimal LLMContinue readingWhat I Read: smaller LLMs, more tokens

What I Read: Bloom filter

By Andrew Fairless on April 26, 2023March 30, 2023

https://luminousmen.com/post/building-a-bloom-filter Building a Bloom filterluminousmen “In this post, we will explore the Bloom filter — a data structure that is ingenious in its simplicity and elegant in its design.”

What I Read: Feature Platforms

By Andrew Fairless on March 14, 2023February 4, 2023

https://huyenchip.com//2023/01/08/self-serve-feature-platforms.html Self-serve feature platforms: architectures and APIsChip HuyenJan 8, 2023 “The last few years saw the maturation of a core component of the MLOps stack that has significantly improved theContinue readingWhat I Read: Feature Platforms

What I Read: Key-Value Databases

By Andrew Fairless on December 5, 2022October 20, 2022

https://www.kdnuggets.com/2021/04/nosql-explained-understanding-key-value-databases.html Key-Value Databases, ExplainedBy Alex Williams, Hosting Data UK on October 4, 2022 in SQL “Among the four big NoSQL database types, key-value stores are probably the most popular onesContinue readingWhat I Read: Key-Value Databases

Tag: latency