data engineering – Page 4 – Andrew Fairless, Ph.D.

What I Read: Why Most Data Projects Fail

By Andrew Fairless on August 2, 2023June 15, 2023

Why Most Data Projects Fail & How to Avoid It • Jesse Anderson • GOTO 2023GOTO ConferencesJun 14, 2023 “This talk will explore the most common reasons data projects failContinue readingWhat I Read: Why Most Data Projects Fail

What I Read: Kubernetes, Batch

By Andrew Fairless on July 25, 2023June 15, 2023

https://betterprogramming.pub/kubernetes-was-never-designed-for-batch-jobs-f59be376a338 Kubernetes Was Never Designed for Batch JobsAnd what it would look like if it had beenMeadowrunSep 1, 2022 “…Kubernetes is philosophically biased towards microservices over batch jobs. This resultsContinue readingWhat I Read: Kubernetes, Batch

What I Read: MLOps, Data Engineering

By Andrew Fairless on May 18, 2023May 1, 2023

https://www.cpard.xyz/posts/mlops_is_mostly_data_engineering/ MLOps is Mostly Data Engineering.22 March 2023Kostas Pardalis “The question here is… why do we need a whole new category of products?… The true need here is developer toolingContinue readingWhat I Read: MLOps, Data Engineering

What I Read: databases

By Andrew Fairless on May 2, 2023March 30, 2023

https://www.thenile.dev/blog/things-dbs-dont-do Things DBs Don’t Do – But ShouldFebruary 6, 2023Gwen Shapira “Why do I still need to implement this in every project? why doesn’t the DB just take care ofContinue readingWhat I Read: databases

What I Read: Bloom filter

By Andrew Fairless on April 26, 2023March 30, 2023

https://luminousmen.com/post/building-a-bloom-filter Building a Bloom filterluminousmen “In this post, we will explore the Bloom filter — a data structure that is ingenious in its simplicity and elegant in its design.”

What I Read: Infrastructure

By Andrew Fairless on April 12, 2023March 30, 2023

https://www.kleinerperkins.com/perspectives/infrastructure-in-23/ Infrastructure in ’23Kleiner PerkinsWednesday, February 22nd 2023 “I set aside some time at the beginning of the year to share what I believe to be the most dynamic andContinue readingWhat I Read: Infrastructure

What I Read: Data Product vs. Service

By Andrew Fairless on April 5, 2023February 22, 2023

https://readtechnically.medium.com/data-as-a-product-vs-data-as-a-service-d9f7e622dc55 Data as a Product vs. Data as a ServiceJustin GageJul 14, 2019 “For hiring in particular, DaaP and DaaS require completely different plans and head counts. It’s extremely rareContinue readingWhat I Read: Data Product vs. Service

What I Read: SQL pipelines

By Andrew Fairless on March 27, 2023February 6, 2023

https://www.robinlinacre.com/recommend_sql/ SQL should be your default choice for data engineering pipelinesRobin Linacre2023-01-30 “SQL should be the first option considered for new data engineering work. It’s robust, fast, future-proof and testable.Continue readingWhat I Read: SQL pipelines

What I Read: Feature Platforms

By Andrew Fairless on March 14, 2023February 4, 2023

https://huyenchip.com//2023/01/08/self-serve-feature-platforms.html Self-serve feature platforms: architectures and APIsChip HuyenJan 8, 2023 “The last few years saw the maturation of a core component of the MLOps stack that has significantly improved theContinue readingWhat I Read: Feature Platforms

What I Read: Data Pipeline Design Patterns

By Andrew Fairless on March 8, 2023January 9, 2023

https://www.startdataengineering.com/post/design-patterns/ Data Pipeline Design Patterns – #1. Data flow patternsStart Data EngineeringDec 11, 2022 “This post will cover the typical data flow design patterns. We will learn about the prosContinue readingWhat I Read: Data Pipeline Design Patterns

Tag: data engineering