data engineering – Page 8 – Andrew Fairless, Ph.D.

What I Read: AntiPatterns, MLOps

By Andrew Fairless on January 4, 2022December 11, 2021

https://arxiv.org/abs/2107.00079 Using AntiPatterns to avoid MLOps MistakesNikhil Muralidhar, Sathappah Muthiah, Patrick Butler, Manish Jain, Yu Yu, Katy Burne, Weipeng Li, David Jones, Prakash Arunachalam, Hays ‘Skip’ McCormick, Naren Ramakrishnan “HereContinue readingWhat I Read: AntiPatterns, MLOps

What I Read: Lessons on ML Platforms

By Andrew Fairless on December 20, 2021November 16, 2021

https://towardsdatascience.com/lessons-on-ml-platforms-from-netflix-doordash-spotify-and-more-f455400115c7 Lessons on ML Platforms — from Netflix, DoorDash, Spotify, and moreErnest ChanMay 12 “Many companies who do ML well have invested in ML platforms to enable data scientists toContinue readingWhat I Read: Lessons on ML Platforms

What I Read: Is the data engineer still the “worst seat at the table?”

By Andrew Fairless on November 22, 2021November 16, 2021

https://towardsdatascience.com/the-future-of-the-data-engineer-4dcfa53800ab?gi=f71612388916 The Future of the Data EngineerIs the data engineer still the “worst seat at the table?” Thoughts on the past, present, and future of tooling, processes, and culture inContinue readingWhat I Read: Is the data engineer still the “worst seat at the table?”

What I Read: Data Orchestration w/ Nick Schrock (Elementl)

By Andrew Fairless on November 10, 2021October 24, 2021

https://youtu.be/jRrx8Vvjae0 DC_THURS on Data Orchestration w/ Nick Schrock (Elementl)Streamed live on Jun 24, 2021Data Council“Nick is the founder of Elementl and the original author of the dagster data orchestration project.Continue readingWhat I Read: Data Orchestration w/ Nick Schrock (Elementl)

What I Watch: Streaming Data Systems w/ Eric Sammer (Decodable)

By Andrew Fairless on October 27, 2021October 24, 2021

https://youtu.be/ZGGLtqwJOAw DC_THURS on Streaming Data Systems w/ Eric Sammer (Decodable)Streamed live on Sep 30, 2021Data Council “Eric is an OG data engineer and one of most knowledgeable people on theContinue readingWhat I Watch: Streaming Data Systems w/ Eric Sammer (Decodable)

What I Read: The dysfunctions of Data Engineering

By Andrew Fairless on September 9, 2021August 20, 2021

https://medium.com/@mrtrustworthy/from-data-driven-to-driving-data-the-dysfunctions-of-data-engineering-34c34496ed8e From Data Driven to Driving Data— The dysfunctions of Data EngineeringMrTrustworthyJul 27 “Being Data Driven isn’t enough…. We need Data Engineering… as a methodical approach at re-designing how aContinue readingWhat I Read: The dysfunctions of Data Engineering

What I Read: Machine Learning, Rendezvous Architecture

By Andrew Fairless on September 8, 2021August 17, 2021

https://www.saigeetha.in/post/machine-learning-rendezvous-architecture Machine Learning – Rendezvous ArchitectureSai Geetha M N “The Rendezvous architecture proposed by Ted Dunning and Ellen Friedman in their book on Machine Learning Logistics was a wonderful solutionContinue readingWhat I Read: Machine Learning, Rendezvous Architecture

What I Read: Against SQL

By Andrew Fairless on September 1, 2021August 17, 2021

https://scattered-thoughts.net/writing/against-sql/ Against SQLJamie BrandonLast updated 2021-07-09 “The core message that I want people to take away is that there is potentially a huge amount of value to be unlocked byContinue readingWhat I Read: Against SQL

Tag: data engineering