data engineering – Page 6 – Andrew Fairless, Ph.D.

What I Read: data catalogs, metadata

By Andrew Fairless on November 28, 2022October 20, 2022

https://towardsdatascience.com/forrester-changed-the-way-they-think-about-data-catalogs-and-heres-what-you-need-to-know-139e13a5869d?gi=7192c997040d Forrester changed the way they think about data catalogs, and here’s what you need to knowThe latest sign of a major shift in how we think about metadataPrukalpaOct 4Continue readingWhat I Read: data catalogs, metadata

What I Read: ML Engineering

By Andrew Fairless on November 1, 2022September 26, 2022

https://www.shreya-shankar.com/phd-year-one/ Thoughts on ML Engineering After a Year of my PhDJuly 18, 2022Shreya Shankar “There are two types of business-critical MLEs. The first is the Task MLE…”

What I Read: deliberately create data

By Andrew Fairless on October 31, 2022September 9, 2022

https://datacreation.substack.com/p/organizations-need-to-deliberately Organizations need to deliberately create dataWhy we need to stop thinking of data as oilYali SassoonSep 5 “Organizations can and should deliberately create data to power machine learning… theyContinue readingWhat I Read: deliberately create data

What I Read: streaming for data scientists

By Andrew Fairless on September 21, 2022August 22, 2022

https://huyenchip.com//2022/08/03/stream-processing-for-data-scientists.html Introduction to streaming for data scientistsChip HuyenAug 3, 2022 “In our recent survey, almost half of the data scientists we asked said they would like to move from batchContinue readingWhat I Read: streaming for data scientists

What I Read: Is Data Scientist Still the Sexiest Job?

By Andrew Fairless on September 5, 2022August 3, 2022

https://hbr.org/2022/07/is-data-scientist-still-the-sexiest-job-of-the-21st-century Is Data Scientist Still the Sexiest Job of the 21st Century?Thomas H. Davenport and DJ PatilJuly 15, 2022 “Ten years ago we published the article “Data Scientist: Sexiest JobContinue readingWhat I Read: Is Data Scientist Still the Sexiest Job?

What I Read: Pandas Anti-Patterns

By Andrew Fairless on August 17, 2022July 18, 2022

https://www.aidancooper.co.uk/pandas-anti-patterns/ 4 Pandas Anti-Patterns to Avoid and How to Fix ThemAidan Cooper “This post highlights four common pandas anti-patterns and outlines a complementary set of techniques that you should useContinue readingWhat I Read: Pandas Anti-Patterns

What I Read: Hidden Technical Debts

By Andrew Fairless on August 15, 2022July 18, 2022

https://www.kdnuggets.com/2022/07/hidden-technical-debts-every-ai-practitioner-aware.html Hidden Technical Debts Every AI Practitioner Should be Aware ofVidhi ChughJuly 7, 2022 “…technical debt is the long-term costs incurred by moving quickly in software engineering…. A large partContinue readingWhat I Read: Hidden Technical Debts

What I Read: State of Data Engineering 2022

By Andrew Fairless on August 3, 2022June 27, 2022

https://www.rudderstack.com/blog/the-state-of-data-engineering-in-2022/ The State of Data Engineering in 2022Eric DoddsJanuary 05, 2022 “In this post, we wanted to share our thoughts on the data industry in 2022…”

What I Read: data replication in production

By Andrew Fairless on July 25, 2022June 27, 2022

https://medium.com/shippeo-tech-blog/debezium-to-snowflake-lessons-learned-building-data-replication-in-production-a5430a9fe85b Debezium to Snowflake: Lessons learned building data replication in productionOmar GhalawinjiJun 1 “We use Debezium, an excellent open-source tool to perform log-based Change Data Capture; which is the processContinue readingWhat I Read: data replication in production

What I Read: Death of Data Modeling

By Andrew Fairless on July 18, 2022June 27, 2022

https://dataproducts.substack.com/p/the-death-of-data-modeling-pt-1?s=r The Death of Data Modeling – Pt. 1And why it must be resurrected in the Modern Data StackChad Sanderson “The Death of Data Modeling and why it must beContinue readingWhat I Read: Death of Data Modeling

Tag: data engineering