data engineering – Page 9 – Andrew Fairless, Ph.D.

What I Read: The one data platform to rule them all

By Andrew Fairless on August 26, 2021August 17, 2021

https://leighmariebraswell.substack.com/p/the-one-data-platform-to-rule-them The one data platform to rule them all… but according to whom?An overview of recent data startups based on popular end usersLeigh Marie BraswellJul 20 “…seeing so many “dataContinue readingWhat I Read: The one data platform to rule them all

What I Read: Building Data Platform

By Andrew Fairless on August 12, 2021July 22, 2021

https://www.montecarlodata.com/the-quick-and-dirty-guide-to-building-your-data-platform/ Updated July 9, 2021The Quick and Dirty Guide to Building Your Data PlatformBarr Moses, Lior Gavish“For most organizations, building a data platform is no longer a nice-to-have but aContinue readingWhat I Read: Building Data Platform

What I Read: Dask vs Vaex

By Andrew Fairless on July 12, 2021June 22, 2021

https://vaex.io/blog/dask-vs-vaex-a-qualitative-comparison Dask vs Vaex – a qualitative comparisonJovan VeljanoskiJune 15, 2021 “Vaex is flat out the fastest and most memory efficient Python DataFrame library out there…. There are still plentyContinue readingWhat I Read: Dask vs Vaex

What I Read: What is a Data Mesh?

By Andrew Fairless on July 6, 2021June 22, 2021

https://cnr.sh/essays/what-the-heck-data-mesh What the Heck is a Data Mesh?!Chris Riccomini on June 8, 2021 “Yet, organizations don’t think of data as a product…. It would be madness to propose centralizing allContinue readingWhat I Read: What is a Data Mesh?

What I Read: Hiring Data Scientists

By Andrew Fairless on June 21, 2021June 7, 2021

https://towardsdatascience.com/stop-hiring-data-scientists-improve-ml-product-team-retention-8ae04dac406e?gi=175fec4d5962 Stop (and Start) Hiring Data ScientistsThree “stop & start” tactics to improve talent retentionIan XiaoMay 14 “… we’ve been overly spotlighting the algorithmic work and success of data scienceContinue readingWhat I Read: Hiring Data Scientists

What I Read: Feature stores

By Andrew Fairless on May 31, 2021May 14, 2021

https://www.kdnuggets.com/2021/05/feature-stores-how-avoid-feeling-every-day-is-groundhog-day.html Feature stores – how to avoid feeling that every day is Groundhog DayBy Monte Zweben, CEO, Splice Machine. “Feature stores stop the duplication of each task in the MLContinue readingWhat I Read: Feature stores

What I Read: Models of Data Science teams

By Andrew Fairless on May 11, 2021April 17, 2021

https://www.marcosantoni.com/chess_vs_checkers_teams.html Marco SantoniModels of Data Science teams: Chess vs Checkers “One of the key decisions to take when building a data science team is the mix of roles…. I’ll compareContinue readingWhat I Read: Models of Data Science teams

What I Read: Understanding Key-Value Databases

By Andrew Fairless on April 29, 2021April 10, 2021

https://www.kdnuggets.com/2021/04/nosql-explained-understanding-key-value-databases.html NoSQL Explained: Understanding Key-Value DatabasesBy Alex Williams, Hosting Data UK “Among the four big NoSQL database types, key-value stores are probably the most popular ones due to their simplicityContinue readingWhat I Read: Understanding Key-Value Databases

What I Read: Common Errors when Debugging Airflow DAGs

By Andrew Fairless on April 14, 2021April 2, 2021

https://www.astronomer.io/blog/7-common-errors-to-check-when-debugging-airflow-dag 7 Common Errors to Check when Debugging Airflow DAGsTasks not running? DAG stuck? Logs nowhere to be found? We’ve been there. Here’s a list of common snags and someContinue readingWhat I Read: Common Errors when Debugging Airflow DAGs

What I Read: Kedro Pipelines with Airflow

By Andrew Fairless on March 30, 2021March 15, 2021

https://medium.com/quantumblack/kedro-airflow-0-4-0-orchestrating-kedro-pipelines-with-airflow-23fb1283f24d Kedro-Airflow 0.4.0 — Orchestrating Kedro Pipelines with AirflowThe Kedro team and Astronomer have released Kedro-Airflow 0.4.0 to help you develop modular, maintainable & reproducible code with orchestration superpowers!QuantumBlack, aContinue readingWhat I Read: Kedro Pipelines with Airflow

Tag: data engineering