Skip to content

Andrew Fairless, Ph.D.

Data, Science, and Tinkering

Overview
Experience and Education
Publications
SHAP Tutorial
Understanding the Basics of Bayesian Linear Regression
Classifying Medicine
The Peanuts Project

Search for:

Search for:

What I Read: Data Pipeline Smoke Tests

Home/What I Learn/What I Read: Data Pipeline Smoke Tests

By BylineAndrew Fairless on January 4, 2023November 5, 2022

https://dagster.io/blog/smoke-test-data-pipeline

The Unreasonable Effectiveness of Data Pipeline Smoke Tests
Sandy Ryza
October 19, 2022

“Data practitioners waste time writing unit tests to catch bugs they could have caught with smoke tests.”

Cat Links What I Learn Tag Links data engineering database pipeline SQL testing unit test

Post navigation

What I Read: Russian RoulettePrev post

What I Read: Poisson Flow Generative ModelsNext post

Categories

Bayesian statistics Machine Learning Statistics What I Learn What I Make

Tags

artificial intelligence attention Bayesian chatbot cognition computer vision database data engineering data science deployment DevOps economics efficiency embedding generalization generative GPU graph healthcare image interpretability large language model latency linear algebra machine learning medicine MLOps monitoring natural language processing neural network neuroscience optimization pipeline probability Python recurrent reinforcement learning reproducibility scalability software engineering SQL statistics training transformer unit test

Copyright © 2024 Andrew Fairless, Ph.D.. All Rights Reserved. | Simple Persona by Catch Themes

Scroll Up