hypothesis testing – Andrew Fairless, Ph.D.

What I Read: decision analysis, significance testing

By Andrew Fairless on October 3, 2024July 14, 2024

https://statmodeling.stat.columbia.edu/2024/07/10/a-misunderstanding-about-decision-analysis-and-significance-testing (Trying to) clear up a misunderstanding about decision analysis and significance testingAndrew Gelman7/10/24 9:03 AM “…we’re just saying that screening based on statistical significance has lots of problems. P-valuesContinue readingWhat I Read: decision analysis, significance testing

What I Read: different meanings of p-value

By Andrew Fairless on June 7, 2023May 1, 2023

4 different meanings of p-value (and how my thinking has changed) 4 different meanings of p-value (and how my thinking has changed)Posted on April 14, 2023 9:14 AMAndrew Gelman “TheContinue readingWhat I Read: different meanings of p-value

What I Read: Concept Drift Without Labeled Data

By Andrew Fairless on September 26, 2022August 22, 2022

https://concept-drift.fastforwardlabs.com/ Inferring Concept Drift Without Labeled DataFF22Aug 2021 “…we explore broadly applicable approaches for dealing with concept drift when labeled data is not readily accessible. We’ll start by defining whatContinue readingWhat I Read: Concept Drift Without Labeled Data

What I Read: never speak of these values

By Andrew Fairless on April 19, 2022March 12, 2022

https://www.argmin.net/2022/02/23/standard-errors/ Let us never speak of these values again.Ben RechtFeb 23, 2022 “…I’ll explain in as plain terms as I can what statistical significance means in almost every published scientificContinue readingWhat I Read: never speak of these values

What I Read: Permutation Tests

By Andrew Fairless on January 19, 2022December 11, 2021

https://towardsdatascience.com/how-to-use-permutation-tests-bacc79f45749 A walkthrough of permutation tests and how they can be applied to time series data.Michael BerkSep 21 “In this post we will discuss the basics of permutation tests andContinue readingWhat I Read: Permutation Tests

What I Read: null hypothesis significance testing falls apart when considering replications

By Andrew Fairless on July 8, 2021June 22, 2021

https://statmodeling.stat.columbia.edu/2021/06/17/guttman-points-out-another-problem-with-null-hypothesis-significance-testing-it-falls-apart-when-considering-replications/ Guttman points out another problem with null hypothesis significance testing: It falls apart when considering replications.by Andrew Gelman17 June 2021, 9:22 am “… another problem with null hypothesis significanceContinue readingWhat I Read: null hypothesis significance testing falls apart when considering replications

What I Read: A winner’s curse adjustment

By Andrew Fairless on January 10, 2021December 23, 2020

http://www.erikdrysdale.com/winners_curse/ Erik DrysdalebioeconometRicianAbout Recent Posts ShinyApps CVA winner’s curse adjustment for a single test statistic “One consequence of using frequentist statistical tools to conduct scientific inference is that effect sizesContinue readingWhat I Read: A winner’s curse adjustment

Tag: hypothesis testing