44
edits
Changes
Jump to navigation
Jump to search
mLine 5:
Line 5: − + − − Statisticians use the concept of _P Value_ to discuss the how often a result might appear to be significant even when it’s not. While this crude measure doesn’t describe all the ways something might happen due to chance, generally the lower the P Value, the better. Professional scientists, especially those who understand statistics, will get touchy if you claim a result based purely on P Values, but for Personal Science purposes, it’s a good start. There is no “correct” cutoff value that can determine the likelihood that something is due to chance alone, but traditionally people assume that anything under 0.05 deserves a closer look. − + − − Line 25:
Line 21: − +
Is it chance? Use a T-Test to identify how likely an intervention worked (edit)
Revision as of 22:18, 24 February 2022
, 22:18, 24 February 2022formatting and images
== Solution ==
== Solution ==
One of the simplest tests is a “T-Test”, sometimes called a “Student T Test”.
One of the simplest tests is a '''T-Test''', sometimes called a “Student T Test”.
Statisticians use the concept of ''P Value'' to discuss the how often a result might appear to be significant even when it’s not. While this crude measure doesn’t describe all the ways something might happen due to chance, generally the lower the P Value, the better. Professional scientists, especially those who understand statistics, will get touchy if you claim a result based purely on P Values, but for Personal Science purposes, it’s a good start. There is no “correct” cutoff value that can determine the likelihood that something is due to chance alone, but traditionally people assume that anything under 0.05 deserves a closer look.
Here’s an example for how to do this in Excel.
Here’s an example for how to do this in Excel.
Suppose you’d like to know if taking a melotonin supplement will help you sleep longer. You’ve measured your daily sleep, taking the supplements on some days (the “intervention”) and not on others (“control”).
Suppose you’d like to know if taking a melotonin supplement will help you sleep longer. You’ve measured your daily sleep, taking the supplements on some days (the “intervention”) and not on others (“control”).
Track your sleep under two columns: one for nights when you took the supplement, and the other for nights you didn’t.
Track your sleep under two columns: one for nights when you took the supplement, and the other for nights you didn’t.
The built-in Excel statistical function `T.TEST` will calculate the P-Value when you give it two ranges, the “intervention” (nights we took melotonin) and the “control” (nights without).
The built-in Excel statistical function <code>T.TEST</code> will calculate the P-Value when you give it two ranges, the “intervention” (nights we took melotonin) and the “control” (nights without).
See the screenshot for the exact formula in this case:
See the screenshot for the exact formula in this case: