|
|
| Line 1: |
Line 1: |
| {{Refimprove|date=October 2011}}
| | Hello buddy. Let me introduce myself. I am Luther Aubrey. I am a production and distribution officer. I've always cherished residing in Idaho. Playing crochet is some thing that I've done for many years.<br><br>Visit my site extended car warranty ([http://hs-s.com/dayz/home/index.php?mod=users&action=view&id=8983 visit the up coming document]) |
| In [[statistics|statistical]] [[hypothesis testing]], '''p-rep''' or ''p''<sub>rep</sub> has been proposed as a statistical [http://sciencewatch.com/dr/erf/2010/10octerf/10octerfKill/ alternative] to the classic [[p-value]]. <ref name="Killeen2005">{{cite journal |author=Killeen PR |title=An alternative to null-hypothesis significance tests |journal=Psychological science : a journal of the American Psychological Society / APS |volume=16 |issue=5 |pages=345–53 |year=2005 |pmid=15869691 |doi=10.1111/j.0956-7976.2005.01538.x |pmc=1473027}}</ref> Whereas a p-value is the probability of obtaining a result under the null hypothesis, p-rep computes the probability of replicating an effect. Whether it does so is heavily disputed – some have argued that the concept rests on a mathematical falsehood.
| |
| | |
| For a while, the [[Association for Psychological Science]] recommended that articles submitted to [[Psychological Science]] and their other journals report p-rep rather than the classic p-value,<ref>[http://web.archive.org/web/20060525043648/http://www.blackwellpublishing.com/submit.asp?ref=0956-7976 archived version of "Psychological Science Journal, Author Guidelines"]</ref> <!-- hiding dead link <ref>[http://wiki.brainimaging.waisman.wisc.edu/index.php/NHST references it; about p-rep, null hypothesis]</ref> --> but this is no longer the case.<ref>[http://www.wiley.com/bw/submit.asp?ref=0956-7976 Psychological Science Journal, Author Guidelines.]</ref>
| |
| | |
| == Calculation ==
| |
| | |
| [[Image:Prep log.png|thumb|310px|right|P-rep function (in log scale)]]
| |
| | |
| The value of the p-rep (''p''<sub>rep</sub>) can be approximated based on the p-value (''p'') as follows:
| |
| | |
| : <math>p_\text{rep} = \left[ 1 + \left( \frac{p}{1-p} \right)^{\frac{2}{3}} \right]^{-1}.</math>
| |
| | |
| == Criticism ==
| |
| The fact that the p-rep has a [[bijection|one-to-one correspondence]] with the p-value makes it clear that this new measure doesn't bring any additional information on the significance of the result of a given experiment. However, according to Killeen who acknowledges this latter point, the main advantage of p-rep lies in the fact that it better captures the way experimenters [[folk science|naively]] think and conceptualize p-values and [[statistical hypothesis testing]].
| |
| | |
| Among the criticisms of p-rep is the fact that it does not take prior probabilities into account.<ref>Macdonald, R. R. (2005) "Why Replication Probabilities Depend on Prior Probability Distributions" ''Psychological Science'', 2005, 16, 1006–1008 [http://www3.interscience.wiley.com/journal/118661704/abstract/]</ref> For example, if an experiment on some unlikely paranormal phenomenon produced a p-rep of 0.75, most right-thinking people would not believe the probability of a replication is 0.75. Instead they would conclude that it is much closer to 0. Extraordinary claims require extraordinary evidence, and p-rep ignores this. This consideration undermines the argument that p-rep is easier to interpret than a classical p value. The fact that p-rep requires assumptions about prior probabilities for it to be valid makes its interpretation complex. The classical p merely states the probability of an outcome (or more extreme outcome) given a null hypothesis and therefore is valid without regard to prior probabilities. Killeen argues that new results should be evaluated in their own right, without the burden of history, with flat priors: that is what p-rep yields. A more pragmatic estimate of replicability would include prior knowledge, which the logic of p-rep permits, but which null testing does not.
| |
| | |
| Critics have also underscored mathematical errors in the original paper by Killeen. For example, the formula relating the [[effect size]]s from two replications of a given experiment erroneously uses one of these [[random variable]]s as a [[parameter]] of the [[probability distribution]] of the other while he previously hypothesized these two variables to be [[Statistical independence|independent]].<ref>[http://probonostats.wordpress.com/2007/09/14/p-rep/ "p-rep" at Pro Bono Statistics]</ref>{{Verify credibility|failed=y|date=October 2011}}
| |
| These criticisms were addressed in his rejoinder.<ref>Killeen, P. R. (2005)" Replicability, Confidence, and Priors", ''Psychological Science'', 2005, 16, 1009–1012 [http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pmcentrez&artid=1440522]</ref>
| |
| | |
| A further criticism of the P-rep statistic involves the logic of experimentation. The purpose of replication in science is to adequately account for unmeasured factors in the testing environment, and in the case of human-subjects research: unmeasured participant variables and response biases, characteristics of the individual(s) conducting the experiment, and to replicate findings using different samples of participants. The idea that any value can, from one sample of data, meaningfully capture the likelihood of (by definition) unmeasured factors to affect the outcome, and thus the likelihhod of replicability, is a logical fallacy.{{citation needed|date=January 2011}}
| |
| | |
| == References ==
| |
| <references/>
| |
| | |
| == External links ==
| |
| | |
| {{DEFAULTSORT:P-Rep}}
| |
| [[Category:Statistical tests]]
| |
| [[Category:Hypothesis testing]]
| |
Hello buddy. Let me introduce myself. I am Luther Aubrey. I am a production and distribution officer. I've always cherished residing in Idaho. Playing crochet is some thing that I've done for many years.
Visit my site extended car warranty (visit the up coming document)