Yesterday I found a copy of one of the first manuscripts I ever submitted. It was never published, so it is time for it to be made available. Ideas discussed are nowadays common place. The manuscript, I think, is still mostly valid almost 30 years after I wrote it… I should have tried harder to get it published then.
A small set observations with a few extreme observations plus subjective splitting of a data set into two subsets to be fitted separately to a linear regression model resulted in very clear cut conclusions and striking figures. However, none of this is solid evidence, or evidence at all supporting the paper’s conclusions. This series of articles, not only discusses the problems in the paper, but more importantly, it traces the review process that allowed it to be published in Nature.
A new analysis of the data appears in an article at “Ask a Swiss” but still based on model fitting. They detect a significant change in slope, but still we do not have confidence bands available.
I earlier mentioned that a high-ranking journal in Psychology called “Basic and Applied Social Psychology” has banned the use of P-values. Today, I came across some additional material on this question. First of all, the controversial editorial where the decision was announced.
He also has a series of videos in YouTube from which the three linked to below are related to the use (and misuse) of P-values. For my liking he does not make a clear enough distinction between the problem inherent to P-values (that they discard a lot of information to reach a true/false decision) and those problems due to the misuse and misinterpretation of tests of significance. He does mention the difference, but you need to keep your eyes and ears open to get this out of his presentations.