Distorted visions 3

December 17, 2004

Brian Josephson's arguments are scientifically and statistically correct.

In contrast, the statement of Richard Wiseman - "I don't see how you could argue there's anything wrong with having to get five out of seven when (Natasha) agrees with the target in advance" - demonstrates a lack of understanding of how experimental data should be interpreted statistically.

The experiment is woefully inadequate. The chance of the observed four successes in seven subjects by pure guessing is 1 in 78. But suppose Natasha had a diagnosis rate of 1 in 2, compared with the chance rate of 1 in 7: then there is equal chance of getting 4 or more from 7, or 3 or less from 7. That is, the probability of detecting a true 50 per cent diagnosis rate on 7 subjects using a 0.01 significance level is only 50 per cent. There should have been at least 21 subjects to ensure a 90 per cent probability of detecting a true diagnosis rate of 50 per cent (using a 0.01 significance level test). Only if Natasha had a true diagnosis rate as high as 72 per cent would there have been a 90 per cent chance of detecting the effect using a 0.01 test on 7 subjects.

The experiment had high chances of failing to detect important effects, but this may have been due merely to no statistician being involved.

Keith Rennolls
Professor of applied statistics
University of Greenwich

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 10 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments

Most Commented

Brexit, EU referendum

Joanna Williams voted Leave, and has been left disappointed by the academy’s reaction to the EU referendum result

Elly Walton illustration (7 July 2016)

Researchers in the liberal arts seem to have made it their mission to communicate in the most obscure fashion, says Zachary Foster

Daniel Mitchell illustration (14 July 2016)

Frank Furedi says the mournful mood on campus and the disparagement and silencing of Leave supporters betray an isolated scholarly class

Michael Parkin illustration (7 July 2016)

Rising immigration-related costs and lack of employer support send an unwelcoming message to international staff, says Jason Danely

People walk past second hand books for sale

Shift may be evidence that researchers feel they are increasingly judged on citations and journal impact factors