OUP user menu

Do medical students and physicians understand probability?

A.K. Ghosh, K. Ghosh, P.J. Erwin
DOI: http://dx.doi.org/10.1093/qjmed/hch010 53-55 First published online: 31 December 2003

Sir,

We read with great interest the recent article by Dr Cahan and colleagues regarding the inability of residents to accurately determine probability.1 Despite the recent surge in teaching Evidence Based Medicine (EBM) in medical schools, the effectiveness of current teaching strategies remains unclear. We sought to determine how readily medical students and physicians identify the diagnostic terms often stressed in EBM.

Relevant articles were identified by searching various database including Medline (1980–2003), Embase (1988–2003), PsychInfo (1984–2003), Web of Science (1993–2003), educational websites, and bibliography of relevant articles. Study design, quality of study, and limitations of study were abstracted by two independent reviewers. Review articles, letters of editors, editorials of innumeracy, and diagnostic tests were excluded.

We identified eight articles (5 case scenarios, 2 questionnaires, and 1 telephone survey) that met the inclusion criteria (Table 1).2–,9 The number of participants in the studies varied from 31 to 300. There was considerable heterogeneity in the various studies. The commonest physician error was in overestimating the PPV (78–95%). One study described that the number of physicians using Bayesian calculations, ROC and LR was 3%, 1% and 0.66%, respectively. Medical students could not rule out diseases in low and intermediate probability case scenarios applying Bayesian estimates. In one study from Australia, 13 of 50 (26%) physicians stated that they could describe PPV, although on direct interviewing only one could actually illustrate it with an example. In another study, presenting the data in Natural frequency format increased the accuracy of determining PPV to 46%.

View this table:
Table 1

Studies of understanding diagnostic terms

Despite the heterogeneity in the various studies, the results are generalizable as they have been carried out in four continents and yield similar results. Physician innumeracy remains an impediment in popularizing EBM. Inattention to pre-test probability, and inability to assess the PPV accurately, could result in increased anxiety in patients by generating unnecessary tests and consultations. Increased attention to EBM instructions and presentation of data in alternative formats (e.g. natural frequency) may be indicated. The limitations of our analysis include the small number of studies, their sometimes small number of subjects, and the variation in study design.

References