An innovative research replication initiative has generated results that have important implications for eyewitness memory. The project confirms earlier findings that asking witnesses to provide a verbal description of a suspect can impair their ability to select that suspect from a lineup — the so-called "verbal overshadowing" effect.
This Registered Replication Report (RRR) is the first completed project from an initiative launched in 2013 by the journal Perspectives on Psychological Science, a publication of the Association for Psychological Science.
In an RRR, many laboratories independently conduct a direct replication of an important original finding, following a pre-established and vetted protocol. The results are published regardless of the outcome, and the article, raw data, and study materials are all made available online.
By guaranteeing publication, the RRR encourages researchers to participate in the process of conducting replications, something that has been relatively undervalued in the scientific literature.
"Any individual study provides only a noisy estimate of the actual size of an effect," says Daniel J. Simons, Professor of Psychology at the University of Illinois at Urbana-Champaign and editor of this RRR. "By conducting multiple, independent replications, it is possible both to measure that effect accurately and to test whether it is stable across laboratories."
In the original study, published in 1990 by Schooler and Engstler-Schooler, participants viewed a video of a simulated bank robbery and were then asked to write a description of the robber or to generate a list of US states and their capitals. The results showed that participants who described the robber were less likely to pick him out of a subsequent lineup than were those who listed states and capitals.
This verbal overshadowing effect has theoretical implications for our understanding of memory interference, and it also has practical implications for procedures related to eyewitness testimony. Yet subsequent studies failed to show as strong of an effect, increasing uncertainty about the effect's true size. This uncertainty made the verbal overshadowing effect a prime candidate for an organized replication effort.
The RRR consisted of two separate collections of replications. The first, conducted by 31 laboratories, revealed only a small verbal overshadowing effect when witnesses described the suspect immediately after seeing the simulated bank robbery. A follow-up replication, conducted by 22 of the same laboratories, found a larger verbal overshadowing effect when witnesses waited 20 minutes before describing the suspect. Both effects were smaller than those reported in the original paper.
"Finding a smaller effect in a replication does not invalidate the original research," says Simons. "We should expect smaller effects in this sort of replication, in part because of the incentives and biases of the publication system itself. One conclusion we can draw from this RRR is that most earlier studies of the verbal overshadowing effect used sample sizes that were too small to detect the effect reliably or to measure it precisely."
In contrast to the original study, in the RRR, participants who provided a verbal description were more likely than those who listed countries and their capitals (the control group in the RRR) to say that the suspect was "not present" in the lineup. Further research is needed to explore whether providing a verbal description makes people more hesitant to rely on what they remember when faced with a lineup choice.
Simons, fellow Special Associate Editor for Replication Reports Alex O. Holcombe (Associate Professor of Psychology at the University of Sydney), and Perspectives editor Barbara A. Spellman (Professor of Law at the University of Virginia), hope that researchers will fully explore the RRR data, which are publicly available, and conduct their own analyses to identify possible moderators or even discover new effects.
"We hope that the RRR process of open and careful replication, estimation, and evaluation will lead to a better understanding of important effects in our field, and more generally advance the reproducibility and replicability of psychological science," Simons, Holcombe, and Spellman write in their introduction. The introduction is followed by the RRR and an accompanying commentary by original study author Jonathan Schooler.
The second RRR is currently under way, and future RRR projects are in development. Funding is available to facilitate participation in RRR projects.
For more information, please visit: http://www.psychologicalscience.org/index.php/replication
The introduction, RRR, and commentary are available free to the public: An Introduction to Registered Replication Reports at Perspectives on Psychological Science - Daniel J. Simons, Alex O. Holcombe, Barbara A. Spellman
http://pps.sagepub.com/content/9/5/552.full
Registered Replication Report: Schooler and Engstler-Schooler (1990)
http://pps.sagepub.com/content/9/5/556.full
Turning the Lens of Science on Itself: Verbal Overshadowing, Replication, and Metascience - Jonathan W. Schooler
http://pps.sagepub.com/content/9/5/579.full
For a copy of the research article and access to other Perspectives on Psychological Science research findings, please contact:
Anna Mikulak
Association for Psychological Science
202-293-9300
amikulak@psychologicalscience.org
Journal
Perspectives on Psychological Science