Publishing peer review

November 15, 2010

Peer review is the central pillar of the process of scientific research yet it remains a black box, invisible to those outside of the research community. As I have said previously, lifting this veil and making peer review of journal articles more transparent could make a big contribution to increasing trust in scientific research. A recent report [subscription required] in Nature decribes a programme to just that at the journal of the European Molecular Biology Organisation (EMBO). There is also an excellent discussion of the article by Joerg Heber on his blog.

The experience at EMBO demonstrates that:

  • Researchers seem to be happy with publishing peer review. In the case of the EMBO Journal, only 5% of authors declined to have peer review process documents published.
  • Readers of papers see a value in accessing this material. Although for this pilot study peer review process documents were made comparatively difficult to access there was a reasonable rate, about one tenth of the access of the papers themselves.
  • The process influences (and probably improves) the quality of peer review. Peer reviewers claim to be taking more care over the wording of their reports because they know that they will be published, albeit anonymously. Even if this is just about writing in a clearer way it represents a real benefit, but it may also be encouraging more considered and constructive comments.

Overall this seems to have been a really successful experiment, which is now to become a standard part of the operating procedures at this journal. Given this success it is hard to find reasons for not applying the practice to all peer reviewed research.


One Response to “Publishing peer review”

  1. This seems a very sensible approach Stephen for the reasons you outline. As you say, no reason not to apply this for all peer reviewed research.

    We are also starting to explore with businesses what is reasonable to ask them to be transparent about in their research and their processes of review. This is a tricky and contentious issue, but this approach is a helpful pointer to the usefulness of greater transparency, though it is I think too much to ask for similar transparency of business with their IP sensitive research, but this is work in progress so may revisit it in a few months when we have reflected together more.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: