Bizarus.

The Reading Room.

Short, annotated readings on how research evidence gets checked, reviewed and kept honest — each one free to read in full, with a note on what to look for.

Links are best-effort. If one breaks or is now paywalled, search for a current open copy — that is a reason to look further, not to distrust the source.

Foundational Text

The Belmont Report (1979). US National Commission for the Protection of Human Subjects, via hhs.gov.
By National Commission for the Protection of Human Subjects · 1979

Written after the Tuskegee syphilis study came to public attention, this short report set out three principles now underlying nearly every research ethics framework in use: respect for persons, beneficence, and justice.

While reading, notice how directly these three principles map onto the sections of a typical ethics application: informed consent, risk-benefit assessment, and fair selection of participants. The document is short; the influence is not.

research ethicsinformed consenthuman subjectsBelmont principles
Best, M. and Neuhauser, D. (2004). Ignaz Semmelweis and the birth of infection control. Quality and Safety in Health Care, via PubMed Central.
By Best, M. & Neuhauser, D. · 2004

In 1847, Ignaz Semmelweis showed that hand disinfection with a chlorinated lime solution cut maternal deaths on his obstetric ward by roughly two thirds. The data were clear and reproducible, yet the medical establishment of Vienna largely ignored or rejected them for years.

While reading, notice that Semmelweis suspects "cadaverous particles" but has no germ theory to explain them. Watch how the case for adoption stalls less on the strength of the evidence than on the professional resistance it collided with.

evidence resistanceinfection controlhistory of medicinehand hygieneEvidence & Evaluation

Method Reference

Tranfield, D., Denyer, D. and Smart, P. (2003). Towards a methodology for developing evidence-informed management knowledge by means of systematic review. British Journal of Management, open version via institutional repository.
By Tranfield, D., Denyer, D., Smart, P. · 2003

This paper imported the systematic review method from medicine into management research, arguing that literature reviews in the field were too often unsystematic and vulnerable to a reviewer’s own biases. It set out an explicit protocol for searching, appraising, and synthesizing evidence.

Notice the distinction the authors draw between a narrative review, built around an argument, and a systematic one, built around a documented, repeatable process. That distinction still underlies most review methodology courses today.

systematic reviewmanagement researchevidence-informed practicereview protocolResearch Methodology
Wohlin, C. (2014). Guidelines for snowballing in systematic literature studies and a replication in software engineering, open version via author’s institutional page.
By Wohlin, C. · 2014

Database keyword searches miss relevant work for many reasons, including inconsistent terminology and poor indexing. Wohlin lays out snowballing, tracing a paper’s reference list backward and its citing papers forward, as a systematic complement to keyword search.

While reading, notice the distinction between backward snowballing, following references, and forward snowballing, following citations, and how the method proposes stopping criteria so the process does not run forever.

snowballingliterature searchcitation chainingsoftware engineeringResearch Methodology
Page, M. J. et al. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ, open access.
By Page, M. J. & et al. · 2021

PRISMA 2020 is the current reporting standard most journals expect systematic reviews to follow, updating the widely used 2009 version with a checklist and a flow diagram tracking records through identification, screening, eligibility, and inclusion.

Read it as a transparency requirement, not a quality guarantee. A review can follow the checklist item by item and still rest on a weak search strategy; notice what the checklist can and cannot certify.

PRISMAsystematic review reportingreporting standardflow diagramResearch Methodology
Ross-Hellauer, T. (2017). What is open peer review? A systematic review. F1000Research.
By Ross-Hellauer, T. · 2017

This systematic review surveyed how the term "open peer review" is actually used across the literature and found no single agreed definition, only a cluster of related but separable practices. It proposes seven traits that different journals mix and match.

While reading, use the seven-trait table as a checklist the next time a journal describes itself as using "open peer review." Notice how much that phrase can hide.

peer reviewopen peer reviewdefinitionssystematic reviewScholarly Publishing

Critical Perspective

Godlee, F., Smith, J. and Marcovitch, H. (2011). Wakefield's article linking MMR vaccine and autism was fraudulent. BMJ.
By Godlee, F., Smith, J., Marcovitch, H. · 2011

This BMJ editorial lays out how Andrew Wakefield's 1998 paper linking the MMR vaccine to autism was not simply flawed but fabricated, including altered patient histories and undisclosed financial conflicts. It is one of the clearest public records of a retraction process actually working.

Notice who did the checking: not a peer reviewer at the point of publication, but journalists and regulators, years later, reconstructing the original clinical records. That gap between publication and correction is worth sitting with.

research fraudretractionMMR vaccinescientific misconductResearch Integrity
Open Science Collaboration (2015). Estimating the reproducibility of psychological science. Science, via the OSF open repository.
By Open Science Collaboration · 2015

A large, coordinated team of researchers attempted to replicate 100 published psychology studies using the original materials wherever possible. Well under half of the replications produced results matching the originals.

Read this as psychology checking its own methods, not as a scandal. Notice the paper's own care in distinguishing a failed replication, which can have many innocent causes, from evidence of fraud, which this project was never designed to detect.

reproducibilityreplication crisispsychologyopen scienceResearch Integrity
Grudniewicz, A. et al. (2019). Predatory journals: no definition, no defence. Nature, open access.
By Grudniewicz, A. & et al. · 2019

A cross-disciplinary group of researchers and editors set out to define "predatory journal" precisely enough to act on, after years of the term being used loosely. They arrived at a working definition built around deceptive practices, not simply low quality.

Notice their point that price alone, whether an author-pays fee is cheap or expensive, proves nothing about legitimacy. Reputable open-access journals also charge fees; the deciding signals are elsewhere.

predatory journalspublishing integrityopen accessjournal credibilityScholarly Publishing