Reading the science

How to evaluate peptide research claims

Revial Labs Research · · 8 min read

Peptides attract a lot of online enthusiasm, and claims often run well ahead of the evidence. Here is how scientists judge whether a finding is solid.

Not all evidence is equal

Different kinds of study answer different questions, and they carry very different weight:

Study typeWhat it can showMain limitation
In vitro (cells, tissues)A possible mechanismCells in a dish aren't a whole organism
Animal studiesEffects in a living systemOften don't carry over to humans
Case reports and anecdotesSomething worth investigatingNo control group; prone to bias and placebo effects
Observational studiesAssociations in real populationsCorrelation isn't causation
Randomised controlled trialsWhether an intervention causes an effectExpensive, and sometimes small or short
Systematic reviews and meta-analysesThe combined weight of many trialsOnly as good as the studies included

Many peptides discussed online have been studied only in cells or rodents. A striking result in a rat model is a reason to do more research, not evidence that something works or is safe in people.

Questions to ask about any study

  1. Who or what was studied? Cells, mice or people? How many?
  2. Was there a control group? Was it randomised and blinded?
  3. What was measured? A real outcome, or a surrogate marker such as a lab value?
  4. How big was the effect? Statistically significant isn't the same as meaningful.
  5. Has it been replicated by an independent group?
  6. Is it peer-reviewed? Preprints are useful but haven't been checked yet.
  7. Who funded it? Conflicts of interest don't invalidate work, but they're worth knowing about.

Red flags

Where to find reliable information

Rule of thumb: the more surprising the claim, the stronger the evidence it needs, and that means randomised human trials, not mechanisms and mouse models.

Related articles

Sources and further reading

  1. Ioannidis JPA. Why most published research findings are false. PLoS Med 2005;2:e124. doi:10.1371/journal.pmed.0020124 · PMID: 16060722
  2. Schulz KF, Altman DG, Moher D. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMJ 2010;340:c332. doi:10.1136/bmj.c332 · PMID: 20332509
  3. PubMed. pubmed.ncbi.nlm.nih.gov
  4. ClinicalTrials.gov. clinicaltrials.gov
  5. ISRCTN registry. www.isrctn.com
  6. Cochrane Library. www.cochranelibrary.com