Formula milk trials have a high risk of bias, authors almost always report favourable conclusions, transparency is lacking, and findings are selectively reported, finds a review of evidence from recently published trials in The BMJ today.
The researchers say their findings “support the need for a substantial change in the conduct and reporting of formula trials to adequately protect participants from harm and protect consumers from misleading information.”
Formula milk is consumed by most European and North American infants, and new formula products need to be tested in clinical trials. But concerns have been raised that formula trials are biased and could undermine breastfeeding.
To explore this further, an international team of researchers set out to evaluate the conduct and reporting of formula milk trials. They were specifically interested in understanding the risk of bias in published formula trials and if trial procedures could cause harm by undermining breastfeeding of participants.
They carried out a detailed analysis of 125 trials published since 2015 that compared at least two formula milk products in a total of 23,757 children less than three years of age.
The trials were mainly carried out in Europe (42%), Asia (28%), or North America (18%) and the most common measures were weight gain (36%), intestinal health (26%), nutrient absorption (10%), behaviour (6%), and allergy (6%).
The researchers found that only 17 (14%) of these trials were conducted independently of formula companies, 26 (21%) were prospectively registered with a clear aim and main (primary) outcome, and 11 (9%) had a publicly available protocol.
Most (80%) of trials had a high risk of bias for their primary outcome, usually because of inappropriate exclusions of participants from the analysis, and selective reporting (when results are not fully or accurately reported, to suppress negative or undesirable findings).
Favourable conclusions were reported for more than 90% of trials.
This is a comprehensive evaluation of the conduct and reporting of formula trials, but the researchers acknowledge that because the results of many formula trials are not in the public domain, their findings cannot fully represent all trials conducted.
Nevertheless, they say their study suggests that formula trials are not reliable and might not adequately protect participants in the trials.
“The formula industry is closely involved in formula trials, findings are almost always reported as favourable, and little transparency exists about the aims of the trial or reporting of results,” they write. “Our findings support the need for a substantial change in the conduct and reporting of formula trials to adequately protect participants from harm and protect consumers from misleading information.”
[Ends]
Method of Research
Systematic review
Subject of Research
Not applicable
Article Title
Formula milk trials are not reliable, warn experts
Article Publication Date
13-Oct-2021
COI Statement
All authors have completed the ICMJE uniform disclosure form at www.icmje.org/disclosure-of-interest/ and declare support from Imperial Health Charity: RJB received personal fees from Cochrane, DBV Technologies, and Prota Therapeutics, and from expert witness work in cases of food anaphylaxis and class actions related to infant formula health claims, outside the submitted work, and received personal fees from Public Health England as a member of the UK Nutrition and Health Claims Committee and the Maternal and Child Nutrition Subgroup of the Scientific Advisory Committee on Nutrition. JL-B received fees from Danone Nutricia Research and the Food Standards Agency, outside of the submitted work. The University of Colorado receives remuneration for LB’s work as senior editor, Cochrane, which is outside the submitted work. The authors report no other relationships or activities that could appear to have influenced the submitted work.