Spin in science writing – 2: making clinical recommendations

In my previous post, I wrote about one spin method in science writing: use of causal language in reporting findings from observational study designs.

This post adds another spinning method used frequently in reporting results of observational studies: making clinical recommendations based on results from observational study designs.

The observational studies are very useful in science; however, these designs cannot be used to make clinical recommendations without first suggesting randomized trials. This is because these study designs allow us only to determine prevalence, incidence or demonstrate either associations or correlations. And, certainly, it does not allow us to infer causation.

However, this happens;

In 2013, a research team reviewed 298 observational studies published in 2010 in four high impact research journals.

They found more than half (56 percent exactly) these studies have made clinical recommendations without first calling for randomized controlled trials; only 14 percent suggested that step.

To put this into context, I delved into two studies that they have mentioned in their paper.

Case study 1

The title of this study is “fructose-rich beverages and the risk of gout in women. It was a prospective cohort study spanning 22 years. The researchers have documented 778 new cases of gout during the study period. And, they have found a statistically significant association between consumption of fructose-rich beverages and the occurrence of gout.

They have written their conclusion in their abstract as follows: “the data suggest that fructose-rich beverages increase the risk of gout in women”.

Can they make this conclusion? If you remember my previous post, these researchers have done the same mistake here: using causal language in observational study design.

Further, in the main text, they stepped into the other type of spin; under the discussion section, they promote the reduction of fructose intake – a recommendation the study design does not allow. They have not suggested a randomized study either.

Case study 2

In this study, the researchers have compared 366 children with ADHD for genetic variants with 1047 controls. Based on their positive results, they recommend referring such children with ADHD for routine screening for such variants.

Can they make such a recommendation based on this study?

The simple answer is no.

However, the presence of findings from randomized controlled trials is not the only criterion to make recommendations. It is a far more complex topic. Because of that, experts in the field have developed the GRADE approach as a guideline in developing recommendations for practice.

What is the GRADE approach?

The GRADE is an acronym for the Grading of Recommendations Assessment, Development, and Evaluation. Its working group presented its first report in 2004.

It categorizes the quality (strength) of evidence produced into four levels: high, moderate, low, and very low. While the evidence derived from randomized studies is considered high-quality, the evidence from observational studies is of low-quality with regard to making any recommendations.

However, with regard to testing the accuracy of diagnostic tests, there are instances that observational studies provide high-quality evidence.

Whatever it is before making any recommendation, one has to consult the GRADE approach since, in addition to the study design, several other factors should be considered.

Author: Prasantha De Silva

A specialist in Community Medicine board-certified in Sri Lanka and a research analyst in Canada

Leave a Reply

Your email address will not be published.

Spin in science writing – 2: making clinical recommendations

In my previous post, I wrote about one spin method in science writing: use of causal language in reporting findings from observational study designs.

This post adds another spinning method used frequently in reporting results of observational studies: making clinical recommendations based on results from observational study designs.

The observational studies are very useful in science; however, these designs cannot be used to make clinical recommendations without first suggesting randomized trials. This is because these study designs allow us only to determine prevalence, incidence or demonstrate either associations or correlations. And, certainly, it does not allow us to infer causation.

However, this happens;

In 2013, a research team reviewed 298 observational studies published in 2010 in four high impact research journals.

They found more than half (56 percent exactly) these studies have made clinical recommendations without first calling for randomized controlled trials; only 14 percent suggested that step.

To put this into context, I delved into two studies that they have mentioned in their paper.

Case study 1

The title of this study is “fructose-rich beverages and the risk of gout in women. It was a prospective cohort study spanning 22 years. The researchers have documented 778 new cases of gout during the study period. And, they have found a statistically significant association between consumption of fructose-rich beverages and the occurrence of gout.

They have written their conclusion in their abstract as follows: “the data suggest that fructose-rich beverages increase the risk of gout in women”.

Can they make this conclusion? If you remember my previous post, these researchers have done the same mistake here: using causal language in observational study design.

Further, in the main text, they stepped into the other type of spin; under the discussion section, they promote the reduction of fructose intake – a recommendation the study design does not allow. They have not suggested a randomized study either.

Case study 2

In this study, the researchers have compared 366 children with ADHD for genetic variants with 1047 controls. Based on their positive results, they recommend referring such children with ADHD for routine screening for such variants.

Can they make such a recommendation based on this study?

The simple answer is no.

However, the presence of findings from randomized controlled trials is not the only criterion to make recommendations. It is a far more complex topic. Because of that, experts in the field have developed the GRADE approach as a guideline in developing recommendations for practice.

What is the GRADE approach?

The GRADE is an acronym for the Grading of Recommendations Assessment, Development, and Evaluation. Its working group presented its first report in 2004.

It categorizes the quality (strength) of evidence produced into four levels: high, moderate, low, and very low. While the evidence derived from randomized studies is considered high-quality, the evidence from observational studies is of low-quality with regard to making any recommendations.

However, with regard to testing the accuracy of diagnostic tests, there are instances that observational studies provide high-quality evidence.

Whatever it is before making any recommendation, one has to consult the GRADE approach since, in addition to the study design, several other factors should be considered.

Author: Prasantha De Silva

A specialist in Community Medicine board-certified in Sri Lanka and a research analyst in Canada

Leave a Reply

Your email address will not be published.