The Personal Blog of Stephen Sekula

Bad Science Watch: acupuncture and lung cancer pain

Having needles shoved in your skin can seem like a major medical intervention, but science says it's a sham. Is a new study about lung cancer pain and acupuncture going to change that picture? In short . . . no. It's terrible science. Photo from Ref. 4.
Having needles shoved in your skin can seem like a major medical intervention, but science says it’s a sham. Is a new study about lung cancer pain and acupuncture going to change that picture? In short . . . no. It’s terrible science. Photo from Ref. 4.

I saw this headline in my Google News feed this morning: “Acupuncture Reduces Pain in Lung Cancer Patients – New Findings” [1]. The article was posted on a credulous site that promotes acupuncture, a practice that has never been proven to yield any benefit over the placebo effect.

So I thumbed through the news article. It claimed:

The focus of the study was the evaluation of acupuncture and its effect on lung cancer related symptoms such as nausea, anxiety, pain, depression and a sense of not

feeling well. A total of 33 lung cancer patients received 45 minute acupuncture treatments at a rate of 1 – 2 times per week for at least 4 treatments. The results demonstrated that acupuncture effectively reduced pain levels in over 60% of patients. Additionally, 30% of patients noted improvements with a sense of well-being with at least 4 acupuncture treatments. This number jumps to a 70% improvement in well-being when patients received 6 or more acupuncture treatments.  [1]

The original paper making the claim of such findings is references in [2]. A read through the abstract of the paper reveals that the news site summarized it appropriately. Reading the abstract also reveals a set of major scientific flaws:

  1. There is no placebo control group in the study.
  2. There is no group that receives the best known and possible medical pain intervention for lung cancer patients.

The placebo effect is a powerful, built-in effect wherein belief about outcome affects outcome. If a patient receives a sham, non-medical treatment, but the treatment provider believes it’s effective and the patience believes it’s effective, then the patient can get better even though no medical intervention actually occurs. It must be controlled for before declaring a treatment successful. Degree of belief determines outcome, independent of the activity of the treatment.

While for acupuncture it is difficult to provide a sham control procedure, in fact sham acupuncture (where the needles press against, but never puncture, the skin) exists and has been used in properly controlled studies of acupuncture. Those independent studies have shown no effect of acupuncture over placebo. At best, a patient is paying for the privilege of being deceived.

This study [2] is bad science. Without a control group, the most accurate and scientifically honest interpretation is that the patients experienced the placebo effect. Studies of placebo have shown that “more sham intervention equals faster positive outcome,” because the belief is that more treatment means more healing. The results – more acupuncture led to more reports of pain relief – are consistent with the null hypothesis. That is, the data are consistent with acupuncture behaving as a placebo, where more placebo speeds the placebo effect.

You can find lots of good information about the amazing placebo effect, and understand why it’s critical to control for it, in ref [3]. What is most scientifically DISHONEST about this paper is that the study fails to do the most important thing: compare against the BEST POSSIBLE TREATMENT. It’s not enough to test against nothing (e.g. placebo) and then claim your treatment is equal to or better than doing nothing – it’s medically and scientifically honest to test against the best pain control interventions. 

 

[1] http://www.healthcmi.com/acupuncturist-news-online/813-lungcancerli4lv3

[2] Kasymjanova, G., M. Grossman, T. Tran, R. T. Jagoe, V. Cohen, C. Pepe, D. Small, and J. Agulnik. “The potential role for acupuncture in treating symptoms in patients with lung cancer: an observational longitudinal study.” Current Oncology 20, no. 3 (2013): 152.

[3] David Moermon. “Cultural Variations in the Placebo Effect: Ulcers, Anxiety, and Blood Pressure”. Medical Anthropology Quarterly. Vol 14, Issue 1. 2008

[4] http://en.wikipedia.org/wiki/File:Acupuncture1-1.jpg

2 thoughts on “Bad Science Watch: acupuncture and lung cancer pain”

Comments are closed.