Skip to main navigation menu Skip to main content Skip to site footer
##common.pageHeaderLogo.altText##

Review article: Biomedical intelligence

Vol. 143 No. 1920 (2013)

Cancer, meta-analysis and reporting biases: the case of erythropoiesis-stimulating agents

  • Thomy Tonia
  • Guido Schwarzer
  • Julia Bohlius
DOI
https://doi.org/10.4414/smw.2013.13776
Cite this as:
Swiss Med Wkly. 2013;143:w13776
Published
05.05.2013

Summary

Reporting and publication bias is a well-known problem in meta-analysis and healthcare research. In 2002 we conducted a meta-analysis on the effects of erythropoiesis-stimulating agents (ESAs) on overall survival in cancer patients, which suggested some evidence for improved survival in patients receiving ESAs compared with controls. However, a meta-analysis of individual patient data conducted several years later showed the opposite of our first meta-analysis, that is, evidence for increased on-study mortality and reduced overall survival in cancer patients receiving ESAs. We aimed to determine whether the results of our first meta-analysis could have been affected by publication and reporting biases and, if so, whether timely access to clinical study reports and individual patient data could have prevented this. We conducted a hypothetical meta-analysis for overall survival including all studies and study data that could have been available in 2002, at the time when we conducted our first meta-analysis. Compared with our original meta-analysis, which suggested an overall survival benefit for cancer patients receiving ESAs [hazard ratio (HR) 0.81, 95% confidence interval (CI) 0.67‒0.99], our hypothetical meta-analysis based on the results of all studies conducted at the time of the first analysis did not show evidence for a beneficial effect of ESAs on overall survival (HR 0.97, 95% CI 0.83‒1.12). Thus we have to conclude that our first meta-analysis showed misleading overall survival benefits due to publication and reporting biases, which could have been prevented by timely access to clinical study reports and individual patient data. Unrestricted access to clinical study protocols including amendments, clinical study reports and individual patient data is needed to ensure timely detection of both beneficial and harmful effects of healthcare interventions.

References

  1. Nordmann A, Kasenda B, Briel M. Meta-analyses: what they can and cannot do. Swiss Med Wkly. 2012;142(w13518).
  2. Stern JM, Simes RJ. Publication bias: evidence of delayed publication in a cohort study of clinical research projects. BMJ. 1997;315(7109):640–5.
  3. Song F, Parekh S, Hooper L, Loke Y, Ryder J, Sutton A, et al. Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess. 2010;14(8):1–220.
  4. von Elm E, Rollin A, Blumle A, Huwiler K, Witschi M, Egger M. Publication and non-publication of clinical trials: longitudinal study of applications submitted to a research ethics committee. Swiss Med Wkly. 2008;138(13-14):197–203.
  5. Bourgeois FT, Murthy S, Mandl KD. Outcome reporting among drug trials registered in ClinicalTrials.gov. Ann Intern Med. 2010;153(3):158–66.
  6. Chan AW, Altman DG. Identifying outcome reporting bias in randomised trials on PubMed: review of publications and survey of authors. BMJ. 2005;330(7494):753.
  7. Hollis S, Campbell F. What is meant by intention to treat analysis? Survey of published randomised controlled trials. BMJ. 1999;319(7211):670–4.
  8. Norris SL, Holmer HK, Ogden LA, Fu R, Abou-Setta AM, Viswanathan MS, et al. Selective Outcome Reporting as a Source of Bias in Reviews of Comparative Effectiveness. 2012 Aug.
  9. Aapro M, Scherhag A, Burger HU. Effect of treatment with epoetin-beta on survival, tumour progression and thromboembolic events in patients with cancer: an updated meta-analysis of 12 randomised controlled studies including 2301 patients. Br J Cancer. 2008;99(1):14–22.
  10. Bennett CL, Silver SM, Djulbegovic B, Samaras AT, Blau CA, Gleason KJ, et al. Venous thromboembolism and mortality associated with recombinant erythropoietin and darbepoetin administration for the treatment of cancer-associated anemia. JAMA. 2008;299(8):914–24.
  11. Seidenfeld J, Piper M, Flamm C, Hasselblad V, Armitage JO, Bennett CL, et al. Epoetin treatment of anemia associated with cancer therapy: a systematic review and meta-analysis of controlled clinical trials. J Natl Cancer Inst. 2001;93(16):1204–14.
  12. Bohlius J, Langensiepen S, Schwarzer G, Seidenfeld J, Piper M, Bennett C, et al. Recombinant human erythropoietin and overall survival in cancer patients: results of a comprehensive meta-analysis. J Natl Cancer Inst. 2005;97(7):489–98.
  13. Wilson J, Yao GL, Raftery J, Bohlius J, Brunskill S, Sandercock J, et al. A systematic review and economic evaluation of epoetin alpha, epoetin beta and darbepoetin alpha in anaemia associated with cancer, especially that attributable to cancer treatment. Health Technol Assess. 2007;11(13):1-iv.
  14. Bohlius J, Wilson J, Seidenfeld J, Piper M, Schwarzer G, Sandercock J, et al. Erythropoietin or darbepoetin for patients with cancer. Cochrane Database Syst Rev 2006;3:CD003407.
  15. Bohlius J, Wilson J, Seidenfeld J, Piper M, Schwarzer G, Sandercock J, et al. Recombinant human erythropoietins and cancer patients: updated meta-analysis of 57 studies including 9353 patients. J Natl Cancer Inst. 2006;98(10):708–14.
  16. Seidenfeld J, Piper M, Bohlius J, Weingart O, Trelle S, Engert A, et al. Comparative effectiveness of epoetin and darbepoetin for managing anemia in patients undergoing cancer treatment. Comparative effectiveness Review No. 3. (Prepared by Blue Cross and Blue Shield Association Technology Evaluation Center. Evidence-based Practice Center under contract No. 290-02-0026). Rockville, MD. Agency for Healthcare Research and Quality. May 2006. Available at: www.effectivehealthcare.ahrq.gov/reports/final.cfm.
  17. Tonelli M, Hemmelgarn B, Reiman T, Manns B, Reaume MN, Lloyd A, et al. Benefits and harms of erythropoiesis-stimulating agents for anemia related to cancer: a meta-analysis. CMAJ. 2009;180(11):E62–E71.
  18. Tonelli M, Lloyd A, Lee H, Wiebe N, Hemmelgarn B, Reiman T, et al. Erythropoiesis-stimulating agents for anemia of cancer or of chemotherapy: systematic review and economic evaluation. Ottawa: Canadian Agency for Drugs and Technologies in Health; 2009. Report No.: Technology report number 119. -. p.
  19. Ross SD, Allen IE, Henry DH, Seaman C, Sercus B, Goodnough LT. Clinical benefits and risks associated with epoetin and darbepoetin in patients with chemotherapy-induced anemia: a systematic review of the literature. Clin Ther. 2006;28(6):801–31.
  20. Minton O, Richardson A, Sharpe M, Hotopf M, Stone P. A systematic review and meta-analysis of the pharmacological treatment of cancer-related fatigue. J Natl Cancer Inst. 2008;20;100(16):1155–66.
  21. Minton O, Richardson A, Sharpe M, Hotopf M, Stone P. Drug therapy for the management of cancer-related fatigue. Cochrane Database Syst Rev. 2010;(7):CD006704.
  22. Aapro M, Coiffier B, Dunst J, Osterborg A, Burger HU. Effect of treatment with epoetin beta on short-term tumour progression and survival in anaemic patients with cancer: A meta-analysis. Br J Cancer. 2006;95(11):1467–73.
  23. Aapro M, Osterwalder B, Scherhag A, Burger HU. Epoetin-beta treatment in patients with cancer chemotherapy-induced anaemia: the impact of initial haemoglobin and target haemoglobin levels on survival, tumour progression and thromboembolic events. Br J Cancer. 2009;101(12):1961–71.
  24. Ludwig H, Crawford J, Osterborg A, Vansteenkiste J, Henry DH, Fleishman A, et al. Pooled analysis of individual patient-level data from all randomized, double-blind, placebo-controlled trials of darbepoetin alfa in the treatment of patients with chemotherapy-induced anemia. J Clin Oncol. 2009;27(17):2838–47.
  25. Glaspy J, Crawford J, Vansteenkiste J, Henry D, Rao S, Bowers P, et al. Erythropoiesis-stimulating agents in oncology: a study-level meta-analysis of survival and other safety outcomes. Br J Cancer. 2010;19;102(2):301–15.
  26. Aapro M, Jelkmann W, Constantinescu SN, Leyland-Jones B. Effects of erythropoietin receptors and erythropoiesis-stimulating agents on disease progression in cancer. Br J Cancer. 2012;106(7):1249–58.
  27. Bohlius J, Schmidlin K, Brillant C, Schwarzer G, Trelle S, Seidenfeld J, et al. Recombinant human erythropoiesis-stimulating agents and mortality in patients with cancer: a meta-analysis of randomised trials. Lancet. 2009;373(9674):1532–42.
  28. Bohlius J, Schmidlin K, Brillant C, Schwarzer G, Trelle S, Seidenfeld J, et al. Erythropoietin or Darbepoetin for patients with cancer – meta-analysis based on individual patient data. Cochrane.Database.Syst.Rev. 2009;(3):CD007303.
  29. Littlewood TJ, Bajetta E, Nortier JW, Vercammen E, Rapoport B. Effects of epoetin alfa on hematologic parameters and quality of life in cancer patients receiving nonplatinum chemotherapy: results of a randomized, double-blind, placebo-controlled trial. J Clin Oncol. 2001;19(11):2865–74.
  30. Frommhold H, Guttenberger R, Henke M. The impact of blood hemoglobin content on the outcome of radiotherapy. The Freiburg experience. Strahlenther Onkol. 1998;174(Suppl 4):31–4.
  31. Hockel M, Knoop C, Schlenger K, Vorndran B, Baussmann E, Mitze M, et al. Intratumoral pO2 predicts survival in advanced cancer of the uterine cervix. Radiother Oncol. 1993;26(1):45–50.
  32. Knocke TH, Weitmann HD, Feldmann HJ, Selzer E, Potter R. Intratumoral pO2-measurements as predictive assay in the treatment of carcinoma of the uterine cervix. Radiother Oncol. 1999;53(2):99–104.
  33. Glaser CM, Millesi W, Kornek GV, Lang S, Schull B, Watzinger F, et al. Impact of hemoglobin level and use of recombinant erythropoietin on efficacy of preoperative chemoradiation therapy for squamous cell carcinoma of the oral cavity and oropharynx. Int J Radiat Oncol Biol Phys. 2001;50(3):705–15.
  34. Silver DF, Piver MS. Effects of recombinant human erythropoietin on the antitumor effect of cisplatin in SCID mice bearing human ovarian cancer: A possible oxygen effect. Gynecol Oncol. 1999;73(2):280–4.
  35. Leyland-Jones B. Breast cancer trial with erythropoietin terminated unexpectedly. Lancet Oncol. 2003;4(8):459–60.
  36. Henke M, Laszig R, Rube C, Schafer U, Haase KD, Schilcher B, et al. Erythropoietin to treat head and neck cancer patients with anaemia undergoing radiotherapy: randomised, double-blind, placebo-controlled trial. Lancet. 2003;362(9392):1255–60.
  37. Smith RE, Jr., Aapro MS, Ludwig H, Pinter T, Smakal M, Ciuleanu TE, et al. Darbepoetin alpha for the treatment of anemia in patients with active cancer not receiving chemotherapy or radiotherapy: results of a phase III, multicenter, randomized, double-blind, placebo-controlled study. J Clin Oncol. 2008;26(7):1040–50.
  38. Hedenus M, Adriansson M, San MJ, Kramer MH, Schipperus MR, Juvonen E, et al. Efficacy and safety of darbepoetin alfa in anaemic patients with lymphoproliferative malignancies: a randomized, double-blind, placebo-controlled study. Br J Haematol. 2003;122(3):394–403.
  39. Overgaard J, Hoff CM, Hansen HS, Specht L, Overgaard M, Grau C, et al. Randomized study of darbepoetin alfa as modifier of radiotherapy in patients with primary squamous cell carcinoma of the head and neck (HNSCC): Final outcome of the DAHANCA 10 trial. In 2009. p. abstr 6007.
  40. Wright JR, Ung YC, Julian JA, Pritchard KI, Whelan TJ, Smith C, et al. Randomized, double-blind, placebo-controlled trial of erythropoietin in non-small-cell lung cancer with disease-related anemia. J Clin Oncol. 2007;20;25(9):1027–32.
  41. Goss G, Feld R, Bezjak A, Perry G, Melosky B, Smith C, et al. O-154 Impact of maintaining Hb with epoetin alfa on time toprogression (TTP), overall survival (OS), quality of life (QOL) and transfusion reduction in limited disease SCLC patients. Lung Cancer 49[Supplement 2], S53. 2005.
  42. Luksenburg H, Weir A, Wager R. Safety concerns associated with Aranesp (darbepoetin alfa) Amgen, Inc. and Procrit (epoetin alfa) Ortho Biotech, L.P., for the treatment of anemia associated with cancer chemotherapy. 2004. Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research, Oncologic Drugs Advisory Committee.
  43. Dunphy FR, Harrison BR, Dunleavy TL, Rodriguez JJ, Hilton JG, Boyd JH. Erythropoietin reduces anemia and transfusions: A randomized trial with or without erythropoietin during chemotherapy. Cancer. 1999;86(7):1362–7.
  44. Thatcher N, De Campos ES, Bell DR, Steward WP, Varghese G, Morant R, et al. Epoetin alpha prevents anaemia and reduces transfusion requirements in patients undergoing primarily platinum-based chemotherapy for small cell lung cancer. Br J Cancer. 1999;80(3-4):396–402.
  45. Thompson JA, Gilliland DG, Prchal JT, Bennett JM, Larholt K, Nelson RA, et al. Effect of recombinant human erythropoietin combined with granulocyte/ macrophage colony-stimulating factor in the treatment of patients with myelodysplastic syndrome. GM/EPO MDS Study Group. Blood. 2000;95(4):1175–9.
  46. Dammacco F, Castoldi G, Rodjer S. Efficacy of epoetin alfa in the treatment of anaemia of multiple myeloma. Br J Haematol. 2001;113(1):172–9.
  47. Abels R. Erythropoietin for anaemia in cancer patients. Eur J Cancer. 1993;29A(Suppl 2):S2-8.:S2–S8.
  48. Case DC, Jr., Bukowski RM, Carey RW, Fishkin EH, Henry DH, Jacobson RJ, et al. Recombinant human erythropoietin therapy for anemic cancer patients on combination chemotherapy. J Natl Cancer Inst. 1993;19;85(10):801–6.
  49. Cascinu S, Fedeli A, Del Ferro E, Fedeli SL, Catalano G. Recombinant Human Erythropoietin Treatment in Cisplatin-Associated Anemia: A Randomized, Double-Blind Trial With Placebo. J Clin Oncol. 1994;12:1058–62.
  50. Rose E, Rai K, Revicki D, et al. Clinical and health status assessments in anemic chronic lymphocytic leukemia (CLL) patients treated with epoetin alfa (EPO). Blood. 1994;84(10 Suppl 1):526a.
  51. Cazzola M, Messinger D, Battistel V, Bron D, Cimino R, Enller-Ziegler L, et al. Recombinant human erythropoietin in the anemia associated with multiple myeloma or non-Hodgkin’s lymphoma: dose finding and identification of predictors of response. Blood. 1995;86(12):4446–53.
  52. Henry DH, Abels RI. Recombinant human erythropoietin in the treatment of cancer and chemotherapy-induced anemia: results of double-blind and open-label follow-up studies. Semin Oncol. 1994;21(2 Suppl 3):21–8.
  53. Osterborg A, Boogaerts MA, Cimino R, Essers U, Holowiecki J, Juliusson G, et al. Recombinant human erythropoietin in transfusion-dependent anemic patients with multiple myeloma and non-Hodgkin’s lymphoma – a randomized multicenter study. The European Study Group of Erythropoietin (Epoetin Beta) Treatment in Multiple Myeloma and Non-Hodgkin’s Lymphoma. Blood. 1996;87(7):2675–82.
  54. Del Mastro L, Venturini M, Lionetto R, Garrone O, Melioli G, Pasquetti W, et al. Randomized phase III trial evaluating the role of erythropoietin in the prevention of chemotherapy-induced anemia. J Clin Oncol. 1997;15(7):2715–21.
  55. Kurz C, Marth C, Windbichler G, Lahousen M, Medl M, Vavra N, et al. Erythropoietin treatment under polychemotherapy in patients with gynecologic malignancies: a prospective, randomized, double-blind placebo-controlled multicenter study. Gynecol Oncol. 1997;65(3):461–6.
  56. Oberhoff C, Neri B, Amadori D, Petry KU, Gamucci T, Rebmann U, et al. Recombinant human erythropoietin in the treatment of chemotherapy-induced anemia and prevention of transfusion requirement associated with solid tumors: a randomized, controlled study. Ann Oncol. 1998;9(3):255–60.
  57. ten Bokkel Huinink WW, de Swart CA, van Toorn DW, Morack G, Breed WP, Hillen HF, et al. Controlled multicentre study of the influence of subcutaneous recombinant human erythropoietin on anaemia and transfusion dependency in patients with ovarian carcinoma treated with platinum-based chemotherapy. Med Oncol. 1998;15(3):174–82.
  58. Throuvalas NA, Antonadou D, Boufi M, Lavey R. Erythropoietin decreases Transfusion Requirements during Radiochemotherapy. Proc Am Soc Clin Oncol. 2000;19:2000.
  59. Boogaerts M, Coiffier B, Kainz C. Impact of epoetin beta on quality of life in patients with malignant disease. Br J Cancer. 2003;88(7):988–95.
  60. Osterborg A, Brandberg Y, Molostova V, Iosava G, Abdulkadyrov K, Hedenus M, et al. Randomized, double-blind, placebo-controlled trial of recombinant human erythropoietin, epoetin Beta, in hematologic malignancies. J Clin Oncol. 2002;20(10):2486–94.
  61. Quirt I, Micucci S, Moran LA, Pater J, Browman G. The role of recombinant human erythropoietin (EPO) in reducing red blood cell transfusions and maintaining quality of life (QOL) in patients with lymphoma and solid tumors receiving cytotoxic chemotherapy. Results of a randomized, double-blind, placebo-controlled clinical trial. Blood. 1996;88(10 (Suppl 1)):347a. Blood. 1996;88[10 (Suppl 1)], 347a.
  62. Bamias A, Aravantinos G, Kalofonos C, Timotheadou N, Siafaka V, Vlahou I, et al. Prevention of anemia in patients with solid tumors receiving platinum-based chemotherapy by recombinant human Erythropoietin (rHuEpo): a prospective, open label, randomized trial by the Hellenic Cooperative Oncology Group. Oncology. 2003;64(2):102–10.
  63. Huddart RA, Welch RS, Chan S, Perren T, Atkinson R. A prospective randomised comparative-group evaluation of epoetin alfa for the treatment of anaemia in UK cancer patients receiving platinum-based chemotherapy. [Miscellaneous]. Annals of Oncology Abstract Book of the 27th ESMO Congress, Nice, France, 2002;13(Suppl 5):177.
  64. INT-1. 2004. Department of Health and Human Services Food and Drug Administration Center for Drug Evaluation and Research, Oncologic Drugs Advisory Committee.
  65. INT-3. 2004. Department of Health and Human Services Food and Drug Administration Center for Drug Evaluation and Research, Oncologic Drugs Advisory Committee.
  66. P-174. 2004. Department of Health and Human Services Food and Drug Administration Center for Drug Evaluation and Research, Oncologic Drugs Advisory Committee.
  67. ODAC 2003. 2004. Department of Health and Human Services Food and Drug Administration Center for Drug Evaluation and Research, Oncologic Drugs Advisory Committee.
  68. Tonia T, Mettler A, Robert N, Schwarzer G, Seidenfeld J, Weingart O, Hyde C, Engert A, Bohlius J. Erythropoietin or darbepoetin for patients with cancer. Cochrane Database of Systematic Reviews 2012.
  69. Kirkham JJ, Dwan KM, Altman DG, Gamble C, Dodd S, Smyth R, Williamson PR. The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ. 2010;340:c365.
  70. Poppe K, Doughty R, Yu C, Quintana M, Moller J, Klein A, et al. Understanding differences in results from literature-based and individual patient meta-analyses: An example from meta-analyses of observational data. Int J Cardiol. 2011;148:209–13.
  71. McCormack K, Grant A, Scott N. Value of updating a systematic review in surgery using individual patient data. Br J Surg. 2004;91(4):495–9.
  72. DeAngelis CD, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, et al. Clinical trial registration: a statement from the International Committee of Medical Journal Editors. Archives of Otolaryngology – Head & Neck Surgery. 2005;131(6):479–80.
  73. International Committee of Medical Journal Editors (ICMJE), Laine C, Horton R, De AC, Drazen JM, Frizelle FA, Godlee F, et al. Clinical trial registration: looking back and moving ahead. [Danish]. Ugeskrift for Laeger. 2007;169(26):2505–6.
  74. Huic M, Marusic M, Marusic A. Completeness and changes in registered data and reporting bias of randomized controlled trials in ICMJE journals after trial registration policy. PLoS ONE [Electronic Resource] 2011;6(9):e25258.
  75. Golder S, Loke YK, Bland M. Unpublished data can be of value in systematic reviews of adverse effects: methodological overview. [Review]. J Clin Epidemiol. 2010;63(10):1071–81.
  76. FDA Amendments Act of 2007. http://frwebgate.access.gpo.gov/cgi-bin/getdoc.cgi?dbname=110_cong_public_laws&docid=f:publ085.110. Pdf
  77. Wieseler B, McGauran N, Kaiser T. Finding studies on reboxetine: a tale of hide and seek. BMJ. 2010;341:c4942.
  78. Godlee F, Loder E. Missing clinical trial data: setting the record straight. BMJ. 2010;341:c5641.
  79. Jefferson T, Jones MA, Doshi P, Del Mar CB, Heneghan CJ, Hama R, et al. Neuraminidase inhibitors for preventing and treating influenza in healthy adults and children. [Review]. Cochrane Database of Systematic Reviews 2012;1:CD008965.
  80. Eichler H, Abadie E, Breckenridge H, Leufkens H, Rasi G. Open clinical trial data for all? A view from regulators. PLoS.Med. 2012;9(4):e1001202.
  81. European Medicines Agency widens public access to documents: Policy on access to documents also sets out new approach for proactive disclosure of documents. http://www.ema.europa.eu/ema/index.jsp?curl=pages/news_and_events/news/2010/11/news_detail_001158.jsp&mid=WC0b01ac058004d5c1
  82. Wieseler B, McGauran N, Kerekes M, Kaiser T. Access to regulatory data from the European Medicines Agency: the times they are a-changing. Systematic Reviews 2012;1:50.
  83. Hrynaszkiewicz I, Norton ML, Vickers AJ, Altman DG. Preparing raw clinical data for publication: guidance for journal editors, authors, and peer reviewers. BMJ. 2010;340:c181.
  84. Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gotzsche PC, Krleza-Jeric K, et al. SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical Trials. Ann Intern Med. 2013 Jan 8.
  85. Guideline for industry: structure and content of clinical study reports. http://www.fda.gov/downloads/regulatoryinformation/guidances/ucm129456.pdf. 2013.
  86. Humaidan P, Polyzos NP. (Meta)analyze this: Systematic reviews might lose credibility. Nat Med. 2012;18(9):1321.
  87. Bohlius J, Langensiepen S, Schwarzer G, Seidenfeld J, Piper M, Bennett C, Engert A. Recombinant human erythropoietin and overall survival in cancer patients: results of a comprehensive meta-analysis. J Natl Cancer Inst. 2005;97(7):489–98.
  88. Littlewood TJ, Bajetta E, Nortier JW, Vercammen E, Rapoport B. Effects of epoetin alfa on hematologic parameters and quality of life in cancer patients receiving nonplatinum chemotherapy: results of a randomized, double-blind, placebo-controlled trial. J Clin Oncol. 2001;19(11):2865–74.