Skip to main navigation menu Skip to main content Skip to site footer
##common.pageHeaderLogo.altText##

Original article

Vol. 148 No. 3334 (2018)

The Expanded Risk Score in Rheumatoid Arthritis (ERS-RA): performance of a disease-specific calculator in comparison with the traditional prediction scores in the assessment of the 10-year risk of cardiovascular disease in patients with rheumatoid arthritis

  • Fausto Salaffi
  • Marina Carotti
  • Marco Di Carlo
  • Marika Tardella
  • Valentina Lato
  • Andrea Becciolini
  • Ennio Giulio Favalli
  • Andrea Giovagnoni
DOI
https://doi.org/10.4414/smw.2018.14656
Cite this as:
Swiss Med Wkly. 2018;148:w14656
Published
22.08.2018

Summary

AIMS OF THE STUDY

To assess the performance of the Expanded Risk Score in Rheumatoid Arthritis (ERS-RA), a disease-specific cardiovascular disease (CVD) prediction score, in evaluating the 10-year risk, in comparison with other traditional algorithms in patients with rheumatoid arthritis (RA).

METHODS

Consecutive RA patients, aged 40–75 years, without established CVD, were included. We calculated the disease-specific ERS-RA and four traditional CVD prediction scores: the modified Systematic Coronary Risk Evaluation (mSCORE), the Framingham Risk Score using body mass index (FRS BMI), the calculator developed by the American College of Cardiology / American Heart Association in 2013 (ACC/AHA 2013) and the QRISK3. Subjects also underwent ultrasound assessment of the carotid arteries. The presence of a carotid intima-media thickness (CIMT) >0.90 mm or of carotid plaques identified the high-risk patients.

RESULTS

Of the 84 patients evaluated, 33 (39.3%), 16 (19.0%), 24 (28.6%), 25 (29.8%) and 33 (39.3%) subjects were defined as having high CVD risk according to ACC/AHA 2013, mSCORE, FRS BMI, QRISK3 and ERS-RA, respectively. Compared with the ultrasound results, all the areas under the receiver operating characteristic curves (AUC-ROC) showed good discrimination properties (0.848 – FRS BMI, 0.816 – mSCORE, 0.828 – ACC/AHA 2013, 0.844 – QRISK3, 0.869 – ESR-RA). Comparison of the AUC-ROCs did not show that discriminative ability for detecting subclinical atherosclerotic damage was improved with ESR-RA.

CONCLUSIONS

Using a surrogate marker of subclinical atherosclerotic organ damage as indicator of CVD burden, the newly ERS-RA risk score that incorporates specific aspects of RA performs as well as ACC/AHA 2013, mSCORE, FRS BMI and QRISK3 estimators.

References

  1. Salaffi F, De Angelis R, Grassi W ; MArche Pain Prevalence; INvestigation Group (MAPPING) study. Prevalence of musculoskeletal conditions in an Italian population sample: results of a regional community-based study. I. The MAPPING study. Clin Exp Rheumatol. 2005;23(6):819–28.
  2. Meune C, Touzé E, Trinquart L, Allanore Y. Trends in cardiovascular mortality in patients with rheumatoid arthritis over 50 years: a systematic review and meta-analysis of cohort studies. Rheumatology (Oxford). 2009;48(10):1309–13. doi:.https://doi.org/10.1093/rheumatology/kep252
  3. Ferraccioli G, Gremese E. Adiposity, joint and systemic inflammation: the additional risk of having a metabolic syndrome in rheumatoid arthritis. Swiss Med Wkly. 2011;141:w13211.
  4. Aviña-Zubieta JA, Choi HK, Sadatsafavi M, Etminan M, Esdaile JM, Lacaille D. Risk of cardiovascular mortality in patients with rheumatoid arthritis: a meta-analysis of observational studies. Arthritis Rheum. 2008;59(12):1690–7. doi:.https://doi.org/10.1002/art.24092
  5. John H, Kitas G. Inflammatory arthritis as a novel risk factor for cardiovascular disease. Eur J Intern Med. 2012;23(7):575–9. doi:.https://doi.org/10.1016/j.ejim.2012.06.016
  6. Lassere MN, Rappo J, Portek IJ, Sturgess A, Edmonds JP. How many life years are lost in patients with rheumatoid arthritis? Secular cause-specific and all-cause mortality in rheumatoid arthritis, and their predictors in a long-term Australian cohort study. Intern Med J. 2013;43(1):66–72. doi:.https://doi.org/10.1111/j.1445-5994.2012.02727.x
  7. D’Agostino RB, Sr, Vasan RS, Pencina MJ, Wolf PA, Cobain M, Massaro JM, et al. General cardiovascular risk profile for use in primary care: the Framingham Heart Study. Circulation. 2008;117(6):743–53. doi:.https://doi.org/10.1161/CIRCULATIONAHA.107.699579
  8. Conroy RM, Pyörälä K, Fitzgerald AP, Sans S, Menotti A, De Backer G, et al.; SCORE project group. Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. Eur Heart J. 2003;24(11):987–1003. doi:.https://doi.org/10.1016/S0195-668X(03)00114-3
  9. Ridker PM, Buring JE, Rifai N, Cook NR. Development and validation of improved algorithms for the assessment of global cardiovascular risk in women: the Reynolds Risk Score. JAMA. 2007;297(6):611–9. doi:.https://doi.org/10.1001/jama.297.6.611
  10. Goff DC, Jr, Lloyd-Jones DM, Bennett G, Coady S, D’Agostino RB, Sr, Gibbons R, et al.; American College of Cardiology/American Heart Association Task Force on Practice Guidelines. 2013 ACC/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol. 2014;63(25, 25 Pt B):2935–59. doi:.. Correction in: J Am Coll Cardiol. 2014;63(25):302. doi:https://doi.org/10.1016/j.jacc.2013.11.005
  11. Arts EE, Popa C, Den Broeder AA, Semb AG, Toms T, Kitas GD, et al. Performance of four current risk algorithms in predicting cardiovascular events in patients with early rheumatoid arthritis. Ann Rheum Dis. 2015;74(4):668–74. doi:.https://doi.org/10.1136/annrheumdis-2013-204024
  12. Crowson CS, Matteson EL, Roger VL, Therneau TM, Gabriel SE. Usefulness of risk scores to estimate the risk of cardiovascular disease in patients with rheumatoid arthritis. Am J Cardiol. 2012;110(3):420–4. doi:.https://doi.org/10.1016/j.amjcard.2012.03.044
  13. Peters MJ, Symmons DP, McCarey D, Dijkmans BA, Nicola P, Kvien TK, et al. EULAR evidence-based recommendations for cardiovascular risk management in patients with rheumatoid arthritis and other forms of inflammatory arthritis. Ann Rheum Dis. 2010;69(2):325–31. doi:.https://doi.org/10.1136/ard.2009.113696
  14. Hippisley-Cox J, Coupland C, Brindle P. Development and validation of QRISK3 risk prediction algorithms to estimate future risk of cardiovascular disease: prospective cohort study. BMJ. 2017;357:j2099. doi:.https://doi.org/10.1136/bmj.j2099
  15. Hippisley-Cox J, Coupland C, Vinogradova Y, Robson J, Minhas R, Sheikh A, et al. Predicting cardiovascular risk in England and Wales: prospective derivation and validation of QRISK2. BMJ. 2008;336(7659):1475–82. doi:.https://doi.org/10.1136/bmj.39609.449676.25
  16. Agca R, Heslinga SC, Rollefstad S, Heslinga M, McInnes IB, Peters MJ, et al. EULAR recommendations for cardiovascular disease risk management in patients with rheumatoid arthritis and other forms of inflammatory joint disorders: 2015/2016 update. Ann Rheum Dis. 2017;76(1):17–28. doi:.https://doi.org/10.1136/annrheumdis-2016-209775
  17. Martín-Martínez MA, González-Juanatey C, Castañeda S, Llorca J, Ferraz-Amaro I, Fernández-Gutiérrez B, et al. Recommendations for the management of cardiovascular risk in patients with rheumatoid arthritis: scientific evidence and expert opinion. Semin Arthritis Rheum. 2014;44(1):1–8. doi:.https://doi.org/10.1016/j.semarthrit.2014.01.002
  18. Roubille C, Richer V, Starnino T, McCourt C, McFarlane A, Fleming P, et al. Evidence-based recommendations for the management of comorbidities in rheumatoid arthritis, psoriasis, and psoriatic arthritis: expert opinion of the Canadian dermatology-rheumatology comorbidity initiative. J Rheumatol. 2015;42(10):1767–80. doi:.https://doi.org/10.3899/jrheum.141112
  19. Dessein PH, Norton GR, Woodiwiss AJ, Joffe BI, Wolfe F. Influence of nonclassical cardiovascular risk factors on the accuracy of predicting subclinical atherosclerosis in rheumatoid arthritis. J Rheumatol. 2007;34(5):943–51.
  20. del Rincón I, Freeman GL, Haas RW, O’Leary DH, Escalante A. Relative contribution of cardiovascular risk factors and rheumatoid arthritis clinical manifestations to atherosclerosis. Arthritis Rheum. 2005;52(11):3413–23. doi:.https://doi.org/10.1002/art.21397
  21. Solomon DH, Greenberg J, Curtis JR, Liu M, Farkouh ME, Tsao P, et al. Derivation and internal validation of an expanded cardiovascular risk prediction score for rheumatoid arthritis: a Consortium of Rheumatology Researchers of North America Registry Study. Arthritis Rheumatol. 2015;67(8):1995–2003. doi:.https://doi.org/10.1002/art.39195
  22. Rollefstad S, Kvien TK, Holme I, Eirheim AS, Pedersen TR, Semb AG. Treatment to lipid targets in patients with inflammatory joint diseases in a preventive cardio-rheuma clinic. Ann Rheum Dis. 2013;72(12):1968–74. doi:.https://doi.org/10.1136/annrheumdis-2012-202789
  23. Greenland P, Alpert JS, Beller GA, Benjamin EJ, Budoff MJ, Fayad ZA, et al.; American College of Cardiology Foundation; American Heart Association. 2010 ACCF/AHA guideline for assessment of cardiovascular risk in asymptomatic adults: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol. 2010;56(25):e50–103. doi:.https://doi.org/10.1016/j.jacc.2010.09.001
  24. Gonzalez-Juanatey C, Llorca J, Martin J, Gonzalez-Gay MA. Carotid intima-media thickness predicts the development of cardiovascular events in patients with rheumatoid arthritis. Semin Arthritis Rheum. 2009;38(5):366–71. doi:.https://doi.org/10.1016/j.semarthrit.2008.01.012
  25. Evans MR, Escalante A, Battafarano DF, Freeman GL, O’Leary DH, del Rincón I. Carotid atherosclerosis predicts incident acute coronary syndromes in rheumatoid arthritis. Arthritis Rheum. 2011;63(5):1211–20. doi:.https://doi.org/10.1002/art.30265
  26. O’Leary DH, Bots ML. Imaging of atherosclerosis: carotid intima-media thickness. Eur Heart J. 2010;31(14):1682–9. doi:.https://doi.org/10.1093/eurheartj/ehq185
  27. Aletaha D, Neogi T, Silman AJ, Funovits J, Felson DT, Bingham CO, 3rd, et al. 2010 rheumatoid arthritis classification criteria: an American College of Rheumatology/European League Against Rheumatism collaborative initiative. Ann Rheum Dis. 2010;69(9):1580–8. doi:.https://doi.org/10.1136/ard.2010.138461
  28. Mancia G, Fagard R, Narkiewicz K, Redón J, Zanchetti A, Böhm M, et al.; Task Force Members. 2013 ESH/ESC Guidelines for the management of arterial hypertension: the Task Force for the management of arterial hypertension of the European Society of Hypertension (ESH) and of the European Society of Cardiology (ESC). J Hypertens. 2013;31(7):1281–357. doi:.https://doi.org/10.1097/01.hjh.0000431740.32696.cc
  29. Wolfe F. Which HAQ is best? A comparison of the HAQ, MHAQ and RA-HAQ, a difficult 8 item HAQ (DHAQ), and a rescored 20 item HAQ (HAQ20): analyses in 2,491 rheumatoid arthritis patients following leflunomide initiation. J Rheumatol. 2001;28(5):982–9.
  30. Aletaha D, Nell VP, Stamm T, Uffmann M, Pflugbeil S, Machold K, et al. Acute phase reactants add little to composite disease activity indices for rheumatoid arthritis: validation of a clinical activity score. Arthritis Res Ther. 2005;7(4):R796–806. doi:.https://doi.org/10.1186/ar1740
  31. Pincus T, Summey JA, Soraci SA, Jr, Wallston KA, Hummon NP. Assessment of patient satisfaction in activities of daily living using a modified Stanford Health Assessment Questionnaire. Arthritis Rheum. 1983;26(11):1346–53. doi:.https://doi.org/10.1002/art.1780261107
  32. Mierau M, Schoels M, Gonda G, Fuchs J, Aletaha D, Smolen JS. Assessing remission in clinical practice. Rheumatology (Oxford). 2007;46(6):975–9. doi:.https://doi.org/10.1093/rheumatology/kem007
  33. Anderson KM, Odell PM, Wilson PW, Kannel WB. Cardiovascular disease risk profiles. Am Heart J. 1991;121(1):293–8. doi:.https://doi.org/10.1016/0002-8703(91)90861-B
  34. Pencina MJ, D’Agostino RB, Sr, Larson MG, Massaro JM, Vasan RS. Predicting the 30-year risk of cardiovascular disease: the framingham heart study. Circulation. 2009;119(24):3078–84. doi:.https://doi.org/10.1161/CIRCULATIONAHA.108.816694
  35. Gabriel SE, Crowson CS. Risk factors for cardiovascular disease in rheumatoid arthritis. Curr Opin Rheumatol. 2012;24(2):171–6. doi:.https://doi.org/10.1097/BOR.0b013e32834ff2fd
  36. Stone NJ, Robinson JG, Lichtenstein AH, Bairey Merz CN, Blum CB, Eckel RH, et al.; American College of Cardiology/American Heart Association Task Force on Practice Guidelines. 2013 ACC/AHA guideline on the treatment of blood cholesterol to reduce atherosclerotic cardiovascular risk in adults: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. Circulation. 2014;129(25, Suppl 2):S1–45. doi:.https://doi.org/10.1161/01.cir.0000437738.63853.7a
  37. Stein JH, Korcarz CE, Hurst RT, Lonn E, Kendall CB, Mohler ER, et al.; American Society of Echocardiography Carotid Intima-Media Thickness Task Force; Endorsed by the Society for Vascular Medicine. Use of carotid ultrasound to identify subclinical vascular disease and evaluate cardiovascular disease risk: a consensus statement from the American Society of Echocardiography Carotid Intima-Media Thickness Task Force. J Am Soc Echocardiogr. 2008;21(2):93–111, quiz 189–90. doi:.https://doi.org/10.1016/j.echo.2007.11.011
  38. Touboul PJ, Hennerici MG, Meairs S, Adams H, Amarenco P, Bornstein N, et al. Mannheim carotid intima-media thickness consensus (2004-2006). An update on behalf of the Advisory Board of the 3rd and 4th Watching the Risk Symposium, 13th and 15th European Stroke Conferences, Mannheim, Germany, 2004, and Brussels, Belgium, 2006. Cerebrovasc Dis. 2007;23(1):75–80. doi:.https://doi.org/10.1159/000097034
  39. Corrales A, González-Juanatey C, Peiró ME, Blanco R, Llorca J, González-Gay MA. Carotid ultrasound is useful for the cardiovascular risk stratification of patients with rheumatoid arthritis: results of a population-based study. Ann Rheum Dis. 2014;73(4):722–7. doi:.https://doi.org/10.1136/annrheumdis-2012-203101
  40. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143(1):29–36. doi:.https://doi.org/10.1148/radiology.143.1.7063747
  41. Hanley JA, McNeil BJ. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology. 1983;148(3):839–43. doi:.https://doi.org/10.1148/radiology.148.3.6878708
  42. Crowson CS, Gabriel SE, Semb AG, van Riel PLCM, Karpouzas G, Dessein PH, et al.; Trans-Atlantic Cardiovascular Consortium for Rheumatoid Arthritis. Rheumatoid arthritis-specific cardiovascular risk scores are not superior to general risk scores: a validation analysis of patients from seven countries. Rheumatology (Oxford). 2017;56(7):1102–10. doi:.https://doi.org/10.1093/rheumatology/kex038
  43. Ikdahl E, Rollefstad S, Olsen IC, Kvien TK, Hansen IJ, Soldal DM, et al. EULAR task force recommendations on annual cardiovascular risk assessment for patients with rheumatoid arthritis: an audit of the success of implementation in a rheumatology outpatient clinic. BioMed Res Int. 2015;2015:515280. doi:.https://doi.org/10.1155/2015/515280
  44. Aviña-Zubieta JA, Abrahamowicz M, De Vera MA, Choi HK, Sayre EC, Rahman MM, et al. Immediate and past cumulative effects of oral glucocorticoids on the risk of acute myocardial infarction in rheumatoid arthritis: a population-based study. Rheumatology (Oxford). 2013;52(1):68–75. doi:.https://doi.org/10.1093/rheumatology/kes353
  45. Prasad M, Hermann J, Gabriel SE, Weyand CM, Mulvagh S, Mankad R, et al. Cardiorheumatology: cardiac involvement in systemic rheumatic disease. Nat Rev Cardiol. 2015;12(3):168–76. doi:.https://doi.org/10.1038/nrcardio.2014.206
  46. Pyörälä K, De Backer G, Graham I, Poole-Wilson P, Wood D. Prevention of coronary heart disease in clinical practice. Recommendations of the Task Force of the European Society of Cardiology, European Atherosclerosis Society and European Society of Hypertension. Eur Heart J. 1994;15(10):1300–31.
  47. Woodward M, Brindle P, Tunstall-Pedoe H ; SIGN group on risk estimation. Adding social deprivation and family history to cardiovascular risk assessment: the ASSIGN score from the Scottish Heart Health Extended Cohort (SHHEC). Heart. 2007;93(2):172–6. doi:.https://doi.org/10.1136/hrt.2006.108167
  48. Hata J, Nagai A, Hirata M, Kamatani Y, Tamakoshi A, Yamagata Z, et al.; Biobank Japan Cooperative Hospital Group. Risk prediction models for mortality in patients with cardiovascular disease: The BioBank Japan project. J Epidemiol. 2017;27(3):S71–6. doi:.https://doi.org/10.1016/j.je.2016.10.007
  49. Ridker PM, Paynter NP, Rifai N, Gaziano JM, Cook NR. C-reactive protein and parental history improve global cardiovascular risk prediction: the Reynolds Risk Score for men. Circulation. 2008;118(22):2243–51, 4p, 2251. doi:.https://doi.org/10.1161/CIRCULATIONAHA.108.814251
  50. Cooney MT, Dudina AL, Graham IM. Value and limitations of existing scores for the assessment of cardiovascular risk: a review for clinicians. J Am Coll Cardiol. 2009;54(14):1209–27. doi:.https://doi.org/10.1016/j.jacc.2009.07.020
  51. Tournadre A, Tatar Z, Pereira B, Chevreau M, Gossec L, Gaudin P, et al. Application of the European Society of Cardiology, Adult Treatment Panel III and American College of Cardiology/American Heart Association guidelines for cardiovascular risk management in a French cohort of rheumatoid arthritis. Int J Cardiol. 2015;183:149–54. doi:.https://doi.org/10.1016/j.ijcard.2015.01.069
  52. Galarza-Delgado DA, Azpiri-Lopez JR, Colunga-Pedraza IJ, Cardenas-de la Garza JA, Vera-Pineda R, Serna-Peña G, et al. Assessment of six cardiovascular risk calculators in Mexican mestizo patients with rheumatoid arthritis according to the EULAR 2015/2016 recommendations for cardiovascular risk management. Clin Rheumatol. 2017;36(6):1387–93. doi:.https://doi.org/10.1007/s10067-017-3551-7
  53. Ozen G, Sunbul M, Atagunduz P, Direskeneli H, Tigen K, Inanc N. The 2013 ACC/AHA 10-year atherosclerotic cardiovascular disease risk index is better than SCORE and QRisk II in rheumatoid arthritis: is it enough? Rheumatology (Oxford). 2016;55(3):513–22.
  54. Roman MJ, Moeller E, Davis A, Paget SA, Crow MK, Lockshin MD, et al. Preclinical carotid atherosclerosis in patients with rheumatoid arthritis. Ann Intern Med. 2006;144(4):249–56. doi:.https://doi.org/10.7326/0003-4819-144-4-200602210-00006
  55. Stamatelopoulos KS, Kitas GD, Papamichael CM, Chryssohoou E, Kyrkou K, Georgiopoulos G, et al. Atherosclerosis in rheumatoid arthritis versus diabetes: a comparative study. Arterioscler Thromb Vasc Biol. 2009;29(10):1702–8. doi:.https://doi.org/10.1161/ATVBAHA.109.190108
  56. Vandhuick T, Allanore Y, Borderie D, Louvel JP, Fardellone P, Dieudé P, et al. Early phase clinical and biological markers associated with subclinical atherosclerosis measured at 7 years of evolution in an early inflammatory arthritis cohort. Clin Exp Rheumatol. 2016;34(1):58–67.
  57. Kerekes G, Soltész P, Nurmohamed MT, Gonzalez-Gay MA, Turiel M, Végh E, et al. Validated methods for assessment of subclinical atherosclerosis in rheumatology. Nat Rev Rheumatol. 2012;8(4):224–34. doi:.https://doi.org/10.1038/nrrheum.2012.16
  58. Gonzalez-Gay MA, Gonzalez-Juanatey C, Vazquez-Rodriguez TR, Martin J, Llorca J. Endothelial dysfunction, carotid intima-media thickness, and accelerated atherosclerosis in rheumatoid arthritis. Semin Arthritis Rheum. 2008;38(2):67–70. doi:.https://doi.org/10.1016/j.semarthrit.2008.02.001
  59. Nambi V, Chambless L, Folsom AR, He M, Hu Y, Mosley T, et al. Carotid intima-media thickness and presence or absence of plaque improves prediction of coronary heart disease risk: the ARIC (Atherosclerosis Risk In Communities) study. J Am Coll Cardiol. 2010;55(15):1600–7. doi:.https://doi.org/10.1016/j.jacc.2009.11.075
  60. Salonen R, Salonen JT. Determinants of carotid intima-media thickness: a population-based ultrasonography study in eastern Finnish men. J Intern Med. 1991;229(3):225–31. doi:.https://doi.org/10.1111/j.1365-2796.1991.tb00336.x
  61. Howard G, Burke GL, Evans GW, Crouse JR, 3rd, Riley W, Arnett D, et al. Relations of intimal-medial thickness among sites within the carotid artery as evaluated by B-mode ultrasound. ARIC Investigators. Atherosclerosis Risk in Communities. Stroke. 1994;25(8):1581–7. doi:.https://doi.org/10.1161/01.STR.25.8.1581
  62. de Groot E, van Leuven SI, Duivenvoorden R, Meuwese MC, Akdim F, Bots ML, et al. Measurement of carotid intima-media thickness to assess progression and regression of atherosclerosis. Nat Clin Pract Cardiovasc Med. 2008;5(5):280–8. doi:.https://doi.org/10.1038/ncpcardio1163
  63. Kooter AJ, Kostense PJ, Groenewold J, Thijs A, Sattar N, Smulders YM. Integrating information from novel risk factors with calculated risks: the critical impact of risk factor prevalence. Circulation. 2011;124(6):741–5. doi:.https://doi.org/10.1161/CIRCULATIONAHA.111.035725
  64. Dessein PH, Corrales A, Lopez-Mejias R, Solomon A, Woodiwiss AJ, Llorca J, et al. The Framingham Score and the Systematic Coronary Risk Evaluation at Low Cutoff Values Are Useful Surrogate Markers of High-risk Subclinical Atherosclerosis in Patients with Rheumatoid Arthritis. J Rheumatol. 2016;43(3):486–94. doi:.https://doi.org/10.3899/jrheum.150510
  65. Wahlin B, Meedt T, Jonsson F, Henein MY, Wållberg-Jonsson S. Coronary Artery Calcification Is Related to Inflammation in Rheumatoid Arthritis: A Long-Term Follow-Up Study. BioMed Res Int. 2016;2016:1261582. doi:.https://doi.org/10.1155/2016/1261582