Issue 6 / 23 February 2015

EXPERTS still support the use of absolute cardiovascular disease risk calculators in practice, despite evidence that they overestimate the likelihood of vascular events and concerns they may lead to overtreatment.

A 10-year prospective study, published in Annals of Internal Medicine, found the three widely used Framingham algorithms and the new American Heart Association and American College of Cardiology atherosclerotic cardiovascular disease (AHA-ACC-ASCVD) risk score overestimated the risk of vascular events by 37%‒154% in men and 8%‒67% in women. (1)

A fifth calculator — the Reynolds Risk Score, which included family history and high-sensitivity C-reactive protein — was found to be better calibrated, but it underestimated risk in women by 21%.

The study was based on a multiethnic US cohort of 4227 people (26% African American, 20% Hispanic, 12% Chinese) aged 50–74 years without CVD or diabetes at baseline.

Concerns had previously been raised about the applicability of the Framingham equations outside of white populations. However, the new AHA-ACC-ASCVD score, which was derived from multiethnic cohorts to overcome this problem, did not perform any better in the current study.

For instance, in men and women predicted to have 10-year risk scores between 7.5% and 10% by the AHA-ACC-ASCVD score, the actual observed risks were only 3% and 5.1%, respectively.

The study found medication use and interim revascularisations were “not robust explanations of the overestimation”. Nor could the results be entirely explained by the changing significance of risk factors between older and modern cohorts, study participation bias or incomplete capture of cardiovascular events, the authors said.

They raised concerns that overestimation leading to overtreatment which “could result in more health care dollars spent, less health gain, and exposure to drug side effects”.

An accompanying editorial by the developers of the Reynolds score noted that, reassuringly, all five models correctly rank-ordered the higher- and low-risk participants. (2)

However, the study authors said that overestimation was a problem across the continuum of risk for these tools, “including the intermediate risk groups in which treatment decisions balancing therapeutic risk and benefit are more challenging”.

The editorial suggested three ways in which clinicians might respond to the limitations of the calculators: recalibrating the algorithm, simultaneously calculating multiple risk algorithms, or electing to “ignore the problem and accept that more persons will be treated with a class of drugs proven to reduce vascular event rates”.

In support of the third option, it argued “systematic overestimation of risk may be less concerning for statin use because meta-analyses indicate that statins achieve risk reduction even among patients at low levels of absolute risk and the benefits of vascular event reduction seem to exceed the [small increase in] risk of diabetes [from statins]”.

Associate Professor Scott Kinlay, an Australian cardiologist based at the US Department of Veterans Affairs Boston Healthcare System and associate professor in medicine at Harvard Medical School, agreed that the risks of overestimation and resultant overtreatment with statins were likely to be less important, particularly in populations with a high prevalence of disease.

“There is a very small risk of rare and mostly reversible myopathies with statins, but this is arguably less important than if you undertreat high-risk patients and end up with more heart disease”, he told MJA InSight.

Professor Kinlay stressed that the findings of the latest US study could not always be extrapolated to other populations, adding that underestimation, rather than overestimation, may be the problem in other settings.

“If you use these calculators in higher-risk communities where people have poor diets and exercise little, you may find these calculators underestimate risk because the overall incidence of cardiovascular disease is so high, whereas in lower-risk communities they are more likely to overestimate risk”, he said.

He urged doctors to choose a well publicised risk calculator that was easy to apply, and to interpret the results in light of the background prevalence of cardiovascular disease in their region.

“Risk calculators are an imperfect but pragmatic tool for clinical practice, particularly when it comes to making decisions about the patient whose risk is unclear”, he said.

Professor Mark Harris, executive director of the Centre for Primary Health Care and Equity at the University of NSW, said that while risk calculators were imperfect, they were far more reliable than basing prescribing decisions on a single risk factor.

“While there may be some overestimation with risk calculators in some populations, a much bigger problem [in terms of overtreatment] is the large number of low-risk people receiving pharmacological intervention based on a single risk factor such as slightly elevated blood pressure or slightly elevated cholesterol”, he told MJA InSight.

Professor Harris suggested that using a risk calculator would help doctors distinguish between patients who would benefit from lifestyle interventions alone and those who would benefit from antihypertensives and lipid-lowering medications.

He also cautioned that in some populations, such as Indigenous communities, Framingham-based risk calculators had been shown to underestimate cardiovascular risk.


1. Ann Intern Med 2015; 162: 266-275
2. Ann Intern Med 2015; 162: 313-314

(Photo: Rawpixel / shutterstock)

2 thoughts on “Tick for CVD risk calculators

  1. Sue Ieraci says:

    The comment above about Statins in the elderly is pertinent. Quite apart from side-effects in the elderly, what is the point of continuing risk reduction in the very old? There comes a time when an organ system fails. This is how life eventually ends. Tools and strategies that are appropriate in a person’s sixties may not be appropriate into ripe old age.

  2. Anthony Collins says:

    …..overestimated the risk of vascular events by 37%‒154% in men and 8%‒67% in women. (1)

    While I do not dispute the benefit of statins in reducing clinical risk of CV events in high risk patients there needs to be a better balance between the decision to treat and minimise risk for lower risk patients and the need to allow elderly people to have a better quality of life

    What concerns me about statins is the unseen and insidious onset of reduction in mental ability in some elderly people. This is put down to getting old but when the statins are ceased mental cognition generally improves

    This is from personal family experience

    What good is a “healthy” heart when the brain has been affected by the very drugs that have kept the heart “healthy”

    Regretfully I think in years to come we are going to find this is a bigger problem than people realise and it will need some researchers to do a trial testing patients for mental agility after a several years of statin use and then cease statins ~6 months and re test.

    Doubtless the manufacturers will fight this type of trial tooth and claw as they have a vested interest in putting everyone on a statin for life

    To me it comes down to quality of life




Leave a Reply

Your email address will not be published. Required fields are marked *