Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Development of a clinical decision tool to reduce diagnostic testing for primary aldosteronism in patients with difficult-to-control hypertension

BMC Endocrine Disorders volume 20, Article number: 56 (2020) Cite this article

Abstract

Background

Satisfactory tools to preclude low-risk patients from intensive diagnostic testing for primary aldosteronism (PA) are lacking. Therefore, we aimed to develop a decision tool to determine which patients with difficult-to-control hypertension have a low probability of PA, thereby limiting the exposure to invasive testing while at the same time increasing the efficiency of testing in the remaining patients.

Methods

Data from consecutive patients with difficult-to-control hypertension, analysed through a standardized diagnostic protocol between January 2010 and October 2017 (n = 824), were included in this cross-sectional study. PA was diagnosed by a combined approach: 1) elevated aldosterone-to-renin ratio (> 5.0 pmol/fmol/s), confirmed with 2) non-suppressible aldosterone after standardized saline infusion (≥280 pmol/L). Multivariable logistic regression analyses including seven pre-specified clinical variables (age, systolic blood pressure, serum potassium, potassium supplementation, serum sodium, eGFR and HbA1c) was performed. After correction for optimism, test reliability, discriminative performance and test characteristics were determined.

Results

PA was diagnosed in 40 (4.9%) of 824 patients. Predicted probabilities of PA agreed well with observed frequencies and the c-statistic was 0.77 (95% confidence interval (95%CI) 0.70–0.83). Predicted probability cut-off values of 1.0–2.5% prevented unnecessary testing in 8–32% of the patients with difficult-to-control hypertension, carrying sensitivities of 0.98 (95%CI 0.96–0.99) and 0.92 (0.83–0.97), and negative predictive values of 0.99 (0.98–1.00) and 0.99 (0.97–0.99).

Conclusions

With a decision tool, based on seven easy-to-measure clinical variables, patients with a low probability of PA can be reliably selected and a considerable proportion of patients with difficult-to-control hypertension can be spared intensive diagnostic testing.

Peer Review reports

Background

Primary aldosteronism (PA) is one of the most common causes of secondary hypertension. The estimated prevalence ranges from 3–6% in primary care [1, 2] to 5–11% in referred hypertensive patients [3, 4] and is even higher in patients with resistant hypertension (more than 11%) [5]. Diagnosing PA is important as targeted therapy may lower the increased risk for cardiovascular events and target organ damage [6] in these patients.

As supported by the Endocrine Society Clinical Practice Guideline, diagnosis of PA is generally made by a sequence of blood tests: elevated aldosterone-to-renin ratio (ARR) [7], followed by confirmation of autonomous aldosterone production by non-suppressible aldosterone levels [8]. Many antihypertensive medications change renin and aldosterone levels, falsely increasing or decreasing the ARR, which leads to false positive or false negative test results [9, 10]. Therefore, aldosterone and renin levels are usually determined after cessation of antihypertensive medications that affect the ARR [8]. However, medication washout raises safety concerns in patients with severe hypertension or individuals with a recent cardiovascular event in which tight blood pressure (BP) control is necessary. In addition, a substantial number of patients experience symptoms during the washout period: i.e. (worsening of) headache, fatigue or palpitations.

Since diagnostic testing is burdensome, potentially harmful and costly, it is necessary to select carefully which patients to further test for PA. The Endocrine Society Clinical Practice Guideline recommends to perform diagnostic testing in all patients with ‘an increased risk of having PA’, this includes patients with hypertension and either sustained BP above 150/100 mmHg, spontaneous or diuretic-induced hypokalemia, adrenal incidentaloma, obstructive sleep apnea or a family history of early onset hypertension or cerebrovascular accident, patients with resistant hypertension and first-degree relatives of patients with PA [8]. The majority of hypertensive patients referred to hospitals fulfil at least one of these criteria, meaning that most referred patients should be tested for PA. With a prevalence of 4–10% this strategy results in many negative test results and thus to unnecessary testing and costs. This may be one of the reasons that the Clinical Practice Guideline is poorly adopted and that many patients with hypertension are left unscreened for PA [11]. Therefore, we aimed to develop and validate a clinical decision tool to determine which patients with difficult-to-control hypertension have a low probability of PA and do not need to undergo intensive testing. Thereby we aim to limit exposure to invasive testing while at the same time increasing the efficiency of testing in the remaining patients.

Methods

Study population

1125 hypertensive patients were referred to the University Medical Center Utrecht between January 2010 and October 2017. Patients with difficult-to-control hypertension, defined as persistent hypertension despite treatment according to the current guidelines and/or presence of (sub) clinical vascular disease [12], were eligible for this cross-sectional study. These patients reflect the group of patients commonly referred by general practitioners. Patients with difficult-to-control hypertension underwent an extensive, standardized diagnostic protocol to evaluate the cause of hypertension. The diagnostic protocol has been outlined in detail previously [13]. In general, patient selection for this protocol was in line with the Endocrine Society Clinical Practice Guideline recommendations, which recommends widespread screening for PA. Since participants in this study were not subject to procedures and were not required to follow rules of behaviour outside the scope of routine clinical practice, no formal consent was required [14, 15], which was approved by the institutional ethics committee (Medisch Ethische Toetsingscommissie Utrecht, University Medical Center Utrecht, Utrecht, The Netherlands). Patients who were normotensive on 24-h ambulatory BP measurement, patients with an evident and treatable cause of hypertension such as steroid or excessive liquorice use, and patients with a recent cardiovascular event in which withdrawal of antihypertensive medication was not safe, did not undergo the extensive, standardized diagnostic work-up and were excluded from this study (n = 299).

Baseline measurements

During the first hospital visit information on patient demographics, medical history and medication use was collected. Office BP was measured with an automated oscillometric device (Omron M7 Intelli IT, OMRON Healthcare, Hoofddorp, Netherlands; or WatchBP Office, Microlife, Widnau, Switzerland) after five min rest while the patient was seated. Three readings were recorded, simultaneously on both arms, and one min apart. The third BP measurement on the arm that measured the highest BP was recorded. 24-h ambulatory BP measurement (WatchBP O3 Ambulatory, Microlife, Widnau, Switzerland) was also performed on the arm that measured the highest BP and recorded BP every 20 to 30 min, day and night. Screening for obstructive sleep apnea was performed with the Philips questionnaire. Patients at intermediate or high risk for obstructive sleep apnea as determined by this questionnaire, were additionally screened by the overnight RUSleeping RTS [16]. Patients with more than 15 events per hour were considered having probable obstructive sleep apnea. Blood tests were performed and included fasting glucose, HbA1c, sodium, potassium, creatinine, cholesterol levels, TSH and fT4. Urinary sodium, albumin and creatinine were determined in the first morning-void urine sample. Calculated albumin-to-creatinine ratios were categorized into category 1 (< 3 mg/mmol), category 2 (3–30 mg/mmol) or category 3 (≥30 mg/mmol).

The diagnostic protocol was changed in June 2015. Before that time, the protocolised set of laboratory tests was performed during the medication washout period. Baseline laboratory tests and pre-washout 24-h ambulatory BP measurements were only performed as indicated.

Diagnosis of primary aldosteronism

Aldosterone and renin levels were measured after cessation of antihypertensive medication for 2 to 6 weeks: 2 weeks for ACE inhibitors, angiotensin II antagonists, calcium channel blockers, alpha blockers and direct vasodilators; 4 weeks for diuretics and beta blockers (the latter including a two-week tapering scheme); and 6 weeks for mineralocorticoid receptor antagonists and direct renin inhibitors. In addition, oral contraceptives and NSAIDs were discontinued for at least six respectively 2 weeks. If BP rose above the predetermined BP level or if the patient experienced hypertensive symptoms, diltiazem and/or doxazosin [9] were prescribed. Plasma aldosterone concentration (PAC; pmol/L) and plasma renin activity (PRA; fmol/L/s) were measured seated in the early morning after patients had been up for at least 90 min and after correction of hypokalemia (potassium < 3.8 mmol/L). PAC and PRA were both measured using a radioimmunoassay, the methodology has been described elsewhere [17]. The ARR was calculated by dividing PAC by PRA. The ARR cut-off value was 5 pmol/fmol/s, which has been shown to reach a sensitivity of 100% in our laboratory [17]. The diagnosis of PA was confirmed by a non-suppressible aldosterone (≥280 pmol/L) after salt loading (SLT) with two liters intravenous saline (0.9%) infusion in 4 h [8]. A CT-scan with/without adrenal venous sampling (AVS) was performed to distinguish between unilateral PA (i.e. aldosterone-producing adenomas or unilateral adrenal hyperplasia) and bilateral PA (bilateral adrenal hyperplasia).

Statistical analyses

The decision tool was built with the following pre-specified clinical variables: age, 24-h ambulatory systolic BP, serum potassium, potassium supplementation (yes/no), serum sodium, eGFR and HbA1c. These variables were chosen based on findings from previous studies in which they significantly differed between patients with PA and primary hypertension and/or were independently associated with PA [3, 18,19,20]. More importantly, these clinical variables are easy to obtain in the hospital setting as well as in general practice, enabling widespread use of the diagnostic model.

Patients with a missing reference test (ARR or saline infusion test result after elevated ARR) were excluded from analysis (n = 2). Baseline characteristics are given for the observed, non-imputed data. Missing values for the variables in the model were assumed to be missing at random conditional on other observed variables and/or the outcome. For further analysis, missing values (age, n = 1; 24-h ambulatory systolic BP, n = 497; serum potassium, n = 451; potassium supplementation, n = 0; serum sodium, n = 454; eGFR, n = 413; and HbA1c, n = 76) were imputed using 20-fold multiple imputation by predictive mean matching (for continuous variables) and polytomous regression (for categorical variables) (R-package MICE). A complete case analysis excluding these patients would yield loss of efficiency and would provide biased results, since missing data rarely occur completely at random and are usually dependent on the outcome [21]. The imputation model included the seven clinical characteristics for the decision tool, the outcome, and several other clinical variables collected during the outpatient visits [22] including prescribed antihypertensive medication, measures of target organ damage and laboratory values measured during medication washout. Ambulatory blood pressure and laboratory values of potassium, sodium and creatinine measured during medication washout were available for > 96 and > 99% of the patients with missing baseline values. Primarily using these follow-up values to build the decision tool would provide incorrect estimates as medication withdrawal changes the laboratory values.

Model derivation was performed by multivariable logistic regression, including the seven pre-specified clinical variables. A separate model was fit on each multiply imputed dataset. No variable selection was performed. Variables were logarithmically or quadratically transformed if this improved overall model fit, determined by Akaike’s Information Criterion. Internal validation was performed by applying a bootstrap-based shrinkage technique [23, 24]. The intercept was adjusted after recalibration.

Model performance was assessed by discrimination and calibration. In addition, test characteristics for different cut-off values of the predicted probability were determined. Discriminative performance was estimated by pooling the c-statistics from each dataset using Rubin’s rule. Test characteristics (positive and negative predictive value (PPV and NPV), positive and negative likelihood ratio (LR+ and LR-), sensitivity and specificity) were obtained similarly. These estimates and their standard errors (except LR+) were logit transformed, pooled by using Rubin’s rule, and then back transformed [25]. The calibration plot was obtained by plotting the observed frequencies of PA against the pooled predictions of the 20 imputed datasets. The final model was presented after pooling the shrunken beta coefficients, recalibrated intercepts and standard errors through Rubin’s rule.

Since other centers may use different post-SLT aldosterone cut-off values to increase sensitivity of the confirmation test, sensitivity analysis was performed by using the final model to predict PA defined as ARR > 5 pmol/fmol/sec confirmed by post-SLT aldosterone ≥190 pmol/L. Predicted probabilities, c-statistic and test characteristics were obtained by applying the final model to the 20 imputed datasets and pooling the results in a similar way as described above. All statistical analyses were performed with R, version 3.4.3 (R Development Core Team, Vienna, Austria).

Results

Baseline characteristics and prevalence of PA

Baseline characteristics for patients included in this cross-sectional, diagnostic study differed from those who were excluded: age 53.2 (±13.3) vs 58.1 (±15.9) years, family history of hypertension 66% vs 54%, 24-h ambulatory BP 144/86 (±17/11) vs 134/78 (±18/10) mmHg and probable obstructive sleep apnea 19% vs 42% (Supplementary File 1). Although the study population comprised 49% women, the proportion of women among the PA cases was only 20% (Table 1). The majority of the patients (94% in the original, non-imputed dataset) fulfilled the Endocrine Society Guidelines of increased risk for PA. 137 of 824 patients (17%) had an elevated ARR (> 5 pmol/fmol/s) and 40 patients (4.9%) had a confirmed diagnosis of PA after saline infusion. AVS was performed in 29 patients, 17 showed lateralization and were therefore diagnosed as having unilateral PA. In 10 patients PA subtyping was based on the CT-scan, which showed a unilaterally enlarged adrenal gland in four patients. One patient did not undergo additional subtyping.

Table 1 Patient characteristics summarized for the total population and patients with and without primary aldosteronism
Full size table

Development and validation of the diagnostic model

The average shrinkage factor over the 20 imputed datasets was 0.78, resulting in the following diagnostic model after pooling:

Predicted probability = 1/(1 + exp-(− 27.3348 + 0.2082*age (in years) – 0.0021*age (in years)2 + 0.0138*24-h ambulatory systolic BP (in mmHg) – 0.8296*potassium (in mmol/L) + 1.5057 (if potassium is supplemented) + 0.1593*sodium (in mmol/L) – 0.0103*eGFR (in mmol/L) – 0.0246*HbA1c (in mmol/mol))).

The predicted probability for an individual patient can be calculated by using the calculator provided in Supplementary File 2. Pooled model coefficients and odds ratios are presented in Table 2. The calibration plot (Fig. 1) shows the agreement between predicted probabilities and observed frequencies of PA. The discriminative ability of the diagnostic tool was moderate to good with a c-statistic of 0.77 (95%CI 0.70–0.83) (Fig. 2). Table 3 shows the test characteristics (sensitivity, specificity, PPV, NPV, LR+ and LR-) and proportion of patients spared intensive testing for predicted probability cut-off values between 1.0 and 2.5%. This range is chosen as this is the zone where clinical decision making is going on. The proportion of patients spared intensive testing reflects the proportion of patients with a predicted probability equal to or below the cut-off value in which (according to our decision tool) no further testing is needed, and is estimated at 8% (95%CI 4–18%) to 32% (18–50%). These cut-off values carry a sensitivity of 0.98 (95%CI 0.96–0.99) and 0.92 (0.83–0.97), and NPV of 0.99 (0.98–1.00) and 0.99 (0.97–0.99). Sensitivity analysis predicting PA when a lower post-SLT aldosterone cut-off value (≥190 pmol/L) was applied, hardly changed sensitivity and NPV, and demonstrated similar agreement (Supplementary files 3–4).

Table 2 Model coefficients and odds ratios
Full size table
Fig. 1
figure 1

Calibration plot showing the agreement between predicted and observed probabilities of primary aldosteronism. Error bars represent corresponding Bootstrap-based standard errors. PA = primary aldosteronism

Full size image
Fig. 2
figure 2

Receiver operating characteristics (ROC) curve showing the discriminative performance of the diagnostic tool. Discriminative performance is the ability of the model to distinguish between patients with and without primary aldosteronism. The ROC curve plots the sensitivity vs specificity for different cut-off values of the tool (predicted probabilities)

Full size image
Table 3 Test characteristics and proportion of patients spared intensive testing
Full size table

Discussion

The main finding of this cross-sectional, diagnostic study is that a decision tool with seven easy-to-measure clinical variables can reliably select patients with difficult-to-control hypertension with a low probability of PA, sparing 8 to 32% of patients intensive diagnostic testing.

This is an important finding since satisfactory tools to preclude low-risk patients from diagnostic testing are lacking. There is a need for diagnostic tools that reduce the number of patients to be intensively tested for PA to a greater extent than the algorithm provided by the Endocrine Society does. Moreover, results from a French study deriving a diagnostic model to estimate the probability of PA in patients referred for PA screening [19], cannot be generalized to all patients referred with difficult-to-control hypertension. The investigators included a study population with a substantial higher prevalence of PA (elevated ARR was 45% compared to 17% in our study) and a relatively large proportion of patients on potassium supplementation. Moreover, they predicted the presence of elevated ARR instead of PA itself.

The population of patients with difficult-to-control hypertension in the present study represents the group of hypertensive patients generally referred by general practitioners, which is reflected by the prevalence of PA: 4.9% in this study compared to 4.6–11.2% in other cohorts of referred hypertensive patients [3, 4]. More importantly, the majority of the patients in this study fulfil the Endocrine Society Clinical Practice Guidelines of increased risk for PA [8]. Therefore, the decision tool in the present study adds diagnostic value on top of the diagnostic algorithm presented in the Guideline. The proportion of male PA patients in this study is relatively high, given the small number of PA cases in the present study, the observed difference may also be due to chance.

The clinical value of the decision tool lies in excluding PA, precluding low-risk patients from intensive diagnostic testing, rather than confirming PA. The extent to which it reduces the proportion of patients to be tested varies with the cut-off value chosen and depends on the clinical setting in which the decision tool will be applied. In community hospitals, where the prevalence of PA is relatively low, a high cut-off value (for example 2.5%) may be chosen, sparing intensive diagnostic testing in a considerable proportion of patients, while the absolute number of missed cases remains low. In a tertiary center, where the prevalence of PA is relatively high, a lower cut-off value (for example 1.5%) may be chosen, limiting the chance of a missed case but still reducing the diagnostic burden. By reducing the proportion of hypertensive patients to be intensively tested and increasing the probability of catching a PA case among those tested, our decision tool may motivate physicians to perform diagnostic workup for PA in patients with difficult-to-control hypertension, thereby reducing underdiagnoses.

One of the strengths of this study is that the reference test was missing in only two of the 826 patients. Additionally, the chance of missing a PA case based on a false negative ARR is low: sensitivity of the ARR (cut-off value 5 pmol/fmol/s) reached 100% (95%CI 75.9–100%) in our laboratory [17] and hypokalemia was corrected before it was determined. Since all patients were diagnosed by the same combined approach, our results do not suffer from differential verification bias. Yet, the aldosterone cut-off value of ≥280 pmol/L after saline infusion (as proposed by the Endocrine Society Clinical Practice Guideline [8]) on which PA diagnosis was based, is rather arbitrary and results in a small number of false negative test results [26, 27]. Some patients with an intermediate post-SLT aldosterone (140–280 pmol/L) do have the clinical syndrome of PA based on adrenal computed tomography, adrenal venous sampling and/or expert panel assessment [26]. However, sensitivity analysis showed that our decision tool also reliably selects patients at low risk for PA when a lower post-SLT cut-off value is used. In addition, patients with an intermediate test result are more likely to have idiopathic aldosteronism [27], limiting the chance of withholding a surgical cure for these patients, but possibly precluding them from receiving adequate medical treatment with a mineralocorticoid receptor antagonist. Other patients may have pre-stages of PA, illustrating the importance of repeated screening by the decision tool after several months or years. Another strength of this study is that clinical variables were routinely collected, resembling daily clinical practice, which is critical in a diagnostic study.

One of the limitations of this study, as in any study using multiple imputation methods to impute missing baseline values, is that the robustness of the method highly depends on the validity of the missing at random assumption. Although our diagnostic protocol was changed in June 2015 and many patients had missing values before that time, one third of the patients evaluated before June 2015 did have a complete set of baseline values. Therefore, these missings can be considered missing at random. Furthermore, although pre-specified clinical variables were used to minimize the risk of overfitting, the methodology by which these variables were selected was not systematic and is therefore vulnerable to bias. The lack of statistical significance for some of the pre-specified variables in the model can be the result of this unsystematic selection but can also be due to a lack of power. Finally, the model was not externally validated in another cohort of patients with difficult-to-control hypertension, which is required to guarantee generalizability and should be done before the decision tool is applied in clinical practice.

Conclusions

In conclusion, with a decision tool based on seven easy-to-measure clinical variables, patients with a low probability of PA can be reliably selected and a considerable proportion of patients with difficult-to-control hypertension can be spared further intensive diagnostic testing.

Future perspectives

By excluding patients at low risk for PA, the decision tool reduces the number of patients to be invasively tested and increases the efficiency of testing in the remaining patients, which will allow health-care providers to allocate their (financial) resources to patients with difficult-to-control hypertension at higher risk for PA. This work raises the opportunity for external validation in other patient populations (i.e. primary care) and may lead to extensive clinical application, better detection and, subsequently, earlier treatment of PA. Also, given the high prevalence of PA in drug-adherent patients as compared to non-adherent patients [28], adding a measure of adherence to the existing model may further improve the diagnostic accuracy of the decision tool. That may decrease the number of patients that need invasive testing even more.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

ARR:

Aldosterone-to-renin ratio

AVS:

Adrenal venous sampling

BP:

Blood pressure

NPV:

Negative predictive value

PA:

Primary aldosteronism

PAC:

Plasma aldosterone concentration

PPV:

Positive predictive value

PRA:

Plasma renin activity

SLT:

Salt loading test

References

  1. Fogari R, Preti P, Zoppi A, Rinaldi A, Fogari E, Mugellini A. Prevalence of primary aldosteronism among unselected hypertensive patients: a prospective study based on the use of an aldosterone/renin ratio above 25 as a screening test. Hypertens Res. 2007;30(2):111–7.

    Article  Google Scholar 

  2. Kayser SC, Deinum J, de Grauw WJ, Schalk BW, Bor HJ, Lenders JW, et al. Prevalence of primary aldosteronism in primary care: a cross-sectional study. Br J Gen Pract. 2018;68(667):e114–e22.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Rossi GP, Bernini G, Caliumi C, Desideri G, Fabris B, Ferri C, et al. A prospective study of the prevalence of primary aldosteronism in 1,125 hypertensive patients. J Am Coll Cardiol. 2006;48(11):2293–300.

    Article  CAS  Google Scholar 

  4. Mulatero P, Stowasser M, Loh KC, Fardella CE, Gordon RD, Mosso L, et al. Increased diagnosis of primary aldosteronism, including surgically correctable forms, in centers from five continents. J Clin Endocrinol Metab. 2004;89(3):1045–50.

    Article  CAS  Google Scholar 

  5. Douma S, Petidis K, Doumas M, Papaefthimiou P, Triantafyllou A, Kartali N, et al. Prevalence of primary hyperaldosteronism in resistant hypertension: a retrospective observational study. Lancet. 2008;371(9628):1921–6.

    Article  CAS  PubMed  Google Scholar 

  6. Monticone S, D'Ascenzo F, Moretti C, Williams TA, Veglio F, Gaita F, et al. Cardiovascular events and target organ damage in primary aldosteronism compared with essential hypertension: a systematic review and meta-analysis. Lancet Diabetes Endocrinol. 2018;6(1):41–50.

    Article  CAS  Google Scholar 

  7. Hiramatsu K, Yamada T, Yukimura Y, Komiya I, Ichikawa K, Ishihara M, et al. A screening test to identify aldosterone-producing adenoma by measuring plasma renin activity. Results in hypertensive patients. Arch Intern Med. 1981;141(12):1589–93.

    Article  CAS  Google Scholar 

  8. Funder JW, Carey RM, Mantero F, Murad MH, Reincke M, Shibata H, et al. The Management of Primary Aldosteronism: case detection, diagnosis, and treatment: an Endocrine Society clinical practice guideline. J Clin Endocrinol Metab. 2016;101(5):1889–916.

    Article  CAS  Google Scholar 

  9. Mulatero P, Rabbia F, Milan A, Paglieri C, Morello F, Chiandussi L, et al. Drug effects on aldosterone/plasma renin activity ratio in primary aldosteronism. Hypertension. 2002;40(6):897–902.

    Article  CAS  PubMed  Google Scholar 

  10. Jansen PM, van den Born BJ, Frenkel WJ, de Bruijne EL, Deinum J, Kerstens MN, et al. Test characteristics of the aldosterone-to-renin ratio as a screening test for primary aldosteronism. J Hypertens. 2014;32(1):115–26.

    Article  CAS  Google Scholar 

  11. Mulatero P, Monticone S, Burrello J, Veglio F, Williams TA, Funder J. Guidelines for primary aldosteronism: uptake by primary care physicians in Europe. J Hypertens. 2016;34(11):2253–7.

    Article  CAS  Google Scholar 

  12. Beeftink MM, van der Sande NG, Bots ML, Doevendans PA, Blankestijn PJ, Visseren FL, et al. Safety of temporary discontinuation of antihypertensive medication in patients with difficult-to-control hypertension. Hypertension. 2017;69(5):927–32.

    Article  CAS  PubMed  Google Scholar 

  13. Van Der Sande NGC, Blankestijn PJ, Visseren FLJ, Beeftink MM, Voskuil M, Westerink J, et al. Prevalence of potential modifiable factors of hypertension in patients with difficult-to-control hypertension. J Hypertens. 2019;37(2):398–405.

    Article  Google Scholar 

  14. Subjects CCoRIH. Legal framework for medical scientific research: Your research: Is it subject to the WMO or not? [Available from: https://english.ccmo.nl/investigators/legal-framework-for-medical-scientific-research/your-research-is-it-subject-to-the-wmo-or-not.

  15. Overheid.nl. Wettenbank - Wet medisch-wetenschappelijk onderzoek met mensen 2020 [updated January 1, 2020. Available from: https://wetten.overheid.nl/BWBR0009408/2020-01-01.

  16. Grover SS, Pittman SD. Automated detection of sleep disordered breathing using a nasal pressure monitoring device. Sleep Breath. 2008;12(4):339–45.

    Article  PubMed  Google Scholar 

  17. Vorselaars W, Valk GD, Vriens MR, Westerink J, Spiering W. Case detection in primary aldosteronism: high-diagnostic value of the aldosterone-to-renin ratio when performed under standardized conditions. J Hypertens. 2018;36(7):1585–91.

    Article  CAS  PubMed  Google Scholar 

  18. Hanslik G, Wallaschofski H, Dietz A, Riester A, Reincke M, Allolio B, et al. Increased prevalence of diabetes mellitus and the metabolic syndrome in patients with primary aldosteronism of the German Conn's registry. Eur J Endocrinol. 2015;173(5):665–75.

    Article  CAS  PubMed  Google Scholar 

  19. Ducher M, Mounier-Vehier C, Lantelme P, Vaisse B, Baguet JP, Fauvel JP. Reliability of a Bayesian network to predict an elevated aldosterone-to-renin ratio. Arch Cardiovasc Dis. 2015;108(5):293–9.

    Article  PubMed  Google Scholar 

  20. Rossi GP, Bernini G, Desideri G, Fabris B, Ferri C, Giacchetti G, et al. Renal damage in primary aldosteronism: results of the PAPY study. Hypertension. 2006;48(2):232–8.

    Article  CAS  PubMed  Google Scholar 

  21. Donders AR, van der Heijden GJ, Stijnen T, Moons KG. Review: a gentle introduction to imputation of missing values. J Clin Epidemiol. 2006;59(10):1087–91.

    Article  PubMed  Google Scholar 

  22. van Buuren S. Multiple imputation of discrete and continuous data by fully conditional specification. Stat Methods Med Res. 2007;16(3):219–42.

    Article  PubMed  Google Scholar 

  23. Steyerberg EW, Eijkemans MJ, Harrell FE Jr, Habbema JD. Prognostic modeling with logistic regression analysis: in search of a sensible strategy in small data sets. Med Decis Mak. 2001;21(1):45–56.

    Article  CAS  Google Scholar 

  24. Schomaker M, Heumann C. Bootstrap inference when using multiple imputation. Stat Med. 2018;37(14):2252–66.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Wood AM, Royston P, White IR. The estimation and use of predictions for the assessment of model performance using large samples with multiply imputed data. Biom J. 2015;57(4):614–32.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Giacchetti G, Ronconi V, Lucarelli G, Boscaro M, Mantero F. Analysis of screening and confirmatory tests in the diagnosis of primary aldosteronism: need for a standardized protocol. J Hypertens. 2006;24(4):737–45.

    Article  CAS  PubMed  Google Scholar 

  27. Rossi GR, Bernini GP, Caliumi C, Desideri GB, Fabris B, Giacchetti G, et al. Prospective assessment of the diagnostic performance of the saline infusion test in the primary aldosteronism prevalence in hypertensives (PAPY) study. J Hypertens. 2006;24:S360-S.

    Google Scholar 

  28. Velasco A, Chung O, Raza F, Pandey A, Brinker S, Arbique D, et al. Cost-effectiveness of therapeutic drug monitoring in diagnosing primary Aldosteronism in patients with resistant hypertension. J Clin Hypertens. 2015;17(9):713–9.

    Article  Google Scholar 

Download references

Acknowledgements

The authors gratefully acknowledge the contribution of C. Flint and J. Wierdsma (the specialized nurses supporting the diagnostic work-up of patients with difficult-to-control hypertension in our clinic) and W. Pasma (data manager).

Funding

No funding was received for the presented manuscript.

Author information

Authors and Affiliations

  1. Department of Vascular Medicine, University Medical Center Utrecht, Utrecht University, 85500, 3508 GA, Utrecht, The Netherlands

    Monique E. A. M. van Kleef, Frank L. J. Visseren, Jan Westerink & Wilko Spiering

  2. Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands

    Michiel L. Bots & Yolanda van der Graaf

  3. Department of Nephrology, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands

    Peter J. Blankestijn

Authors
  1. Monique E. A. M. van Kleef
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Frank L. J. Visseren
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jan Westerink
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Michiel L. Bots
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Peter J. Blankestijn
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yolanda van der Graaf
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Wilko Spiering
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

MK, FV, YG and WS contributed to the design of the work. MK, FV, JW, PB and WS were involved in the data collection. MK, FV and WS contributed to the interpretation of data. MK analysed the data and wrote the manuscript draft. FV, JW, MB, PB, YG and WS substantively revised the work. All authors read and approved the final manuscript and agreed both to be personally accountable for the author’s own contributions and to ensure that questions related to the accuracy or integrity of any part of the work, even ones in which the author was not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature.

Corresponding author

Correspondence to Wilko Spiering.

Ethics declarations

Ethics approval and consent to participate

Since participants in this study were not subject to procedures and were not required to follow rules of behaviour outside the scope of routine clinical practice, this study was not subject to the Dutch Medical Research Involving Human Subjects Act [https://wetten.overheid.nl/BWBR0009408/2020-01-01] [14, 15]. Therefore, it did not require informed consent or ethical approval, which was approved by the institutional ethics committee of the University Medical Center Utrecht (Medisch Ethische Toetsingscommissie Utrecht, reference number: WAG/mb/16/019878).

Consent for publication

Not applicable.

Competing interests

M.E.A.M. van Kleef is paid from a research grant by Vascular Dynamics, Inc. to study endovascular baroreflex amplification; F.L.J. Visseren, J. Westerink, M.L. Bots, P.J. Blankestijn and Y. van der Graaf report no conflicts; W. Spiering is a consultant for and has received a research grant from Vascular Dynamics, Inc.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Non-imputed patient characteristics summarized for the patients included in and excluded from this study.

Additional file 2.

Primary aldosteronism probability calculator. Excel sheet for calculating the predicted probability of primary aldosteronism for an individual patient with difficult-to-control hypertension.

Additional file 3.

Test characteristics and proportion of patients spared intensive testing resulting from sensitivity analysis.

Additional file 4.

Calibration plot showing the agreement after sensitivity analysis. It shows the agreement between predicted and observed probabilities of primary aldosteronism when a post-salt loading test aldosterone cut-off value of ≥190 pmol/L is applied. The error bars represent the corresponding Bootstrap-based standard errors. PA = primary aldosteronism.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

van Kleef, M.E.A.M., Visseren, F.L.J., Westerink, J. et al. Development of a clinical decision tool to reduce diagnostic testing for primary aldosteronism in patients with difficult-to-control hypertension. BMC Endocr Disord 20, 56 (2020). https://0-doi-org.brum.beds.ac.uk/10.1186/s12902-020-0528-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12902-020-0528-3

Keywords

BMC Endocrine Disorders

ISSN: 1472-6823

Contact us