Journal Article Page
European UrologyVolume 58, issue 5, pages e51-e52, November 2010
Predictive and Prognostic Models in Radical Prostatectomy Candidates: A Critical Analysis of the Literature
Accepted 26 July 2010, Published online 10 August 2010, pages 687 - 700
Numerous predictive and prognostic tools have recently been developed for risk stratification of prostate cancer (PCa) patients who are candidates for or have been treated with radical prostatectomy (RP).
To critically review the currently available predictive and prognostic tools for RP patients and to describe the criteria that should be applied in selecting the most accurate and appropriate tool for a given clinical scenario.
A review of the literature was performed using the Medline, Scopus, and Web of Science databases. Relevant reports published between 1996 and January 2010 identified using the keywords prostate cancer, radical prostatectomy, predictive tools, predictive models, and nomograms were critically reviewed and summarised.
We identified 16 predictive and 22 prognostic validated tools that address a variety of end points related to RP. The majority of tools are prediction models, while a few consist of risk-stratification schemes. Regardless of their format, the tools can be distinguished as preoperative or postoperative. Preoperative tools focus on either predicting pathologic tumour characteristics or assessing the probability of biochemical recurrence (BCR) after RP. Postoperative tools focus on cancer control outcomes (BCR, metastatic progression, PCa-specific mortality [PCSM], overall mortality). Finally, a novel category of tools focuses on functional outcomes. Prediction tools have shown better performance in outcome prediction than the opinions of expert clinicians. The use of these tools in clinical decision-making provides more accurate and highly reproducible estimates of the outcome of interest. Efforts are still needed to improve the available tools’ accuracy and to provide more evidence to further justify their routine use in clinical practice. In addition, prediction tools should be externally validated in independent cohorts before they are applied to different patient populations.
Predictive and prognostic tools represent valuable aids that are meant to consistently and accurately provide most evidence-based estimates of the end points of interest. More accurate, flexible, and easily accessible tools are needed to simplify the practical task of prediction.
Prostate cancer (PCa) is the most common solid malignancy in men, with 192 280 new cases having been diagnosed in 2009 in the United States . Different treatment options are currently available for men with localised PCa, such as external-beam radiation therapy (EBRT), brachytherapy, and active surveillance. Radical prostatectomy (RP) represents one of the most commonly used therapies for clinically localised PCa. The selection of a candidate for RP remains complex because of the variety of strategies that can be followed in planning the surgical technique, postoperative treatment, and follow-up. Tools that could facilitate the decision-making process in these phases would be very valuable.
In this manuscript, we provide an overview of the currently available predictive (ie, predicting the probability of an outcome without considering the effect of time) and prognostic (ie, predicting the probability of an outcome over time) tools for candidates to RP and for patients who have already undergone the procedure. In addition, we provide objective characteristics that support the use of some models over others. Finally, because several patients with localised PCa may elect other treatment options, we provide a brief summary of prediction tools in patients treated with EBRT or brachytherapy.
2. Evidence acquisition
A review of the literature using the Medline, Scopus, and Web of Science databases was conducted to identify original articles, review articles, and editorials regarding predictive and prognostic tools in patients treated with RP and in candidates for RP. Searches were limited to the English language. The literature search was performed by combining the following terms: prostate cancer, radical prostatectomy, predictive tools, predictive models, and nomograms. A total of 415 records were retrieved from Medline, 748 from Scopus, and 712 from Web of Science. Subsequently, the search results were pooled, and articles published between 1996 and January 2010 were identified. The articles with the highest level of evidence were selected, reviewed, and summarised, with the consensus of all of the authors of this paper.
3. Evidence synthesis
3.1. Different methods used for clinical decision making
Clinical decision-making may be based on physician experience; randomised, controlled trials (RCTs); or on the information received from decision aids. Experience alone results in poorly reproducible predictions and in excessive interrater variability , , and . Moreover, RCTs are too infrequently performed in the context of RP; even when RCT data exist, they are not universally implemented for a number of reasons  and . Therefore, most clinical questions that pertain to PCa cannot be solved using RCT data. As a consequence, several predictive and prognostic tools have been developed to assist with uncertainties related to clinical decision-making. These tools are intended to provide more accurate and highly reproducible estimates of the outcome of interest  and . To date, these tools have shown better performance in outcome prediction than the opinions of expert clinicians in both prostate and breast cancer , , and .
3.2. How should a model be evaluated?
Predictive tools can be subdivided into risk groupings, look-up tables, classification and regression tree analyses, artificial neural networks, and prediction models, with the latter often presented graphically in the form of a nomogram. Despite their methodologic differences, these models can be compared using several common parameters: discrimination, calibration, generalisability, level of complexity, and clinical net benefit , , , and .
Discrimination and calibration represent the key properties that should invariably be reported when any model is validated. Discrimination represents the probability that the tool will correctly predict a poorer outcome for the patient who initially develops the outcome of interest out of a randomly selected pair of patients. Discrimination is usually quantified using the area under curve for binary outcomes and the concordance index for censored data. Both metrics range from 50% (no discrimination) to 100% (perfect discrimination) , , , and . Overall discrimination needs to be complemented with calibration, which is an evaluation of the relationship between predicted probabilities and observed rates of the outcome of interest, throughout the entire range of predictions , , , and . Inclusion of calibration properties is necessary, because a model may predict perfectly well in low-risk patients, but its predictions may be of dismal quality in high-risk individuals.
In addition, discrimination and calibration findings need to be generalisable and applicable to the population of interest. For example, data confirming the validity of a tool in Caucasian patients may not be generalisable to African American patients, even if all other variables are held constant . Therefore, external validation of a predictive or prognostic tool should be mandatory to establish whether the tool works satisfactorily in different patient populations , , and . Moreover, predictive and prognostic tools need to be simple enough to ensure that physicians are capable of using them in a busy clinical practice.
Finally, a recommended tool should be better than competing tools. Recently, Vickers et al described decision curve analysis, which is used to evaluate the effect of different models on medical decision-making . Decision curve analysis provides a common denominator for comparing predictive tools, as it factors the harms and benefits of a given tool within a single metric, and should therefore complement discrimination and calibration results when different predictive or prognostic tools are compared . Moreover, decision curve analysis is easier to implement than classic decision analysis .
3.3. End points of model application in the context of radical prostatectomy
3.3.1. Surgical planning
184.108.40.206. Preoperative prediction of Gleason score upgrading
Gleason score upgrading (GSU) between prostatic biopsy and RP pathology may affect treatment planning (Table 1). Therefore, knowing the probability of GSU may help select the best treatment option according to preoperative characteristics. This is especially important in patients with low-risk PCa who seek less invasive therapy, such as active surveillance, because the presence of potentially life-threatening disease may be underestimated. Five tools can predict the probability of GSU. D’Amico et al (n = 693; original discrimination not reported) developed a look-up table based on serum prostate-specific antigen (PSA), clinical stage, and prostate volume for predicting GSU . The last model showed low discrimination (52.3%) at external validation . Chun et al (n = 2892; internal discrimination: 80.4%), Kulkarni et al (n = 175; internal discrimination: 71.0%), Capitanio et al (n = 301; internal discrimination: 66.1%), and Moussa et al (n = 1017; internal discrimination: 68.0%) devised four nomograms for predicting GSU that include primary and secondary Gleason score along with several other preoperative variables , , , and . Of these, both the Kulkarni et al and the Capitanio et al nomograms focused on prediction of GSU in low-risk patients (Gleason score ≤6)  and . To date, only the Chun et al nomogram has been externally validated in a European and in a Japanese cohort, showing good discrimination (external discrimination: 74.9% and 79.2%, respectively)  and . However, calibration properties of this nomogram were suboptimal in the Japanese patients . Accordingly, this tool should be given priority in European patients. Other tools are still needed for predicting GSU in other patient populations.
|Reference||Year||Prediction form||Outcome||No. of patients||Variables||Discrimination||Validation|
|Prediction of Gleason score upgrading|
|D’Amico et al ||1999||Look-up table||Gleason score upgrading (defined as 50% or higher probability of Gleason ≥4)||693||PSA, clinical stage, prostate volume||Internal: Not reported||–||X|
|Chun et al ||2006||Nomogram||Gleason score upgrading (defined as any upgrade from prostatic biopsy to RP pathology)||2982||PSA, clinical stage, primary biopsy Gleason, secondary biopsy Gleason||Internal: 80.4%||X||X|
|Kulkarni et al ||2007||Nomogram||Gleason score upgrading (defined as upgrade from Gleason sum 6 to Gleason sum ≥7)||175||Age, PSA, clinical stage, primary biopsy Gleason, secondary biopsy Gleason||Internal: 71.0%||X||–|
|Capitanio et al ||2009||Nomogram||Gleason score upgrading (defined as upgrade from Gleason sum ≤6 to Gleason sum ≥7)||301||Biopsy Gleason sum, number of cores, number of positive cores||Internal: 66.1%||X||–|
|Moussa et al ||2009||Nomogram||Gleason score upgrading (defined as upgrade from Gleason sum 6 to Gleason sum ≥7 and from primary Gleason 3 to primary Gleason 4)||175||Age, race, abnormal DRE, prostate volume, clinical stage, number of previous biopsies, PSA, number of cores, number of positive cores, percent of cancer in positive cores, secondary biopsy Gleason, perineural invasion, inflammation, HGPIN, atypia||Internal: 68.0%||X||–|
|Prediction of pathologic stage|
|Prediction of pathologic stage|
|Partin et al ||1997||Look-up table||Pathologic stage (ECE, SVI, LNI)||4133||Biopsy Gleason sum, clinical stage, PSA||Internal: 72.4%||X||X|
|Ohori et al ||2004||Nomogram||Side-specific ECE||763||PSA, clinical stage, side-specific biopsy Gleason sum, side-specific percent of positive cores, side-specific percent of cancer in positive cores||Internal: 80.6%||X||–|
|Steuber et al ||2006||Nomogram||Side-specific ECE||1118||PSA, clinical stage, biopsy Gleason sum, percent of positive cores, percent of cancer in positive cores||Internal: 84.0%||X||–|
|Koh et al ||2003||Nomogram||SVI||763||PSA, clinical stage, primary and secondary Gleason sum, percent of cancer at the base||Internal: 88.3%||X||–|
|Baccala et al ||2007||Nomogram||SVI||6740||Age, PSA, biopsy Gleason sum, clinical stage||Internal: 80.0%||X||–|
|Gallina et al ||2007||Nomogram||SVI||666||PSA, clinical stage, biopsy Gleason sum, percent positive biopsy cores||Internal: 79.2%||X||X|
|Cagiannos et al ||2003||Nomogram||LNI assessed with limited pelvic lymphadenectomy||5510||PSA, clinical stage, biopsy Gleason sum||Internal: 76.0%||X||–|
|Briganti et al ||2006||Nomogram||LNI assessed with extended pelvic lymphadenectomy (≥10 nodes removed)||602||PSA, clinical stage, biopsy Gleason sum||Internal: 76.0%||X||X|
|Briganti et al ||2007||Nomogram||LNI (probability of exclusive non-obturator lymph node metastases)||565||PSA, clinical stage, biopsy Gleason sum||Internal: 80.2%||X||–|
|Prediction of functional outcomes|
|Eastham et al ||2008||Nomogram||Trifecta probability (BCR, continence, potency)||1577||PSA, clinical stage, biopsy Gleason core, pretreatment erectile function, months from RP, age at RP||Internal: 77.3%||X||–|
|Briganti et al ||2010||Probability graph||Erectile function recovery||435||Age, CCI score, baseline IIEF||Internal: 69.1%||X||X|
|External: Not reported|
PSA = prostate-specific antigen; RP = radical prostatectomy; DRE = digital rectal examination; HGPIN = high-grade prostatic intraepithelial neoplasia; ECE = extracapsular extension; SVI = seminal vesical invasion; LNI = lymph node invasion; BCR = biochemical recurrence, CCI = Charlson Comorbidity Index; IIEF = International Index of Erectile Function.
Only one tool for GSU prediction has been externally validated. However, the currently available GSU predictive tools were devised on a sextant prostate biopsy population. Therefore, these tools need to be validated and/or updated in a contemporary extended prostate biopsy population.
220.127.116.11. Preoperative prediction of life expectancy
Ten years is usually considered the minimum life expectancy prerequisite for RP candidates (Table 2). Unfortunately, clinicians are poor raters of life expectancy  and . Therefore, tools that can accurately identify those individuals who do not have sufficient life expectancy to warrant definitive PCa treatment are needed to help optimise treatment decision-making.
|Reference||Yr||Prediction form||Outcome||No. of patients||Variables||Discrimination||Validation|
|Preoperative prediction of perioperative mortality|
|Walz et al ||2007||Nomogram||30-d mortality after RP||9208||Age, patient comorbidities, and surgical volume||Internal: 67.1%||X||–|
|Preoperative prediction of PCSM|
|D’Amico et al ||2003||Probability graph||PCSM||4946||Biopsy Gleason sum, clinical stage, PSA||Not reported||–||–|
|Cooperberg et al ||2009||Probability graph||PCSM (5 and 10 yr after RP)||10627 (5378 RP patients)||Age, PSA, biopsy Gleason sum, clinical stage, percent positive biopsy||Internal: 80.0%||X||–|
|Stephenson et al ||2009||Nomogram||PCSM (10 and 15 yr after BCR)||6398||Primary and secondary Gleason grade, PSA, clinical stage||External: 82.0%||–||X|
|Postoperative prediction of PCSM|
|Zhou et al ||2005||Probability graph||PCSM (5 yr after BCR)||498||PDT, biopsy Gleason sum||Not reported||–||–|
|Freedland et al ||2005||Look-up table||PCSM (5, 10, and 15 yr after BCR)||379||PDT, Gleason sum, time from surgery to BCR||Internal: 84.0%||X||–|
|Preoperative prediction of life expectancy|
|Albertsen et al ||1996||Probability formula||OS (10 yr)||451||Age, Gleason sum, and index of coexistent disease category||Internal: Not reported||–||X|
|Tewari et al ||2004||Probability graph||OS (10 yr)||1611||Age, race, comorbidity, PSA, Gleason sum, treatment type||Internal: Not reported||–||X|
|External: 70.0% and 81.0%|
|Cowen et al ||2006||Nomogram||Life expectancy (5, 10, and 15 yr)||506||Age, CCI, presence of angina, systolic blood pressure, BMI, smoking, marital status, PSA< Gleason sum, clinical stage, treatment type||Internal: 73.0%||X||–|
|Walz et al ||2007||Nomogram||Life expectancy (10 yr)||9131 (5955 RP patients)||Age, CCI, treatment type||Internal: 84.3%||X||X|
RP = radical prostatectomy; PCSM = prostate cancer–specific mortality; PSA = prostate-specific antigen; BCR = biochemical recurrence; PDT = PSA doubling time; OS = overall survival; CCI = Charlson Comorbidity Index; BMI = body mass index.
Two models with proven external validity can provide life expectancy estimates. The Tewari et al model for prediction of life expectancy in RP candidates (n = 1611; internal discrimination: 71.0%) relies on four variables (patient age, Charlson Comorbidity Index [CCI], biopsy Gleason score, and PSA) to predict 10-yr overall (OS) survival . Conversely, the Walz et al model (n = 5965; internal discrimination: 84.0%) relies solely on age and baseline comorbidities to predict life expectancy in RP candidates . In external validation, both models showed excellent discrimination: 81.0% and 82.0% for the Tewari et al model and the Walz et al model, respectively  and . To date, only the Walz et al nomogram was externally validated in both an American and a European cohort. Therefore, this model should be chosen over the Tewari et al model when life expectancy predictions are made in European patients. Two competing models showed lower discrimination (from 71.0% to 73.0%) and should represent second choices when life expectancy predictions are required  and .
18.104.22.168. Preoperative prediction of pathologic stage
Prediction of pathologic stage is obviously important in surgical treatment planning (Table 1). Patients with a low probability of having PCa with extracapsular extension (ECE) of their disease may benefit from a more conservative (eg, nerve-sparing) surgery relative to individuals with a high risk of ECE. Similarly, individuals at high risk of having seminal vesical invasion (SVI) or lymph node invasion (LNI) may benefit from more extensive surgical approaches as well as from the prompted use of adjuvant therapies.
Partin et al (n = 4133; internal discrimination: 72.4%) pioneered an evidence-based approach for the prediction of pathologic stage at RP. The Partin tables predict the probability of ECE, SVI, and LNI after RP according to the patient's PSA level, clinical stage, and biopsy Gleason sum . This tool has been subjected to numerous updates and external validations , , , , , and . Some of them failed to confirm the ability of the Partin tables to generate accurate and/or well-calibrated predictions , , and . This was particularly evident in European patients, where the Partin tables showed significant departures from ideal predictions for each of the three predicted outcomes  and . Conversely, a recent external validation in the Surveillance, Epidemiology and End Results dataset showed good discrimination for both SVI (74%) and LNI (77%) predictions . However, calibration results were not reported .
Lack of ability to provide side-specific ECE predictions represents a limitation of the Partin tables. This information is particularly important during surgical planning, because the decision to preserve one or both neurovascular bundles affects functional outcomes and, subsequently, the patient's quality of life. The issue of side-specific ECE predictions was addressed by two nomograms devised by Ohori et al (n = 763; internal discrimination: 80.6%) and by Steuber et al (n = 1118; internal discrimination: 84.0%). Both nomograms rely on serum PSA, clinical stage, biopsy Gleason sum, percent of positive cores, and percent of cancer in positive cores  and . To date, only the Steuber et al nomogram has been externally validated (89.0%) .
Koh et al (n = 763), Baccala et al (n = 6740), and Gallina et al (n = 666) developed three preoperative nomograms for SVI prediction that showed internal discrimination ranging from 78% to 88% , , and . All these nomograms include serum PSA, clinical stage, and biopsy Gleason sum among the predictors of SVI. Of those, only the Gallina et al nomogram was externally validated in a cohort of 2584 patients who underwent a robot-assisted laparoscopic radical prostatectomy (RARP) and showed 81.0% discrimination .
Cagiannos et al (n = 5510; internal discrimination: 78.0%) developed a nomogram for prediction of LNI at RP according to preoperative PSA, clinical stage, and biopsy Gleason sum . Using the same variables, Briganti et al devised two nomograms to predict LNI when extended pelvic lymph node dissection (PLND) was performed (n = 602; internal discrimination 76.0%) and LNI outside the obturator fossa (n = 565; internal discrimination: 80.2%)  and . The former nomogram was externally validated in a European cohort and showed 82.1% discrimination . However, this external validation was performed in patients treated with limited PLND, thus potentially underestimating the real LNI rate . A formal external validation of this nomogram in patients treated with extended PLND is needed.
In sum, several tools are available for the prediction of pathologic stage (ECE, SVI, and LNI) at RP. Of those, some have been externally validated and should be given higher priority when making pathologic stage predictions. However, it is worth noting that most external validations were performed in a single cohort , , and .
22.214.171.124. Preoperative prediction of perioperative mortality
Perioperative mortality remains an important issue in any type of surgery (Table 2). Mortality rates after RP can vary from 0.1% to 0.5% according to the type of population and type of institution  and . Recently, Walz et al (n = 9208) devised a model predicting 30-d mortality after RP and showed that age, comorbidities, and surgical expertise are capable of predicting perioperative mortality with 72.3% discrimination . This model still awaits external validation.
126.96.36.199. Preoperative prediction of biochemical recurrence
Biochemical recurrence (BCR) is widely used as an end point to assess RP efficacy (Table 3). BCR also represents a marker of metastatic progression and PCa-specific mortality  and . Despite the widespread use of BCR, uniform criteria to define BCR after RP are lacking, and numerous definitions are used in the medical literature, leading to different results in outcome reporting . Of note, estimates of risk ratio and predictive accuracy are generally robust regarding the definition of BCR . Stratifying patients according to their risk of BCR may be useful in selecting those who may benefit from an adjuvant therapy on the basis of their likelihood of treatment failure.
|Reference||Yr||Prediction form||BCR, yr||No. of patients||Variables||Discrimination||Validation|
|Preoperative prediction of BCR|
|D’Amico et al ||1998||Probability graph||3 and 5||888||Biopsy Gleason sum, clinical stage, PSA||Internal: Not reported||–||X|
|Cooperberg et al ||2005||Probability graph||3 and 5||1439||Age, PSA, biopsy Gleason sum, clinical stage, percent positive biopsy||Internal: 66.0%||X||X|
|Stephenson et al ||2006||Nomogram||1–10||1978||PSA, clinical stage, biopsy Gleason sum, yr of surgery, number of positive and negative cores||Internal: 76.0%||X||X|
|Postoperative prediction of BCR|
|D’Amico et al ||1998||Look-up table||2||862||PSA, pathologic stage, Gleason sum, surgical margin status||Not reported||–||–|
|Walz et al ||2009||Nomogram||2||2911||PSA, Gleason sum, surgical margin status, ECE, SVI, LNI||Internal: Not reported||–||X|
|Stephenson et al ||2005||Nomogram||10||1881||PSA, Gleason sum, ECE, SVI, LNI, surgical margin status||Internal: 86.0%||X||X|
|Suardi et al ||2008||Nomogram||5, 10, 15, and 20||601||Gleason sum, pathologic stage, surgical margin status, type of surgery, adjuvant RT||Internal: 77.2–80.6%||X||X|
BCR = biochemical recurrence; PSA = prostate-specific antigen; ECE = extracapsular extension; SVI = seminal vesical invasion; LNI = lymph node invasion; RT = radiation therapy.
Preoperative prediction of BCR can be accomplished with the D’Amico et al risk stratification scheme (n = 888; original discrimination not reported) , the Stephenson et al nomogram (n = 1978; internal discrimination: 76.0%) , and the Cancer of the Prostate Risk Assessment (CAPRA) score (n = 1439; internal discrimination: 66.0%) . All of these models rely on commonly available variables, such as PSA, clinical stage, and biopsy Gleason sum, and all have been externally validated. Accordingly, their use should be encouraged , , , , and . It is noteworthy that both the Stephenson nomogram and the CAPRA score showed better discrimination abilities than the D’Amico et al risk stratification scheme , , , , and . Therefore, when preoperative BCR predictions are made, these two models should be prioritised over the D’Amico et al risk stratification scheme. However, further comparative studies between the Stephenson nomogram and the CAPRA score are still needed to determine whether one model should be chosen over the other.
188.8.131.52. Preoperative prediction of prostate cancer–specific mortality
PCa-specific mortality (PCSM) represents the most important cancer-control end point in RP candidates (Table 2). D’Amico et al (n = 4946; original discrimination not reported) and Cooperberg et al (n = 5378; internal discrimination: 80.0%) devised two risk-stratification schemes to predict PCSM  and . Both models rely on preoperative patient and tumour characteristics, such as age, biopsy Gleason sum, serum PSA level, and clinical stage  and . Unfortunately, the discrimination and calibration of these models have not been externally validated.
More recently, Stephenson et al devised a competing-risks regression-based nomogram for predicting PCSM in the PSA era (n = 6398) . This nomogram, which is based on biopsy Gleason grade, serum PSA, and clinical stage, was externally validated in an external cohort of 6278 patients, showing an 82.0% discrimination . Therefore, when predicting PCSM, the prognostic model developed by Stephenson et al should be chosen over the two other tools.
184.108.40.206. Preoperative prediction of functional outcomes
Similarly to cancer-control outcomes, functional outcomes can be predicted prior to RP, thus helping clinicians choose the best treatment options according to preoperative patient and tumour characteristics (Table 1). Eastham et al (n = 1577; internal discrimination: 77.3%) developed a nomogram that predicts cancer control outcomes (BCR-free survival) combined with continence and potency after RP (trifecta probability) according to various preoperative characteristics (PSA, clinical stage, biopsy Gleason core, pretreatment erectile function, months from RP, and age at RP) . Recently, Briganti et al developed a preoperative risk stratification tool (n = 435; internal discrimination: 69.1%) aimed at predicting erectile function recovery after bilateral nerve-sparing radical retropubic prostatectomy . This tool relies on patient age, CCI, and preoperative International Index of Erectile Function questionnaire results and has been externally validated in a European cohort of patients treated with RARP . However, its external discrimination has not been quantified . Despite good discrimination, because all patients were operated on by high-volume surgeons, the applicability of these models may be limited to the tertiary care setting.
3.3.2. Immediate postoperative counselling
220.127.116.11. Postoperative prediction of biochemical recurrence
Prediction of BCR after RP represented the focus of several previously reported prognostic tools (Table 3) , , , and . Early BCR prediction was first addressed by D’Amico et al (n = 862; original discrimination not reported), who devised a look-up table based on serum PSA, pathologic stage, Gleason sum, and surgical margin status for 2-yr BCR predictions . Unfortunately, this model was never externally validated. Since then, Walz et al has devised (n = 2911) and externally validated (n = 2825; external discrimination: 82.0%) a highly accurate tool for prediction of BCR 2 yr after RP . This model, which relies on serum PSA, pathologic Gleason sum, surgical margin status, ECE, SVI, and LNI, can be used to discriminate among individuals who require adjuvant EBRT and those who can be observed .
BCR up to 10 yr after RP can be predicted using the postoperative Stephenson nomogram (n = 1881; internal discrimination: 86.0%), which relies on the same variables included in the Walz et al early BCR prediction nomogram . A new, important feature of the Stephenson et al nomogram is the possibility of adjusting predictions according to disease-free interval. This tool has been externally validated in two other North American cohorts (n = 1782 and n = 1357) with highly satisfactory results (discrimination: 79.0–81.0%) .
BCR can also be predicted for even more distant end points (up to 20 yr after RP) using the nomogram developed by Suardi et al . This nomogram relies on pathologic Gleason sum, pathologic stage, surgical margin status, type of surgery, and adjuvant radiation therapy (RT), and it has been externally validated in a European cohort (discrimination: 77.9–86.3%). Moreover, its predictions can be adjusted according to the disease-free interval .
In sum, three externally validated nomograms are available for BCR predictions. Of these, the Stephenson et al nomogram has the greatest flexibility in providing BCR predictions at different time points (1–10 yr after RP) . The Walz et al nomogram is most specific for early BCR predictions . Finally, the Suardi et al nomogram is best suited to predictions beyond 10 yr and illustrates the persistent risk of BCR despite ≥10 yr of follow-up .
3.3.3. Long-term end points
18.104.22.168. Prediction of progression to metastatic disease
After RP, patients may develop BCR, and a portion of those patients may eventually develop bone metastases (Table 4). Three investigators devised tools capable of predicting the probability of metastatic progression after BCR. Pound et al examined 1997 RP patients (original discrimination not reported) and found that PSA doubling time (PDT) < 10 mo, time to BCR ≤2 yr, and pathologic Gleason score 8–10 were the strongest predictors of bone metastasis and stratified the 3-, 5-, and 7-yr probability of such metastases according to these three values . Unfortunately, external validation of the tool was not performed. Dotan et al (n = 239; internal discrimination: 93.0%) and Slovin et al (n = 148; internal discrimination: 69%) combined PSA kinetics, along with other patient characteristics, to devise two nomograms predicting the probability of radiographically detectable bone metastases after BCR  and . Porter et al (n = 752; internal discrimination: 76.0–80.2%) also devised a nomogram for predicting metastatic progression at 5, 10, 15, and 20 yr after RP that can be adjusted according to the disease-free interval . Finally, Cooperberg et al (n = 5378; internal discrimination 78.0%) devised a risk stratification scheme (CAPRA score) that also focused on bone metastasis after RP . To date, neither of the models has undergone formal external validation.
|Reference||Yr||Prediction form||Patient population||Outcome||No. of Patients||Variables||Discrimination||Validation|
|Progression to metastatic disease|
|Pound et al ||1999||Regression tree||BCR after RP||Metastasis (metastatic disease-free probability at 3, 5, and 7 yr)||315||PDT, Gleason sum, time to BCR||Not reported||–||–|
|Dotan et al ||2005||Nomogram||BCR after RP||Positive bone scan||239||Pre-treatment PSA, surgical margin status, SVI, Gleason sum, trigger PSA, ECE, PSA slope, PSA velocity||Internal: 93.0%||X||–|
|Slovin et al ||2005||Nomogram||BCR after RP||Metastasis (1 and 2 yr after treatment)||74||Baseline PSA, PDT, pathologic stage, Gleason sum||Internal: 69.0%||X||–|
|Porter et al ||2008||Nomogram||RP||Metastasis (5, 10, 15, and 20 yr after RP)||752||Pathologic stage, Gleason sum, comorbidity, adjuvant RT||Internal: 76.0–82.0%||X||–|
|Cooperberg et al ||2009||Probability graph||RP||Metastasis (5 and 10 yr after RP)||10 627 (5378 RP patients)||Age, PSA, biopsy Gleason sum, clinical stage, percent positive biopsy||Internal: 78.0%||X||–|
BCR = biochemical recurrence; RP = radical prostatectomy; PDT = PSA doubling time; PSA = prostate-specific antigen; SVI = seminal vesical invasion; ECE = extracapsular extension; RT = radiation therapy.
In sum, no available tools with externally confirmed discrimination can assist the clinician with the prediction of bone metastasis after RP. As a consequence, the existing models need to be used with caution when determining the timing or type of staging investigations in patients treated with RP.
22.214.171.124. Postoperative prediction of prostate cancer–specific mortality
D’Amico et al (n = 5918) and Zhou et al (n = 498) observed that the PCSM of patients with localised or locally advanced PCa can be stratified according to PDT (Table 2)  and . Subsequently, Freedland et al (n = 379; internal discrimination: 84.0%) devised a look-up table for the prediction of PCSM in patients with an established PSA recurrence after RP . This model relies on postoperative variables—namely, PDT, pathologic Gleason sum, and time from surgery to BCR . Unfortunately, as in the case of several other tools, the Freedland et al model still awaits external validation. Consequently, caution should be taken when using it to stratify the risk of PCSM after RP.
3.4. Models in the context of external-beam radiation therapy or focal therapy
Although RP remains one of the most commonly used therapies, an increasingly higher number of patients with localised PCa are currently managed with different treatment strategies (Table 5). Because no randomised trials directly comparing the efficacy and morbidity of these various treatment approaches have been undertaken, management decisions are often based on physician judgment and patient preferences. Therefore, prediction tools can be used to provide the most unbiased estimates of clinically relevant end points and facilitate patient counselling.
|Reference||Yr||Prediction form||Patient population||BCR, yr||No. of patients||Variables||Discrimination||Validation|
|Prediction of BCR|
|Pisansky et al ||1997||Probability graph||EBRT||5||500||Biopsy Gleason sum, clinical stage, PSA||Not available||–||–|
|D’Amico et al ||1998||Probability graph||EBRT and brachytherapy||3, 5||766 and 218||Biopsy Gleason sum, clinical stage, PSA||Not available||–||–|
|Kattan et al ||2000||Nomogram||EBRT||5||1042||PSA, biopsy Gleason sum, clinical stage, neoadjuvant ADT, radiation dose delivered||Internal: 73%||X||X|
|Kattan et al ||2001||Nomogram||Brachytherapy||5||920||Biopsy Gleason sum, clinical stage, PSA, co-administration of EBRT||Internal: Not reported||–||X|
|Zelefsky et al ||2007||Nomogram||EBRT||5, 10||2253||PSA, biopsy Gleason sum, clinical stage, neoadjuvant ADT, radiation dose delivered||Internal: 72%||X||–|
|Potters et al ||2010||Nomogram||Brachytherapy||9||5931||Clinical stage, biopsy Gleason sum, isotope, EBRT, minimum dose to 90% of the prostate, PSA||Internal: 71%||X||–|
|Reference||Yr||Prediction form||Patient population||Outcome||No. of patients||Variables||Discrimination||Validation|
|Prediction of survival/progression to distant metastasis|
|D’Amico et al ||2002||Probability graph||EBRT||PCSM (10 yr)||381||Biopsy Gleason sum, clinical stage, PSA||Not available||–||–|
|D’Amico et al ||2003||Probability graph||EBRT||PCSM (8 yr)||2370||Biopsy Gleason sum, clinical stage, PSA||Not available||–||–|
|Zhou et al ||2005||Probability graph||EBRT||PCSM (5 yr)||661||PDT, biopsy Gleason sum||Not available||–||–|
|Kattan et al ||2003||Nomogram||EBRT||Progression to metastasis (5 yr)||1677||PSA, clinical stage, biopsy Gleason sum||Internal: Not reported||X||X|
|Slovin et al ||2005||Nomogram||EBRT||Progression to metastasis (1–2 yr)||71||Baseline PSA, PDT, pathologic T stage, Gleason sum||Internal: 69%||X||–|
BCR = biochemical recurrence; EBRT = external-beam radiation therapy; PSA = prostate-specific antigen; ADT = androgen-deprivation therapy; PCSM = prostate cancer–specific mortality; PDT = PSA doubling time.
Many of the prediction tools that we previously discussed (eg, tools predicting pathologic stage, Gleason score upgrading, life expectancy) may help patients and clinicians in deciding the most appropriate treatment option. In addition, several other tools have been developed to predict BCR, survival, or progression to distant metastasis in patients treated with EBRT or brachytherapy , , , , , , , , , , and . The currently available tools for these patient categories are summarised in Table 5.
3.5. Limitations of existing models
Although the existing models provide an evidence-based approach to various clinical scenarios in the management of RP patients, several limitations persist. Lack of external validation for several of the existing tools represents the most important limitation, because it may limit the model's applicability to a population of patients different from that used for its development  and . Moreover, lack of periodic updates that reflect changes in patient and disease characteristics may undermine the applicability of some models to contemporary patient populations. For example, some of the preoperative nomograms addressing GSU rely on a sextant prostatic biopsy population, which is now considered obsolete .
Predictive and prognostic models remain imperfect in their discrimination properties and in their calibration characteristics. Therefore, the use of novel, promising predictive or prognostic variables is required to reduce the error margin of existing models  and . Several biomarkers have demonstrated a powerful ability to improve models’ predictions. For example, transforming growth factor-β1, interleukine-6–soluble receptor, plasminogen activator inhibitor type 1, human glandular kallicrein-2, or gene expression signatures significantly improved the ability of different BCR predictive models to discriminate , , , , and . Shariat et al demonstrated that a panel of blood-based biomarkers improved the preoperative prediction of BCR . Similarly, plasma endoglin improved predictions of LNI at RP .
Lack of consideration of competing risks represents another problem with some models, especially those that predict distant end points, such as long-term BCR, metastatic progression, or PCSM. Lack of consideration of competing risks may confound the association between clinical and pathologic predictors and the outcome of interest. Similarly, only a few tools that predict BCR, metastatic progression, or PCSM adjust for disease-free interval since RP , , and . Adjustment for disease-free interval should be made, and models that allow it may provide more realistic predictions of the outcome of interest.
Besides methodologic issues, clinicians may be unaware of how and when to apply specific predictive or prognostic tools . Recently, Nguyen and Kattan addressed this issue and systematically organised the currently available PCa prediction tools within a metagram, which represents a framework on which existing PCa prediction tools are organised and stratified by their accuracy, quality, and usefulness in a clinical setting . The metagram showed that there is a great need for additional models as well as improvement in the accuracy of existing tools. Moreover, the existing nomograms may not provide adequate flexibility when it comes to predictor variables. For example, clinicians may not dispose of all the variables that were used to devise a specific model. Therefore, improvements in the accessibility and flexibility of predictive and prognostic tools are still needed to further promote their use in everyday clinical practice.
Finally, it deserves mention that predictive models reduce the amount of averaging. Nevertheless, they are based on averages of outcomes in patients with specific baseline risk factors. In addition, to the best of our knowledge, no tools are capable of quantifying the benefit of RP relative to other treatment modalities, such as active surveillance, EBRT, or focal therapy. Although prediction tools may help clinicians in choosing the best treatment option by stratifying the risk of harbouring a specific outcome (eg, Gleason score upgrading or PCa stage), no tools are capable of indicating the optimal therapy. Therefore, clinicians still have to carefully interpret the prediction tool results and discuss the risk–benefit ratio of any treatment type with the patient.
A recent international consensus conference on predictive modelling in PCa concluded that “nomograms are here to stay”. Moreover, despite the large number of available tools, additional models are still needed . Recently, Nguyen and Kattan observed that only 31 out of 160 possible treatment–outcome combinations are covered by existing models . However, the applicability of existing tools needs to be improved. Vickers et al suggested that predictive and prognostic models should be grouped into a unique platform to provide for the possibility of handling missing data and changing predictions with changing data or changing status of the patient and to provide better flexibility (ie, the possibility of generating predictions for more than one outcome) .
Similarly, the accessibility of the existing tools needs to be simplified. To date, only three Web sites (www.nomogram.org, www.nomograms.org, and www.clinicriskcalculators.org) offer a structured overview and easy access to several nomograms for prediction of numerous outcomes in PCa patients. In the future, personal digital assistant–based nomograms will likely complement Web-based tools and will further increase their accessibility and improve ease of use. Clearly, the optimal solution is for predictive models to be built into electronic medical records so that predictions are automatically generated from a patient's medical data.
Finally, a partially unanswered question remains as to whether nomograms improve patient outcomes or other indicators of quality of care. To date, no formal trials have addressed this question. However, data indicate that specific questions are answered more accurately if model predictions are used instead of even expert clinicians’ ratings , , and . Using decision curve analyses, Vickers et al recently demonstrated that the use of predictive tools resulted in better clinical outcomes both in PCa and bladder cancer  and .
Therefore, at least partial evidence supports the benefits of predictive or prognostic models relative to experience-based predictions. Based on this evidence, the last version of the European Association of Urology guidelines for PCa recommends the use of nomograms for predicting Gleason score, pathologic T and N stages, PCSM . Nonetheless, these data are scant, and more extensive proof continues to be required.
Author contributions: Giovanni Lughezzani had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Study concept and design: Lughezzani, Karakiewicz.
Acquisition of data: Lughezzani.
Analysis and interpretation of data: Lughezzani, Karakiewicz.
Drafting of the manuscript: Lughezzani, Karakiewicz.
Critical revision of the manuscript for important intellectual content: Briganti, Karakiewicz, Kattan, Montorsi, Shariat, Vickers.
Statistical analysis: Lughezzani.
Obtaining funding: None.
Administrative, technical, or material support: None.
Other (specify): None.
Financial disclosures: I certify that all conflicts of interest, including specific financial interests and relationships and affiliations relevant to the subject matter or materials discussed in the manuscript (eg, employment/affiliation, grants or funding, consultancies, honoraria, stock ownership or options, expert testimony, royalties, or patents filed, received, or pending), are the following: None.
Funding/Support and role of the sponsor: None.
-  A. Jemal, R. Siegel, E. Ward, et al. Cancer statistics, 2009. CA Cancer J Clin. 2009;59:225-249 Crossref.
-  R.M. Dawes, D. Faust, P.E. Meehl. Clinical versus actuarial judgment. Science. 1989;243:1668-1674
-  A.S. Elstein. Heuristics and biases: selected errors in clinical reasoning. Acad Med. 1999;74:791-794
-  R.M. Hogarth, N. Karelaia. Heuristic and linear models of judgment: matching rules and environments. Psychol Rev. 2007;114:733-758 Crossref.
-  A. Bill-Axelson, L. Holmberg, M. Ruutu, et al. Radical prostatectomy versus watchful waiting in early prostate cancer. N Engl J Med. 2005;352:1977-1984 Crossref.
-  I.M. Thompson, P.J. Goodman, C.M. Tangen, et al. The influence of finasteride on the development of prostate cancer. N Engl J Med. 2003;349:215-224 Crossref.
-  M.W. Kattan. When and how to use informatics tools in caring for urologic patients. Nat Clin Pract Urol. 2005;2:183-190 Crossref.
-  M.W. Kattan. Should I use this nomogram?. BJU Int. 2008;102:421-424
-  P.L. Ross, C. Gerigk, M. Gonen, et al. Comparisons of nomograms and urologists’ predictions in prostate cancer. Semin Urol Oncol. 2002;20:82-88
-  M.C. Specht, M.W. Kattan, M. Gonen, J. Fey, K.J. Van Zee. Predicting nonsentinel node status after positive sentinel lymph biopsy for breast cancer: clinicians versus nomogram. Ann Surg Oncol. 2005;12:654-659 Crossref.
-  J. Walz, A. Gallina, P. Perrotte, et al. Clinicians are poor raters of life-expectancy before radical prostatectomy or definitive radiotherapy for localized prostate cancer. BJU Int. 2007;100:1254-1258 Crossref.
-  D.G. Altman, P. Royston. What do we mean by validating a prognostic model? Stat Med. 2000;19:453-473 Crossref.
-  Y. Vergouwe, E.W. Steyerberg, M.J. Eijkemans, J.D. Habbema. Validity of prognostic models: when is a model clinically useful? Semin Urol Oncol. 2002;20:96-107
-  S.F. Shariat, P.I. Karakiewicz, C.G. Roehrborn, M.W. Kattan. An updated catalog of prostate cancer predictive tools. Cancer. 2008;113:3075-3099 Crossref.
-  A.J. Vickers, E.B. Elkin. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making. 2006;26:565-574 Crossref.
-  F.E. Harrell. Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. (Springer, New York, 2001)
-  J.B. Yu, D.V. Makarov, R. Sharma, R.E. Peschel, A.W. Partin, C.P. Gross. Validation of the Partin nomogram for prostate cancer in a national sample. J Urol. 2010;183:105-111 Crossref.
-  S.E. Bleeker, H.A. Moll, E.W. Steyerberg, et al. External validation is necessary in prediction research: a clinical example. J Clin Epidemiol. 2003;56:826-832 Crossref.
-  E.W. Steyerberg, S.E. Bleeker, H.A. Moll, D.E. Grobbee, K.G. Moons. Internal and external validation of predictive models: a simulation study of bias and precision in small samples. J Clin Epidemiol. 2003;56:441-447 Crossref.
-  M.W. Kattan, M.E. Cowen, B.J. Miles. A decision analysis for treatment of clinically localized prostate cancer. J Gen Intern Med. 1997;12:299-305
-  A.V. D’Amico, A.A. Renshaw, L. Arsenault, D. Schultz, J.P. Richie. Clinical predictors of upgrading to Gleason grade 4 or 5 disease at radical prostatectomy: potential implications for patient selection for radiation and androgen suppression therapy. Int J Radiat Oncol Biol Phys. 1999;45:841-846 Crossref.
-  F.K.-H. Chun, T. Steuber, A. Erbersdobler, et al. Development and internal validation of a nomogram predicting the probability of prostate cancer Gleason sum upgrading between biopsy and radical prostatectomy pathology. Eur Urol. 2006;49:820-826 Abstract, Full-text, PDF, Crossref.
-  G.S. Kulkarni, G. Lockwood, A. Evans, et al. Clinical predictors of Gleason score upgrading: implications for patients considering watchful waiting, active surveillance, or brachytherapy. Cancer. 2007;109:2432-2438 Crossref.
-  U. Capitanio, P.I. Karakiewicz, L. Valiquette, et al. Biopsy core number represents one of foremost predictors of clinically significant Gleason sum upgrading in patients with low-risk prostate cancer. Urology. 2009;73:1087-1091 Crossref.
-  A.S. Moussa, M.W. Kattan, R. Berglund, C. Yu, K. Fareed, J.S. Jones. A nomogram for predicting upgrading in patients with low- and intermediate-grade prostate cancer in the era of extended prostate sampling. BJU Int. 2010;105:352-358 Crossref.
-  U. Capitanio, P.I. Karakiewicz, C. Jeldres, et al. The probability of Gleason score upgrading between biopsy and radical prostatectomy can be accurately predicted. Int J Urol. 2009;16:526-529 Crossref.
-  T. Imamoto, H. Suzuki, T. Utsumi, et al. External validation of a nomogram predicting the probability of prostate cancer Gleason sum upgrading between biopsy and radical prostatectomy pathology among Japanese patients. Urology. 2010;76:404-410 Crossref.
-  M.D. Krahn, K.E. Bremner, J. Asaria, et al. The ten-year rule revisited: accuracy of clinicians’ estimates of life expectancy in patients with localized prostate cancer. Urology. 2002;60:258-263 Crossref.
-  A. Tewari, C.C. Johnson, G. Divine, et al. Long-term survival probability in men with clinically localized prostate cancer: a case-control, propensity modeling study stratified by race, age, treatment and comorbidities. J Urol. 2004;171:1513-1519 Crossref.
-  J. Walz, A. Gallina, F. Saad, et al. A nomogram predicting 10-year life expectancy in candidates for radical prostatectomy or radiotherapy for prostate cancer. J Clin Oncol. 2007;25:3576-3581 Crossref.
-  N. Suardi, C. Jeldres, P.I. Karakiewicz. Reply to letter to Editor: “Life expectancy estimation by nomogram”. J Clin Oncol.. 2008;26:691-693 Crossref.
-  P.C. Albertsen, D.G. Fryback, B.E. Storer, T.F. Kolon, J. Fine. The impact of co-morbidity on life expectancy among men with localized prostate cancer. J Urol. 1996;156:127-132
-  M.E. Cowen, L.K. Halasyamani, M.W. Kattan. Predicting life expectancy in men with clinically localized prostate cancer. J Urol. 2006;175:99-103 Crossref.
-  A.W. Partin, M.W. Kattan, E.N. Subong, et al. Combination of prostate-specific antigen, clinical stage, and Gleason score to predict pathological stage of localized prostate cancer. A multi-institutional update. JAMA. 1997;277:1445-1451 Crossref.
-  M.L. Blute, E.J. Bergstralh, A.W. Partin, et al. Validation of Partin tables for predicting pathological stage of clinically localized prostate cancer. J Urol. 2000;164:1591-1595
-  A.W. Partin, L.A. Mangold, D.M. Lamm, P.C. Walsh, J.I. Epstein, J.D. Pearson. Contemporary update of prostate cancer staging nomograms (Partin tables) for the new millennium. Urology. 2001;58:843-848 Crossref.
-  D.V. Makarov, B.J. Trock, E.B. Humphreys, et al. Updated nomogram to predict pathologic stage of prostate cancer given prostate-specific antigen level, clinical stage, and biopsy Gleason score (Partin tables) based on cases from 2000 to 2005. Urology. 2007;69:1095-1101 Crossref.
-  P.I. Karakiewicz, N. Bhojani, U. Capitanio, et al. External validation of the updated Partin tables in a cohort of North American men. J Urol. 2008;180:898-902 discussion 902–3
-  N. Bhojani, L. Salomon, U. Capitanio, et al. External validation of the updated Partin tables in a cohort of French and Italian men. Int J Radiat Oncol Biol Phys. 2009;73:347-352 Crossref.
-  N. Bhojani, S. Ahyai, M. Graefen, et al. Partin tables cannot accurately predict the pathological stage at radical prostatectomy. Eur J Surg Oncol. 2009;35:123-128 Crossref.
-  M. Ohori, M.W. Kattan, H. Koh, et al. Predicting the presence and side of extracapsular extension: a nomogram for staging prostate cancer. J Urol. 2004;171:1844-1849 discussion 1849 Crossref.
-  T. Steuber, M. Graefen, A. Haese, et al. Validation of a nomogram for prediction of side specific extracapsular extension at radical prostatectomy. J Urol. 2006;175:939-944 discussion 944 Crossref.
-  K.C. Zorn, A. Gallina, G.C. Hutterer, et al. External validation of a nomogram for prediction of side-specific extracapsular extension at robotic radical prostatectomy. J Endourol. 2007;21:1345-1351
-  H. Koh, M.W. Kattan, P.T. Scardino, et al. A nomogram to predict seminal vesicle invasion by the extent and location of cancer in systematic biopsy results. J Urol. 2003;170:1203-1208 Crossref.
-  A. Baccala Jr., A.M. Reuther, F.J. Bianco Jr., P.T. Scardino, M.W. Kattan, E.A. Klein. Complete resection of seminal vesicles at radical prostatectomy results in substantial long-term disease-free survival: multi-institutional study of 6740 patients. Urology. 2007;69:536-540 Crossref.
-  A. Gallina, F.K.-H. Chun, A. Briganti, et al. Development and split-sample validation of a nomogram predicting the probability of seminal vesicle invasion at radical prostatectomy. Eur Urol. 2007;52:98-105 Abstract, Full-text, PDF, Crossref.
-  K.C. Zorn, U. Capitanio, C. Jeldres, et al. Multi-institutional external validation of seminal vesicle invasion nomograms: head-to-head comparison of Gallina nomogram versus 2007 Partin tables. Int J Radiat Oncol Biol Phys. 2009;73:1461-1467 Crossref.
-  I. Cagiannos, P. Karakiewicz, J.A. Eastham, et al. A preoperative nomogram identifying decreased risk of positive pelvic lymph nodes in patients with prostate cancer. J Urol. 2003;170:1798-1803 Crossref.
-  A. Briganti, F.K.-H. Chun, A. Salonia, et al. Validation of a nomogram predicting the probability of lymph node invasion among patients undergoing radical prostatectomy and an extended pelvic lymphadenectomy. Eur Urol. 2006;49:1019-1027 discussion 1026–7 Abstract, Full-text, PDF, Crossref.
-  A. Briganti, F.K.-H. Chun, A. Salonia, et al. A nomogram for staging of exclusive nonobturator lymph node metastases in men with localized prostate cancer. Eur Urol. 2007;51:112-120 discussion 119–20 Abstract, Full-text, PDF, Crossref.
-  A. Briganti, A. Gallina, N. Suardi, et al. A nomogram is more accurate than a regression tree in predicting lymph node invasion in prostate cancer. BJU Int. 2008;101:556-560 Crossref.
-  S.M. Alibhai, M. Leach, G. Tomlinson, et al. 30-day mortality and major complications after radical prostatectomy: influence of age and comorbidity. J Natl Cancer Inst. 2005;97:1525-1532 Crossref.
-  B.R. Konety, V. Allareddy, S. Modak, B. Smith. Mortality after major surgery for urologic cancers in specialized urology hospitals: are they any better?. J Clin Oncol. 2006;24:2006-2012 Crossref.
-  J. Walz, F. Montorsi, C. Jeldres, et al. The effect of surgical volume, age and comorbidities on 30-day mortality after radical prostatectomy: a population-based analysis of 9208 consecutive cases. BJU Int. 2008;101:826-832 Crossref.
-  C.R. Pound, A.W. Partin, M.A. Eisenberger, D.W. Chan, J.D. Pearson, P.C. Walsh. Natural history of progression after PSA elevation following radical prostatectomy. JAMA. 1999;281:1591-1597 Crossref.
-  S.J. Freedland, E.B. Humphreys, L.A. Mangold, et al. Risk of prostate cancer-specific mortality following biochemical recurrence after radical prostatectomy. JAMA. 2005;294:433-439
-  A.J. Stephenson, M.W. Kattan, J.A. Eastham, et al. Defining biochemical recurrence of prostate cancer after radical prostatectomy: a proposal for a standardized definition. J Clin Oncol. 2006;24:3973-3978
-  A.M. Cronin, G. Godoy, A.J. Vickers. Definition of biochemical recurrence after radical prostatectomy does not substantially impact prognostic factor estimates. J Urol. 2010;183:984-989 Crossref.
-  A.V. D’Amico, R. Whittington, S.B. Malkowicz, et al. Biochemical outcome after radical prostatectomy, external beam radiation therapy, or interstitial radiation therapy for clinically localized prostate cancer. JAMA. 1998;280:969-974 Crossref.
-  A.J. Stephenson, P.T. Scardino, J.A. Eastham, et al. Preoperative nomogram predicting the 10-year probability of prostate cancer recurrence after radical prostatectomy. J Natl Cancer Inst. 2006;98:715-717 Crossref.
-  M.R. Cooperberg, D.J. Pasta, E.P. Elkin, et al. The University of California, San Francisco Cancer of the Prostate Risk Assessment score: a straightforward and reliable preoperative predictor of disease recurrence after radical prostatectomy. J Urol. 2005;173:1938-1942 Crossref.
-  F.K. Chun, P.I. Karakiewicz, A. Briganti, et al. A critical appraisal of logistic regression-based nomograms, artificial neural networks, classification and regression-tree models, look-up tables and risk-group stratification models for prostate cancer. BJU Int. 2007;99:794-800 Crossref.
-  M.R. Cooperberg, S.J. Freedland, D.J. Pasta, et al. Multiinstitutional validation of the UCSF cancer of the prostate risk assessment for prediction of recurrence after radical prostatectomy. Cancer. 2006;107:2384-2391 Crossref.
-  M. May, N. Knoll, M. Siegsmund, et al. Validity of the CAPRA score to predict biochemical recurrence-free survival after radical prostatectomy. Results from a European multicenter survey of 1,296 patients. J Urol. 2007;178:1957-1962 discussion 1962 Crossref.
-  H. Isbarn, P.I. Karakiewicz, J. Walz, et al. External validation of a preoperative nomogram for prediction of the risk of recurrence after radical prostatectomy. Int J Radiat Oncol Biol Phys. 2010;77:788-792 Crossref.
-  G. Lughezzani, L. Budäus, H. Isbarn, et al. Head-to-head comparison of the three most commonly used preoperative models for prediction of biochemical recurrence after radical prostatectomy. Eur Urol. 2010;57:562-568 Abstract, Full-text, PDF, Crossref.
-  A.V. D’Amico, J. Moul, P.R. Carroll, L. Sun, D. Lubeck, M.H. Chen. Cancer-specific mortality after surgery or radiation for patients with clinically localized prostate cancer managed during the prostate-specific antigen era. J Clin Oncol. 2003;21:2163-2172 Crossref.
-  M.R. Cooperberg, J.M. Broering, P.R. Carroll. Risk assessment for prostate cancer metastasis and mortality at the time of diagnosis. J Natl Cancer Inst. 2009;101:878-887 Crossref.
-  A.J. Stephenson, M.W. Kattan, J.A. Eastham, et al. Prostate cancer-specific mortality after radical prostatectomy for patients treated in the prostate-specific antigen era. J Clin Oncol. 2009;27:4300-4305 Crossref.
-  J.A. Eastham, P.T. Scardino, M.W. Kattan. Predicting an optimal outcome after radical prostatectomy: the Trifecta nomogram. J Urol. 2008;179:2207-2210 discussion 2210–1
-  A. Briganti, A. Gallina, N. Suardi, et al. Predicting erectile function recovery after bilateral nerve sparing radical prostatectomy: a proposal of a novel preoperative risk stratification. J Sex Med. 2010;7:2521-2531
-  G. Novara, V. Ficarra, C. D’Elia, et al. Preoperative criteria to select patients for bilateral nerve-sparing robotic-assisted radical prostatectomy. J Sex Med. 2010;7:839-845 Crossref.
-  A.V. D’Amico, R. Whittington, S.B. Malkowicz, et al. The combination of preoperative prostate specific antigen and postoperative pathological findings to predict prostate specific antigen outcome in clinically localized prostate cancer. J Urol. 1998;160:2096-2101
-  J. Walz, F.K. Chun, E.A. Klein, et al. Nomogram predicting the probability of early recurrence after radical prostatectomy for prostate cancer. J Urol. 2009;181:601-607 discussion 607–8
-  A.J. Stephenson, P.T. Scardino, J.A. Eastham, et al. Postoperative nomogram predicting the 10-year probability of prostate cancer recurrence after radical prostatectomy. J Clin Oncol. 2005;23:7005-7012 Crossref.
-  N. Suardi, C.R. Porter, A.M. Reuther, et al. A nomogram predicting long-term biochemical recurrence after radical prostatectomy. Cancer. 2008;112:1254-1263 Crossref.
-  Z.A. Dotan, F.J. Bianco Jr., F. Rabbani, et al. Pattern of prostate-specific antigen (PSA) failure dictates the probability of a positive bone scan in patients with an increasing PSA after radical prostatectomy. J Clin Oncol. 2005;23:1962-1968 Crossref.
-  S.F. Slovin, A.S. Wilton, G. Heller, H.I. Scher. Time to detectable metastatic disease in patients with rising prostate-specific antigen values following surgery or radiation therapy. Clin Cancer Res. 2005;11:8669-8673 Crossref.
-  C.R. Porter, N. Suardi, K. Kodama, et al. A nomogram predicting metastatic progression after radical prostatectomy. Int J Urol. 2008;15:889-894 Crossref.
-  A.V. D’Amico, J.W. Moul, P.R. Carroll, L. Sun, D. Lubeck, M.H. Chen. Surrogate end point for prostate cancer-specific mortality after radical prostatectomy or radiation therapy. J Natl Cancer Inst. 2003;95:1376-1383 Crossref.
-  P. Zhou, M.H. Chen, D. McLeod, P.R. Carroll, J.W. Moul, A.V. D’Amico. Predictors of prostate cancer-specific mortality after radical prostatectomy or radiation therapy. J Clin Oncol. 2005;23:6992-6998 Crossref.
-  T.M. Pisansky, M.J. Kahn, G.M. Rasp, S.S. Cha, M.G. Haddock, D.G. Bostwick. A multiple prognostic index predictive of disease outcome after irradiation for clinically localized prostate carcinoma. Cancer. 1997;79:337-344 Crossref.
-  M.W. Kattan, M.J. Zelefsky, P.A. Kupelian, P.T. Scardino, Z. Fuks, S.A. Leibel. Pretreatment nomogram for predicting the outcome of three-dimensional conformal radiotherapy in prostate cancer. J Clin Oncol. 2000;18:3352-3359
-  M.W. Kattan, L. Potters, J.C. Blasko, et al. Pretreatment nomogram for predicting freedom from recurrence after permanent prostate brachytherapy in prostate cancer. Urology. 2001;58:393-399 Crossref.
-  M.W. Kattan, M.J. Zelefsky, P.A. Kupelian, et al. Pretreatment nomogram that predicts 5-year probability of metastasis following three-dimensional conformal radiation therapy for localized prostate cancer. J Clin Oncol. 2003;21:4568-4571 Crossref.
-  M.J. Zelefsky, M.W. Kattan, P. Fearn, et al. Pretreatment nomogram predicting ten-year biochemical outcome of three-dimensional conformal radiotherapy and intensity-modulated radiotherapy for prostate cancer. Urology. 2007;70:283-287 Crossref.
-  L. Potters, M. Roach IIIrd, B.J. Davis, et al. Postoperative nomogram predicting the 9-year probability of prostate cancer recurrence after permanent prostate brachytherapy using radiation dose as a prognostic variable. Int J Radiat Oncol Biol Phys. 2010;76:1061-1065 Crossref.
-  A.V. D’Amico, K. Cote, M. Loffredo, A.A. Renshaw, D. Schultz. Determinants of prostate cancer-specific survival after radiation therapy for patients with clinically localized prostate cancer. J Clin Oncol. 2002;20:4567-4573 Crossref.
-  M.W. Kattan. Judging new markers by their ability to improve predictive accuracy. J Natl Cancer Inst. 2003;95:634-635 Crossref.
-  M.W. Kattan. Evaluating a new marker's predictive contribution. Clin Cancer Res. 2004;10:822-824 Crossref.
-  M.W. Kattan, S.F. Shariat, B. Andrews, et al. The addition of interleukin-6 soluble receptor and transforming growth factor beta1 improves a preoperative nomogram for predicting biochemical progression in patients with clinically localized prostate cancer. J Clin Oncol. 2003;21:3573-3579 Crossref.
-  S.F. Shariat, J. Walz, C.G. Roehrborn, et al. External validation of a biomarker-based preoperative nomogram predicts biochemical recurrence after radical prostatectomy. J Clin Oncol. 2008;26:1526-1531 Crossref.
-  S.F. Shariat, S. Park, Q.D. Trinh, C.G. Roehrborn, K.M. Slawin, P.I. Karakiewicz. Plasminogen activation inhibitor-1 improves the predictive accuracy of prostate cancer nomograms. J Urol. 2007;178:1229-1236 discussion 1236–7
-  T. Steuber, A.J. Vickers, A. Haese, et al. Risk assessment for biochemical recurrence prior to radical prostatectomy: significant enhancement contributed by human glandular kallikrein 2 (hK2) and free prostate specific antigen (PSA) in men with moderate PSA-elevation in serum. Int J Cancer. 2006;118:1234-1240 Crossref.
-  A.J. Stephenson, A. Smith, M.W. Kattan, et al. Integration of gene expression profiling and clinical variables to predict prostate carcinoma recurrence after radical prostatectomy. Cancer. 2005;104:290-298 Crossref.
-  S.F. Shariat, J.A. Karam, J. Walz, et al. Improved prediction of disease relapse after radical prostatectomy through a panel of preoperative blood-based biomarkers. Clin Cancer Res. 2008;14:3785-3791 Crossref.
-  J.A. Karam, R.S. Svatek, P.I. Karakiewicz, et al. Use of preoperative plasma endoglin for prediction of lymph node metastasis in patients with clinically localized prostate cancer. Clin Cancer Res. 2008;14:1418-1422 Crossref.
-  U. Capitanio, C. Jeldres, S.F. Shariat, P. Karakiewicz. Clinicians are most familiar with nomograms and rate their clinical usefulness highest, look-up tables are second best. Eur Urol. 2008;54:958-959 Abstract, Full-text, PDF, Crossref.
-  C.T. Nguyen, M.W. Kattan. Development of a prostate cancer metagram: a solution to the dilemma of which prediction tool to use in patient counseling. Cancer. 2009;115(Suppl 13):3039-3045 Crossref.
-  L.J. Denis, M.K. Gospodarowicz. Predictive modeling in prostate cancer. Conclusions and reflections. Cancer. 2009;115(Suppl 13):3160-3162 Crossref.
-  A.J. Vickers, P. Fearn, P.T. Scardino, M.W. Kattan. Why can’t nomograms be more like Netflix?. Urology. 2010;75:511-513 Crossref.
-  A.J. Vickers, A.M. Cronin, G. Aus, et al. A panel of kallikrein markers can reduce unnecessary biopsy for prostate cancer: data from the European Randomized Study of Prostate Cancer Screening in Goteborg, Sweden. BMC Med.. 2008;6:19 Crossref.
-  A.J. Vickers, A.M. Cronin, M.W. Kattan, et al. Clinical benefits of a multivariate prediction model for bladder cancer: a decision analytic approach. Cancer. 2009;115:5460-5469 Crossref.
-  Heidenreich A, Bolla M, Joniau S, et al. Guidelines on prostate cancer. European Association of Urology Web site. http://www.uroweb.org/gls/pdf/Prostate Cancer 2010.pdf. Accessed July 22, 2010.
a Department of Urology, Vita-Salute San Raffaele University, Milano, Italy
b Cancer Prognostics and Health Outcomes Unit, University of Montreal Health Centre, Montreal, Quebec, Canada
c Quantitative Health Sciences, Cleveland Clinic Lerner College of Medicine, Cleveland, Ohio, USA
d Department of Urology, Weill Medical College of Cornell University, New York, New York, USA
e Department of Statistics, Memorial Sloan-Kettering Cancer Centre, New York, New York, USA
Please visit www.eu-acme.org/europeanurology to read and answer questions on-line. The EU-ACME credits will then be attributed automatically.
© 2010 European Association of Urology, Published by Elsevier B.V.
Recommend this article
Currently this article has a rating of 1. Please log in to recommend it.