Confusion matrix: | ||||
 |  | Predictions | Classification error | |
Absence | Presence | |||
Observations in the building set | Absence | 149 | 77 | 0.34 (FPR) |
Presence | 401 | 665 | 0.38 (FNR) | |
Observations in the validation set | Absence | 17 | 47 | 0.73 (FPR) |
Presence | 12 | 112 | 0.09 (FNR) | |
Performance metrics: | ||||
 | Building set | Validation set | ||
 TSSmax | 0.28 | 0.18 | ||
 Cutoff | 0.84 | 0.61 | ||
 Observed prevalencea | 0.83 | 0.66 | ||
 Predicted prevalencea | 0.57 | 0.85 | ||
 TNR (1-FPR) | 0.66 | 0.27 | ||
 TPR (1-FNR) | 0.63 | 0.91 | ||
 Accuracyb | 0.63 | 0.69 | ||
 Precisionc | 0.90 | 0.70 | ||
 AUC | 0.69 | 0.57 | ||
 RMSE | 0.36 | 0.47 | ||
 Brier scored | 0.13 | 0.22 |