calibrationDoes your confidence match your track record?
Confidence can be checked against outcomes over many predictions. If events you label 80% likely occur about eight times out of ten across a large enough set, that level is well calibrated. One failed prediction does not by itself disprove the estimate, because 80% still leaves room for failure.