FHIR-Decide
Research prototype · synthetic data

Auto-accept threshold

0.501.000.90

–

How it works
  1. 1 Set a threshold
  2. 2 Work down the review list (A accept, C change)
  3. 3 Export decisions

Queue

    Loading…

    A AcceptC Change to…S SkipJ/K Next / previousG Show goldU Undo last

    Model report

    Calibration

    How often the model's chosen answer is right, against how confident it was.

    Accuracy and confidence agreeConfidence above accuracyAccuracy above confidenceMean confidencePerfect calibrationCutoff

    Raw model probabilities, with no recalibration. ECE averages the gap between accuracy and mean confidence over 15 equal-width bins, weighted by bin size, as in the evaluation code. Brier is the multi-class form (0 is best, 2 is worst).

    Bin table
    BinItemsAccuracyMean conf.Gap

    Compare models

    Same items, same cutoff. Select a row to switch model.

    ModelAccuracyECEAuto-accept at ≤1%At current cutoff

    Breakdown

    GroupItemsAccuracyMean conf.