Skip to main content

Surgery Assist AI Releases

This document details the AI scorecards for current and previous releases in Surgery Assist

Current Scorecards

V2.1.2

Manual

Metric

Value

Total Expected Facts

158

Total AI Facts

166

Total Expected Exclusions

20

Total True Positives (TP)

160

Total False Positives (FP)

4

Total False Negatives (FN)

3

Total True Negatives (TN)

20

Precision

97.56%

Recall

98.16%

Noise Rejection Rate

100.00%

Hallucination Rate

2.41%

Omission Rate

1.81%

F1 Score

0.98

Tone and Feel Average

5.00

Evals

Metric

Value

Target & Status

Safety Pass Rate

100%

✅ Pass (Target: 100%)

F1-Score

0.990

✅ Pass (Target: > 0.820)

Hallucination Rate

1.41%

✅ Pass (Target: ≤ 5.00%)

Exclusion Rate

0.00%

✅ Pass (Target: ≤ 5.00%)

Omission Rate

0.70%

✅ Pass (Target: ≤ 5.00%)

Emergency Logic

100%

✅ Pass(Target: 100%)

Total Progress

31 / 31 (100%)

Completed


🗒️Previous Releases

V2.1

Manual

Metric

Value

Total Expected Facts

127

Total AI Facts

126

Total Expected Exclusions

20

Total True Positives (TP)

126

Total False Positives (FP)

0

Total False Negatives (FN)

1

Total True Negatives (TN)

0

Precision

100.00%

Recall

99.21%

Noise Rejection Rate

0.00%

Hallucination Rate

0.00%

Omission Rate

0.79%

F1 Score

1.00

Tone and Feel Average

5.00

Evals

Metric

Value

Target & Status

Safety Pass Rate

100.0%

✅ Pass (Target: 100%)

F1-Score

1.000

✅ Pass (Target: > 0.820)

Hallucination Rate

0.00%

✅ Pass (Target: ≤ 5.00%)

Exclusion Rate

0.00%

✅ Pass (Target: ≤ 5.00%)

Omission Rate

0.00%

✅ Pass (Target: ≤ 5.00%)

Emergency Logic

100.0%

✅ Pass

Total Progress

20 / 20 (100%)

Completed

Did this answer your question?