Skip to main content

Table 4 Inter-rater agreement for single video data

From: Validation of machine learning models for estimation of left ventricular ejection fraction on point-of-care ultrasound: insights on features that impact performance

Observation

Rater 1 of LVEF

Rater 2 of LVEF

ICC (95% CI)

1

ML model

Level III expert visual LVEF on randomized single videos

0.772 (0.501, 1.000)

2

ML model

Level III expert segmentation LVEF on randomized single videos

0.778 (0.578, 1.000)

3

ML model

Level III expert visual LVEF, accounting for all videos for a participant

0.794 (0.173, 1.000)

4

ML model

Level III expert segmentation LVEF, accounting for all videos for a participant

0.843 (0.310, 1.000)

5

ML model

Derived LVEF from echo reports

0.798 (0.143, 1.000)