| Within listener agreement | Listener (N=number of recordings interpreted by each panellist) | |||||||||
| Dichotomous lung examination group | Overall (n=136) | Listener #1 (n=18) | Listener #2 (n=13) | Listener #3 (n=20) | Listener #4 (n=19) | Listener #5 (n=18) | Listener #6 (n=17) | Listener #7 (n=16) | Listener #8 (n=15) | |
| Abnormal or normal† | Agreement, n (%) | 110 (80.8) | 16 (88.8) | 11 (84.6) | 14 (70.0) | 14 (73.6) | 16 (88.8) | 16 (94.2) | 11 (68.8) | 12 (80.0) |
| Kappa statistic (95% CI) | 0.61 (0.48 to 0.75) | 0.75 | 0.68 | 0.42 | 0.44 | 0.73 | 0.77 | 0.23 | 0.55 | |
| PABAK (95% CI)** | 0.62 (0.49 to 0.75) | 0.78 | 0.69 | 0.40 | 0.47 | 0.78 | 0.88 | 0.38 | 0.60 | |
| Crackle or no crackle | Agreement, n/N (%) | 112 (82.4) | 15 (83.4) | 13 (100.0) | 12 (60.0) | 17 (89.4) | 17 (94.4) | 15 (88.2) | 12 (75.0) | 11 (73.4) |
| Kappa statistic (95% CI) | 0.62 (0.48 to 0.76) | 0.67 | 1.00 | 0.20 | 0.46 | 0.82 | 0.77 | 0.50 | 0.47 | |
| PABAK (95% CI)†† | 0.65 (0.52 to 0.78) | 0.67 | 1.00 | 0.2 | 0.79 | 0.89 | 0.77 | 0.5 | 0.47 | |
| Wheeze or no wheeze | Agreement, n/N (%) | 114 (83.8) | 14 (77.8) | 11 (84.6) | 16 (80.0) | 16 (84.2 | 17 (94.4) | 16 (94.2) | 13 (81.2) | 11 (73.4) |
| Kappa statistic (95% CI) | 0.67 (0.55 to 0.80) | 0.56 | 0.68 | 0.57 | 0.62 | 0.77 | 0.85 | 0.63 | 0.47 | |
| PABAK (95% CI)‡‡ | 0.68 (0.55 to 0.80) | 0.56 | 0.69 | 0.60 | 0.68 | 0.89 | 0.88 | 0.63 | 0.47 | |
*Excludes uninterpretable primary listener lung examination results for 83/792 cases. Primary listeners were the first two listeners randomly assigned to interpret a lung sound examination.
†Crackle and/or wheeze (abnormal) or no crackle and/or wheeze (normal).
‡Prevalence index 0.30, bias index −0.04.
§Prevalence index −0.15, bias index 0.01.
¶Prevalence index 0.1, bias index −0.05.
**Prevalence index 0.13, bias index 0.03.
††Prevalence index −0.28, bias index 0.
‡‡Prevalence index −0.13, bias index 0.03.
PABAK, prevalence-adjusted, bias-adjusted kappa statistic.