Introduction Chest tube insertion can be associated with serious complications. A structured training programme is needed to minimise complications and enhance patient safety. Novices should pass a reliable test with solid evidence of validity before performing the procedure supervised on patients. The aim of this study was to establish a credible pass/fail standard.
Methods We used an established assessment tool the Chest Tube Insertion Competency Test (TUBE-iCOMPT). Validity evidence was explored according to Messick’s five sources of validity. Two methods were used to establish a credible pass/fail standard. Contrasting groups’ method: 34 doctors (23 novices and 11 experienced surgeons) performed the procedure twice and all procedures were video recorded, edited, blinded and rated by two independent, international raters. Modified Angoff method: seven thoracic surgeons individually determined the scores that defined the pass/fail criteria. The data was gathered in Copenhagen, Denmark and Riyadh, Saudi Arabia.
Results Internal consistency reliability was calculated as Cronbach’s alpha to 0.94. The generalisability coefficient with two raters and two procedures was 0.91. Mean scores were 50.7 (SD±13.2) and 74.7 (SD±4.8) for novices and experienced surgeons, respectively (p<0.001). The pass/fail score of 62 points resulted in zero false negatives and only three false positives.
Discussion We have gathered valuable additional validity evidence for the assessment tool TUBE-iCOMPT including establishment of a credible pass/fail score. The TUBE-iCOMPT can now be integrated in mastery learning programmes to ensure competency before independent practice.
- chest tube
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
Contributors LK contributed to the development of the statistical analysis plan. HL implemented the data collection in Riyadh. YS was repsonsible for the video data management and statistical analysis. MS contributed to the data collection. SNA and KJ are expert raters. PH was responsible for the data collection, drafted and revised the paper and is the guarantor. LK and PH analysed the data. LK, HL and PH contributed to the design and idea of the study. HL, YS, MS, SNA and KJ contributed to the critical revision of the draft paper.
Funding The two medical education centres covered equipment and travel costs.
Competing interests None declared.
Patient consent for publication Not required.
Ethics approval Danish Ethical Committee (journal no. 150019066) and Saudi Arabia IRB (reg. IRB00008644 and FWA00018774).
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.