RSS-Feed abonnieren
DOI: 10.1055/a-2173-3966
Structured Reporting of Head and Neck Sonography Achieves Substantial Interrater Reliability
Abstract
Purpose Ultrasound examinations are often criticized for having higher examiner dependency compared to other imaging techniques. Compared to free-text reporting, structured reporting (SR) of head and neck sonography (HNS) achieves superior time efficiency as well as report quality. However, there are no findings concerning the influence of SR on the interrater reliability (IRR) of HNS.
Materials and Methods Typical pathologies (n=4) in HNS were documented by video/images by two certified head and neck ultrasound instructors. Consequently, structured reports of these videos/images were created by n=9 senior physicians at departments of otolaryngology or maxillofacial surgery with DEGUM instructors on staff. Reports (n=36) were evaluated regarding overall completeness and IRR. Additionally, user satisfaction was assessed by a visual analog scale (VAS).
Results SR yielded very high report completeness (91.8%) in all four cases with a substantial IRR (Fleiss‘ κ 0.73). Interrater agreement was high at 87.2% with very good user satisfaction (VAS 8.6).
Conclusion SR has the potential to ensure high-quality examination reports with substantial comparability and very high user satisfaction. Furthermore, big data collection and analysis are facilitated by SR. Therefore, process quality, workflow, and scientific output are potentially enhanced by SR.
Publikationsverlauf
Eingereicht: 30. Juli 2023
Angenommen nach Revision: 14. August 2023
Artikel online veröffentlicht:
05. Oktober 2023
© 2023. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial-License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/).
Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany
-
References
- 1 Coltrera MD. Clinician-performed thyroid ultrasound. Otolaryngol Clin North Am 2014; 47: 491-507 DOI: 10.1016/j.otc.2014.04.001.
- 2 Bialek EJ, Jakubowski W, Zajkowski P. et al. US of the major salivary glands: anatomy and spatial relationships, pathologic conditions, and pitfalls. Radiographics 2006; 26: 745-763 DOI: 10.1148/rg.263055024.
- 3 Künzel J, Bozzato A, Strieth S. Sonographie in der Nachsorge bei Kopf- und Halskarzinomen. [Follow-up ultrasound of head and neck cancer]. HNO 2017; 65: 939-952 DOI: 10.1007/s00106-017-0411-3.
- 4 Beggs AD, Thomas PR. Point of use ultrasound by general surgeons: review of the literature and suggestions for future practice. Int J Surg 2013; 11: 12-17 DOI: 10.1016/j.ijsu.2012.11.014.
- 5 Goncalves M, Mantsopoulos K, Schapher ML. et al. Interrater Reliability of Ultrasound in the Diagnosis of Sialolithiasis. Ultraschall Med 2019; 40: 481-487 DOI: 10.1055/a-0837-0712.
- 6 Takahashi Y, Fujino Y, Miura K. et al. Intra- and inter-rater reliability of rectus femoris muscle thickness measured using ultrasonography in healthy individuals. Ultrasound J 2021; 13: 21 DOI: 10.1186/s13089-021-00224-8.
- 7 Cohen O, Blank A, Meiersdorf S. et al. Impact of high-quality ultrasound following community ultrasound on surgical planning and active surveillance in patients with thyroid cancer. Clin Endocrinol (Oxf) 2021; 94: 990-997 DOI: 10.1111/cen.14415.
- 8 Ernst BP, Katzer F, Künzel J. et al. Impact of structured reporting on developing head and neck ultrasound skills. BMC Med Educ 2019; 19: 102 DOI: 10.1186/s12909-019-1538-6.
- 9 Todsen T, Ewertsen C, Jenssen C. et al. Head and Neck Ultrasound - EFSUMB Training Recommendations for the Practice of Medical Ultrasound in Europe. Ultrasound Int Open 2022; 8: E29-E34 DOI: 10.1055/a-1922-6778.
- 10 Wustner M, Radzina M, Calliada F. et al. Professional Standards in Medical Ultrasound - EFSUMB Position Paper (Short Version) - General Aspects. Ultraschall Med 2022; 43: 456-463 DOI: 10.1055/a-1854-2936.
- 11 Kunzel J, Bozzato V, Ernst BP. et al. Musterbefund zur sonografischen Diagnostik im Kopf-Hals-Bereich (Sektion Kopf-Hals der DEGUM. ) [Standard reporting for head and neck ultrasound - a proposal]. Ultraschall Med 2022; DOI: 10.1055/a-1810-7173.
- 12 Kunzel J, Bozzato A, Ernst BP. et al. Qualität in der Befundung von Kopf- und Halssonographien an Universitätskliniken – eine Stichprobe [Quality in the appraisal of head and neck sonography results in university hospitals-a random sample]. HNO 2021; 69: 907-912 DOI: 10.1007/s00106-020-00989-9.
- 13 Ernst BP, Hodeib M, Strieth S. et al. Structured reporting of head and neck ultrasound examinations. BMC Med Imaging 2019; 19: 25 DOI: 10.1186/s12880-019-0325-5.
- 14 Ernst BP, Strieth S, Katzer F. et al. The use of structured reporting of head and neck ultrasound ensures time-efficiency and report quality during residency. Eur Arch Otorhinolaryngol 2020; 277: 269-276 DOI: 10.1007/s00405-019-05679-z.
- 15 Ernst BP, Strieth S, Künzel J. et al. Evaluation of optimal education level to implement structured reporting into ultrasound training. Med Ultrason 2020; DOI: 10.11152/mu-2530.
- 16 Ernst BP, Reissig MR, Strieth S. et al. The role of structured reporting and structured operation planning in functional endoscopic sinus surgery. PLoS One 2020; 15: e0242804 DOI: 10.1371/journal.pone.0242804.
- 17 Becker S, Gonser P, Haas M. et al. ENT Residents Benefit from a Structured Operation Planning Approach in the Training of Functional Endoscopic Sinus Surgery. Medicina (Kaunas) 2021; 57 DOI: 10.3390/medicina57101062.
- 18 Norenberg D, Sommer WH, Thasler W. et al. Structured Reporting of Rectal Magnetic Resonance Imaging in Suspected Primary Rectal Cancer: Potential Benefits for Surgical Planning and Interdisciplinary Communication. Invest Radiol 2017; 52: 232-239 DOI: 10.1097/RLI.0000000000000336.
- 19 Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159-174 DOI: 10.2307/2529310.
- 20 Tuncyurek O, Garces-Descovich A, Jaramillo-Cardoso A. et al. Structured versus narrative reporting of pelvic MRI in perianal fistulizing disease: impact on clarity, completeness, and surgical planning. Abdom Radiol (NY) 2019; 44: 811-820 DOI: 10.1007/s00261-018-1858-8.
- 21 Shen YT, Yue WW, Xu HX. Editorial: Ultrasound in Oncology: Application of Big Data and Artificial Intelligence. Front Oncol 2021; 11: 819487 DOI: 10.3389/fonc.2021.819487.
- 22 Sluijter CE, van Lonkhuijzen LR, van Slooten HJ. et al. The effects of implementing synoptic pathology reporting in cancer diagnosis: a systematic review. Virchows Arch 2016; 468: 639-649 DOI: 10.1007/s00428-016-1935-8.
- 23 Johannesen DTS, Wiig S. Exploring hospital certification processes from the certification body's perspective - a qualitative study. BMC Health Serv Res 2020; 20: 242 DOI: 10.1186/s12913-020-05093-w.
- 24 Matsumoto M, Koike S, Kashima S. et al. Geographic Distribution of Radiologists and Utilization of Teleradiology in Japan: A Longitudinal Analysis Based on National Census Data. PLoS One 2015; 10: e0139723 DOI: 10.1371/journal.pone.0139723.
- 25 Johnston K, Smith D, Preston R. et al. “From the technology came the idea”: safe implementation and operation of a high quality teleradiology model increasing access to timely breast cancer assessment services for women in rural Australia. BMC Health Serv Res 2020; 20: 1103 DOI: 10.1186/s12913-020-05922-y.
- 26 Sobez LM, Kim SH, Angstwurm M. et al. Creating high-quality radiology reports in foreign languages through multilingual structured reporting. Eur Radiol 2019; 29: 6038-6048 DOI: 10.1007/s00330-019-06206-8.
- 27 European Society of R. ESR paper on structured reporting in radiology. Insights Imaging 2018; 9: 1-7 DOI: 10.1007/s13244-017-0588-8.
- 28 Kahn CE, Heilbrun ME, Applegate KE. From guidelines to practice: how reporting templates promote the use of radiology practice guidelines. J Am Coll Radiol 2013; 10: 268-273 DOI: 10.1016/j.jacr.2012.09.025.