Download PDF
Facial Plast Surg 2023; 39(05): 508-511
DOI: 10.1055/s-0043-1769805
Original Article

Deep Learning for the Assessment of Facial Nerve Palsy: Opportunities and Challenges

Kieran Boochoon
1   Department of Otolaryngology – Head and Neck Surgery, University of Nebraska Medical Center, Omaha, Nebraska
,
Ali Mottaghi
2   Department of Electrical Engineering, Stanford University, Stanford, California
,
Aya Aziz
3   Department of Human Biology, Stanford University, Stanford, California
,
Jon-Paul Pepper
4   Department of Otolaryngology – Head and Neck Surgery, Stanford University School of Medicine, Stanford, California
› Author Affiliations
› Further Information
    Permissions and Reprints

Abstract

Automated evaluation of facial palsy using machine learning offers a promising solution to the limitations of current assessment methods, which can be time-consuming, labor-intensive, and subject to clinician bias. Deep learning-driven systems have the potential to rapidly triage patients with varying levels of palsy severity and accurately track recovery over time. However, developing a clinically usable tool faces several challenges, such as data quality, inherent biases in machine learning algorithms, and explainability of decision-making processes. The development of the eFACE scale and its associated software has improved clinician scoring of facial palsy. Additionally, Emotrics is a semiautomated tool that provides quantitative data of facial landmarks on patient photographs. The ideal artificial intelligence (AI)-enabled system would analyze patient videos in real time, extracting anatomic landmark data to quantify symmetry and movement, and estimate clinical eFACE scores. This would not replace clinician eFACE scoring but would offer a rapid automated estimate of both anatomic data, similar to Emotrics, and clinical severity, similar to the eFACE. This review explores the current state of facial palsy assessment, recent advancements in AI, and the opportunities and challenges in developing an AI-driven solution.

Keywords

facial palsy - eFACE - computer vision - artificial intelligence - facial paralysis


Publication History

Article published online:
08 June 2023

© 2023. Thieme. All rights reserved.

Thieme Medical Publishers, Inc.
333 Seventh Avenue, 18th Floor, New York, NY 10001, USA

 

  • References

  • 1 Hohman MH, Hadlock TA. Etiology, diagnosis, and management of facial palsy: 2000 patients at a facial nerve center. Laryngoscope 2014; 124 (07) e283-e293
    CrossrefPubMedGoogle Scholar
  • 2 Kimura KS, Kfoury P, Pepper JP. Evidence-based medicine: facial reanimation. Facial Plast Surg 2023; 39 (03) 266-272
    Article in Thieme ConnectPubMedGoogle Scholar
  • 3 Fattah AY, Gurusinghe ADR, Gavilan J. et al; Sir Charles Bell Society. Facial nerve grading instruments: systematic review of the literature and suggestion for uniformity. Plast Reconstr Surg 2015; 135 (02) 569-579
    CrossrefPubMedGoogle Scholar
  • 4 Ross BG, Fradet G, Nedzelski JM. Development of a sensitive clinical facial grading system. Otolaryngol Head Neck Surg 1996; 114 (03) 380-386
    CrossrefPubMedGoogle Scholar
  • 5 Kanerva M, Poussa T, Pitkäranta A. Sunnybrook and House-Brackmann facial grading systems: intrarater repeatability and interrater agreement. Otolaryngol Head Neck Surg 2006; 135 (06) 865-871
    CrossrefPubMedGoogle Scholar
  • 6 Banks CA, Bhama PK, Park J, Hadlock CR, Hadlock TA. Clinician-graded electronic facial paralysis assessment: the eFACE. Plast Reconstr Surg 2015; 136 (02) 223e-230e
    CrossrefPubMedGoogle Scholar
  • 7 Song I, Vong J, Yen NY, Diederich J, Yellowlees P. Profiling Bell's palsy based on House-Brackmann score. J Artif Intell Soft Comput Res 2013; 3 (01) 41-50
    CrossrefPubMedGoogle Scholar
  • 8 Malka R, Miller M, Guarin D, Fullerton Z, Hadlock T, Banks C. Reliability between in-person and still photograph assessment of facial function in facial paralysis using the eFACE facial grading system. Facial Plast Surg Aesthet Med 2021; 23 (05) 344-349
    CrossrefPubMedGoogle Scholar
  • 9 Miller MQ, Hadlock TA, Fortier E, Guarin DL. The Auto-eFACE: machine learning-enhanced program yields automated facial palsy assessment tool. Plast Reconstr Surg 2021; 147 (02) 467-474
    CrossrefPubMedGoogle Scholar
  • 10 Deo RC. Machine learning in medicine. Circulation 2015; 132 (20) 1920-1930
    CrossrefPubMedGoogle Scholar
  • 11 Sagonas C, Tzimiropoulos G, Zafeiriou S, Pantic M. A semi-automatic methodology for facial landmark annotation. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. 2013: 896-903
    Google Scholar
  • 12 Kazemi V, Sullivan J. One millisecond face alignment with an ensemble of regression trees. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Computer Society. 2014: 1867-1874
    Google Scholar
  • 13 Guarin DL, Dusseldorp J, Hadlock TA, Jowett N. A machine learning approach for automated facial measurements in facial palsy. JAMA Facial Plast Surg 2018; 20 (04) 335-337
    CrossrefPubMedGoogle Scholar
  • 14 Parra-Dominguez GS, Sanchez-Yanez RE, Garcia-Capulin CH. Facial paralysis detection on images using key point analysis. Appl Sci 2021; 11 (05) 2435
    CrossrefPubMedGoogle Scholar
  • 15 Gaber A, Taher MF, Abdel Wahed M, Shalaby NM, Gaber S. Comprehensive assessment of facial paralysis based on facial animation units. PLoS One 2022; 17 (12) e0277297
    CrossrefPubMedGoogle Scholar
  • 16 Knoedler L, Baecher H, Kauke-Navarro M. et al. Towards a reliable and rapid automated grading system in facial palsy patients: facial palsy surgery meets computer science. J Clin Med 2022; 11 (17) 4998
    CrossrefPubMedGoogle Scholar