Subscribe to RSS
Please copy the URL and add it into your RSS Feed Reader.
https://www.thieme-connect.de/rss/thieme/en/10.1055-s-00000067.xml
CC BY-NC-ND 4.0 · Semin Hear 2021; 42(03): 295-308
DOI: 10.1055/s-0041-1735136
DOI: 10.1055/s-0041-1735136
Review Article
Improving Speech Understanding and Monitoring Health with Hearing Aids Using Artificial Intelligence and Embedded Sensors
Abstract
This article details ways that machine learning and artificial intelligence technologies are being integrated in modern hearing aids to improve speech understanding in background noise and provide a gateway to overall health and wellness. Discussion focuses on how Starkey incorporates automatic and user-driven optimization of speech intelligibility with onboard hearing aid signal processing and machine learning algorithms, smartphone-based deep neural network processing, and wireless hearing aid accessories. The article will conclude with a review of health and wellness tracking capabilities that are enabled by embedded sensors and artificial intelligence.
Keywords
hearing aid - speech intelligibility - background noise - artificial intelligence - machine learning - deep neural networks - embedded sensors - fall detectionPublication History
Article published online:
24 September 2021
© 2021. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)
Thieme Medical Publishers, Inc.
333 Seventh Avenue, 18th Floor, New York, NY 10001, USA
-
References
- 1 Hsu J. Starkey's AI transforms hearing aids into smart wearables. IEEE (Institute for Electrical and Electronic Engineers). Spectrum 27 August 2018. Accessed May 12, 2021 at: https://spectrum.ieee.org/the-human-os/biomedical/devices/starkeys-ai-transforms-hearing-aid-into-smart-wearables
- 2 Fabry D, Rodemark K, Vase Legarth S, Crukley J, Pociecha A, Seitz-Paquette K. Evidence of Noise Management Preference for Starkey Hearing Aids. White Paper. 2019 . Accessed May 21, 2021 at: https://starkeypro.com/pdfs/white-papers/Evidence_of_Noise_Management_Preference.pdf
- 3 Rahme M, Folkeard P, Scollie S. Evaluating the accuracy of step tracking and fall detection in the Starkey Livio artificial intelligence hearing aids: a pilot study. Am J Audiol 2021; 30 (01) 182-189
- 4 Burwinkel JR, Xu B, Crukley J. Preliminary examination of the accuracy of a fall detection device embedded into hearing instruments. J Am Acad Audiol 2020; 31 (06) 393-403
- 5 Picou EM. MarkeTrak 10 (MT10) survey results demonstrate high satisfaction with and benefits from hearing aids. Semin Hear 2020; 41 (01) 21-36
- 6 Sternberg RJ. Human Intelligence. Encyclopedia Britannica, November 6, 2020
- 7 Bhowmik A. Artificial intelligence: from pixels and phonemes to semantic understanding and interactions. Proc Int Display Workshops 2019 (26) 9-12
- 8 Bregman AS. Auditory Scene Analysis: The Perceptual Organization of Sound. Cambridge, MA: MIT Press; 1990
- 9 Zhang T, Kindred JS. System for evaluating hearing assistance device settings using detected sound environment. 2011 ; U.S. Patent no. 7,986,790
- 10. Fabry D, Tchorz J. Results from a new hearing aid using “acoustic scene analysis”. Hearing J 2005; 58 (04) 30-36
- 11 Buchler M, Allegro S, Launer S, Dillier N. Sound classification in hearing aids inspired by auditory scene analysis. EURASIP J Appl Signal Process 2005; (18) 2991-3002
- 12 Xiang JJ, McKinney MF, Fitz K, Zhang T. Evaluation of sound classification algorithms for hearing aid applications. In: 2010 IEEE International Conference on Acoustics, Speech and Signal Processing, 2010: 185-188
- 13 Harianawala J, McKinney M, Fabry D. Intelligence at the Edge. White paper; 2020. Accessed May 12, 2021 at: https://starkeypro.com/pdfs/technical-papers/Intelligence_at_the_Edge_White_Paper.pdf
- 14 Ten Hulzen RD, Fabry DA. Impact of hearing loss and universal masking in the COVID 19 era. Mayo Clin Proc 2020; 95 (10) 2069-2072
- 15 Fabry D, Burns T, McKinney M, Bhowmik A. “Unmasking” benefits for hearing aid users in challenging listening environments. Hearing Review 2020; 27 (11) 18-20
- 16 Corey RM, Jones U, Singer AC. Acoustic effects of medical, cloth, and transparent face masks on speech signals. 2020 arXiv:2008.04521. Accessed May 12, 2021 at: https://publish.illinois.edu/augmentedlistening/face-masks/
- 17 Goldin A, Weinstein B, Shiman N. How do medical masks degrade speech reception?. Hearing Review 2020; 27 (05) 8-9
- 18 Zhao Y, Wang D, Merks I, Zhang T. DNN-based enhancement of noisy and reverberant speech. In: 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2016: 6525-6529
- 19 Zhao Y, Xu B, Giri R, Zhang T. Perceptually guided speech enhancement using deep neural networks. In: 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2018: 5074-5078
- 20 Cook D. AI can now help you hear speech better. Hearing Loss Journal 2020. Accessed May 12, 2021 at: https://www.hearinglossjournal.com/ai-can-now-help-you-hear-speech/
- 21 Walsh K, Zakharenko V. 2.4 GHz Table Microphone. Starkey White paper 2020. Accessed May 12, 2021 at: https://home.starkeypro.com/pdfs/WTPR/SG/WTPR2787-00-EE-SG/Table_Microphone_White_Paper.pdf
- 22 Lin FR, Metter EJ, O'Brien RJ, Resnick SM, Zonderman AB, Ferrucci L. Hearing loss and incident dementia. Arch Neurol 2011; 68 (02) 214-220
- 23 Lin FR, Albert M. Hearing loss and dementia - Who is listening?. Aging Ment Health 2014; 18 (06) 671-673
- 24 Livingston G, Huntley J, Sommerlad A. et al Dementia prevention, intervention, and care: 2020 report of the Lancet Commission. Lancet 2020; 396 (10248): 413-446
- 25 Ray J, Popli G, Fell G. Association of cognition and age-related hearing impairment in the English longitudinal study of ageing. JAMA Otolaryngol Head Neck Surg 2018; 144 (10) 876-882
- 26 Takahashi G, Martinez CD, Beamer S. et al Subjective measures of hearing aid benefit and satisfaction in the NIDCD/VA follow-up study. J Am Acad Audiol 2007; 18 (04) 323-349
- 27 Jorgensen L, Novak M. Factors influencing hearing aid adoption. Semin Hear 2020; 41 (01) 6-20
- 28 Mueller G, Carr K. 20Q: Consumer Insights on Hearing Aids, PSAPs, OTC Devices, and More from MarkeTrak 10. Audiology Online, March 16, 2020. Accessed May 15, 2021 at: https://www.audiologyonline.com/articles/20q-understanding-today-s-consumers-26648
- 29 Humes LE, Rogers SE, Main AK, Kinney DL. The acoustic environments in which older adults wear their hearing aids: insights from datalogging sound environment classification. Am J Audiol 2018; 27 (04) 594-603
- 30 Solheim J, Hickson L. Hearing aid use in the elderly as measured by datalogging and self-report. Int J Audiol 2017; 56 (07) 472-479
- 31 Laplante-Lévesque A, Nielsen C, Dons Jensen L, Naylor G. Patterns of hearing aid usage predict hearing aid. J Am Acad Audiol 2014; 25: 187-198
- 32 Howes C. Thrive Hearing Control: An App for a Hearing Revolution. Starkey White paper 2019. Accessed May 17, 2021 at: https://starkeypro.com/pdfs/white-papers/Thrive_Hearing_Control.pdf
- 33 Starkey Thrive Care application. Accessed May 17, 2021 at: https://starkeypro.com/pdfs/quicktips/Thrive_Care_App.pdf
- 34 Helzner EP, Patel AS, Pratt S. et al Hearing sensitivity in older adults: associations with cardiovascular risk factors in the health, aging and body composition study. J Am Geriatr Soc 2011; 59 (06) 972-979
- 35 McCormack G, Giles-Corti B, Milligan R. Demographic and individual correlates of achieving 10,000 steps/day: use of pedometers in a population-based study. Health Promot J Austr 2006; 17 (01) 43-47
- 36 Lavie CJ, Ozemek C, Carbone S, Katzmarzyk PT, Blair SN. Sedentary behavior, exercise, and cardiovascular health. Circ Res 2019; 124 (05) 799-815
- 37 Garber CE, Blissmer B, Deschenes MR. et al; American College of Sports Medicine. American College of Sports Medicine position stand. Quantity and quality of exercise for developing and maintaining cardiorespiratory, musculoskeletal, and neuromotor fitness in apparently healthy adults: guidance for prescribing exercise. Med Sci Sports Exerc 2011; 43 (07) 1334-1359
- 38 Rubenstein LZ. Falls in older people: epidemiology, risk factors and strategies for prevention. Age Ageing 2006; 35 (02, Suppl 2): ii37-ii41
- 39 Lin FR, Ferrucci L. Hearing loss and falls among older adults in the United States. Arch Intern Med 2012; 172 (04) 369-371
- 40 Crenshaw JR, Bernhardt KA, Achenbach SJ. et al The circumstances, orientations, and impact locations of falls in community-dwelling older women. Arch Gerontol Geriatr 2017; 73: 240-247