Open Access
CC BY-NC-ND 4.0 · Endoscopy 2023; 55(S 01): E179-E180
DOI: 10.1055/a-1960-2610
E-Videos

Eye-tracking fluoroscopy system: a new artificial intelligence-based system to communicate activate watching of the monitor during endoscopy

Autoren

  • Masaki Takinami

    1   Division of Gastroenterology, Iwata City Hospital, Shizuoka, Japan
  • Junichi Kaneko

    1   Division of Gastroenterology, Iwata City Hospital, Shizuoka, Japan
  • Megumu Koda

    1   Division of Gastroenterology, Iwata City Hospital, Shizuoka, Japan
  • Masafumi Nishino

    1   Division of Gastroenterology, Iwata City Hospital, Shizuoka, Japan
  • Takanori Sakaguchi

    2   Department of Surgery, Iwata City Hospital, Shizuoka, Japan
  • Shohachi Suzuki

    2   Department of Surgery, Iwata City Hospital, Shizuoka, Japan
  • Takanori Yamada

    1   Division of Gastroenterology, Iwata City Hospital, Shizuoka, Japan

Minimizing radiation exposure time is one of the three principles of radiation safety. However, fluoroscopy is often used unnecessarily when endoscopists are not looking at the fluoroscopy monitor. Unnecessary radiation exposure is due to the complexity of fluoroscopic endoscopy procedures, wherein multiple operators independently view different parts of multiple monitors. These procedures usually need an endoscopist for endoscope maneuvers and one or more assistants for other devices; therefore, a radiologic technologist, who manages radiation exposure, cannot always monitor the line of sight of all operators at once. As limited tools are available to reduce endoscopic radiation exposure time [1], we developed a new eye-tracking fluoroscopy system that informs the radiologic technologist when the operators’ line of sight is directed toward the monitor. It can track the operators’ line of sight and flash a “watching” alert on the detection monitor once a line of sight to the fluoroscopy monitor is detected. This system, jointly developed with NEC Corporation (Tokyo, Japan), was designed to detect remote gaze of operators simultaneously using artificial intelligence (AI)-based face-recognition technology. Radiologic technologists can use this system by attaching an external camera to the fluoroscopy monitor ([Fig. 1]) and connecting the camera to the detection monitor and the AI software.

Zoom
Fig. 1 The eye-tracking camera located in the center of multiple monitors, with the fluoroscopy monitor at the lower right.

The system could detect the operators’ line of sight to the fluoroscopy monitor with high accuracy. This was demonstrated in an experimental study by three personnel wearing radiation safety glasses and personal protective equipment, who raised their hands only when gazing at the fluoroscopy monitor ([Fig. 2]). The line of sight detected included both deliberate and unconscious gaze by operators. The system worked in real time during endoscopic procedures ([Fig. 3]). Radiation exposure could thus be minimized by detecting line of sight during actual endoscopy ([Video 1]).

Zoom
Fig. 2 Detection of direct lines of sight to the fluoroscopy monitor displayed on the detection monitor.
Zoom
Fig. 3 The eye-tracking fluoroscopy system during actual endoscopy.

Video 1 Eye-tracking fluoroscopy system for reducing radiation exposure time during endoscopy.

This AI-based eye-tracking system is a promising tool to reduce radiation exposure time of patients and operators during fluoroscopic endoscopy procedures.

Endoscopy_UCTN_Code_TTT_1AR_2AK

Endoscopy E-Videos is an open access online section, reporting on interesting cases and new techniques in gastroenterological endoscopy. All papers include a high quality video and all contributions are freely accessible online. Processing charges apply (currently EUR 375), discounts and wavers acc. to HINARI are available.

This section has its own submission website at https://mc.manuscriptcentral.com/e-videos



Publikationsverlauf

Artikel online veröffentlicht:
11. November 2022

© 2022. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany

 
  • Reference

  • 1 Kwok K, Hasan N, Duloy A. et al. American Society for Gastrointestinal Endoscopy radiation and fluoroscopy safety in GI endoscopy. Gastrointest Endosc 2021; 94: 685-697