Head Motion Controlled Endoscopic Camera Manipulation using Inertial Motion Sensor and Mixed Reality Headset

Yoeko Mak
Presentation MSc presentation
Date 2018-12-18
Time 11:00
Location Carré 3D

A Minimally Invasive Surgery (MIS) procedure normally requires an assistant to hold and control the endoscope camera, such that the assistant will move the camera while the surgeon performs the surgical operation. A head motion controlled endoscope will allow the surgeon to control the camera directly.

During the master’s assignment, a head motion controlled endoscopic camera system has been developed and evaluated. First, a system is built using an inertial measurement unit (IMU) attached to the surgeon’s head as input and a standard display monitor as output, followed by using a Microsoft Hololens Mixed Reality headset as additional visual output. One challenge in realizing the system is to compensate for the rotation of the endoscope tip in order to have the visual output stable orientation-wise.

A pointing task experiment is conducted with help from clinicians and trained non-clinician participants to compare the human performance while using the head-controlled system versus manual usage of the flexible endoscope. The acceptability of the developed system is evaluated through a questionnaire.

Posted on Tuesday, November 6, 2018