two augmented reality headsets hanging on a wall covered by recycled crate boards
Photo by NeONBRAND on Unsplash.

The Problem

MRI, CT, PET scans of the brain are visualized by default on a computer screen or paper in a 2D format as slices. Electrical localization on electroencephalography (EEG) is also in 2D format. These can be transformed into 3D representations and ‘heat maps’ using software like BrainLab® with ROSA®(4) and Curry® to find the best approximation for a seizure focus. However, these references are not available or accessible in the OR.

When doing the resection, the surgeon often has to reference the core imaging described above to re-orient him or herself. To do this now, that individual either has a technician pull up the latest MRI (in 2D format) and scroll through it several times so that he or she can re-create that 3D image in their mind or as is sometimes the case, break sterility and manually go through the images again mid-case on a computer.

Our Solution

We will put patient-specific 3D images in the Neurosurgeon’s field of view while doing brain surgeries, especially for those patients suffering from Epilepsy where the area of the brain causing seizures can look totally normal.

By using augmented reality via the Hololens®(5), Augmedix (or other augmented reality) system, we can project moveable 3D models of the patients’ brains around the operating suite and project the agreed-upon seizure focus directly into the brain itself.

References

4. Brainlab elements and intracranial planning URL: https://www.brainlab.com/surgery-products/overview-neurosurgery-products/brainlab-elements/
5. Microsoft Hololens https://www.microsoft.com/en-us/hololens

Innovation & Implementation Team

More Projects