Imec hyperspectral camera paves the way for in-vivo detection of low-grade gliomas

LEUVEN (Belgium), JANUARY 27, 2023 — At this week’s BiOS, the biomedical optics and biophotonics exhibition at SPIE Photonics West, imec – a world-leading research and innovation hub in nanoelectronics and digital technologies – presents a promising path to the in-vivo detection of low-grade gliomas (a group of slow-growing brain tumors). The breakthrough was realized by mounting imec’s SNAPSCAN VNIR 150 hyperspectral camera on a standard OR-approved surgical microscope. Intraoperative pilot tests were performed at the neurosurgical department of the University Hospital Leuven (KU Leuven). A milestone, imec researchers found the compact set-up to generate accurate clinical data, ready to be fed into a neural network that can convert those data into actionable knowledge. In time, the approach could help surgeons detect intrinsic brain tumors’ exact demarcations intraoperatively and label-free, which would make for a whole new way of providing medical care.

Low-grade gliomas are a diverse group of (slow-growing) brain tumors that often arise in young, otherwise healthy patients. While typically considered benign in origin, studies have shown that low-grade gliomas can expand at a rate of four to five millimeters annually and come with the risk of malignant transformation. The tumor’s early surgical resection has thus become a much-favored treatment option – although in-vivo detection of low-grade gliomas and retrieving their exact demarcations is notoriously hard, even with the aid of surgical microscopes.

Unlocking the potential of hyperspectral imaging for low-grade gliomas’ in-vivo detection

“Giving surgeons the proper tools to detect these tumors in-vivo would make for an important breakthrough. Hyperspectral imaging (HSI) technology shows great potential to do just that,” says Roeland Vandebriel, field application engineer at imec. “Using HSI, brain tissue is illuminated, after which its reflected light is captured in many narrow spectral bands – resulting in a different spectral signature for healthy and anomalous cells.”

Bulky hardware and integration challenges have prevented HSI technology from being straightforwardly used in hospitals’ operating theatres. Yet, two presentations at this year’s BiOS now show a promising path forward.

Roeland Vandebriel: “It is a breakthrough we realized by mounting imec’s SNAPSCAN VNIR 150 hyperspectral camera on a surgical microscope. We found this compact set-up to generate accurate clinical data that can then be fed into a deep-learning neural network to convert the data into actionable knowledge, allowing surgeons to discriminate between healthy and anomalous tissue. Clearly, these learnings are an important first step to accommodating the in-vivo detection of intrinsic brain tumors – such as low-grade gliomas.”

Combining a small form factor with high accuracy

Thanks to its small form factor (10 x 7 x 6.5 cm, and weighing 645 g), and its compatibility with standard C-mount optics, imec’s SNAPSCAN VNIR can easily be mounted on a surgical microscope. It makes for a compact set-up that can be incorporated in hospitals’ stringent clinical workflows, contrary to the bulky systems used in previous studies.  

“Imec’s contribution also focused on how to acquire accurate and relevant clinical data in a (sterile) intraoperative environment,” comments Siri Luthman, imec’s project lead. “It had us rethink HSI’s existing spatial and spectral calibration methods, and necessitated us to interface imec’s SNAPSCAN directly with the surgical microscope’s optics and light source. As such, the first feasibility data set was generated – allowing us to evaluate HSI’s potential for the in-vivo detection of low-grade gliomas; an approach coming with minimal adaptations to both the system and our data pre-processing methods.”

“Lighting is one of the other parameters we studied. To avoid excessive noise, we adapted the spectral range of the SNAPSCAN camera to match that of the microscope’s internal light source. We also looked at the system’s integration time modalities to find the right balance between saturation and noise. And last, we defined the microscope’s ideal zoom level and working distance to optimize the field of view,” she adds.

Prof. Dr. Steven De Vleeschouwer, neurosurgeon, University Hospital Leuven: “While removing a low-grade glioma from the brain, the neurosurgeon typically navigates on anatomical knowledge, functional boundaries, haptic skills and subtle tissue changes. The latter however as a rule, fade away in the tumor periphery where these gliomas are highly invasive in the normal brain. Detecting these tumor boundaries with the naked eye, even with the aid of an high-end surgical microscope is simply impossible. Therefore, we have been engaging for many years into a proof-of-concept study with imec to go beyond this current state-of-the-art. With the imec VNIR SNAPSCAN camera, integrated into a surgical microscope, we are developing a real-time, intraoperative, label-free and wide-field assessment tool to distinguish invaded from normal brain without disrupting the normal surgical flow. I have no doubt that such pioneering efforts will become the new gold standard in the near future.”

The next step: moving on to video-rate hyperspectral imaging for real-time tumor classification

“Today’s findings indicate which hyperspectral bands are critical when interfacing with high-end surgical microscopes for an in-vivo classification of low-grade gliomas. While intraoperative use of our set-up is premature, the approach has so far been validated using a clinical dataset of six patients at Belgium’s Leuven University Hospital. Going forward, we aim to further this project by integrating our SNAPSHOT technology, which accommodates video-rate hyperspectral imaging. This should allow us to explore the real-time detection of low-grade gliomas in surgical practice,” Roeland Vandebriel concludes.

This study was conducted in collaboration with Carl Zeiss Meditec AG. The results will be presented at SPIE BiOS 2023 in the following papers:

• Integrating hyperspectral imaging in an existing intra-operative environment for detection of intrinsic brain tumors, R. Vandebriel (imec)
• Intra-operative brain tumor detection with deep learning-optimized hyperspectral imaging, X. Zhang (Carl Zeiss Meditec AG)

Interested in experimenting with imec’s SNAPSCAN and/or SNAPSHOT hyperspectral cameras? Discover the technology’s potential in domains as diverse as agriculture, sorting, or a variety of medical applications at this year’s BiOS at SPIE Photonics West (imec booth 4614), or have a look at our hyperspectral webpages