Perspective
Reading the mind with EEG and fNIRS
Context
Non-invasive neural decoding has seen various approaches over the years, each to varying degrees of success but none achieving true viability for a consumer product. fMRI and MEG approaches are provenly good, yet impractical due to large machines and magnetic shielding requirements. EEG approaches often display flashes of brilliance, but inconsistencies plague model outputs due to the weak biological nature of the electrical signal.
Teal’s thesis revolves around a less-used data modality called fNIRS to supercharge our biological context, which uses infrared light to image blood flow and metabolic activity at much higher spatial resolutions.
Light is a good listener
Certain wavelengths of near-infrared light are primarily absorbed by hemoglobin, passing through most tissues and miscellaneous matter in the brain and head. Because intentional brain activity demands energy, tracing the movement of the blood’s oxygen carrier enables us to peek into the mind comfortably—without making any incisions.
Timing from electricity, place from light
EEG samples at an incredibly high rate, but smears across space because axonal electrical fields require mass coupling to reach the scalp’s surface. Optical fNIRS signals are slower, but image a more reliable byproduct of neural activity through a more consistent physical medium.
It should be intuitive from here that neither signal, independently, provides enough information. Unfortunately, reading minds is pretty hard. Fused, however, EEG and fNIRS seem to cover each other’s blind spots. One tells us when, the other tells us where, and structure begins to emerge.
With our multimodal data pipeline, the random noise that plagues raw EEG data is replaced in favor of visibly clearer signals. Improving signal-to-noise ratio in this manner is a significant step forward, and it has propelled our efforts to develop a powerful, consumer-viable decoding model.
Looking forward
This is the first of many notes from the lab. We’ll share what we’re learning, what we’re getting wrong, and what we’re building towards as we bring Teal to life.
← All science