The detection of events in time-series data is a common signal-processing problem. When the data can be modeled as a known template signal with an unknown delay in Gaussian noise, detection of the template signal can ...
详细信息
The detection of events in time-series data is a common signal-processing problem. When the data can be modeled as a known template signal with an unknown delay in Gaussian noise, detection of the template signal can be done with a traditional matched filter. However, in many applications, the event of interest is represented in multimodal data consisting of both Gaussian and point-process time series. Neuroscience experiments, for example, can simultaneously record multimodal neural signals such as local field potentials (LFPs), which can be modeled as Gaussian, and neuronal spikes, which can be modeled as point processes. Currently, no method exists for event detection from such multimodal data, and as such our objective in this work is to develop a method to meet this need. Here we address this challenge by developing the multimodal event detector (MED) algorithm which simultaneously estimates event times and classes. To do this, we write a multimodal likelihood function for Gaussian and point-process observations and derive the associated maximum likelihood estimator of simultaneous event times and classes. We additionally introduce a cross-modal scaling parameter to account for model mismatch in real datasets. We validate this method in extensive simulations as well as in a neural spike-LFP dataset recorded during an eye-movement task, where the events of interest are eye movements with unknown times and directions. We show that the MED can successfully detect eye movement onset and classify eye movement direction. Further, the MED successfully combines information across data modalities, with multimodal performance exceeding unimodal performance. This method can facilitate applications such as the discovery of latent events in multimodal neural population activity and the development of brain-computer interfaces for naturalistic settings without constrained tasks or prior knowledge of event times.
Objective. When making decisions, humans can evaluate how likely they are to be correct. If this subjective confidence could be reliably decoded from brain activity, it would be possible to build a brain-computer inte...
详细信息
Objective. When making decisions, humans can evaluate how likely they are to be correct. If this subjective confidence could be reliably decoded from brain activity, it would be possible to build a brain-computer interface (BCI) that improves decision performance by automatically providing more information to the user if needed based on their confidence. But this possibility depends on whether confidence can be decoded right after stimulus presentation and before the response so that a corrective action can be taken in time. Although prior work has shown that decision confidence is represented in brain signals, it is unclear if the representation is stimulus-locked or response-locked, and whether stimulus-locked pre-response decoding is sufficiently accurate for enabling such a BCI. Approach. We investigate the neural correlates of confidence by collecting high-density electroencephalography (EEG) during a perceptual decision task with realistic stimuli. Importantly, we design our task to include a post-stimulus gap that prevents the confounding of stimulus-locked activity by response-locked activity and vice versa, and then compare with a task without this gap. Main results. We perform event-related potential and source-localization analyses. Our analyses suggest that the neural correlates of confidence are stimulus-locked, and that an absence of a post-stimulus gap could cause these correlates to incorrectly appear as response-locked. By preventing response-locked activity from confounding stimulus-locked activity, we then show that confidence can be reliably decoded from single-trial stimulus-locked pre-response EEG alone. We also identify a high-performance classification algorithm by comparing a battery of algorithms. Lastly, we design a simulated BCI framework to show that the EEG classification is accurate enough to build a BCI and that the decoded confidence could be used to improve decision making performance particularly when the task difficulty and cost o
This paper investigates the possibility of decoding decision confidence from electroencephalographic (EEG) brain activity of human subjects during a multisensory decision-making task. In recent research we have shown ...
详细信息
Objective. Information encoding in neurons can be described through their response fields. The spatial response field of a neuron is the region of space in which a sensory stimulus or a behavioral event causes that ne...
详细信息
Objective. Information encoding in neurons can be described through their response fields. The spatial response field of a neuron is the region of space in which a sensory stimulus or a behavioral event causes that neuron to fire. Neurons can also exhibit temporal response fields (TRFs), which characterize a transient response to stimulus or behavioral event onsets. These neurons can thus be described by a spatio-temporal response field (STRF). The activity of neurons with STRFs can be well-described with point process models that characterize binary spike trains with an instantaneous firing rate that is a function of both time and space. However, developing decoders for point process models of neurons that exhibit TRFs is challenging because it requires prior knowledge of event onset times, which are unknown. Indeed, point process filters (PPF) to date have largely focused on decoding neuronal activity without considering TRFs. Also, neural classifiers have required data to be behavior- or stimulus-aligned, i.e. event times to be known, which is often not possible in real-world applications. Our objective in this work is to develop a viable decoder for neurons with STRFs when event times are unknown. Approach. To enable decoding of neurons with STRFs, we develop a novel point-process matched filter (PPMF) that can detect events and estimate their onset times from population spike trains. We also devise a PPF for neurons with transient responses as characterized by STRFs. When neurons exhibit STRFs and event times are unknown, the PPMF can be combined with the PPF or with discrete classifiers for continuous and discrete brain state decoding, respectively. Main results. We validate our algorithm on two datasets: simulated spikes from neurons that encode visual saliency in response to stimuli, and prefrontal spikes recorded in a monkey performing a delayed-saccade task. We show that the PPMF can estimate the stimulus times and saccade times accurately. Further, the PP
The point-process filter (PPF) is a real-time recursive algorithm that computes the minimum mean-squared error estimate of a behavioral state, given neural spiking observations. When used with stimulus-sensitive neuro...
详细信息
ISBN:
(纸本)9781538636466
The point-process filter (PPF) is a real-time recursive algorithm that computes the minimum mean-squared error estimate of a behavioral state, given neural spiking observations. When used with stimulus-sensitive neurons that represent behavioral states transiently, the PPF needs to know the times at which stimuli will occur. However, these times will not be known a-priori. In this work, we develop a matched-filter point process filter (MF-PPF) that can decode behavioral states that are encoded transiently in neural activity when stimulus times are unknown. A linear filter matched to each neuron's temporal receptive field is used to estimate stimulus onset times, which are then fed into the PPF to decode the behavioral state. As an example, we use the MF-PPF to decode visual saliency from simulated superior colliculus spiking activity. This new decoder has the potential to decode behavioral states from brain regions with transient representations and temporal receptive fields.
The point-process filter (PPF) is a real-time recursive algorithm that computes the minimum mean-squared error estimate of a behavioral state, given neural spiking observations. When used with stimulus-sensitive neuro...
详细信息
The point-process filter (PPF) is a real-time recursive algorithm that computes the minimum mean-squared error estimate of a behavioral state, given neural spiking observations. When used with stimulus-sensitive neurons that represent behavioral states transiently, the PPF needs to know the times at which stimuli will occur. However, these times will not be known a-priori. In this work, we develop a matched-filter point process filter (MF-PPF) that can decode behavioral states that are encoded transiently in neural activity when stimulus times are unknown. A linear filter matched to each neuron's temporal receptive field is used to estimate stimulus onset times, which are then fed into the PPF to decode the behavioral state. As an example, we use the MF-PPF to decode visual saliency from simulated superior colliculus spiking activity. This new decoder has the potential to decode behavioral states from brain regions with transient representations and temporal receptive fields.
We present a domed programmable LED array attachment for CellScope, enabling streaming brightfield, darkfield, and differential phase contrast imaging and digital refocusing on a smartphone-based microscope, without t...
详细信息
暂无评论