NWB & DANDI Archive Guide: Cloud Streaming & Analysis of Cellular Electrophysiology & Patch-seq
Working with Neuropixels, intracellular patch-clamp, and optical physiology datasets without downloading terabytes of raw files.
Modern cellular neurophysiology experiments—such as multi-probe Neuropixels recordings, two-photon calcium imaging, and human/mouse cortical Patch-seq—generate datasets ranging from hundreds of gigabytes to tens of terabytes. Hosted on the DANDI Archive in the Neurodata Without Borders (NWB) standard, these datasets can be streamed directly over HTTP in Python.
1. Understanding the Core NWBFile Data Hierarchy
- Use remfile or fsspec to lazy-load only the specific time slices or Units table needed for your analysis.
- Always multiply raw integer data arrays by series.conversion and add series.offset to obtain physical units (Volts or Amperes).
- Filter single units by quality metrics (SNR > 2.5, ISI violations < 0.5%) before computing firing rate correlations.
2. Extracting Intrinsic Membrane Properties in Patch-seq Studies
Python Example: Lazy-Loading Spike Times & Trial PSTH from a Remote DANDI NWB File
Standard Python template ready for integration into local Jupyter notebooks or automated pipelines.
import h5py
import pynwb
import remfile
import numpy as np
# Stream directly from DANDI S3 asset URL via HTTP range requests
s3_url = "https://dandiarchive.s3.amazonaws.com/blobs/example-session.nwb"
remote_file = remfile.File(s3_url)
with h5py.File(remote_file, "r") as h5_f:
with pynwb.NWBHDF5IO(file=h5_f, load_namespaces=True) as io:
nwbfile = io.read()
if nwbfile.units is not None:
units_df = nwbfile.units.to_dataframe()
print(f"Total sorted single units: {len(units_df)}")
# Compute mean firing rate for the first unit
spike_times = units_df.iloc[0]["spike_times"]
duration_sec = spike_times[-1] - spike_times[0]
print(f"Unit 0 Mean Firing Rate: {len(spike_times) / max(duration_sec, 1.0):.2f} Hz")Research Governance & Reproducibility Checklist
- Verify timestamp synchronization across multiple probes or behavioral cameras inside the NWB file.
- Use slice notation (series.data[0:10000]) rather than series.data[:] when streaming over HTTP to avoid loading 50GB into RAM.
- Include the Dandiset version identifier (e.g., draft or 0.230915.1200) when citing DANDI datasets.
Key Biomarkers & Standards Referenced in This Guide
Unified data standard for cellular neurophysiology, packaging intracellular/extracellular recordings, optical physiology, and behavior into HDF5/Zarr files.
Multimodal single-cell technique simultaneously capturing intrinsic electrophysiological properties, 3D axonal/dendritic morphology, and full-length transcriptome from the same neuron.
High-temporal-resolution recording of postsynaptic cortical electrical potentials and neural oscillations (delta, theta, alpha, beta, gamma bands).
High-throughput transcriptomic profiling at individual cell or nucleus resolution, enabling identification of disease-associated microglia (DAM), astrocytes, and vulnerable neuronal subtypes.
Live Open Datasets & Papers Matching This Guide
Dandiset 000108: Single-Cell Patch-seq Electrophysiology and Morphometry of Human Neocortical Neurons
Over 1,200 human surgical neocortical pyramidal neurons and interneurons characterized simultaneously with patch-clamp electrophysiology, fluorescent morphological reconstruction, and single-cell RNA sequencing in NWB 2.0 format.
Dandiset 001475: NHP patch-seq
BRAIN Initiative neurophysiology dataset deposited to DANDI Archive.
Dandiset 000108: Single-Cell Patch-seq Electrophysiology and Morphometry of Human Neocortical Neurons
Over 1,200 human surgical neocortical pyramidal neurons and interneurons characterized with patch-clamp electrophysiology, morphological reconstruction, and scRNA-seq.
Allen Brain Atlas: Human Brain ISH Autism Study
High-resolution ISH data detailing gene expression with a unique panel of lamina- and cell type- specific markers to phenotype cortical microstructure during the early years after autism onset.... Freely accessible open data product maintained by the Allen Institute for Brain Science.
Allen Brain Atlas: Multi-plane optical physiology during image change detection
Time series of behavioral variables and neural activity measured with multi-plane in vivo 2-photon imaging in mice performing a visual change detection task where mice were trained with image set A and tested with a novel image set B... Freely accessible open data product maintained by the Allen Institute for Brain Science.
BICCN Whole Human Brain Single-Cell Transcriptomic Cell Type Atlas
Cell atlas spanning >3 million single nuclei across 100+ human brain regions, mapping distinct vulnerable neuronal and glial sublineages.