Specialized research software has historically been costly and time-consuming to create, but large language models (LLMs) have become capable enough at code generation to fundamentally change this. We describe how LLM-assisted programming disrupts the landscape by allowing researchers to build tools without support from software engineers, illustrate this with an example built rapidly by a single LLM-assisted developer, and discuss opportunities and risks.

Immature neurons in the adult brain migrate into existing circuits, contributing to plasticity, learning, and complex behaviors. While prior studies have examined the molecular mechanisms and functional consequences of adult neurogenesis, few have investigated the physical interactions between migrating neurons and their surrounding microenvironment. Here, we used electron microscopy (EM)-based connectomics to examine how migrating neurons interact with mature circuit elements in the adult zebra finch striatum. Migratory neurons contacted diverse structures in their microenvironment, including the axons, dendrites, synapses, and somas of mature neurons. Surprisingly, these interactions were structurally complex, often involving pronounced deformations of mature somas and the surrounding neuropil. These deformations appeared as “tunnels” made by the migratory neurons as they displaced mature structures along their path. Together, these findings suggest that migrating neurons may physically reshape the mature circuit to reach their targets, revealing an unexpected degree of structural and functional plasticity in the adult brain.

The basal ganglia (BG) play an essential role in shaping vertebrate behavior, ranging from motor learning to emotions, but comprehensive maps of their canonical synaptic architecture are missing. In mammals, three main neuronal pathways through the BG have been described - the direct, indirect, and hyperdirect pathways - which together orchestrate many aspects of learning and behavior. In songbirds, cell types associated with striatal and pallidal components appear intermingled in a single basal ganglia nucleus, Area X, essential for song learning. This allows for the dense reconstruction of the entire circuit within a compact volume. Here, we introduce the first vertebrate basal ganglia connectome, comprising over 8,500 automated neuron reconstructions connected by about 20 million synapses. High image quality and automated reconstruction allowed analysis with minimal manual proofreading. Based on direct anatomical measurement of synaptic connectivity, we confirm that a direct, indirect and hyperdirect pathway can be traced through Area X. However, detailed morphological and connectomic analysis revealed no clearly distinct direct and indirect medium spiny neuron subpopulations, and a dominance of the direct and hyperdirect pathway. In addition to previously identified neuron types in Area X, we could distinguish three novel GABAergic neuron types, two of which are major output targets of GPe neurons, leading to novel feedback circuitry within Area X. We further found unexpectedly strong neuronal interconnectivity and recurrency between neurons associated with all pathways. Our data thus challenge the universality of the view of the basal ganglia as an information processor organized into discrete feedforward pathways.

A key problem in learning is credit assignment. Biological systems lack a plausible mechanism to implement the backpropagation approach, a method that underlies much of the dramatic progress in artificial intelligence. Here, we use automated connectomic analysis to show that the synaptic architecture of songbird basal ganglia (Area X) supports local credit assignment using a variant of a node perturbation algorithm proposed in a model of reinforcement learning. Using two volume electron microscopy (vEM) datasets, we find that key predictions of the model hold true: axons that encode exploratory variability terminate predominantly on dendritic shafts, while axons that encode song timing (context) terminate predominantly on spines. Based on the detailed EM data, we then built a biophysical model of reinforcement learning that suggests that the synaptic dichotomy between variability and context encoding axons facilitates efficient learning. In combination, these findings provide strong evidence for a general, biologically plausible credit assignment model in vertebrate basal ganglia learning.

Mapping nanoscale neuronal morphology with molecular annotations is critical for understanding healthy and dysfunctional brain circuits. Current methods are constrained by image segmentation errors and by sample defects (e.g., signal gaps, section loss). Genetic strategies promise to overcome these challenges by using easily distinguishable cell identity labels. However, multicolor approaches are spectrally limited in diversity, whereas nucleic acid barcoding lacks a cellfilling morphology signal for segmentation. Here, we introduce PRISM (Protein-barcode Reconstruction via Iterative Staining with Molecular annotations), a platform that integrates combinatorial delivery of antigenically distinct, cell-filling proteins with tissue expansion, multi-cycle imaging, barcode-augmented reconstruction, and molecular annotation. Protein barcodes increase label diversity by >750-fold over multicolor labeling and enable morphology reconstruction with intrinsic error correction. We acquired a ∼10 million µm3 volume of mouse hippocampal area CA2/3, multiplexed across 23 barcode antigen and synaptic marker channels. By combining barcodes with shape information, we achieve an 8x increase in automatic tracing accuracy of genetically labelled neurons. We demonstrate PRISM supports automatic proofreading across micron-scale spatial gaps and reconnects neurites across discontinuities spanning hundreds of microns. Using PRISM’s molecular annotation capability, we map the distribution of synapses onto traced neural morphology, characterizing challenging synaptic structures such as thorny excrescences (TEs), and discovering a size correlation among spatially proximal TEs on the same dendrite. PRISM thus supports selfcorrecting neuron reconstruction with molecular context.

A fluorescence-microscopy method for tracing neuronal connections in the brain could make connectomics studies more widely accessible for neuroscientists.

High-throughput 2D and 3D scanning electron microscopy, which relies on automation and dependable control algorithms, requires high image quality with minimal human intervention. Classical focus and astigmatism correction algorithms attempt to explicitly model image formation and subsequently aberration correction. Such models often require parameter adjustments by experts when deployed to new microscopes, challenging samples, or imaging conditions to prevent unstable convergence, making them hard to use in practice or unreliable. Here, we introduce DeepFocus, a purely data-driven method for aberration correction in scanning electron microscopy. DeepFocus works under very low signal-to-noise ratio conditions, reduces processing times by more than an order of magnitude compared to the state-of-the-art method, rapidly converges within a large aberration range, and is easily recalibrated to different microscopes or challenging samples.

While genetically encoded reporters are common for fluorescence microscopy, equivalent multiplexable gene reporters for electron microscopy (EM) are still scarce. Here, by installing a variable number of fixation-stable metal-interacting moieties in the lumen of encapsulin nanocompartments of different sizes, we developed a suite of spherically symmetric and concentric barcodes (EMcapsulins) that are readable by standard EM techniques. Six classes of EMcapsulins could be automatically segmented and differentiated. The coding capacity was further increased by arranging several EMcapsulins into distinct patterns via a set of rigid spacers of variable length. Fluorescent EMcapsulins were expressed to monitor subcellular structures in light and EM. Neuronal expression in Drosophila and mouse brains enabled the automatic identification of genetically defined cells in EM. EMcapsulins are compatible with transmission EM, scanning EM and focused ion beam scanning EM. The expandable palette of genetically controlled EM-readable barcodes can augment anatomical EM images with multiplexed gene expression maps.

Electron microscopy is the primary approach to study ultrastructural features of the cerebrovasculature. However, 2D snapshots of a vascular bed capture only a small fraction of its complexity. Recent efforts to synaptically map neuronal circuitry using volume electron microscopy have also sampled the brain microvasculature in 3D. Here, we perform a meta-analysis of 7 data sets spanning different species and brain regions, including two data sets from the MICrONS consortium that have made efforts to segment vasculature in addition to all parenchymal cell types in mouse visual cortex. Exploration of these data have revealed rich information for detailed investigation of the cerebrovasculature. Neurovascular unit cell types (including, but not limited to, endothelial cells, mural cells, perivascular fibroblasts, microglia, and astrocytes) could be discerned across broad microvascular zones. Image contrast was sufficient to identify subcellular details, including endothelial junctions, caveolae, peg-and-socket interactions, mitochondria, Golgi cisternae, microvilli and other cellular protrusions of potential significance to vascular signaling. Additionally, non-cellular structures including the basement membrane and perivascular spaces were visible and could be traced between arterio-venous zones along the vascular wall. These explorations revealed structural features that may be important for vascular functions, such as blood-brain barrier integrity, blood flow control, brain clearance, and bioenergetics. They also identified limitations where accuracy and consistency of segmentation could be further honed by future efforts. The purpose of this article is to introduce these valuable community resources within the framework of cerebrovascular research. We do so by providing an assessment of their vascular contents, identifying features of significance for further study, and discussing next step ideas for refining vascular segmentation and analysis.

The ability to acquire ever larger datasets of brain tissue using volume electron microscopy leads to an increasing demand for the automated extraction of connectomic information. We introduce SyConn2, an open-source connectome analysis toolkit, which works with both on-site high-performance compute environments and rentable cloud computing clusters. SyConn2 was tested on connectomic datasets with more than 10 million synapses, provides a web-based visualization interface and makes these data amenable to complex anatomical and neuronal connectivity queries.

Dense reconstruction of synaptic connectivity requires high-resolution electron microscopy images of entire brains and tools to efficiently trace neuronal wires across the volume. To generate such a resource, we sectioned and imaged a larval zebrafish brain by serial block-face electron microscopy at a voxel size of 14 × 14 × 25 nm3. We segmented the resulting dataset with the flood-filling network algorithm, automated the detection of chemical synapses and validated the results by comparisons to transmission electron microscopic images and light-microscopic reconstructions. Neurons and their connections are stored in the form of a queryable and expandable digital address book. We reconstructed a network of 208 neurons involved in visual motion processing, most of them located in the pretectum, which had been functionally characterized in the same specimen by two-photon calcium imaging. Moreover, we mapped all 407 presynaptic and postsynaptic partners of two superficial interneurons in the tectum. The resource developed here serves as a foundation for synaptic-resolution circuit analyses in the zebrafish nervous system.

Sequential activation of neurons has been observed during various behavioral and cognitive processes, but the underlying circuit mechanisms remain poorly understood. Here, we investigate premotor sequences in HVC (proper name) of the adult zebra finch forebrain that are central to the performance of the temporally precise courtship song. We use high-density silicon probes to measure song-related population activity, and we compare these observations with predictions from a range of network models. Our results support a circuit architecture in which heterogeneous delays between sequentially active neurons shape the spatiotemporal patterns of HVC premotor neuron activity. We gauge the impact of several delay sources, and we find the primary contributor to be slow conduction through axonal collaterals within HVC, which typically adds between 1 and 7.5 ms for each link within the sequence. Thus, local axonal “delay lines” can play an important role in determining the dynamical repertoire of neural circuits.

Reconstruction and annotation of volume electron microscopy data sets of brain tissue is challenging but can reveal invaluable information about neuronal circuits. Significant progress has recently been made in automated neuron reconstruction as well as automated detection of synapses. However, methods for automating the morphological analysis of nanometer-resolution reconstructions are less established, despite the diversity of possible applications. Here, we introduce cellular morphology neural networks (CMNs), based on multi-view projections sampled from automatically reconstructed cellular fragments of arbitrary size and shape. Using unsupervised training, we infer morphology embeddings (Neuron2vec) of neuron reconstructions and train CMNs to identify glia cells in a supervised classification paradigm, which are then used to resolve neuron reconstruction errors. Finally, we demonstrate that CMNs can be used to identify subcellular compartments and the cell types of neuron reconstructions.

Reconstruction of neural circuits from volume electron microscopy data requires the tracing of cells in their entirety, including all their neurites. Automated approaches have been developed for tracing, but their error rates are too high to generate reliable circuit diagrams without extensive human proofreading. We present flood-filling networks, a method for automated segmentation that, similar to most previous efforts, uses convolutional neural networks, but contains in addition a recurrent pathway that allows the iterative optimization and extension of individual neuronal processes. We used flood-filling networks to trace neurons in a dataset obtained by serial block-face electron microscopy of a zebra finch brain. Using our method, we achieved a mean error-free neurite path length of 1.1 mm, and we observed only four mergers in a test set with a path length of 97 mm. The performance of flood-filling networks was an order of magnitude better than that of previous approaches applied to this dataset, although with substantially increased computational costs.

Recent advances in the effectiveness of the automatic extraction of neural circuits from volume electron microscopy data have made us more optimistic that the goal of reconstructing the nervous system of an entire adult mammal (or bird) brain can be achieved in the next decade. The progress on the data analysis side — based mostly on variants of convolutional neural networks — has been particularly impressive, but improvements in the quality and spatial extent of published VEM datasets are substantial. Methodologically, the combination of hot-knife sample partitioning and ion milling stands out as a conceptual advance while the multi-beam scanning electron microscope promises to remove the data-acquisition bottleneck.

Spinal interneurons coordinate the activity of motoneurons to generate the spatiotemporal patterns of muscle contractions required for vertebrate locomotion. It is controversial to what degree the orderly, gradual recruitment of motoneurons is determined by biophysical differences among them rather than by specific connections from presynaptic interneurons to subsets of motoneurons. To answer this question, we mapped all connections from two types of interneurons onto all motoneurons in a larval zebrafish spinal cord hemisegment, using serial block-face electron microscopy (SBEM). We found specific synaptic connectivity from dorsal but not from ventral excitatory ipsilateral interneurons, with large motoneurons, active only when strong force is required, receiving specific inputs from dorsally located interneurons, active only during fast swims. By contrast, the connectivity between inhibitory commissural interneurons and motoneurons lacks any discernible pattern. The wiring pattern is consistent with a recruitment mechanism that depends to a considerable extent on specific connectivity.

Teravoxel volume electron microscopy data sets from neural tissue can now be acquired in weeks, but data analysis requires years of manual labor. We developed the SyConn framework, which uses deep convolutional neural networks and random forest classifiers to infer a richly annotated synaptic connectivity matrix from manual neurite skeleton reconstructions by automatically identifying mitochondria, synapses and their types, axons, dendrites, spines, myelin, somata and cell types. We tested our approach on serial block-face electron microscopy data sets from zebrafish, mouse and zebra finch, and computed the synaptic wiring of songbird basal ganglia. We found that, for example, basal-ganglia cell types with high firing rates in vivo had higher densities of mitochondria and vesicles and that synapse sizes and quantities scaled systematically, depending on the innervated postsynaptic cell types.

The sequential activation of neurons has been observed in various areas of the brain, but in no case is the underlying network structure well understood. Here we examined the circuit anatomy of zebra finch HVC, a cortical region that generates sequences underlying the temporal progression of the song. We combined serial block-face electron microscopy with light microscopy to determine the cell types targeted by HVC(RA) neurons, which control song timing. Close to their soma, axons almost exclusively targeted inhibitory interneurons, consistent with what had been found with electrical recordings from pairs of cells. Conversely, far from the soma the targets were mostly other excitatory neurons, about half of these being other HVC(RA) cells. Both observations are consistent with the notion that the neural sequences that pace the song are generated by global synaptic chains in HVC embedded within local inhibitory networks.

Learning by imitation is fundamental to both communication and social behavior and requires the conversion of complex, nonlinear sensory codes for perception into similarly complex motor codes for generating action. To understand the neural substrates underlying this conversion, we study sensorimotor transformations in songbird cortical output neurons of a basal-ganglia pathway involved in song learning. Despite the complexity of sensory and motor codes, we find a simple, temporally specific, causal correspondence between them. Sensory neural responses to song playback mirror motor-related activity recorded during singing, with a temporal offset of roughly 40 ms, in agreement with short feedback loop delays estimated using electrical and auditory stimulation. Such matching of mirroring offsets and loop delays is consistent with a recent Hebbian theory of motor learning and suggests that cortico-basal ganglia pathways could support motor control via causal inverse models that can invert the rich correspondence between motor exploration and sensory feedback.

Computer simulation using long molecular dynamics (MD) can be used to simulate the folding equilibria of peptides and small proteins. However, a systematic investigation of the influence of the side-chain composition and position at the backbone on the folding equilibrium is computationally as well as experimentally too expensive because of the exponentially growing number of possible side-chain compositions and combinations along the peptide chain. Here, we show that application of the one-step perturbation technique may solve this problem, at least computationally; that is, one can predict many folding equilibria of a polypeptide with different side-chain substitutions from just one single MD simulation using an unphysical reference state. The methodology reduces the number of required separate simulations by an order of magnitude.