Xiongtao Ruan

Light sheet microscopy is a powerful technique for high-speed 3D imaging of subcellular dynamics and large biological specimens. However, it often generates datasets ranging from hundreds of gigabytes to petabytes in size for a single experiment. Conventional computational tools process such images far slower than the time to acquire them and often fail outright due to memory limitations. To address these challenges, we present LLSM5DTools, a scalable software solution for efficient petabyte-scale light sheet image processing. This software incorporates a suite of commonly used processing tools that are memory and performance-optimized. Notable advancements include rapid image readers and writers, fast and memory-efficient geometric transformations, high-performance Richardson-Lucy deconvolution, and scalable Zarr-based stitching. These features outperform state-of-the-art methods by over one order of magnitude, enabling the processing of petabyte-scale image data at the full teravoxel rates of modern imaging cameras. The software opens new avenues for biological discoveries through large-scale imaging experiments.Competing Interest StatementThe authors have declared no competing interest.

Lattice light sheet microscopy excels at the noninvasive imaging of three-dimensional (3D) dynamic processes at high spatiotemporal resolution within cells and developing embryos. Recently, several papers have called into question the performance of lattice light sheets relative to the Gaussian sheets most common in light sheet microscopy. Here, we undertake a theoretical and experimental analysis of various forms of light sheet microscopy, which demonstrates and explains why lattice light sheets provide substantial improvements in resolution and photobleaching reduction. The analysis provides a procedure to select the correct light sheet for a desired experiment and specifies the processing that maximizes the use of all fluorescence generated within the light sheet excitation envelope for optimal resolution while minimizing image artifacts and photodamage. We also introduce a new type of “harmonic balanced” lattice light sheet that improves performance at all spatial frequencies within its 3D resolution limits and maintains this performance over lengthened propagation distances allowing for expanded fields of view. Comparing conventional and lattice light sheets reveals the advantages of the latter and how to improve their performance further.

Cell shape provides both geometry for, and a reflection of, cell function. Numerous methods for describing and modeling cell shape have been described, but previous evaluation of these methods in terms of the accuracy of generative models has been limited. Here we compare traditional methods and deep autoencoders to build generative models for cell shapes in terms of the accuracy with which shapes can be reconstructed from models. We evaluated the methods on different collections of 2D and 3D cell images, and found that none of the methods gave accurate reconstructions using low dimensional encodings. As expected, much higher accuracies were observed using high dimensional encodings, with outline-based methods significantly outperforming image-based autoencoders. The latter tended to encode all cells as having smooth shapes, even for high dimensions. For complex 3D cell shapes, we developed a significant improvement of a method based on the spherical harmonic transform that performs significantly better than other methods. We obtained similar results for the joint modeling of cell and nuclear shape. Finally, we evaluated the modeling of shape dynamics by interpolation in the shape space. We found that our modified method provided lower deformation energies along linear interpolation paths than other methods. This allows practical shape evolution in high dimensional shape spaces. We conclude that our improved spherical harmonic based methods are preferable for cell and nuclear shape modeling, providing better representations, higher computational efficiency and requiring fewer training images than deep learning methods.

Efforts to model how signaling and regulatory networks work in cells have largely either not considered spatial organization or have used compartmental models with minimal spatial resolution. Fluorescence microscopy provides the ability to monitor the spatiotemporal distribution of many molecules during signaling events, but as of yet no methods have been described for large scale image analysis to learn a complex protein regulatory network. Here we present and evaluate methods for identifying how changes in concentration in one cell region influence concentration of other proteins in other regions.Using 3D confocal microscope movies of GFP-tagged T cells undergoing costimulation, we learned models containing putative causal relationships among 12 proteins involved in T cell signaling. The models included both relationships consistent with current knowledge and novel predictions deserving further exploration. Further, when these models were applied to the initial frames of movies of T cells that had been only partially stimulated, they predicted the localization of proteins at later times with statistically significant accuracy. The methods, consisting of spatiotemporal alignment, automated region identification, and causal inference, are anticipated to be applicable to a number of biological systems.The source code and data are available as a Reproducible Research Archive at http://murphylab.cbd.cmu.edu/software/2017_TcellCausalModels/

Live-cell microscopy determines the relative contributions of different signaling pathways to actin reorganization in T cells. T cells must receive signals through the T cell receptor (TCR) and the costimulatory receptor CD28 to become fully activated. Critical to this process is the reorganization of plasma membrane actin at the immunological synapse, the interface between a T cell and an antigen-presenting cell. Roybal et al. imaged actin and fluorescently tagged actin regulatory proteins in T cells activated through the TCR in the absence or presence of CD28 signaling. Computational image processing to normalize differences in cell shape enabled tracking of the fluorescent proteins. The regulatory proteins WAVE2 and cofilin were efficiently recruited to the immunological synapse only when both TCR and CD28 signaled. Constitutive activation of either protein in TCR-stimulated T cells enabled normal actin reorganization even when CD28 signaling was blocked. This combination of imaging and computational analysis could be applied to other systems to determine the spatiotemporal dynamics of signaling molecules. Fluorescence microscopy is one of the most important tools in cell biology research because it provides spatial and temporal information to investigate regulatory systems inside cells. This technique can generate data in the form of signal intensities at thousands of positions resolved inside individual live cells. However, given extensive cell-to-cell variation, these data cannot be readily assembled into three- or four-dimensional maps of protein concentration that can be compared across different cells and conditions. We have developed a method to enable comparison of imaging data from many cells and applied it to investigate actin dynamics in T cell activation. Antigen recognition in T cells by the T cell receptor (TCR) is amplified by engagement of the costimulatory receptor CD28. We imaged actin and eight core actin regulators to generate over a thousand movies of T cells under conditions in which CD28 was either engaged or blocked in the context of a strong TCR signal. Our computational analysis showed that the primary effect of costimulation blockade was to decrease recruitment of the activator of actin nucleation WAVE2 (Wiskott-Aldrich syndrome protein family verprolin-homologous protein 2) and the actin-severing protein cofilin to F-actin. Reconstitution of WAVE2 and cofilin activity restored the defect in actin signaling dynamics caused by costimulation blockade. Thus, we have developed and validated an approach to quantify protein distributions in time and space for the analysis of complex regulatory systems.