InShaDe: Invariant Shape Descriptors for visual 2D and 3D cellular and nuclear shape analysis and classification

We present a shape processing framework for visual exploration of cellular nuclear envelopes extracted from microscopic images arising in histology and neuroscience. The framework is based on a novel shape descriptor of closed contours in 2D and 3D. In 2D, it relies on a geodesically uniform resampling of discrete curves to compute unsigned curvatures at vertices and edges based on discrete differential geometry. Our descriptor is, by design, invariant under translation, rotation, and parameterization. We achieve the latter invariance under parameterization shifts by using elliptic Fourier analysis on the resulting curvature vectors. Uniform scale-invariance is optional and is a result of scaling curvature features to z-scores. We further augment the proposed descriptor with feature coefficients obtained through sparse coding of the extracted cellular structures using K-sparse autoencoders. For the analysis of 3D shapes, we compute mean curvatures based on the Laplace-Beltrami operator on triangular meshes, followed by computing a spherical parameterization through mean curvature flow. Finally, we compute the Spherical Harmonics decomposition to obtain invariant energy coefficients. Our invariant descriptors provide an embedding into a fixed-dimensional feature space that can be used for various applications, e.g., as input features for deep and shallow learning techniques or as input for dimension reduction schemes to provide a visual reference for clustering shape collections. We demonstrate the capabilities of our framework in the context of visual analysis and unsupervised classification of 2D histology images and 3D nuclear envelopes extracted from serial section electron microscopy stacks.

@Article{AAGYPGCMM21,
  author       = {Al-Thelaya, K. and Agus, M. and Gilal, N. and Yang, Y. and Pintore, G. and Gobbetti, E. and Cali, C. and Magistretti, P. and Mifsud, W.},
  title        = {InShaDe: Invariant Shape Descriptors for visual 2D and 3D cellular and nuclear shape analysis and classification},
  journal      = {Computers \& Graphics},
  volume       = {98},
  pages        = {105--125},
  year         = {2021},
  keywords     = {cellular nuclear shape analysis, microscopic images processing},
  issn         = {0097-8493},
  doi          = {10.1016/j.cag.2021.04.037},
  url          = {https://publications.crs4.it/pubdocs/2021/AAGYPGCMM21},
}