A Real-time coarse-to-fine multiview capture system for all-in-focus rendering on a light-field display

We present an end-to-end system capable of real-time capturing and displaying with full horizontal parallax high-quality 3D video contents on a cluster-driven multiprojector light-field display with full horizontal parallax. The capture component is an array of low-cost USB cameras connected to a single PC. Raw M-JPEG data coming from the software-synchronized cameras are multicast over Gigabit Ethernet to the back-end nodes of the rendering cluster, where they are decompressed and rendered. For all-in-focus rendering, view-dependent depth is estimated on the GPU using a customized multiview space-sweeping approach based on fast Census-based area matching implemented in CUDA. Real-time performance is demonstrated on a system with 18 cameras and 72 rendering projectors.

@InProceedings{MGBGP11,
  author       = {Marton, F. and Gobbetti, E. and Bettio, F. and Iglesias Guitián, J. and Pintus, R.},
  title        = {A Real-time coarse-to-fine multiview capture system for all-in-focus rendering on a light-field display},
  booktitle    = {Proc. 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON)},
  pages        = {1--4},
  year         = {2011},
  issn         = {2161-2021},
  doi          = {10.1109/3DTV.2011.5877176},
  url          = {https://publications.crs4.it/pubdocs/2011/MGBGP11},
}