Real-time adaptive content retargeting for live multi-view capture and light field display

The discrete nature of multiprojector light field displays results in aliasing when rendering scene points at depths outside the supported depth of field causing visual discomfort. We propose an efficient on-the-fly content-aware real-time depth retargeting algorithm for live 3D light field video to increase the quality of visual perception on a cluster-driven multiprojector light field display. The proposed algorithm is embedded in an end-to-end real-time system capable of capturing and reconstructing light field from multiple calibrated cameras on a full horizontal parallax light field dis play. By automatically detecting salient regions of a scene, we solve an optimization to derive a non-linear operator to fit the whole scene within the comfortable viewing range of the light field display. We evaluate the effectiveness of our approach on synthetic and real world scenes.

@Article{KMBG15,
  author       = {Kiran Adhikarla, V. and Marton, F. and Balogh, T. and Gobbetti, E.},
  title        = {Real-time adaptive content retargeting for live multi-view capture and light field display},
  journal      = {The Visual Computer},
  volume       = {31},
  year         = {2015},
  keywords     = {light field display, retargeting},
  url          = {https://publications.crs4.it/pubdocs/2015/KMBG15},
}