Photo Repair and 3D Structure from Flatbed Scanners Using 4- and 2-Source Photometric Stereo

We recently introduced a technique that allows 3D information to be captured from a conventional flatbed scanner. The technique requires no hardware modification and allows untrained users to easily capture 3D datasets. Once captured, these datasets can be used for interactive relighting and enhancement of surface detail on physical objects. We have also found that the method can be used to scan and repair damaged photographs. Since only the 3D structure on these photographs will typically be surface tears and creases, our method provides an accurate procedure for automatically detecting these flaws without any user intervention. Once detected, automatic techniques, such as infilling and texture synthesis, can be leveraged to seamlessly repair such damaged areas. We here provide a more thorough exposition and significant new material. We first present a method that is able to repair damaged photographs with minimal user interaction and then show how we can achieve similar results using a fully automatic process.

@InCollection{PMWBNR10,
  author       = {Pintus, R. and Malzbender, T. and Wang, O. and Bergman, R. and Nachlieli, H. and Ruckenstein, G.},
  title        = {Photo Repair and 3D Structure from Flatbed Scanners Using 4- and 2-Source Photometric Stereo},
  booktitle    = {Computer Vision, Imaging and Computer Graphics. Theory and Applications},
  volume       = {68},
  pages        = {326--342},
  year         = {2010},
  editor       = {AlpeshKumar Ranchordas and Joao Madeiras Pereira and Helder J. Araujo and Joao Manuel R. S. Tavares},
  publisher    = {Springer Berlin Heidelberg},
  note         = {isbn = {978-3-642-11840-1}, },
  keywords     = {Computer Science},
  doi          = {10.1007/978-3-642-11840-1_24},
  url          = {https://publications.crs4.it/pubdocs/2010/PMWBNR10},
}