A Structured-Light Approach for the Reconstruction of Complex Objects

Authors

  • Ilias Kalisperakis Department of Surveying, Technological Educational Institute of Athens (TEI-A), GR-12210 Athens, Greece
  • Lazaros Grammatikopoulos Department of Surveying, Technological Educational Institute of Athens (TEI-A), GR-12210 Athens, Greece
  • Elli Petsa Department of Surveying, Technological Educational Institute of Athens (TEI-A), GR-12210 Athens, Greece
  • George Karras Department of Surveying, National Technical University of Athens (NTUA), GR-15780 Athens, Greece

DOI:

https://doi.org/10.14311/gi.6.32

Keywords:

photogrammetric scanning, 3D reconstruction, triangulation, camera calibration

Abstract

Recently, one of the central issues in the fields of Photogrammetry, Computer Vision, Computer Graphics and Image Processing is the development of tools for the automatic reconstruction of complex 3D objects. Among various approaches, one of the most promising is Structured Light 3D scanning (SL) which combines automation and high accuracy with low cost, given the steady decrease in price of cameras and projectors. SL relies on the projection of different light patterns, by means of a video projector, on 3D object sur faces, which are recorded by one or more digital cameras. Automatic pattern identification on images allows reconstructing the shape of recorded 3D objects via triangulation of the optical rays corresponding to projector and camera pixels. Models draped with realistic phototexture may be thus also generated, reproducing both geometry and appearance of the 3D world. In this context, subject of our research is a synthesis of state-of-the-art as well as the development of novel algorithms, in order to implement a 3D scanning system consisting, at this stage, of one consumer digital camera (DSLR) and a video projector. In the following, the main principles of structured light scanning and the algorithms implemented in our system are presented, and results are given to demonstrate the potential of such a system. Since this work is part of an ongoing research project, future tasks are also discussed.

References

Xiao, J., Fang, T., Zhao, P., Lhuillier, M., Quan, L.: Image-based street-side city modeling, ACM Transaction on Graphics (TOG), 28(2009) 5.

Teutsch, C.: Model-based Analysis and Evaluation of Point Sets from Optical 3D Laser Scanners, PhD Thesis, Magdeburger Schriften zur Visualisierung, Shaker Verlag, 2007.

Claes, K., Bruyninckx, H.: Robot positioning using structured light patterns suitable for self calibration and 3D tracking, Proceedings of the 2007 International Conference on Advanced Robotics, Jeju, Korea.

Cignoni, P., Scopigno, R.: Sampled 3D models for CH applications: A viable and enabling new medium or just a technological exercise? ACM Journal on Computing and Cultural Heritage, 1(2008)1. [5] CyArk Project. http://archive.cyark.org/about

D-COFORM. http://www.3dcoform.eu/

Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms, Proceedings CVPR, 1(2006), 519-528.

Strecha, C., Fransens, R., van Gool, L.: Combined depth and outlier estimation in multi-view stereo, Proceedings CVPR, 2(2006), 2394- 2401.

Furukawa, Y., Ponce, J.: Accurate, dense, and robust multi-view stereopsis, Proc. CVPR, 2007, 1-8.

Vu, H.H., Keriven, R., Labatut, P., Pons, J.-P.: Towards high-resolution large-scale multi-view stereo, Proc. CVPR, 2009.

Mercier, B., Meneveaux, D.: Shape from silhouette: Image pixels for marching cubes, Journal of WSCG, 13(2005), 112-118.

Prados, E., Faugeras, O.: Perspective shape from shading and viscosity solutions, Proc. 9th IEEE ICCV, vol. II, Nice, France, October 2003, 826-831.

Tankus, A., Sochen, N., Yeshurun, Y.: A new perspective on shape from-shading, Proc. 9th IEEE ICCV, vol. II, Nice, France, October 2003, 862-869.

Bouguet, J.-Y., Perona, P.: 3D photography on your desk, Proc. ICCV 1998, 43-50.

Winkelbach, S., Molkenstruck, S., Wahl, F.M.: Low-cost laser range scanner and fast surface registration approach, Proc. DAGM '06, Lecture Notes in Computer Science, vol. 4174, Springer, 2006, 718-728.

Prokos, A., Karras, G., Petsa, E.: Automatic 3D surface reconstruction by combining stereovision with the slitscanner approach, International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XXXVIII, Part 5, 2010, 505-509.

Gühring, J.: Dense 3-D surface acquisition by structured light using off-the-shelf components, Videometrics and Optical Methods for 3D Shape Measurement, 2001, 220-231.

Rocchini, C., Cignoni, P., Montani, C., Pingi, P., Scopigno, R.: A low cost 3D scanner based on structured light, EUROGRAPHICS 2001, 20 (2001)3.

Tchou, C.: Image-Based Models: Geometry and Reflectance Acquisition Systems, UC Berkeley, M.Sc. Thesis, 2002.

Scharstein, D., Szeliski, R.: High-accuracy stereo depth maps using structured light, Proc. IEEE CVPR, 1(2003), 195-202.

Fechteler, P., Eisert, P., Rurainsky, J.: Fast and high resolution 3D face Scanning, Proc. ICIP, 2007.

Peng, T., Gupta, S.K.: Model and algorithms for point cloud construction using digital projection patterns, Journal of Computing and Information Science in Engineering, 7(2007)4, 372-381.

Koninckx, T., Griesser, A., van Gool, L.: Real-time range scanning of deformable surfaces by adaptively coded structured light, In: 3-D Digital Imaging & Modelling, Banff Canada, 2003, 293-300.

Peisen, S., Zhang, H.S.: Fast three-step phase-shifting algorithm, Applied Optics, 45(2006)21, 5086-5091.

Chen, S.Y., Li, Y.F., Zhang, J.: Vision processing for realtime 3-D data acquisition based on coded structured light, IEEE Transactions on Image Processing, 17(2008)2, 167-176.

Liu, K., Wang, Y., Lau, D.L., Hao, Q., Hassebrook, L.G.: Dual-frequency pattern scheme for high-speed 3-D shape measurement, Optical Express, 18(2010), 5229-5244.

Zhang, S.: Recent progresses on real-time 3-d shape measurement using digital fringe projection techniques, Optics and Lasers in Engineering, 40(2010), 149-158.

Schmalz, C., Angelopoulou, E.: A graph-based approach for robust single-shot structured light, IEEE International Workshop on Projector-Camera Systems, 2010.

Furukawa, R., Kawasaki, H.: Uncalibrated multiple image stereo system with arbitrarily movable camera and projector for wide range scanning, Proc. 5th 3DIM '05, 2005, 302-309.

Aliaga, D., Xu, Y.: Photogeometric structured light: a self-calibrating and multi-viewpoint framework for accurate 3D modeling, Proc. IEEE CVPR, 2008.

Gao, W., Wang, L., Hu, Z.: Flexible calibration of a portable structured light system through surface plane, Acta Automatica Sinica, 34(2008)11, 1358-1362.

Zhang, S., Huang, P.S.: Novel method for structured light system calibration, Optical Engineering 45(2006)8.

Knyaz, K.L.: Multi-media projector – single camera photogrammetric system for fast 3D reconstruction, International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XXXVIII, Part 5(2010), 343-348.

Douskos, V., Grammatikopoulos, L., Kalisperakis, I., Karras, G., Petsa, E.: FAUCCAL: An open source toolbox for fully automatic camera calibration. XXII CIPA Symposium on Digital Documentation, Interpretation & Presentation of Cultural Heritage, Kyoto, Japan, October 2009.

Salvi, J., Fernandez, S., Pribanic, T., Llado, X.: A state of the art in structured light patterns for surface profilometry, Pattern Recognition, 43(2010)8, 2666-2680.

Downloads

Published

2011-12-21

Issue

Section

Articles