COMS E6733, 3D Photography

Note: This is a tentative class schedule, subject to change

Jan. 21: Introduction and Course overview: The 3D Modeling Pipeline

• The 3D Model Acquisition Pipeline by Fausto Bernardini and Holly Rushmeier, Computer Graphics Forum V. 21, No. 2, pp 149-172.
• 3D Challenges and a Non-In-Depth Overview of Recent Progress by Luc Van Gool, Bastian Leibe, Pascal Müller, Maarten Vergauwen and Thibaut Weise, 3DIM 2007.

• Review of 20 Years of Range Sensor Development by Francois Blais, Journal of Electronic Imaging, 13(1): 231-240. January 2004.
• Active 3D Sensing by J. Beraldin, Francois Blais, Luc Cournoyer, Guy Godin, and Marc Rioux, NRC Technical Report 44159, Ottawa, 2000.
• Class notes on Active 3D Sensing
• Structured Light Active Ranging notes by J. Pages and J. Salvi
• Shadow Based Method for Range Sensing
• Demo: Next Engine Scanner

• A Survey of Free-Form Object Representation and Recognition Techniques by R. Campbell and P. Flynn, Computer Vision and Image Understanding (CVIU), V. 81, N. 2, Feb. 2001. Section 4.1 (Registration)
• Point Based Rigid Registration Notes
• Efficient Variants of the ICP Algorithm by S. Rusinkiewiecz, 3DIM 2001.
• 3D Scan Matching and Registration, ICCV 2005 short course notes, Szymon Rusinkiewicz
• Real-Time 3D Model Acquisiton, Szymon Rusinkiewicz

• Semi-automatic range to range registration: a feature-based method, Ioannis Stamos and Chen Chao, 3DIM 2005. ppt slides
• A Volumetric Method for Building Complex Models from Range Images, by Brian Curless and Marc Levoy, Siggraph '96 [HTML]
• The Digital Michelangelo Project at Stanford, Siggraph 2000 Paper
• Digital Michaelangelo slides from SIGGRAPH 2000
• The Great Buddha Project: Modeling Cultural Heritage for VR Systems through observation, Katsushi Ikeuchi et. al. ISMAR 2003. A longer version is also available here.

Feb 18: Volumetric and Mesh Modeling

• 3-D Modeling from Range Imagery by M. Reed and P. Allen, Image and Vision Computing, V. 17, pp. 99-111, 1999.
• Zippered Polygon Meshes from Range Images by G. Turk and M. LeVoy, SIGGRAPH 94.
• Notes on Turk and Levoy paper
  
• Slides and Video on Modeling from Range Imagery by M. Reed and P. Allen.
• DEMOS: Leica Laser Scanner, and Rapid Propototyping Machine

Note: Project 2 posted, proposal due Mar. 4.

• Image-Based 3D Modelling: A Review by Fabio Remomdino and Sabry El-Hakim, Photogrammetric Record, 21(115), Sep. 2006.
• A Survey of Methods for Volumetric Scene Reconstruction from Photographs, G. Slabaugh et. al., Int. Workshop on Volume Graphics, 2001.
• Passive Vision Slides, Steve Seitz
• PhotoRealistic Scene Scene Reconstruction by Voxel Coloring by Seitz and Dyer.
• Real-time Voxel Coloring, A. Prock and C. Dyer
• Voxel Coloring Project, Mr. Potato Head
• Voxel Coloring Slides, Steve Seitz
• Camera Camera Calibration Slides, Steve Seitz
• Computing the Camera Calibration Matrix

Mar. 4: Scanning Low Library Scanning results:

Mar. 11: View Planning. Guest Speaker: Paul Blaer
Note: Project 2 proposal due, posted on Team web site.

• View planning and automated data acquisition for three-dimensional modeling of complex sites, Paul Blaer and Peter K. Allen, Journal of Field Robotics, Volume 26 Issue 11-12 (November - December 2009).
• Efficient Constraint Evaluation Algorithms for Hierarchical Next-Best-View Planning, K. Low and A. Laastra, 3DPVT 2006.

Mar. 18: No Class, Spring Break

Mar. 25: Automatic Modeling Systems

• Modeling and Rendering Architecture from Photographs by P. Debevec, C. Taylor and J. Malik. Slides and Website
• Photo tourism: Exploring photo collections in 3D, Noah Snavely, Steven M. Seitz, Richard Szeliski, ACM Transactions on Graphics (SIGGRAPH Proceedings), 25(3), 2006, 835-846.
• 3D Structure from 2D Motion survey, Tony Jebara, Ali Azarbayejani and Alex Pentland, IEEE Signal Proc. Magazine, 1999

Apr. 1: Processing Design Environement

• Guest lecture: Processing Design Environment, by Mark Collins and Toru Hasegawa, School of Architecture and Proxy Design.

Apr. 8: Texture Mapping

• Acquiring, Stitching and Blending Appearance Attributes on 3D Models, by Rocchini, P. Cignoni, C. Montani and R. Scopigno The Visual Computer, Springer International, 18 (2002) 3, 186-204, 2002.
• Texture Mapping slides
• Shadow based texture registration for 3D modeling, Alejandro Troccoli and Peter K. Allen, Machine Vision and Applications, V. 18, No. 2, April 2007, pp. 65-72.
• "High-Quality Texture Reconstruction from Multiple Scans" by Fausto Bernardini, Ioana M. Martin and Holly Rushmeier, IBM T. J. Watson Research Center.
• IBM pieta Project
• Building illumination coherent 3D models of large-scale outdoor scenes, Alejandro Troccoli and Peter K. Allen, International Journal of Computer Vision (IJCV), Volume 78, Numbers 2-3 / July, 2008, p. 261-280. Slides and video
• Recovering Photometric Properties Of Architectural Scenes From Photographs, Yizhou Yu and Jitendra Malik

• "An Automated Method for Large-Scale, Ground-Based City Model Acquisition", by C. Fruh and A. Zakhor, IJCV 60(1), 2004.
• "Data Processing Algorithms for Generating Textured 3D Building Facade Meshes from Laser Scans and Camera Images", by C. Fruh, S. Jain and A. Zakhor, IJCV 61(2), 2005.
• Video
• "Constructing 3D City Models by Merging Aerial and Ground Views", by C. Fruh and A. Zakhor, Computer Graphics and Applications, Nov/Dec 2003. Some better color pics.
• Towards Urban 3D Reconstruction From Video, A. Akbarzadeh, J.-M. Frahm, P. Mordohai, B. Clipp, C. Engels, D. Gallup, P. Merrell, M. Phelps, S. Sinha, B. Talton, L. Wang, Q. Yang, H. Stewenius, R. Yang, G. Welch+, H. Towles, D. Nister and M. Pollefeys

Apr. 22: 3D Shape Search

• A Survey of Content Based 3D Shape Retrieval Methods by Johan W.H. Tangelder and Remco C. Veltkamp. Multimedia Tools and Applications Publisher, Springe, Volume 39, Number 3 / September, 2008
• Autotagging to Improve Text Search for 3D Models by Corey Goldfeder and Peter Allen, Joint Conference on Digital Libraries, June 2008, Pittsburgh

Apr. 29: Project Reports and Demos

May 6:

• Final project reports due. Project Report Guidelines.