An optimisation-based reconstruction engine for 3D modelling by sketching

Abstract

An engine that automatically reconstructs a large variety of polyhedral, origami and wire-frame objects from single-view sketched drawings generated in a calligraphic interface is presented. The engine has two stages. An innovative optimisation-based line-drawing beautifier stage is introduced to convert rough sketches into tidied-up line drawings. Optimisation-based 3D reconstruction follows. Solutions are provided with which to overcome the problems associated with earlier approaches to optimisation-based 3D reconstruction. Suitable adjustments in the optimisation algorithms are proposed; simple and efficient tentative models are introduced, and current regularities are categorised in order to allow the objective function to be simplified. All three actions help to prevent local optima and improve the computational efficiency of optimisation-based 3D reconstruction. They all proved to be effective techniques to reduce the typical failure rate of optimisation approaches. A discussion of results that validate the engine is also provided.