3D Modeling From Sketches By Aligning The Contours Of An Image

Introduction Sketching in 2D is much easier than in 3D because most designers can draw but are unfamiliar with 3D modeling tools. It is common to build a 3D model based on an existing object. But it takes professional skills and experience to develop an irregular shape. Even though we have these skills and experience, it still takes time and effort to draw and adjust the unique condition to meet our requirements. In particular, it will be much more practical to use a 2D shape that will come directly from an image, in the case where the object is of irregular shape. The object image can be a cartoon image or a sketched image.3d sketcher

Extracting a 2D shape from an image remains a challenging task due to the endless possibilities of input sketch lines and different design techniques. Sometimes we need to segment the unique profiles into several smaller parts, making it easier to build models, but we need the shape as a whole for the same purpose. So it’s better to align the sketch lines to the image’s outline, rather than just showing the body extracted from the image based on the sketch lines. The exactness of the outcomes fibs in the correspondence between the hand-drawn sketch lines and the removed contour lines. Achieving the most accurate match requires not only interpreting the but of the sketch but also understanding the meaning of the contour lines extracted from the image. Both of these tasks are difficult for a machine to perform.

Related works

Our method is related to two types of modeling methods. One is based on pictures and the other on sketches. There are several image-based modeling methods and sketch-based modeling methods, each applied to different fins. We aim to realize a sketch-based modeling method with the information extracted from the image to exploit the intelligence of a back-end CAD application. Inspired by top-down alignment methods such as active contour models, we use alignment to replace artificial selection to get the most out of input images.

Image-based modeling

Ganged presented a 3D modeling system of free-form surfaces from 2D sketches.  The system allows users to maintain a single view of the model.Chen et al.  Presented another image-based modeling technique called 3-sweep, which distorts input strokes based on the contour of the image.

It should be noted that the extraction of the 3D model is based on the observation that manufactured objects consist of several regular primitives, such as cylinder, cuboid, etc. It has the same limitation that it cannot be used to describe irregularly shaped objects. Presented a framework that allows users to participate in the entire design process of their things, from the initial design phase to the production of a new real-world object that fits well. . With the existing complementary objects. In the method, a single photo is used as a rough guide for the user to draw a new custom object that does not exist in the photo, and extraction of precise information is not required.

Modeling from sketches

There are common problems in sketch-based modeling methods. In a 3D modeling system, view selection is critical to the modeling process. It is difficult and frustrating for users to define in multiple views. There is a solution in that allows the user to sketch in one view and deform the model in other pictures. Automatic model generation can be controlled by users’ modulating the thickness of the 3D model.Similarly, there are several systems used to design 3D models and they convert 2D sketches into 3D models by inflating closed regions—the 2D sketch region bulges in both directions proportional to the width of the area. Generally, the sketch-based modeling method is based on sketch recognition techniques that convert a 2D data line into a 3D model like the systems.

Active contour models

The sketch line alignment method is inspired by active contour models. The initial contour of the traditional snake method must be close to the object’s boundary of interest in an image. Otherwise, it would converge to the wrong result. Additionally, active contours struggle to progress through boundary concavities.

Overview

To build an image-based 3D model, our method needs to take an image with the target object as input. Usually, a complex thing is made up of several simple parts. To design a 3D model, we first create each piece and then merge them into a single object. For the sketch-based modeling method, the sketch line allows the user to draw a part of the whole object. The definition can be concluded from the association between the sketch line and the outlines of the image.