OpenSketch: A Richly-Annotated Dataset of Product Design Sketches

Point coorrespondancies

Data format

For each sketch point correspondancies are encoded in the following format:

            {
                "points_2D_sketch":[ [x1 y1], ... , [xN yN] ],
                "points_3D_object":[ [x1 y1 z1], ... , [xN yN zN]]
            }
        

Download:

• correspondanciesJSON.zip (112 KB)

  Contains files with coordinates of points in 3D shape and 2D sketch.

Camera parameters

Data format

The camera parameters assume that 2D coordinates were normilised to [-1:1,-1:1]. In our sketches height is equal to width.

            {
                "restricted":{ //Restricted camera model
                    "C":[x,y,z],                    // camera eye position
                    "focal_point":[x,y,z],          // camera center position (defines the direction of the principal axis of a camera)
                    "up":[x,y,z],                   // camera up vector
                    "f": value,                     // camera focal length
                    "skew":0,                       // camera skew
                    "u": value, "v": value,         // principal point                    
                    "mvMatrix":[[M_00,M_01,M_02,0],
                                [M_10,M_11,M_12,0],
                                [M_20,M_21,M_22,0],
                                [M_30,M_31,M_32,1]]
                },
                "general":{ //General camera model
                    "C":[x,y,z],                    // camera eye position
                    "focal_point":[x,y,z],          // camera center position (defines the direction of the principal axis of a camera)
                    "up":[x,y,z],                   // camera up vector
                    "fx": x-value,                  // camera focal length
                    "fy": y-value,                  // camera focal length
                    "skew":0,                       // camera skew
                    "u": value, "v": value,         // principal point                    
                    "mvMatrix":[[M_00,M_01,M_02,0],
                                [M_10,M_11,M_12,0],
                                [M_20,M_21,M_22,0],
                                [M_30,M_31,M_32,1]]

                "width": value                      // original sketch dimension in pixels
            }
        

View matrix is computed from "C", "focal_point" and "up". While a projection matrix for a general camera model is:

            [   fx skew u 0
                0    fy v 0
                0     0 1 0]                
        

A projection matrix for a restricted camera model is:

            [   f 0 u 0
                0 f v 0
                0 0 1 0]                
        

Model matrix is identity.

Download:

• camera_parameters.zip (60.0 KB)

  Contains estimated camera parameters for sketches in all viewpoints.

• MATLAB code

  Repository with matlab code for estimation of camera parameters from sparse point correspondancies.

3D models

Download:

• objects.zip (32.7 MB)

  Contains shapes in an 'obj' file format.