build-it - an interactive web application for 3d construction, interior & exterior design

An Interactive Web Application for 3D Construction , Interior &

Exterior Design

A Project by Renien John JosephSupervised by Udayangi Perera

AgendaProblem Domain

Aim and Objectives

Findings of the Literature Review

Software Requirements Specification

Design

Implementation

Evaluation

Testing

Conclusion

Problem Domain• 2D architectural drawings are commonly used.

• Producing a three dimensional (3D) plan is costly.

• Difficult to be satisfied with design by looking at 2D plans.

• 3D drawings take time and money.

• Producing multiple 2D drawings to refine design is also costly

• 3D home reconstruction

• 3D Object Reconstruction

• Interior and Exterior Design

What is Build-IT ?

Literature Review

Finding Were Related To

3D Reconstruction Building Information ModelDrawing

Functionality

Interior Design

Sequence of Images

2D Plan Drawing

3D Plan Drawing

3D Reconstructing

Reconstructed 3D Model

Materials

Using 3D home, 3D models and with the

materials

System Design

Data Storage

WCF RIA Service

Data Access

Web Application5

Desktop Application5

Build-IT

3D Reconstruction

Technology

Image Sequence3D

Model

3D Reconstruction Module

2D plan 3D plan

Architectural Design Module

Interior & Exterior Design

Interior Design Module

3D Editor

Editor Module

Implementation

3D Reconstruction

Feature extraction and matching

Calculate fundamental matrix

Choose reference images and initialize structure of the scene and the motion of the camera

Estimate projection matrix

Optimize the already reconstructed point and

reconstruct the rest points.

Overall optimization of structure and motion

Self-calibration and Euclidean reconstruction

Overall optimization

Dense match and reconstruction

New view?

Projective Reconstruction N

Y

3D model

3D Reconstruction

Pipeline

Testing- 3D ReconstructionSample Test 1

Testing- 3D ReconstructionSample Test 2 (Different Plane Images)

Sample Test 3 (Different Images)

Testing- 3D ReconstructionComputational time graph

Tested under following hardware and OS requirements.

• Laptop (Intel(R) Pentium(R) Dual CPU T3400 @ 2.16GHz (2 CPUs))• Windows 8

m

Building Information Model (BIM)

• 2D Polygonal Drawing – 3D Polygonal Drawing

Single Polygons

Multi Polygons

Parallelogram Theory

• Adhering Architectural drawing standards

Wall Creation

Door-Window Creation

Testing- BIM2D-3D Drawing Sketch

Testing- BIMEditor Module

Interaction Module

Head TrackingHead Tracking GesturesGestures

Wii Mote NavigationWii Mote

Navigation

New Solution

Existing Solution

Key board NavigationKey board Navigation

Building Information

Model

Building Information

Model

Interaction Module

Build-IT Wii Connector (Desktop Application)Build-IT Wii Connector (Desktop Application)

Build-IT Web Application Build-IT Web Application

Transmission Control Protocol (TCP)

AR Module

Evaluation • Charith Prasanga

- Architect - Senior lecturer in Open Systems

Technologies (PVT) Ltd. (CAD Engineer)

• Luca Del Tongo- Researcher in Computer Vision - expert in: Object Recognition

Gesture 3D reconstruction

• Miguel Algaba Borrego - Software Engineer - expert in 3D Medical Imaging - Recommended New Algorithm

Evaluation • Roy Shilkrot

- PHD Student (MIT Media Lab) - Expert in Computer Vision

- Recommended Iterative Linear Triangulation

• Rebecca Rouse- PhD candidate and instructor in the Digital

Media program.- Expert in Vision and Augmented Reality - Suggested new domain

• Dr Gerd Reis - Senior researcher at the German Research

Center for Artificial Intelligence

- Suggested new (HCI) methods

Benchmark

2D Sketch Drawing

3D Building Information Model

User Friendly

Augmented Reality

Gesture Interaction

3D Walkthrough

Build-IT Framework

Future Enhancement

• Increase the robustness in 3D reconstruction• Iterative linear triangulation• Implementing KAZE Features• Optimize the 3D reconstruction pipeline

• Increase user-friendliness of this product

• Update to mobile plat form.

• Improve the interior and exterior design.

• Update the 3D Editor module.

Conclusion

• Contribution to technological / commercial community

An easy to use, low computational cost and hybrid Interior and Exterior Design framework.

• Contribution to research community

Robust 3D Reconstruction.

Building Information Model.

Thank You!