virtual set conference

Summary

1. Introduction2. Virtual Set Definition

3. How it works? The different method4. Practical questions for virtual set

5.Conclusion 6. Q&A

1. Introduction1. Introduction

From a mystical broadcast technology for prime broadcasters to local tv stations, virtual set technology has became a very simple technology. It is now mobile and easy to use

Virtual set technologies has bloomed quickly during the late 90’s with sillicon graphics stations and broadcast professional video boards

Today, Virtual Studio are used on different forms on regular daily basis by all type of broadcasters for different applications (news, talk weather, elections.

1. Introduction

Virtual set are cheaper than before and more mature

Today, thanks to high tech revolution and progress in technology for movies and video games, audience are more receptive to graphical universe. People are now watching movies like Avatar, and pixar movies are very popular. There is no reason that graphical universe will drive the broadcaster to loose audience.

Media competition is higher than before so Broadcaster will have to think more reactive, more creative and more cost effective

2. Virtual Set definition

Virtual Set is a technology to place a physical character in the center of a computer generated environment.

In a normal virtual set production, the physical character will actually be sitted in front of Blue or Green screen and that blue or green screen will be replaced by a computer generated. Those techniques are called as you know «Chroma Keyer».

Virtual Set is allowing more than that, it will actually dive the physical character into the computer generated environment where he will be actually able to walk and interact with its own environment thanks real time camera movements and animations

environnement 3D avec lequel il va pouvoir interagir.

2. Virtual Set definition

More important though, virtual set will allow to do real time camera movements within a 3D Set conceived in 3D max, Maya or Softimage.

To be photorealistic, a 3D set has to be conceived with precise parameters for texturing and lighting, the virtual set software will allow users to play with those parameters. During broadcast production, the physical character will move behind and in front of virtual objects and the real camera on set will be tight to the virtual camera.

3. How it works?

The tracking methodsThe tracking methods

A classic virtual set system has 4 components:

A camera tracking system allowing camera data extraction

A 3D engine software

A professional PC with graphic and video boards

A professional external Chroma Keyer

3. How it works?


The integration of real broadcast picture and computer generated 3D images can be done thanks to advance virtual camera feature of the 3D engine software. This allows to have a perfect match between the real camera on blue or green set and the virtual cameras that render the perfect perspectives.

3. How it works?


To have a perfect match between those two cameras, you need to have the exact positions of the real camera on set, the quality of the virtual studio will all depend on the quality of those information.

The 3D engine will receive the tracking datas (x,y,z), it is thanks to the rendering engine that will render the good picture that the magic will operate.

There are different tracking method: opto mechanical tracking, pattern recognition method and infra red tracking. Each one of those has its own benefit and drawbacks.

3. How it works?

The tracking methodsThe tracking methodsThe opto mechanical method

Those Pan/Tilt robotic or manual heads or crane or Jib are encoded with precise encoders

Zoom and Focus are also using encoders to accomplish camera’s zoom and focus movements

Benefits Drawbacks

Precision and ease of use, some of them has no video/audio delays.

No «Z» movements

3. How it works?

The tracking methodsThe tracking methodsThe pattern recognition method

The pattern recognition method consists in having a floor or wall paint in two different Ultimatte blue that will a print of unique symbol or bar code. Each bar code or symbol has the information of camera positionning.A camera is looking to those bar codes and send the information to a computer which analyze them and send them to the 3D engine

Benefits Drawbacks

No calibration needed when cameras are moving

Delay between sound and image, manual operations and bar codes has to be visible

all the time

3. How it works?

The tracking methodsThe tracking methodsThe infra red method

Infra red camera are looking to the real camera itself (who has a reflective target ring) to have the position of the camera on set

Benefits Drawbacks

A real freedom of movements

Delay between sound and image, long calibration, infra red cameras has to be

visible all the time

3. How it works?

The low cost TrackLess methodThe low cost TrackLess method

Benefits DrawbacksA real low cost installation. Ease of use.

What we so call «the virtual set for dummies»

It is difficult for the physical character to move inside the virtual scene. Tight shots

are difficults and it needs a real good director to set up a good workflow of

production

The trackless method is allowing accomplishing virtual set without tracking and external chroma keyer

Everything is done here through the computer and software, keying, camera movements which are virtual only.

The goal is to have the physical character inside the virtual set and to do a local key on a 2D plan

3. Practical questions for virtual set

How do I do to create my sets?How do I do to create my sets?You know that the question for virtual set creation is crucial to your customer. Those are our recommendations:

- Use a graphic angency with talent for architecture and decoration- Think virtual and not real when your customer wants to create a design- Advise your customer to mix real and virtual elements- Offer virtual set creation services and integration in your package - Convince your customer to think first to the show and then design the set in regards to virtual set capacities and the show itself.


Technically how can I direct a virtual show?Technically how can I direct a virtual show?

Broadcaster will harass you those questions:

- How can I create real time reflections on the ground: Most of virtual set software has functions for it

- How can I retrieve shadows of the real character: Please use a good director of photography and a good guy for chroma keying: It is a mix between chroma lighting and chroma set up


How do I prepare my business plan for virtual set investmentHow do I prepare my business plan for virtual set investmentOur solution are now in a range coming from 27k€

It is interesting to know how many shows customer are producing monthly, daily?

How many studio operators the broadcaster has for now?

Do my virtual set needs to be mobile or fixed?

Can I use my existing broadcast equipment with my new virtual set?

Can I upgrade HD?

Can I go from low end solution to high end tracking solution?

4. Conclusion

Virtual Set technologies are now more popular and 3D experts are more and more:

The audience is now really following TV programs that are using virtual studio technologies

We have now in France TV stations that have their heart for production live using virtual set technologies

There is no need now for broadcasters to think that a virtual set has to look real as the real set are closer to fake sets now (excessive use of plasmas screens, and graphics).

virtual set conference

Documents