theAUGMENTED BODY

360° VIDEO-MAPPING BY RABARAMA

STUDENT: GIUSEPPE D’ALESSANDRO R.N.: P/16DRAWING TECHNIQUES CLASS 2016TEACHER: PROF. ARCH. ALESSANDRA PAGLIANO

WHY THE BODY?-Body can be an interesting surface to be mapped. In addiction to being the way we express ourselves through gestures and movements, it is the medium between our thoughts and the space, seen as a complex system of sensory stimuluses, that surround us.Videomapping can be an useful technology to imagine our body as a canvas, but also to imagine our body that changes the spacial concrete certainties around it.

INK MAPPING OSKAR & GASPAR

HISTORY-In 1950 Bruno Munari was one of the first to draw with lights, with his “Proiezioni Dirette”, an installation of video projection with the most disparate materials (co-loured plastic pieces, plu-mage, cutted paper) inside two slides of glass.Everyone could interact with the projection and with the film, like a game.

2012 - APPLICATION OF THE MUNARI’S METHOD INTO SCHOOLS

HISTORY-In the 1960s the technique was referred to as video mapping, spatial augmented reality, or shader lamps.

In 1966 James Turrel, leased an abandoned hotel, in which he projected his “Cross Corner Projection”, with metal sheets that created, in the corner of the rooms, the illusion of suspending solids of light.

J. TURRELL - “SHANTA II” BLUE 1970

J. TURRELL - FIGURE D 1967

HISTORY-

One of the first public di-splays of projections onto 3D objects was debuted in 1969, when Disneyland opened their Haunted Mansion ride. The ride used fake disembo-died heads as objects which had 16mm film projected onto them to make them appear animated. Videomap-ping was used in the Haun-ted Mansion upon “sacred” portraits too.

Thank to the constant move-ment of the rails of the ca-rousel, the projection fits with the passenger’s seat giving the illusion, in the mirror, to have a ghost sit-ting next to you.

In 1995, Michael Naimark recorded variuos cities around the world, creating the first 360° interactive video.

The next projection mapping in-stance comes in 1980, with the immersive film installation Displa-cements by Michael Naimark. In this art installation a living room with two performers were filmed with a rotating camera, then the camera was replaced with a projector. The result is rotating projection mapping.

HISTORY-

RECORDING SESSION PROJECTION SESSION

HISTORY-Disney not only pioneered the te-chnology of projection mapping, they also have the earliest patent in the space, in 1991. Entitled “Apparatus and method for projection upon a three-di-mensional object“. It essentially describes a system for digitally painting an image onto “a coun-toured, three-dimensional object.”

HISTORY-Ramesh Raskar is a Massachusetts Institute of Technology Associate Professor and head of the MIT Media Lab's Camera Culture resear-ch group.

In 1998 he recorded “Shader Lamps: Animating Real Objects With Image Based Illumination” on static objects.In 2010 he drew upon movable 3d object in “Dynamic Shader Lamps”.Before in 2009, at the UNC Chapel Hill (University of North Carolina) he introduced a new approach for robotic avatars of real people: the use of cameras and projectors to capture and map the dynamic motion and appearance of a real person onto a humanoid animatro-nic model.

1998 SHADER LAMPS BY R.RASKAR

2011 DYNAMIC SHADER LAMPS BY R.RASKAR

2009 ANIMATRONIC SHADER LAMPS BY R.RASKAR

Thank to the constant move-ment of the rails of the ca-rousel, the projection fits with the passenger’s seat giving the illusion, in the mirror, to have a ghost sit-ting next to you.

INTERACTION

2012 - THE MIDAS PROJECT - MIDAS #1

ADAPTATION-Thanks to motion capturewe can map the relationship between human body and space in real time.The body changes the projection, and the projectionstimulates the body.

This kind of performancegives the opportunity to variuos artists to intervene concurrently in one single stage.

ADAPTATION-Hakanai is a dancingperformance by Adrien Mondot & Claire Bardainne in which body’s movement generates structured visual design.

2013 - HAKANAI DE ADRIEN M / CLAIRE B | TEMPS D'IMAGES

2014 - PIXEL DE ADRIEN M / CLAIRE B

PLAYING ANDDRAWING-2011, Turin.For the opening of Nike’s new store in Turin, ToDo projected on the baroque facade of a building in one of the city’s historical squares. An electronic music machine, open to all who felt like getting into the game, stepping up to the control platform, and letting a Kinect-equipped station sense their body’s contour and movements. Interactivity was literally in their hands, as they discovered the power to turn windows on and off with a mere touch, revealing musical notes and samples that combined into ever-changing audio loops.

Laser graffiti can be an inte-ractive, instant, creative and social way to draw upon archi-tecture without intervene on the buildings with aggressive materials. In 2011 Vodafone Ireland armed some of Ire-land’s leading street artists with laser graffiti technology to create events where public could join in.

2011 - LASER GRAFFITI IN IRELAND

SCULPTURE-Sculptures give us the opportunity to map a static body and project a “moving soul” upon it. When the artist of the statue carved the stone he had to fix that moment in a single shape, but through aug-mented reality those statues can wink to us. In the GOLEM project we can see statues come back to life, as a time expansion of that fixed moment.

2016 GOLEM X MBA

2016 GOLEM X MBA

2015 GOLEM X APOLLO

MASKS OF THE FUTURE-22nd October 2015: first-ever real-time face tracking and projection mapping performed at a live event, on stage. All images recorded live, No post-production added.A live / real-time face projection mapping event where 3D rendered images were projected over Kat Von D’s face, following accurately her movements. Custom software and a high-end tracking system were used to track her body movements and adapt the projection content in re-al-time to her torso, neck and face.

One year ago Nobumichi Asai first projected, onto the mapped face of the model, reflexions of the environment.

OMOTE / REAL-TIME F A C E TRACKING & PROJECTION MAPPING

G U I L L E M CASTELLVI - F A C E PROJECTION M A P P I N G WITH KAT VON D

AUGMENTED SKIN-2015 - The first live event of Tattoo Video Mapping. No post-production was used. Cre-ated and Produced by Oskar & Gaspar. movements. Custom software and a high-end tracking system were used to track body movements and adapt the projection content in real-time to body’s parts.

In a nutshell, the Cicret Projector Bracelet is a smart bracelet that can actually “project” a smartphone onto your wrist.Designed to look like a fitness band, the Cicret Projector Bracelet houses a little pico projector along with a row of proximity sen-sors.

INK MAPPING OSKAR & GASPAR

C I C R E T PROJECTOR BRACELET

THE FUTURE IS IN THE AIR-The idea of abandoning surfaces and project directly in the air is now closer to be realized. The Hungarian-British physicist Dennis Gabor was awarded the Nobel Prize in Physics in 1971 "for his invention and development of the holographic method". His work, done in the late 1940s, is still evolving in new ways of mapping and projecting useful technology.

2016 - MICROSOFT HOLOLENS IS STILL DEVELOPING

2016 - AUTODESK “TACTUM” PERCEIVE LIGHT AND MOVEMENT TO CREATE MESHES

A SCENE FROM THE 2013 MOVIE “HER”

LINKS-8 PROJECTION-MAPPED PERFORMANCES THAT HAVE US DANCING WITH OUR COMPUTERShttp://thecreatorsproject.vice.com/blo-g/8-projection-mapp-ped-performances-that-have-us-dancing-with-our-computers

MESH - THE FRAGILITY OF PRIVATE SPACEhttps://fedora.phaidra.bibliothek.uni-ak.ac.a-t/fedora/get/o:6677/bdef:Content/get

http://www.munart.org/index.php?p=15