semiotics, software and media visualization
DESCRIPTION
Talk at Semiofest 2013. June 1st. Barcelone, Spain.TRANSCRIPT
![Page 1: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/1.jpg)
Semiotics, software
and media visualization
E. Reyes
Associate Professor, Université de Paris 13
ereyes.net
Conference at Anaglifos Art Factory, Barcelona, Spain, on June 1st.
Semiofest 2013
Coordinator: Gabriela Pedranti
![Page 2: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/2.jpg)
![Page 3: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/3.jpg)
Lev Manovich Jacques Fontanille
Mediavisualization
Scientific imagery
![Page 4: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/4.jpg)
Media visualization?visualize large amounts of visual media
observe patterns of time
analyze culture
![Page 5: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/5.jpg)
Scientific imagery?allows to see the invisible
occurs within a scientific argument
requires scientific experience + taking decisions
![Page 6: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/6.jpg)
Image plot of Van Gogh productionImagePlot, Lev Manovich, 2009
![Page 7: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/7.jpg)
Car-Parrinello Simulations of Biological SystemsMichele Cascella, c. 2004
![Page 8: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/8.jpg)
Expression plane Content plane
transducting measurements of
material elements
produced by direct interpretation
during exploration
![Page 9: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/9.jpg)
3. Visual experience 4. Sensory experience
1. Scientific experience2. Conceptual experience
allows the creation of
contributes to
referential illusion
5. Practical experiencevisual transductiondevice
intervention in
![Page 10: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/10.jpg)
The invisible of visual media?
• Visual features
• Spatial and temporal patterns
• Software operations
![Page 11: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/11.jpg)
389 types of visual features dataFeatureExtractor, Lev Manovich, 2011
![Page 12: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/12.jpg)
![Page 13: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/13.jpg)
A sequence from Game of Thrones entry titles
![Page 14: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/14.jpg)
Average brightness of 150 frames from the sequenceImageJ, E. Reyes, 2012
![Page 15: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/15.jpg)
3D motion structure modelImageToObject, E. Reyes, 2013
![Page 16: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/16.jpg)
Motion structure printedE. Reyes, 2013
![Page 17: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/17.jpg)
Software operations
Expression plane Content plane
Architectonic Space Semantic Space
![Page 18: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/18.jpg)
Adobe Photoshop 1.0, Thomas & John Knoll, 1990
![Page 19: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/19.jpg)
What is the structure of retouching a photo?
the cycle
![Page 20: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/20.jpg)
...what if we go outside Photoshop?
![Page 21: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/21.jpg)
Context Free, Chris Coyne, 2005-today Pd, Miller Puckette, 1996-today
![Page 22: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/22.jpg)
Which are the lessons, practically?
Use legends and other metadata[ layers of interpretative codes ]
Assemble a narrative[ it’s the skeleton of an argument ]
Don’t panic if your images foster “mundane” readings[ they are useful for scientific dissemination ]
Search for different visual configurations[ welcome to the society of software ]
Document the scientific experience[ it’s background for conventions and visual experience ]
![Page 23: Semiotics, software and media visualization](https://reader034.vdocument.in/reader034/viewer/2022051313/5487a9ea5806b5802f8b4600/html5/thumbnails/23.jpg)
Thank you for your attention// ereyes.net