2004.08.30 SLIDE 1IS246 – FALL 2004

Lecture 01: Introduction

IS246Multimedia Information

Prof. Marc DavisUC Berkeley SIMS

Monday and Wednesday 2:00 pm – 3:30 pmFall 2004

http://www.sims.berkeley.edu/academics/courses/is246/f04/

2004.08.30 SLIDE 2IS246 – FALL 2004

Today’s Agenda

• Introductions

• Problem Domain

• Goals of Course

• Course Overview

• Action Items for Next Time

2004.08.30 SLIDE 3IS246 – FALL 2004

Today’s Agenda

• Introductions

• Problem Domain

• Goals of Course

• Course Overview

• Action Items for Next Time

2004.08.30 SLIDE 4IS246 – FALL 2004

Who Am I?

• Assistant Professor at SIMS (School of Information Management and Systems)

• Background1980 – 1984 B.A. from Wesleyan University in the College of

Letters

1984 – 1987 M.A. from the University of Konstanz in Literary Theory and Philosophy

1990 – 1995 Ph.D. from MIT Media Laboratory in Media Arts and Sciences

1993 – 1998 Member of the Research Staff and Project Coordinator at Interval Research Corporation

1999 – 2002 Chairman and CTO of Amova

2004.08.30 SLIDE 5IS246 – FALL 2004

Why Am I Here?

• Creating technology and applications that will enable daily media consumers to become daily media producers

• Research and teaching in the theory, design, and development of digital media systems for creating and using media metadata to automate media production and reuse

2004.08.30 SLIDE 6IS246 – FALL 2004

Student Introductions

• Who are you?– Name– Undergrad degree and current department– Special areas of expertise and interest

• Why are you here?– What you want to learn from the course

2004.08.30 SLIDE 7IS246 – FALL 2004

Today’s Agenda

• Introductions

• Problem Domain

• Goals of Course

• Course Overview

• Action Items for Next Time

2004.08.30 SLIDE 8IS246 – FALL 2004

Global Media Network

• Digital media produced anywhere by anyone accessible to anyone anywhere

• Today’s media users become tomorrow’s media producers

• Not 500 TV Channels — 500,000,000 multimedia Web sources

2004.08.30 SLIDE 9IS246 – FALL 2004

What is the Problem?

• Today people cannot easily find, edit, share, and reuse media

• Computers don’t understand media content– Media is opaque and data rich– We lack structured representations

• Without content representation (metadata), manipulating digital media will remain like word-processing with bitmaps

2004.08.30 SLIDE 10IS246 – FALL 2004

Types of Multimedia Data

• 1D– Audio (speech, music, sound effects, etc.)– MIDI

• 2D– Photographs– Graphics

• 3D– Video (2D + Time)– Animation (2D + Time)– Computer graphic models

• 4D– Computer graphic model animation (3D + Time)

2004.08.30 SLIDE 11IS246 – FALL 2004

Moore’s Law for Cameras2000

Kodak DC40

Nintendo GameBoy Camera

$400

$ 40

2002

Kodak DX4900

SiPix StyleCam Blink

2004.08.30 SLIDE 12IS246 – FALL 2004

2004: Nokia 7610 Phone

• Integrated megapixel (1152 x 864 pixels) camera

• Integrated video recorder with audio function and 4x digital zoom for video clips up to 10 minutes long

• 65,536 color-display, 176 x 208 pixels

• Bluetooth wireless technology and USB connectivity

• Advanced XHTML browser• 8 MB internal dynamic memory

and 64 MB Reduced Size MultiMediaCard (MMC)

• Downloadable Java™ MIDP 2.0 applications

2004.08.30 SLIDE 13IS246 – FALL 2004

The Media Problem

• Vastly more media will be produced• Without ways to manage it (metadata

creation and use) we lose the advantages of digital media

• Most current approaches are insufficient and perhaps misguided

• Great opportunity for innovation and invention

• Need interdisciplinary approaches to the problem

2004.08.30 SLIDE 14IS246 – FALL 2004

Today’s Agenda

• Introductions

• Problem Domain

• Goals of Course

• Course Overview

• Action Items for Next Time

2004.08.30 SLIDE 15IS246 – FALL 2004

Goals of the Course

• Acquire theoretical and practical foundations to analyze, design, and produce multimedia information systems– Media theory– Media practice– Current and future media systems and applications

• Learn to apply media theory to media design• Gain further experience in project-based

learning and teamwork• Develop an enduring framework and

methodology for media analysis and design

2004.08.30 SLIDE 16IS246 – FALL 2004

What This Course Is

• Graduate level lecture/seminar/studio in multimedia information

• Highly interdisciplinary– Information Management and Systems,

Computer Science, Electrical Engineering– Film Studies, Cognitive Science, Linguistics– Film Practice, Design, HCI

• Project-based and team-oriented• Requires stretching, commitment, and

active participation

2004.08.30 SLIDE 17IS246 – FALL 2004

What This Course Is Not

• Topics– Computer science or engineering course on

media signals and systems– Film criticism course– Advanced media production skills course– Media networking, protocols, compression

course

• Methods– Exams

2004.08.30 SLIDE 18IS246 – FALL 2004

Who This Course Is For

• Students from– SIMS– Film Studies– EECS– Law, Business, Journalism, Architecture– Other departments

• Interested in– Synergizing a variety of disciplinary approaches to a

complex, important, and fascinating problem domain that will shape the future of human communication, technology, and culture

2004.08.30 SLIDE 19IS246 – FALL 2004

Today’s Agenda

• Introductions

• Problem Domain

• Goals of Course

• Course Overview

• Action Items for Next Time

2004.08.30 SLIDE 20IS246 – FALL 2004

Course Format

• Most classes will be lecture/discussion sessions– Lecture ~50 minutes– Discussion ~30 minutes

• For each class two students will prepare discussion questions and help lead discussion

• Some classes will be working sessions– Assignment 3 Overview and Ideation– Annotated Storyboard Working Session and Crit– Final Project Overview and Ideation

• Some classes will be student presentations– Media Production and Theory Presentations– Final Project Presentations

2004.08.30 SLIDE 21IS246 – FALL 2004

Course Overview

• Course phases– Theoretical and practical foundations– Current issues and methods– The future of multimedia

• Course assignments– Theory application– Using a camcorder– Short media production– Final project

2004.08.30 SLIDE 22IS246 – FALL 2004

Course Sessions: Part I

• Theoretical and practical foundations– Communications theory and semiotics (Reddy, Iser,

Barthes, Saussure)– Formalist media theory (Bordwell, Kuleshov)– Semiotic media theory (Metz, Eco)– Integrating theory and practice (Eisenstein)– Video production overview (Guest: Rachel Strickland)– Audio production overview (Guest: Rachel Strickland)

Theory and history of computation (Hillis, Winograd)– Computational media theory (Manovich, Dorai &

Venkatesh, Bloch)

2004.08.30 SLIDE 23IS246 – FALL 2004

Course Sessions: Part II• Current issues and methods

– Metadata for media (Davenport, Davis)– Automated media analysis (Agrain, Jain, Foote -- Guest:

Jonathan Foote)– Multimedia journalism (Guest: Paul Grabowicz)– Media asset management and reuse process (Christel,

Dimitrova, Prelinger, Jenkins)– Commercial editing systems (Adobe Premiere)– Commercial media asset management systems (Virage)– Research multimedia systems (FotoFile -- Guest: Abbe Don)– Research multimedia systems (Informedia – Guest: Michael

Smith)– Multimedia standards (MPEG-7)

2004.08.30 SLIDE 24IS246 – FALL 2004

Course Sessions: Part III

• The future of multimedia– Future of multimedia information technology

(Bush, McLuhan, Davis, Chang)– Active capture (Davis, Nack, Barry)– Adaptive media (Davis, Stern, Varian)– Mobile Media (Naaman, Sarvas, Toyama) – Final project presentations

2004.08.30 SLIDE 25IS246 – FALL 2004

Course Assignments

• Theory application• Using a camcorder: “Object lesson”• Short media production

– Annotated storyboard and goal statement– Rough edit– Presentation

• Final project– Team and idea formation– Project proposal– Project design specifications– Project presentation and write-up

2004.08.30 SLIDE 26IS246 – FALL 2004

Grading

• 20% Theory Application Assignment

• 20% Mini Media Production Project

• 40% Final Project

• 20% Class Participation

2004.08.30 SLIDE 27IS246 – FALL 2004

SIMS Digital Media Studio

• Hardware– Terabyte file server– Gigabit Ethernet– 2 Mac G4 workstations– 2 PC workstations– Various audio/video

input options– 5 Sony DCR-TRV50

DV camcorders– 5 Audio field recording

packs– Greenscreen

• Software– Adobe Premiere– Adobe AfterEffects– Adobe PhotoShop– FinalCut Pro– Media Streams

• Collaboration tools– Brainstorming area– Wall whiteboards

2004.08.30 SLIDE 28IS246 – FALL 2004

Office Hours

• Marc Davis– Thursdays 1:00 pm – 3:00 pm– And by appointment

• Ryan Shaw– TBA

2004.08.30 SLIDE 29IS246 – FALL 2004

Today’s Agenda

• Introductions

• Problem Domain

• Goals of Course

• Course Overview

• Action Items for Next Time

2004.08.30 SLIDE 30IS246 – FALL 2004

Purchase Course Materials

• Purchase Course Textbooks– David Bordwell and Kristin Thompson. Film

Art: An Introduction. 7th Edition. McGraw Hill, New York, 2004.

– W. Daniel Hillis. The Pattern on the Stone: The Simple Ideas That Make Computers Work. Perseus Books Group, New York, 1999.

2004.08.30 SLIDE 31IS246 – FALL 2004

SIMS/CIS Computer Orientation

• See Ryan Shaw about– Filling out SIMS/CIS

Account Request Form– Seeing Roberta Epstein

on the second floor of South Hall to get SIMS/CIS orientation

2004.08.30 SLIDE 32IS246 – FALL 2004

Readings for Next Time

• Wednesday 09/01– Michael Reddy: “The Conduit Metaphor: A

Case of Frame Conflict in Our Language about Language” (Brooke)

– Wolfgang Iser: “The Reading Process: A Phenomenological Approach” (Geoff)

– Roland Barthes: “The Death of the Author” (Rebecca)

– Roland Barthes: “From Work to Text” (Sarah)

2004.08.30 SLIDE 33IS246 – FALL 2004

In Class Writing

• marc@sims.berkeley.edu

• ryanshaw@sims.berkeley.edu

• What is multimedia information?

• What are the main challenges in multimedia information systems?