mw2011: g. chae +, can social tagging be a tool to reduce the semantic gap between curators and...

48
Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences? | KAIST GSCT | 2011.04.07 Chae, Gunho / Kim, Jungwha agarpe,[email protected] KAIST, Republic of Korea Making a Semantic Structure of Tags by Implementing the Facetted Tagging System for Online Art Museums

Upload: museums-and-the-web

Post on 10-May-2015

1.772 views

Category:

Technology


1 download

DESCRIPTION

After the emergence of Web 2.0, online art museums have been evolving into participatory museums, in an attempt to increase the public’s participation through the utilization of social media. Among many types of social media, social tagging has been receiving widespread attention as a tool for reducing the semantic gap between curators and visitors, through the group knowledge obtained from the active participation of the public.In this circumstance, Gyeonggi Museum of Modern Art (GMOMA) embarked on an ongoing project with us to explore the potential of social tagging and applying it into museum management strategy. In the end of 2009, we built our own tag database based on the collections from GMOMA, and experiments were carried out by building a testbed on a website that was created to collect tags of 128 pieces of artworks.After collecting the tags, we evaluated the feasibility of social tagging systems through workshops with curators from GMOMA. From the workshop we found the potentials of social tagging systems in museums through interviews and discussions with the curators, and identified the improvements that could be made in order to apply it to actual museums.However, we discovered that while the number of tags increased, social tagging systems showed limitations in providing meaningful information and supporting semantic relationships between tags and museum collections. The causes are as follows:Lack of order, structure and depth in tagsLinguistic issuesFree forms of tags can cause ambiguity, chaos and noiseSpam tagsFailure to show the semantic relationships between tags; only provides an alphabetical listThus to achieve a participatory web and reflect the visitors’ semantic appreciation of museum collections, we conclude that the existing tagging systems should be supplemented. To improve the existing social tagging system and enhance the semantic appreciation in online art museum, our suggested solution is faceted tagging system which gives a guideline or schema to users when tagging the individual artworks. By collecting tags through the faceted tagging systems, we can automatically obtain a semantic structure and meaningful groups of tags. Before implementing the faceted tagging system and proving that it works, we had to make facets that cover the all the categories of art museum tags. We proceeded with card-sorting tests to extract and verify facets from the collected tag database. We retrieved six facets – “Background, Identification, Theme, Association, Emotion and Figure” – based on the semantic structure of tags, which were in a mess but now can be categorized into meaningful groups (facets). Finally, user-tests are scheduled in order to prove that applying the six facets into the faceted tagging system can help to bridge the semantic gap between curators and audiences. For the user-tests, the same 128 artworks from the first experiment will be used, and we will compare the tags collected from the user-tests with the tags from the first experiment. Then we plan to discuss the feasibility of faceted tagging systems and its results – which we call structured tags – through a workshop with the curators from GMOMA.

TRANSCRIPT

Page 1: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

| KAIST GSCT | 2011.04.07

Chae, Gunho / Kim, Jungwha

agarpe,[email protected]

KAIST, Republic of Korea

Making a Semantic Structure of Tags by Implementing the Facetted Tagging System for Online Art Museums

Page 2: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

“Social tagging has been receiving widespread attention as a tool for creating new metadata on museum collections through the

participation and knowledge of the public. ”

(Trant and Bearman 2006; Smith, 2006; Chun, 2006; Chan 2007)

Page 3: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

3

Social Tagging, Museum, Online Museum,

Museum Website, Visitor-Oriented, Information Management, Social

Computing, Tagging, Folksonomy, Web 2.0, Participation, constructivist Learning, Social Indexing, Accessibility, Museum Communication, Steve.Musuem, Online Collection, Social Search,

Information Science, Art Museum, Meaning Making, social media

Page 4: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

4

Gyeonggi Museum of Modern Art (GMoMA) and we started a new project for social tagging

Page 5: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

5

Building a testbed for collecting social tags

10th ~28th of February, 2010 (19days)http://cultureplanning.kaist.ac.kr/socialtagging

(based on steve-tagger 2.0)Results:

No. of Artworks: 128No. of Participants (Taggers): 168No. of Tags: 14159

Page 6: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

6

After the1st experiment,

We organized workshops with GMoMA Curators(*1st workshop: 15/04/2010)

(*2nd work shop: 28/04/2010)

To find out what we gained from the experiment

Page 7: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Results from the experiment

Tags

Be gone, Boyeong jeong, Oil painting, 162*227.3, 2006

Light(6),Sunshine(5),Space(4),Loneliness(4),Sunlight(4),Empty(3),Room(3),Window(3),Angle(2),Calm(2),Lazy(2), Window with sunshine(2),Sunset(2),Composure(2),Afternoon(2),Chair(2),Working Room(2),cool(2)

How can we interpret the tags from the audiece?What is their initial intention in tagging those words?

Page 8: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Tag Clouds for the Top 100 Tags?, 개미 , 거울 , 겨울 , 계곡 , 고독 , 골판지 , 공간 , 공포 , 공허 , 구름 , 국

화 , 길 , 꽃 , 꿈 , 나무 , 나비 , 낚시 , 남극 , 누드 , 눈 , 단절 , 달 , 대비 ,

대칭 , 도시 , 동양 , 동화 , 뒷모습 , 만화 , 모자이크 , 무서움 , 무제 ,

무중력 , 바다 , 바람 , 반전 , 번짐 , 벚꽃 , 벽 , 병풍 , 봄 , 부조화 , 북한 , 빛 ,

사과 , 사람 , 사진 , 산 , 산수화 , 새 , 선 , 선택 , 숫자 , 슬픔 , 시골 ,

시원함 , 심오 , 심장 , 십장생 , 안개 , 액자 , 어머니 , 어지러움 , 엑박 , 여백 , 여

성 , 여인 , 여자 , 여행 , 외로움 , 원 , 일본 , 자연 , 자유 , 자판기 ,

전쟁 , 절벽 , 점 , 제사 , 조각 , 죽음 , 지도 , 징그러움 , 추상 , 타일 , 폐허 ,

포도 , 폭포 , 풍경 , 피 , 핑크 , 하늘 , 합성 , 호수 , 혼란 , 홍수 ,환상 , 흑백 , 흙

Results from the experiment

?, 개미 ,Mirror,Winter, 계곡 , 고독 , 골판지 , 공간 ,Horror, 공허 ,Cloud,

국화 ,Road,Flower,Dream,Tree, 나비 , 낚시 , 남

극 ,Nude,Snow, 단절 ,Moon,Contrast, 대칭 ,City, 동양 ,Fairytale,

뒷모습 ,Cartoon,Mosaic, 무서움 ,nontitled, 무중력 ,Sea, 바람 , 반전 ,

번짐 , 벚꽃 , 벽 , 병풍 ,Spring, 부조화 , 북한 ,Light,Apple, 사

람 ,Photo,Mountatin, 산수화 , 새 , 선 ,Choice, 숫

자 ,Sorrow, 시골 ,Cool, 심오 ,Heart, 십장생 , 안개 , 액자 ,Mother,

어지러움 , 엑박 , 여백 , 여성 , 여인 ,Woman,Travel,Lonley,

원 ,Japan,Nature, 자유 , 자판기 ,War, 절벽 , 점 , 제사 , 조

각 ,Death,Map, 징그러움 ,Abstract, 타일 , 폐허 ,Grape, 폭

포 ,Scenary, 피 , 핑크 ,Sky, 합성 , 호수 , 혼

란 ,Flood,Fantasy,Black and White, 흙

What keywords can represent GMoMA’s collection?Why do they co-exist with each other?

Page 9: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

9

But Certainly, we realize the power of social tagging in art museum…

Page 10: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

10

“So, GMoMA decided to

apply social tagging system in their website”

And we provide them new museum management strategies

using social tagging system

Page 11: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Museum Management Strategy

Making Use of Social Tagging System

Building public oriented museum collection metadata

New ways of searching art museum collection

Museum Collection Information Management

Idols on Narrative Stage_

소리 , 배우 , 그리고 아무것도

실존하지 않는 무대 , 홍영인

로마 , 무대 , 신전 , 인도 ,

영웅 , 꽃 , 무대 , 개선문 ,

글로벌 , 신전 , 신화 ,

개선문 , 영웅 , 풍자 , 공연 ,

무대 , 서커스 , 글로벌 , 공

연 , 풍자 , 화려함 , 서커스 ,

콜라주 , 패러디 , 공연 ,

개선문 , 공연 , 무대 , 신전 ,

인도 , 영웅 , 서커스 , 신화 ,

최근 작가는 사진작업을 새롭게

시작하고있다 . 정확히 말하면 디지털

이미지를 자신의 미학적 개념에 맞게

재구성하는 것이다 . 작가가 주목하고

있는 것은 일종의 ' 기념비적 조각 '

들로서 , 종교적 기념조각이라 할 수

있는 ' 불상 ' 과 광화문의 ' 이순신 ' 을

비롯해 동서양의 다양한 동상을 차용한

후 거기에 현대판 옷을 입혀 전혀 다른

맥락의 인물을 창조하는 것이다 .

이 ' 기념물 ' 들은 역사 , 사회 ,

문화일반의 관광적 시선 , 즉 발견의

시선에 의해 재맥락화되고 있다 .

Existing Information

Social Tags

Page 12: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Museum Management Strategy

Making Use of Social Tagging System

Reflecting visitors’ perspective into exhibition planning

Tag based online exhibition

Tag tour application

Public Oriented Curating

SocialTags

Public Collection Exhibition

Curator

Page 13: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Museum Management Strategy

Making Use of Social Tagging System

Real-time public survey (Demographic differences, Rising issues, etc.)

Giving curators a chance to understand visitors

A New Way of Public Survey

SocialTags

Public Collection Museum

A new way of Public Survey

Page 14: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

14

Chae, G. and Kim, J. (2011). “Rethinking Museum Management by Exploring the Potential of Social Tagging Systems in Online Art Museums”. The International Journal of the Inclusive Museum, Vol. 3, Number 3, pp.131–140.

Page 15: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Before,

Page 16: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

After,

Page 17: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Still, We can’t help but wonder….

“Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?”

Our answer is “it needs more”.

Page 18: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Related Works

Emphasizing on Meaning, Structure and Facet (Classification)…

Page 19: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Our suggesting solution is applying “facetted tagging system” for art museum tagging system.

A sample of Mefeedia’s Faceted Tagging interface (G. Smith 2008)

What is “facetted tagging system”?

The tagging interface at buzzillions.com gives two facets (G. Smith 2008)

Facette | Facets for Delicious by Peter Lai, 2009

Page 20: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Why do we use “facetted tagging system” for art museum tagging system?

For the Audiece structured tagging may be able to produce stronger user guidance,

hence possibly resulting in higher quality descriptions. (Bar-Ilan et al. 2006)

information seekers in large domains of objects prefer meaningful groupings of related items, in order to quickly understand relationships and so decide how to proceed (Hearst 2006)

For the Museum curators and Staffs Giving a chance to understand sematic structure of tags and

tagger’s initial intention of tags Building public-oriented collection metadata based on facetted

tagging

Page 21: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Manual Indexing

Research Process

Literature Review

1. Constructing the Facet Structure

Closed-Card

Sorting Test

Analyzing Artwork

Description

2. Evaluating Feasibility of Facets

Implementation

Discussion

3. Implementing Facetted Tagging System

Page 22: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

22

Black and White

MirrorWinter

Horror

Cloud RoadFlower

Dream

Tree

NudeSnow Moon

Contrast

City

FairytaleCartoon

Mosaic

nontitled

Sea

Spring

Light

Apple

Photo

Mountain

Choice

Sorrow

Cool

Heart

Mother

Woman

Travel

Lonley

Japan

Nature

War

Death

Map

Abstract

Grape

Scenary

Sky

Flood

Fantasy

Manually matching each tags with artworks…

And then trying to group them

Page 23: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Research Title Facets (or Classification) Results of Application

Facet Tagging

Inducing Ontology from Flickr Tags (Schmitz, 2006)

Place, Activity, Depictions, Emotion, Response

Place, Activity, Depictions, Emotion, Response

Collaborative Classification of Growing Collections with Evolving Facets (Wu, 2007)

Artifact, Location, Foreign Fairs, Topics, Year

Location, Topics, Year

Facetag: Integrating Bottom-up and Top-down Classification in a Social Tagging System (Quintarelli et al; 2007)

Resource Types, Language, Themes, People, Purposes, Date

People, Purposes, Date, Theme

Tag Classification

The structure of collaborative tagging systems (Golder and Huberman, 2005)

Descriptive, Resource, Ownership/Source, Opinion, Self-reference, Task Organizing, Play and Performance

Descriptive, Opinion

Viewing Artwork

Viewer tagging in art museums: Comparisons to concept and vocabularies of art museum visitors (Smith, 2006)

Pictured people, Objects, Events, Actions, Simple mood, Emotions, Theme, Stories

Pictured people, Objects, Events, Actions, Simple mood, Emotions, Theme

The eye of the beholder: Measuring aesthetic development (Housen, 1983)

Figure, Objects, Events, Story, Theme

Figure, Objects, Events, Theme

Facet Tagging Websites

http://www.mefeedia.comEvents, Language, People, Places, Topics

Events, People, Places, Topics

http://www.etsy.com (Ranganathan’s classicifacion)

Space, Time, Material, Topic, Colors, Owners

Space, Time, Material, Topic, Colors

Page 24: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Extrapolating six facets from the literature review

Facets: Background, Identification, Theme, Association, Emotion and Figure

Page 25: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

25

Black and White

MirrorWinter

Horror

Cloud RoadFlower

Dream

Tree

NudeSnow Moon

Contrast

City

FairytaleCartoon

Mosaic

nontitled

Sea

Spring

Light

Apple

Photo

Mountain

Choice

Sorrow

Cool

Heart

Mother

Woman

Travel

Lonley

Japan

Nature

War

Death

Map

Abstract

Grape

Scenary

Sky

Flood

Fantasy

Manually matching each tags with artworks…

And then grouping them into six groups

Black and White

Mirror

Winter

Horror

Cloud Road

Flower

Dream

Tree

NudeSnow Moon

Contrast

City

Fairytale

Cartoon

Mosaic

nontitled

Sea

Spring

Light

Apple

PhotoMountain

Choice

SorrowCool

Heart

Mother

WomanTravel

Lonley

Japan

Nature

War

Death

Map

Abstract

Grape

Scenary

Sky

Flood

Fantasy

Horror

City

Abstract

Sorrow

Death

Cartoon

Dream

Cloud

Background Identification Theme

Association Emotion Figure

Page 26: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Manual Indexing

Research Process

Literature Review

1. Constructing the Facet Structure

Closed-Card

Sorting Test

2. Evaluating Feasibility of Facets

3. Implementing Facetted Tagging System

Page 27: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Purpose: Evaluating feasibility the six facets in categorizing social tags from the user’s point of view

Subjects: Ten artworks with tags (Artworks were randomly chosen from GMOMA Collection)

20 experiment participants were each given five artworks and asked to classify the tags

Page 28: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Result from the Closed-Card Sorting Test

-Consistency of categorization between the participants:91% of the Tags were classified into the 6 facets

More than 3 people categorized equally : 61%More than 2 people categorized equally : 75%

Page 29: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Manual Indexing

Research Process

Literature Review

1. Constructing the Facet Structure

Closed-Card

Sorting Test

Analyzing Artwork

Description

2. Evaluating Feasibility of Facets

3. Implementing Facetted Tagging System

Page 30: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Museum MOMA

Artist Robert Colescott

Title Emergency Room

Description

Using a rich palette and articulated brush strokes, Colescott has depicted a chaotic emergency room, which he considers to be "a vivid allegory for the whole country." Since the 1960s, Colescott has addressed social issues, particularly racial stereotypes, through narrative figuration. This scene is crowded with caricatured figures, including a priest holding a decapitated head, a skeleton receiving a blood transfusion, a gang of knife–wielding apes, and a doctor smoking as he administers an injection. The women in the painting are subject to violence and harassment, and one large, recumbent, objectlike woman in the background has bricks for flesh, skeletons for eyes, and factory smoke for hair.

Facet 1. Background

Since the 1960s

Facet 2. Identification

chaotic emergency room / a priest holding a decapitated head, a skeleton receiving a blood transfusion, a gang of knife–wielding apes, and a doctor smoking as he administers an injection. / women / large, recumbent, objectlike woman / bricks for flesh, skeletons for eyes, and factory smoke for hair

Facet 3. Theme

social issues, particularly racial stereotypes

Facet 4. Association

a vivid allegory for the whole country. / violence and harassment

Facet 5. Emotion

 

Facet 6. Figure

narrative figuration

Example of analyzing a description of “Emergent Room” based on the six facets

Can the six facets be useful for museum curators in reflecting the public’s viewpoint?

Subjects: Ten artworks, randomly selected from the highlight section of four museums’ website – SFMOMA, IMA, MOMA, and Guggenheim were analyzed.

Page 31: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

SFMOMA IMA MOMA GUGGENHEIM Average

Average number of facets implied in the

artworks’ descriptions

4.6 4.3 4.8 5.8 4.9

Result from Analyzing Artwork Descriptions

Page 32: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Manual Indexing

Research Process

Literature Review

1. Constructing the Facet Structure

Closed-Card

Sorting Test

Analyzing Artwork

Description

2. Evaluating Feasibility of Facets

Implementation

3. Implementing Facetted Tagging System

Page 33: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

http://agarpe.cafe24.com/facet/ Twenty four artworks were randomly selected from GMoMA and an online

testbed was created for the experiment During one week, 100 users participated in the experiment Approximately 9400 tags were collected, with an average of 391 tags per artwork. Among all the tags, less than 2% of the total tags (165 tags) did not

belong to any of the six facets and were classified as “etc”

Page 34: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Manual Indexing

Research Process

Literature Review

1. Constructing the Facet Structure

Closed-Card

Sorting Test

Analyzing Artwork

Description

2. Evaluating Feasibility of Facets

Implementation

Discussion

3. Implementing Facetted Tagging System

Page 35: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Social Tags

Hero(4), Circus(3), Myth3), Collage(3), Satire (3), triumphal arch (2), Performance(2), Global(2), Flower(2), Rome(2), Stage(2), Temple(2), India(2), Parody(2), HongYoungIn(2),

Dazzling(2)

Facet tags

Background Identification Theme Association Emotion Figure

Greece(14) Statue(10) Hero(10) Mismatch(6) Unfocused(5) Collage(18)

Ancient(14) God(9) Diversity(6) kitsch(5) Dignity(5) Photo(14)

Medieval(12) General(6)Eastern and Western(5)

Disturbance(5) insensibility(4) Magazine(7)

Temple(10) Stage(6) Myth(5) Pop Art(4) Dazzling(4) Pop Art(7)

Myth(7) Hero(6) Human(3) Greece(3) Inharmony(4) Paper(6)

Modern(6) Flower(6) Chaos(3) Chaos(3) Fun(3) Canvas(4)

Stage(6) Photo(4) Play(3) Dazzling(3) Gorgeous(3) Paints(2)

Eastern and Western(5)

Actor(4) Idol(2) Complex(3) Delight(2) Montage(2)

Idols on Narrative Stage, Hong Youngin, 2007

Result from the Implementation

Page 36: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Non Titled, Lee Bul, Cast polyurethane paint,

two-way mirror, wood frame, 160*120*13, 2008

Social Tags

Machine(12), Infinity(4), Matrix(3), Handcuffs(3), Stocked(2), Mirror(2), Metal(2), Robot(2), Building(2), Cube(2), Transformer(2), Piano(2)

Background Identification Theme Association Emotion Figure

Future(25) Machine(26) City(9) 차가움 (6) 차가움 (16) 철 (12)

Virtual Space(17)

City(12) 차가움 (8) 특이함 (5) 무감각 (5)컴퓨터그래픽

(11)

가상공간 (5) 건물 (9) 혼란 (6) 혼란 (5) 삭막함 (4) 그래픽 (8)4 차원 (5) Robot(4) 혼돈 (4) 어두움 (3) 무서움 (3) 쇠 (6)

우주 (5) 철 (3) 미래 (4) 복잡함 (3) Coldness(2) 물감 (4)

현대 (4) 컴퓨터 (3) 불안 (3) 질서 (2) 딱딱함 (2) Metal(4)City(3) 아파트 (3) 어두움 (3) Computer(2) 메마름 (2) 종이 (4)

Computer(3) Metal(3) 잿빛도시 (2) 도시화 (2) 폐쇄 (2) 플라스틱 (3)

겨울 (3) 기계장치 (3) 빨려들어감 (2) 멸망 (2) 두려움 (2)컴퓨터 그래픽

(3)사이버 (3) 미로 (2) 메마름 (2) Machine(2) 무감정 (2) 프린트 (2)입체 (2) 건축 (2) 단단함 (2) 알수없음 (2) 혼란 (2) 액자 (2)미로 (2) 톱니 (2) 현대문명 (2) Coldness(2) 답답함 (2) 사진 (2)Matrix(2) 알수없음 (2) 알수없음 (2) Future(2) 어지러움 (2) 컴퓨터 (2)

world of dimensions(2)

설계 (2) 어두엄 (1) 삭막함 (2) 기이한 조합 (1)디지털 프린트

(2)

그래픽 (2) 현실 (2)보이지않는손

(1)Virtual Space(2) 낯선 감정 (1) 조형 (2)

5 차원 (2) 레고 (2) 롤러코스터 (1) Robot(2) 도발 (1) 알수없음 (2)

빛 (1) 인위적 (2) Virtual Space(1) 비인간화 (2) 경이 (1) 찹쌀떡 (1)

virtual space(1) 액자 (2) 복잡함 (1) Matrix(2) 공허함 (1)컴퓨터프로그래

밍 (1)

Result from the Implementation

Page 37: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Erased-the sprout, JungjungyupOil Painting, 162*130, 2007

Social Tags

Potato(5), Death(5), Worm(4), Creepy(4), Sprout(2), Empty(2), Dream(2), Chicken(2), Poison(2), Flea(2), Goat(2), Start(2), Lamb(2), Bean(2)

Background Identification Theme Association Emotion Figure

하늘 (29) Potato(11) Life(16) Life(9) Creepy(6) 물감 (24)

현대 (10) 양 (10) Start(5) Potato(4) 알수없음 (4) 수채화 (9)

환상 (8) 뿌리 (9) 탄생 (5) 곤충 (4) 무감각 (3) 유화 (7)

Sea(7) 사람 (9) 몽상 (4) Sea(3) 사랑 (3) 색연필 (6)

알수없음 (5) 싹 (6) 곤충 (4) Cloud(2) 독특함 (2) 종이 (5)

마음 (4) Cloud(6) 알수없음 (3) Start(2) 이상함 (2) 채색 (4)

태초 (4) 씨앗 (5) 생명력 (2) 희망 (2) 안타까움 (2) 캔버스 (3)

동화 (3) 벌레 (4) 붕 떠있는 (2) 푸른여백 (2) Peace(2) 알수없음 (3)

자궁 (2) 곤충 (4) 발아 (2) Creepy(2) 무의식 (2) 연필 (2)

물 (2) 콩 (3) Peace(2) 하늘 (2) 오묘함 (2) 색칠 (2)

뱃속 (2) 알수없음 (3) 무중력 (2) 모호 (2) 공허함 (2) 한지 (1)

만화 (2) 하늘 (3) Creepy(2) 꿈 (2) 신비 (2) 네모낳다 (1)

땅 속 (2) 고구마 (2) 생명의 탄생 (2) 신호등 (1) 슬픔 (2) 페인트 (1)

가상의 공간 (1) 뇌 (2) 뿌리내리다 (2)기괴하나

아름답다 (1)모호 (2) 신선하다 (1)

어떤 공간 (1) 게 (2) 난해함 (1) 가족 (1) 푹신함 (2) 그래픽 (1)

Result from the Implementation

Facet tags give us clues for interpreting the semantic structure of tags

We can guess the initial intention of taggers when they tag It shows relation among tags by grouping them into facets

Page 38: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

38

After the Implementation,

Another workshop was held with GMoMA Curators(*workshop: 09/02/2011)

For exploring potential of

“facetted tagging system” for art museums

Page 39: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Possibility facetted tags “were extremely interesting in that it was easier to see

the intentions of the users”

because tags were grouped, “it would be possible to use such

information when user’s search or categorize artwork.”

“it would be possible to understand the semantic relation between

tags in tag clouds created for facetted tagging.”

Things to be improved “there is a chance that the requirement of users to classify tags into

one of six facets might make them feel like a taking a test and become

a drawback from freely appreciating art”

facets themselves can trigger ambiguities” “the distinction between

‘association’ and ‘emotion’ were unclear.”

QDoes facetted tagging system has potential to

Reduce the Semantic Gap between Curators and Audiences?

Page 40: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

40

What can we expect by applying

“facetted tagging system” for art museums?

Page 41: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Idols on Narrative Stage,

Hong Youngin, 2007

Background

Rome, Stage, Temple,

India, Winter, Farm, NY,

Seoul, War, River,

MountatinTheme

Myth, triumphal arch, apple

Hero, Satire, Stage, Circus,

Global, Peace, Warmhearted,

LoveEmotion

Satire, Dazzling, Horrified,

Scary, Cold, Cool, Creepy,

Cute, Sad

We can develop facet based collection browser!

You can easily browse the artworks!

IdentificationHero, Flower, stage,

triumphal arch, Global,

Temple, coin, Pig, boy, red,

Jeans, Time square Association

triumphal arch,

Performance, Stage, Myth,

India, Hero,, Circus

Global, Figure

Circus, Collage, Parody,

Performance, Contrast,

Photo, Sculpture

Page 42: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Idols on Narrative

Stage,

Hong Youngin, 2007

BackgroundRome, Stage,

Temple, India

Add

Tags:_______________ThemeMyth, triumphal

arch , Hero, Satire,

Stage, Circus,

Add

Tags:_______________Emotion

Satire, Dazzling

Add

Tags:_______________

IdentificationHero, Flower,

stage, triumphal arch,

Global, Temple,

Add

Tags:_______________Association

triumphal arch,

Performance, Stage,

Myth, India, Hero,,

Circus

Add

Tags:_______________

FigureCircus, Collage,

Parody,

Performance

Add

Tags:_______________

Creating a new tagging interface

And this can construct public-oriented collection metadata

Page 43: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

43

What is the next step ?

Page 44: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

44

1. Eliminate the ambiguities in facets

& Develop the better facetted tagging system

?

Page 45: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

45

2. We want to know how the tags will be changed

if audience see the original artworks in museum

Page 46: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

46

3. Public Curated Exhibition

Based on tag DB,

Planning a new modern art exhibition

Page 47: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

References

1) Bar-Ilan, J., et al. (2008). “Structured versus unstructured tagging: a case study”. Online Information Review, Vol. 32, Issuse 5, pp.635 – 647.

2) Chan, S. (2007). Tagging and Searching-Serendipity and museum collection databases. In D. Bearman and J. Trant (eds.). Museums and the Web 2007: Proceedings. Toronto: Archives & Museum Informatics, 2007. http://www.archimuse.com/mw2007/papers/chan/chan.html

3) Chun, S., et al. (2006). Steve. museum: an ongoing experiment in social tagging, folksonomy, and museums. Museums and the Web 2006: Proceedings. Toronto: Archives & Museum Informatics, 2006. http://www.archimuse.com/mw2006/papers/wyman/wyman.html

4) Durbin, G. (2003). Using the Web for Participation and Interactivity, Museum and Web 2003: Proceedings. Toronto: Archives & Museum Informatics, 2003. http://www.archimuse.com/mw2003/papers/durbin/durbin.html

5) Golder, S. and B, Huberman. (2005). The structure of collaborative tagging systems. Arxiv preprint cs/0508082.6) Chae, G. and Kim, J. (2011). “Rethinking Museum Management by Exploring the Potential of Social Tagging Systems in

Online Art Museums”. The International Journal of the Inclusive Museum, Vol. 3, Number 3, pp.131–140.7) Hearst, M. (2006). “Clustering versus faceted categories for information exploration”. Communications of the ACM, Vol. 49,

Issue 4, pp.59 – 61.8) Housen, A. (1983). The eye of the beholder: Measuring aesthetic development. Ed.D. Thesis, Harvard University Graduate

School of Education, UMI number 8320170. 9) Quintarelli, E., et al. (2007). “Information architecture: Facetag: Integrating bottom-up and top-down classification in a social

tagging system”. Bulletin of the American Society for Information Science and Technology, Vol. 33, Issue 5, pp.10–15.10)Schmitz, P. (2006). “Inducing ontology from flickr tags”. In Proceedings of the Collaborative Web Tagging Workshop in

conjunction with the 15th International Conference on the World Wide Web.11)Smith, G. (2007). Tagging: people-powered metadata for the social web. New Riders.12)Smith, M. (2006). “Viewer tagging in art museums: Comparisons to concepts and vocabularies of art museum visitors”. In

Advances in classification research, vol. 17: Proceedings of the 17th ASIS&T SIG/CR Classification Research Workshop.13)Trant, J. and B. Wyman. (2006). “Investigating social tagging and folksonomy in art museums with steve. Museum”. the

Collaborative Web Tagging Workshop (WWW'06).14)Wu, H., et al. (2007). “Collaborative classification of growing collections with evolving facets”. Proceedings of the 18th

conference on Hypertext and hypermedia HT 0715)Xu, Z., et al. (2006). “Towards the semantic web: Collaborative tag suggestions”. Collaborative Web Tagging Workshop

(WWW'06)

Page 48: MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap between Curators and Audiences?

Thank You

| KAIST GSCT | 2011.04.07

Q & A