emotion technology lab kaist graduate school of culture...

Woo, Sungju C r e a t i v e T h i n k i n g

E m o t i o n T e c h n o l o g y L a b

KAIST Graduate School of Culture Technology Emotion Technology Lab


S c i e n c e o f E m o t i o n & S e n s i b i l i t y

1. Science and Art by Secrets of Color, 2011 색채과학의 비밀과 5개의 방

2011, Children’s Center Daejeon, Experience and Media Art Exhibition for Creativity (색채비밀을 통한 과학과 미디어 아트의 만남 : 대전 지역 아동들의 창의적 과학융합 체험전시)

전시 개요 : 색채는 빛의 현상으로 과학의 대상임과 동시에 인간의 감정에 작용하는 “비밀스러운” 성질을 가지고 있습니다. “색채과학의 비밀과 5개의 방 전”은 색의 심리적 활용으로 아동들의 감정표현을 도우며 색채과학을 미디어아트 및 체험전시물로 소개함으로써 과학탐구의 적극적 도전을 배려한 융합적인 기획입니다.

프로그램 개요:

5개의 공간 안에서 미디어 아트체험, 체험활동, 워크북 활동 (색채학 공부)을 실행.본 전시는 5개의 각자 다른 색을 대표하는 공간으로 이루어져 있습니다. 5가지 색채는 “색과 감성심리의 연관관계 분석을 위한 색채와 문화인지도 선행연구”를 적용하여 선택하였습니다. 긍정적인 정서에 높은 응답비율을 보인 빨강, 초록, 파랑, 노랑, 흰색으로 구성된 공간을 탐험하면서 긍정적인 단어에서 비롯한 색채의 체험을 통해 참가하는 아동의 자아존중감 향상을 도모합니다.

사전 활동:

K-HTP 테스트연구소가 기구축한 K-HTP 검사로 아동의 창의력 자가진단 검사

2. Development Program for CPS (Creative Problem Solving) Model in Educating Environment, 2012

2012, M elementary school, April 30. ~ December 31. ‘환경에 대한 기능과 가치 이해를 기반으로 생활 속 실천을 행하는 환경소양인을 양성한다’는 목적으로 아이들이 자발적이고 즐겁게 프로그램에 참여할 수 있는 다양하고 신선한 과학 문화 활동을 제공.



3. Sound Sketchbook: Synthetic Synesthesia on a Mobile Platform, Leonardo, MIT , 2013

We present Sound Sketchbook, a mobile phone application featuring real-time sound synthesis based on simple yet evocative multi-modal data mappings. While originally designed as a tool for evaluation of audiovisual correspondences, the application is also appreciated as an enjoyable sound toy and has a strong potential as a multimedia education tool for children. We introduce the data mapping strategy of Sound Sketchbook with regard to synesthesia, describe the innate sonic properties they can express, and discuss the effectiveness of the mappings based on user survey results.

4. Science and Art Collaboration by Camera Obscura, 2010 Experience Exhibition twice held in Seoul and Daejeon 2011, Daejeon Museum of Art, Children’s Center Daejeon, Experience and

Media Art Exhibition for Creativity



5. Intelligent color conversion technology development for enhancing the usability of culture contents for color vision defectives In this research an intelligent color transformation service technology was developed to increase the usability of cultural contents for color deficient people (CDP). Then the algorithm was optimized for each type (P-type, D-type) and degree (High, Middle, Low) of color deficiency based on the intensive clinical experiments. Finally, the UX-based color transformation application program was developed considering the usability and user’s emotion and experience. The UX-based application software (App-based intelligent color transformation S/W) named Imago Vision (Android App) was developed and registered at Google store. Also various patents, intellectual properties, research papers and reports were produced.

6. Measuring user’s sensibility on skin-tone variations of portrait photography

https://www.youtube.com/watch?v=h8zxhwG15ic

https://www.youtube.com/watch?v=h8zxhwG15ic

ET Lab Research Team

Color Vision Simulator Color Vision Simulator + Color Adjustment

Provides Color Names and Color Info Color Vision Diagnosis


5. Intelligent color conversion technology development for enhancing the usability of culture contents for color vision defectives(1)

Improves reliability of color blindness adjustments and ease of use for colorblind persons by integrating existing color blindness diagnoses and color vision simulators

- In contrast to the existing color diagnosis products utilizing Ishihara Test, this technology developed by ET Lab research team, achieves objectivity and improves color adjustment performance corresponding to each color blindness types through clinical trials, in-depth interviews and behavioral pattern

When the color adjustment technology is applied, maintains resolutions and sharpness of the original

images compared to the existing products

An Android App Developed by NAMA (Japan) An Android App Developed by ET Lab Research Team


5. Intelligent color conversion technology development for enhancing the usability of culture contents for color vision defectives(2)


7. Development of Smart Contents UX Intelligent framework for Senior Generation

시니어 세대의 신체 및 인지적 특성으로서 감각 및 기능의 저하 등에 따른 스마트 콘텐츠 이용 실태의 문제점을 개선하기 위한 통합 측정 툴을 개발하고, 가이드를 구축

하며, 만족도를 증대시킬 수 있는 검증 시스템 개발

시니어 세대의 신체적 특성과 시인성, 가독성, 명시성 등 시청환경의 물리적 특성을 동시에 고려하여 문화콘텐츠 이용편의성을 확대하고자 스마트 콘텐츠 색채 디자인

기본 가이드를 개발하며, 스마트 콘텐츠 UI/UX 분야에 단계적으로 적용할 수 있는 color space science 기반 색채 가이드를 구축

시니어 세대의 신체 및 인지적 특성을 반영하여 최적의 사용자 경험을 제공하는 스마트 콘텐츠 개발을 지원하는 UX 지능형 프레임워크를 개발


우울증에 대한 예방책은 정말 없는 것인가?

우울증 사회적 인식과 접근 태도 1. 부정적 사회인식 : 신경정신과 치료에 대한 부정적 인식 작용 2. 예방치료의 접근 취약 : 치료를 위한 적절한 시기 방치 3. 전문치료단계로의 이행 미흡 : 우울증 치료를 위한 적극적인 대책 시급 자가측정(self-measurement) 접근 방식 제안

국내 우울증과 자살률 현황

S m a r t H e a l t h C a r e S y s t e m


Drawing A Person 정서심리 자가측정 test

높은 Depression의 예 낮은 Depression의 예

1 2

4 3

1 2

3 4



3. Development of Emotional and Psychological Application Using Character to Reduce Stress of Pediatric Dental Patient The purpose of this research is to develop a service that reduces psychological pain of child patient and improves treatment adherence during the treatment process. Previous treatment for child patient has only taken medical or physical approach, and has not cared for the psychological pain of the patient. Blood gathering, injection and administration of medicine by force involve physical pain and frustration of desire, which causes psychological maladjustment. However, researchers and doctors have considered such maladjustment as a mere side effect and neglected it as a secondary problem. In this context, we made a mobile game application that improves treatment adherence by reducing psychological anxiety. The application uses a virtual character to describe the illness, treatment process and method. Consequently, the application can help increase self-efficacy and self-esteem of child patients so that they will understand the illness and take the treatment positively.


STRESS ! Treatment adherence


Publication : • <Do You dream to be a goddess?>

(2004, Mind Book)

• <Analysis of Historical Culture and Image Codes>

(2006, Dure Media)

• <At the forefront of New Knowledge>

(2008, Hangilsa)

• <Frida Kahlo, Self-Portrait of the Other >

(2011, Idam Books)

• <Homo Imago> : 2014년 문체부 우수학술도서 선정

(2013. 04. Haneun books)

C u l t u r a l A r c h e t y p e : I m a g e & S y m b o l


대분류 소분류 특허 출원 (2) 등록 (2)

웹기반의 심리진단 방법 및 시스템 (등록번호: 10-10749152) 심리진단시스템 및 컴퓨터에 의해 실행 가능한 심리진단프로그램이 기록된 기록매체 (등록번호: 10-1098564)

스마트 헬스 케어 시스템

전자기기 기반 심리

진단 장치 및 판독 시스템

전자기기기반의 심리진단장치 방법 및 컴퓨터 판독 가능한 기록매체 (출원번호 : 10-2010-0052620) 전자기기기반의 심리진단장치 방법 및 컴퓨터 판독 가능한 기록매체 (출원번호 : 10-2010-0052620)

국외(1) 국내(3) 논문

Digital Love Letter: A Handwriting Based Interface for Non-instant Digital Messenger, HCii, 2014.06

청소년 자존감 DAP 인물화 검사 개발 및 디지털화 측정 시스템 방향성 연구, 한국HCI학회, 2013.05 청소년우울증에 대한 인지행동 미술치료의 사례연구, 한국미술치료학회 디지털 미술치료의 가능성과 발전방향, HCI학회, 2009.02

연구내용 및 활용방안

Smart Health Care System 구축에서 가장 중요한 주제는 심리 및 정서 건강의 지속적 변화 상태를 관찰하고, 객관적으로 평가하여, 질병을 예방하고 적절한 치료 대비를 위한 것이다. 본 연구는 집단별(청소년층, 유년층, 고령자층 및 일반 성인층) 정서심리를 대상으로 설정한 스마트 폰 등 전자기기를 기반으로 자가진단 SW 프로그램 및 App을 개발하고, 우울감, 불안증, 조울감, 긴장감, 자존감 등을 감성과학의 객관적 지표로 진단 가능한 자가진단 프로그램이다. 쉬운 접근성과 높은 신뢰성을 바탕으로 심리정서의 변화 상태를 측정하는 획기적 장치를 통해 다양한 대상의 특성에 맞춰 개량 개발 가능하다.

대분류 소분류 국외 특허 출원 (1) 국내 특허 등록 (1) 출원 (3)

국외 출원(미국 출원) APPARATUS AND METHOD FOR COLOR ADJUSTMENT OF CONTENT (한국과학기술원, 출원번호: 14613424)

감성과학 (색채감성)

콘텐츠 색감 조절 장치 및 방

법

국내 특허등록 : 콘텐츠 색감 조절 장치 및 방법 (한국과학기술원, 10-2015-0030907 (접수번호 1-1-2015-0218748-44) 색각이상자용 영상 콘텐츠 색감조정 장치 및 방법 (한국과학기술원, 106201460058780 (접수번호 1616201460D751586D4) 콘텐츠 색감 조절 장치 및 방법 콘텐츠 색감 조절 장치 및 방법 (한국과학기술원, 10-2014-0064186 (접수번호 1-1-2014-0504082-97)

콘텐츠 색감 조절 장치 및 방법(한국과학기술원, 10-2013-0167023)

국외 (2) 국내 (3) 논문

Sound Sketchbook: Synthetic Synesthesia on a Mobile Platform, LEONARDO(A&HCI), 2013.09 Preferred Memory Color Difference between the Deuteranomalous and Normal Color Vision,”Proceedings of IS&T/SPIE Vol. 9395, [9395-44] 색각이상자의 색채 감성 연상, 한국감성과학회, 감성과학, 2013.12 색각이상자의 문화콘텐츠 이용실태 및 색채 감성 연상, 한국색채학회 논문게재, 2015.03 색각이상자를 위한 색 변환 알고리즘 비교, 한국색채학회, 2014.11

연구내용 및 활용방안

사물을 인지하는 과정에서 색채의 중요성은 감성반응에 절대적 영향을 미친다. 상품 디자인과 이미지와 같은 외형에 대한 색채 감성 반응을 객관적으로 조절하기 위한 본 연구 성과는 색각이상자들을 대상으로 색채 인지 반응의 왜곡을 보정하는 색감 조절 장치 및 방법 연구의 적용 및 활용 대상을 확장하여 설정하였지만, 색감 조절의 감성 과학적 임상실험과 알고리즘 구축의 색감 조절 장치 및 방법을 활용하여, 콘텐츠에 대한 시각적 반응의 감성을 조절할 수 있도록 제안하고, 적용하기 위한 장치 및 방법으로서, 다양한 대상층을 설정하고 그 집단의 특성에 맞는 색감 조절 장치 적용 등에 활용 가능하다.

Emotion Technology Lab 보유 특허 내용


Lectures : GCT 502 Aesthetics in the Digital Age GCT 602 Cultural archetype & Image code CTP 372 Media, Culture & Art

Jung Eun Nam Ph.D. Candidate (CT)

A Study On The Integrated Experiential Exhibition Model For Improving The Infant's Creativity

Cultural Contents

Seulkee Kang M.S.Candidate (CT)

A Study on the Use of Color and its Impact in Space

Color Studies

Hyeryeong Jun M.S.Candidate (CT)

A Study on the Elderly User’s Experience on Using Mobile Smart Devices

User Experience Design

Yewon Lee Researcher

The actual situation of smart contents for supporting elderly and critical factors for the aesthetic impressions

Aesthetic and Art theory

Introduction While delivering visual information in images and videos with the use of dots, lines, faces, and colors, this research starts with a question whether lines solely influence emotional response. In visual information, lines may be the most fundamental part which determine forms. To determine the effects of lines, we first obtained biodata from each 20 participants (10 males and 10 females) using the measurement instrument SA-3000P to verify the relationship between degrees of stimulation derived from lines and emotional response. Second, we conducted a survey on paintings of Georges Seurat who derived neo-impressionism from impressionism. Based on theories of lines, the survey consists of three parts, 1) Seurat's rhythmical lines in his paintings, 2) Superville's three schemes of expansive, horizontal, and convergent lines applied in face, and 3) Bouhuy's curved lines applied in face. 50 participants (27 males and 23 females) were assigned to participate in the survey and an evaluation scale was constructed on the basis of Russell's circumplex model with eight emotion categories. The result shows that people feel certain emotions strongly as they perceive different types of lines used in paintings and facial expressions. Thus, this research proposes to apply the result to analysis of art and digital contents to explore the relationship between visual perception and corresponding emotions. Methodology Results The result of the survey is shown in a radar chart of eight questionnaire items of emotions.

Fig 1. Circumplex Model of Emotion

Embodiment of Gestures and Emotions: Georges Seurat's Rhythmical Lines

Russell’s circumplex model of emotion shows four dimensions on the basis of the level of valence (negative-positive) and arousal (low arousal-high arousal). This systematic arrangement of emotion provides a measure of different emotional experiences. Based on x and y axis, diagonals in the x and y plane are derived as a combination of the level of valence and arousal (Figure 1). For measuring emotional response, evaluation scale in a survey was designed based on Russell’s circumplex model of emotion where eight groups of emotions are presented according to the combination of the level of valence and arousal. For one axis of emotions, participants were assigned to choose from -4 to 4 for determining the relationship between perceiving different lines and emotional response.

Emotion Technology Lab

Emotional Response to Korean Drama among Three Countries’ : with Drama ‘Goblin’

Background Purpose

• Although the demand and consumption of Hallyu contents are affected by each country's sentiment and environment variables, little analysis and research have been conducted in this regard.

• The content demands are heavily weighted toward Asian countries because of a lack of global-market understanding.

• Describe how people in other countries differently perceive the Korean drama “Goblin”

• Examine which factors are associated with the number of times a person shows emotional interest in the content.

• Suggest guidelines for evaluating how people perceive Korean culture differently. Method

Fig 1. Russell’s Circumplex Model of Emotions

Among three countries, i.e., Korea, Japan, and the Unites States, we found the following eight significant factors in Russell’s model that affect the number of times a person shows emotional interest: “happy,” “glad,” “pleased,” “sad,” “gloomy.” ”astonished,” “satisfied,” and “excited.” Based on this result, we can presume that “happy” is the main factor that could be associated with an individual’s interest when watching Goblin because the higher the mean decrease accuracy, the better emotional level is.

Results

We use the emotional prototype model proposed by Russell [1980] to extract and distinguish emotional words. Russell summed up the emotional elements in 28 words. horizontal and vertical axes in two dimensions shows Valence and Pleasantness, respectively. The horizontal axis consists of Pleasantness and Unpleasantness, and vertical axis is divided into Inaction and Arousal.

As we can see in Fig. 3, the distance of “happy” and “sad” plays a key role in drama consumption among the three countries. In Korea, “happy” is significantly related to “sad,” whereas in Japan, “pleased,” which is a less impactful word than “happy,” is associated with “sad” but to a lesser extent compared with the case of Korea. In the United States, “happy” is less connected to “sad.” This result shows that emotional responses to the same content from country to country. Future research should focus on determining which sensory elements play an important role in determining emotional response.

Fig 2. Variable Importance for the Emotion Words

Fig 3. Types of Emotional Response of those affected by drama ‘goblin’

Emotion Technology Lab


Merci à vous !

[email protected]

[email protected]

emotion technology lab kaist graduate school of culture...

Documents