interactive visual knowledge aggregation · 2017-11-13 · between data, visualisations, models...

InteractiveVisualKnowledgeAggregationOldandNewSilkRoadsasaShowcaseforChallengesin

SocialMediaTechnologies,Communication,andInformatics

Dr.AndreaNANETTI,BAMAPhDAssoc.Prof.andAssociateChair(Research)NTUSchoolofArt,DesignandMedia

Athens,October10,2017

incollaborationwith- MicrosoftResearchBeijing- GuangzhouRuifeng Co.Ltd

Beijing,MicrosoftResearchAsiaOctober10,2014Kickoffmeetingtostarttheproject“AugmentingMicrosoftBingSearchthroughAutomaticNarrativesintheInteractiveGlobalHistories”(MicrosoftResearchGrant,PIAndreaNanetti,Co-PISiewAnnCheongatNTUandChin-YewLinatMSRA,Sept.2014– June2015)

9:00-9:30OpeningbyChin-Yew,Andrea,andSiewAnn)

9:30-12:30Theinviteespresenttheirdatabases- AngeloCattaneo (RenaissanceMapsofAsia)- StefanoBertocci andSaraPorzilli (Michelangeloasavisualgatewaytodigitaldata)

14-17Openthediscussionawriteaworkingagenda1)solutionstoconnectotherdatabasestotheEngineeringHistoricalMemory(EHM)2)useBingtoconnect scholarlydatabases toWikipediaandotherrelevantinformationsourcesthroughtheexperimentalontologyproposedbyEHM

09/10/17

GuangzhouRuifeng Culture&CommunicationCo.,Ltd.September2,20147Meetingtodiscusstheprojectonprojectionmappingforthe2017GuangzhouInternationalLightFestival

PRODUCTIONCREDITSELLIPTICDOMEANIMATION“THESILKROADS”

Production(Ruifeng,NTU,andGAFA)

Producer/Writer:AndreaNanettiDirector:HannesRallDomeTheatreConsultant:BenSheddVisualConceptandLayoutFilm:ShenShen Luo

Storyboards:HannesRallTechnicaladvisor:BenjaminSeideVisualdevelopmentanddigitalpainting:ChuaTinGiapCalvinVisualdevelopment,digitalpaintingandcharacteranimation:TessaLowYunVisualdevelopment,motiongraphicsdesignandanimation,scenes9-16:Jochen Rall

09/10/17

Triplets(threefolddistinctions)HannahArendt,TheHumanCondition,IntroductionbyMargaretCanovan,p.vii.ChicagoandLondon:TheUniversityofChicagoPress.“HannahArendtispreeminently thetheoristofbeginnings.Allherbooksarethetalesoftheunexpected…,andreflectionsonthehumancapacitytostartsomethingnewpervadeherthinking… Oftenthewaysheshedslightintoneglectedcornersofexperienceisbymakingnewdistinctions,manyofthemthreefold,asifconventionaldichotomiesweretooconstrictingforherintellectualimagination.TheHumanCondition iscrammedwithdistinctions:betweenlabor,work,andaction;betweenpower,violence,andstrength,betweentheearthandtheworld;…

09/10/17 ©2017AndreaNanetti

playingtriplets

Liberalarts,FineArts,Humanities

tripletLiberalArts1.Academicdisciplines,includingliterature,history,languages,philosophy,mathematics,andgeneralsciences;intendedtoprovidegeneralknowledgeandintellectualskills(ratherthanoccupationalorprofessionalskills).2.(DuringtheMiddleAges)thedisciplinescomprisingthetriviumandquadrivium.

FineArts1creativearts,especiallyvisualarts,whoseproductsaretobeappreciatedprimarilyorsolelyfortheirimaginative,aesthetic,orintellectualcontent: theconvergenceofpopularcultureandfineart.2anactivityrequiringgreatskilloraccomplishment: he'llhavetolearnthefineartofpersuasion.

HumanitiesThewordhumanitas wascoinedbyCicero(106-43BCE)todescribethestudyofclassicalliterature,especiallypoetry,intheformationofanidealpublicservant(orator).DuringtheRenaissance,Cicero'sinjunctiontocultivate'studia humanitatis'wasunderstoodas:grammar,rhetoric,poetry,history,andmoralphilosophy.

09/10/17 ©2017AndreaNanetti

Triplet

Drawing

a pictureordiagrammadewithapencil,pen,or crayon ratherthanpaint,especiallyonedrawninmonochrome:

Illustration[ameaningfulinsight]apictureillustratingabook,newspaper,etc.:• anexampleservingtoclarifyorprovesomething• theactionorfactofillustratingsomething,eitherpictoriallyorbyexemplificationIllustrate:in thesense ‘illuminate,shedlighton’

Animationthetechniqueof photographing successivedrawings orpositionsofpuppetsormodelstocreateanillusionofmovement when the movie is shown asasequence

09/10/17 ©2017AndreaNanetti

Visualization:Optimisation(Computerengineering)

Visualisation[thesimplerepresentation]

• the representationofanobject,situation,orsetofinformationasachart or otherimage

• theformation of a mental imageofsomething

Visualize:1817, first attested in, and perhaps coined by, Coleridge(dictionary.com)

ComputerGraphics

themanipulationofelectronicimages bymeansof acomputerinordertocreatemovingimages.

ComputerAnimation

visual images produced by computerprocessing.

09/10/17 ©2017AndreaNanetti

P10

The Visual Analytics Process

The visual analytics process ischaracterised through interactionbetween data, visualisations, modelsabout the data, and the usersin order to discover knowledge

The visual analytics process aims attightly coupling automated analysismethods and interactive visualrepresentations.

P11

Keim, Daniel, Jörn Kohlhammer, Geoffrey Ellis, and Florian Mansmann (eds.). Mastering the Information Age Solving Problems with Visual Analytics. Goslar, Germany: EurographicsAssociation, 2010

09/10/17

(VISUAL)KNOWLEDGEAGGREGATION≠INFOGRAPHICS

2011Melda N.Yildizhttps://www.slideshare.net/mnyildiz/visualization-concept-maps-9931446

FraMauroMapoftheWorld(ca.1450).Venice,Marciana LibrarySourceWikipedia.CC-PD-Mark09/10/17 ©2017AndreaNanetti

09/10/17 ©2017AndreaNanetti

• 三幅地图，三个时代，三种风格

09/10/17 ©2017AndreaNanetti

KnowledgeAggregationinDecisionScienceAndreaNANETTI,AngeloCATTANEO,SiewAnnCHEONG,Chin-YewLIN,MapsasKnowledgeAggregators:fromRenaissanceItalyFraMaurotoWebSearchEngines,in«TheCartographicJournal»(©TheBritishCartographicSociety),specialissue,52/2(May2015),[publishedon26November2015],pp.159-167.Intheknowledgemanagementliterature,wefindtheclassificationofhumanawarenessintoadata,information,knowledge,andwisdom (DIKW)hierarchy(Ackoff,1989;Berlinger etal.,2004;Rowley,2007).AccordingtoAckoff (1989),dataaremerelysymbolsthatweassociatewithspecificfeaturesintheoutsideworld,informationiscontextualizeddatathatallowsustoanswerquestions,knowledgeisproceduralized informationthatallowsustoactonandsolveproblems,andwisdomisknowingunderwhichsituationstoact.Todowellintheworldwemustmoveupthishierarchyofknowing,andthegreatestchallengewefaceisthefragmentationofknowledgeandinformation.Inotherwords,theproblemwehavetoovercomeistheproblemofknowledgeaggregation,encounteredindecisionscience(Roy,2005),organizationallearning(Grant,1996;Grundspenkis,2007),andevenbioinformatics(Belleauetal.,2008;Miotto etal.,2008)andmedicine(Hahnetal.,1999;Malterud,2011;McDonagh etal.,2011).

09/10/17 ©2017AndreaNanetti

TheSilkRoadasacasestudyforheritagescience

ANEWSCIENCEattheInterfaceof

(Digital)HUMANITIESand(Data)SCIENCEWheredataareTHEdata

(i.e.TreasureofHumanExperiencesdata)

09/10/17 ©2017AndreaNanetti

THEVISION:Understanding

FROMWHEREwecomefromweunderstandWHOWEARE

UnderstandingWHEREweareNOWweMIGHTinfluence

WHATwewanttobecome

09/10/17 ©2017AndreaNanetti

WhattheWorld’sEmptiestInternationalAirportSaysAboutChina’sInfluence,byBrookLarmer

Thefour-lane highwayleadingoutoftheSriLankantownofHambantotagetssolittletrafficthatitsometimesattractsmorewildelephantsthanautomobiles.Thepachydermsareintelligent— theyseemtousetheroadasajungleshortcut— butnotintelligentenough,alas,toappreciatethepuntheircourseembodies:Itlinkstogetheraseriesofwhiteelephants,i.e.boondoggles,builtandfinancedbytheChinese.Beyondthelonelyhighwayitself,thereisa35,000-seatcricketstadium,analmostvacant$1.5billiondeepwater portand,16milesinland,a$209millionjewelknownas“theworld’semptiestinternationalairport.”Mattala RajapaksaInternationalAirport,thesecond-largestinSriLanka,isdesignedtohandleamillionpassengersperyear.Itcurrentlyreceivesaboutadozenpassengersperday.Businessissoslowthattheairporthasmademoremoneyfromrentingouttheunusedcargoterminalsforricestoragethanfromflight-relatedactivities.Inoneburstofactivitylastyear,350securitypersonnelarmedwithfirecrackersweredeployedtoscareoffwildanimals,theairport’smostcommonvisitors.

TheNewYorkTimesMagazine,13Sept.201709/10/17

Immersive Interactive Knowledge Aggregation

09/10/17

09/10/17 ©2017AndreaNanetti

AndreaNanettireceivedhisuniversityeducationinMedievalandRenaissancestudiesbetween1986and2000inItaly(UniversityofBologna),France(UniversityofParisI-SorbonneandParisXNanterre),Germany(UniversityofCologne),Greece(NationalHellenicResearchFoundation),andUSA(BrownUniversity),wherehehasbeeninstructedbyworld’sleadingprofessorstoworkonresearchquestionsandsolutionsthroughthecross-fertilizationofdifferentmethodologies(historical,philological,diplomatic,aesthetic,anthropological,andcomputational).Asascholar—whostartedhisresearchvocationinhistoricalstudiesattheadventofcomputeroperatingsystemswithgraphicaluserinterfaces—hehasalwaysbeenfascinatedbytheexponentialgrowthofinterdependenciesbetweenartificialactions(i.e.,madebyhumans)andcomputationaloperations(i.e.,completedbyelectronicdevicesabletostoreandprocessdata,typicallyinbinaryform,accordingtoinstructionsgiventotheminavariableprogram)intermsofbothquantityandquality.Withthisinterest,heisproposingthetheoreticalneedtodirecttraditionaldisciplinaryknowledgetowardsaformalscienceofheritageabletostudywhatkindofdataandinformation—nowencodedincomplexinteractionsofwritten,pictorial,sculptural,architectural,anddigitalrecords,oralmemories,practices,andperformedrituals(i.e.,thetreasureofhumanexperiences)—maybeinheritedbymachinelearningalgorithms.Dr. NanettiliveswithhisfamilyinSingapore,atNanyangTechnologicalUniversity,whereheisAssociateChair(Research)intheSchoolofArt,DesignandMedia,SeniorResearchTeammemberintheComplexityInstitute,withacourtesyappointmentintheHistoryProgramme.

Selectedpublications:AndreaNANETTI andSiewAnnCHEONG,ComputationalHistory:FromBigDatatoBigSimulations,inShu-Heng CHEN (Ed.),BigDatainComputationalSocialScienceandHumanities,SpringerSerieson“ComputationalSocialSciences”.InvitedforsubmissioninOctober2015.SubmittedforpublicationinJanuary2017.Forthcoming.WenYuan LIU,AndreaNANETTI,SiewAnnCHEONG.KnowledgeEvolutioninPhysicsResearch:AnAnalysisofBibliographicCouplingNetworks,in«arXiv preprint»,Vol.4/4(2017)arXiv:1704.00875,andinPLoS ONE12(9):e0184821.https://doi.org/10.1371/journal.pone.0184821.AndreaNANETTI,Chin-YewLIN,SiewAnnCHEONG.(2016).ProvenanceandValidationfromtheHumanitiestoAutomaticAcquisitionofSemanticKnowledgeandMachineReadingforNewsandHistoricalSourcesIndexing/Summary. TheAsianReviewofWorldHistories,4/1(Jan.2016),125-132.