interactive visual knowledge aggregation · chair (research) in the school of art, design and...

InteractiveVisualKnowledgeAggregationOldandNewSilkRoadsasaShowcaseforChallengesin

SocialMediaTechnologies,Communication,andInformatics

Dr.AndreaNANETTI,BAMAPhDAssoc.Prof.andAssociateChair(Research)NTUSchoolofArt,DesignandMedia

Athens,October10,2017

incollaborationwith- MicrosoftResearchBeijing- GuangzhouRuifeng Co.Ltd

Beijing,MicrosoftResearchAsiaOctober10,2014Kickoffmeetingtostarttheproject“AugmentingMicrosoftBingSearchthroughAutomaticNarrativesintheInteractiveGlobalHistories”(MicrosoftResearchGrant,PIAndreaNanetti,Co-PISiewAnnCheongatNTUandChin-YewLinatMSRA,Sept.2014– June2015)

9:00-9:30OpeningbyChin-Yew,Andrea,andSiewAnn)

9:30-12:30Theinviteespresenttheirdatabases- AngeloCattaneo (RenaissanceMapsofAsia)- StefanoBertocci andSaraPorzilli (Michelangeloasavisualgatewaytodigitaldata)

14-17Openthediscussionawriteaworkingagenda1)solutionstoconnectotherdatabasestotheEngineeringHistoricalMemory(EHM)2)useBingtoconnect scholarlydatabases toWikipediaandotherrelevantinformationsourcesthroughtheexperimentalontologyproposedbyEHM

09/10/17

GuangzhouRuifeng Culture&CommunicationCo.,Ltd.September2,20147Meetingtodiscusstheprojectonprojectionmappingforthe2017GuangzhouInternationalLightFestival

PRODUCTIONCREDITSELLIPTICDOMEANIMATION“THESILKROADS”

Production(Ruifeng,NTU,andGAFA)

Producer/Writer:AndreaNanettiDirector:HannesRallDomeTheatreConsultant:BenSheddVisualConceptandLayoutFilm:ShenShen Luo

Storyboards:HannesRallTechnicaladvisor:BenjaminSeideVisualdevelopmentanddigitalpainting:ChuaTinGiapCalvinVisualdevelopment,digitalpaintingandcharacteranimation:TessaLowYunVisualdevelopment,motiongraphicsdesignandanimation,scenes9-16:Jochen Rall

09/10/17

Triplets(threefolddistinctions)HannahArendt,TheHumanCondition,IntroductionbyMargaretCanovan,p.vii.ChicagoandLondon:TheUniversityofChicagoPress.“HannahArendtispreeminently thetheoristofbeginnings.Allherbooksarethetalesoftheunexpected…,andreflectionsonthehumancapacitytostartsomethingnewpervadeherthinking… Oftenthewaysheshedslightintoneglectedcornersofexperienceisbymakingnewdistinctions,manyofthemthreefold,asifconventionaldichotomiesweretooconstrictingforherintellectualimagination.TheHumanCondition iscrammedwithdistinctions:betweenlabor,work,andaction;betweenpower,violence,andstrength,betweentheearthandtheworld;…

09/10/17 ©2017AndreaNanetti

playingtriplets

Liberalarts,FineArts,Humanities

tripletLiberalArts1.Academicdisciplines,includingliterature,history,languages,philosophy,mathematics,andgeneralsciences;intendedtoprovidegeneralknowledgeandintellectualskills(ratherthanoccupationalorprofessionalskills).2.(DuringtheMiddleAges)thedisciplinescomprisingthetriviumandquadrivium.

FineArts1creativearts,especiallyvisualarts,whoseproductsaretobeappreciatedprimarilyorsolelyfortheirimaginative,aesthetic,orintellectualcontent: theconvergenceofpopularcultureandfineart.2anactivityrequiringgreatskilloraccomplishment: he'llhavetolearnthefineartofpersuasion.

HumanitiesThewordhumanitas wascoinedbyCicero(106-43BCE)todescribethestudyofclassicalliterature,especiallypoetry,intheformationofanidealpublicservant(orator).DuringtheRenaissance,Cicero'sinjunctiontocultivate'studia humanitatis'wasunderstoodas:grammar,rhetoric,poetry,history,andmoralphilosophy.


Triplet

Drawing

a pictureordiagrammadewithapencil,pen,or crayon ratherthanpaint,especiallyonedrawninmonochrome:

Illustration[ameaningfulinsight]apictureillustratingabook,newspaper,etc.:• anexampleservingtoclarifyorprovesomething• theactionorfactofillustratingsomething,eitherpictoriallyorbyexemplificationIllustrate:in thesense ‘illuminate,shedlighton’

Animationthetechniqueof photographing successivedrawings orpositionsofpuppetsormodelstocreateanillusionofmovement when the movie is shown asasequence


Visualization:Optimisation(Computerengineering)

Visualisation[thesimplerepresentation]

• the representationofanobject,situation,orsetofinformationasachart or otherimage

• theformation of a mental imageofsomething

Visualize:1817, first attested in, and perhaps coined by, Coleridge(dictionary.com)

ComputerGraphics

themanipulationofelectronicimages bymeansof acomputerinordertocreatemovingimages.

ComputerAnimation

visual images produced by computerprocessing.


P10

The Visual Analytics Process

The visual analytics process ischaracterised through interactionbetween data, visualisations, modelsabout the data, and the usersin order to discover knowledge

The visual analytics process aims attightly coupling automated analysismethods and interactive visualrepresentations.

P11

Keim, Daniel, Jörn Kohlhammer, Geoffrey Ellis, and Florian Mansmann (eds.). Mastering the Information Age Solving Problems with Visual Analytics. Goslar, Germany: EurographicsAssociation, 2010

09/10/17

(VISUAL)KNOWLEDGEAGGREGATION≠INFOGRAPHICS

2011Melda N.Yildizhttps://www.slideshare.net/mnyildiz/visualization-concept-maps-9931446

FraMauroMapoftheWorld(ca.1450).Venice,Marciana LibrarySourceWikipedia.CC-PD-Mark09/10/17 ©2017AndreaNanetti

• 三幅地图，三个时代，三种风格


KnowledgeAggregationinDecisionScienceAndreaNANETTI,AngeloCATTANEO,SiewAnnCHEONG,Chin-YewLIN,MapsasKnowledgeAggregators:fromRenaissanceItalyFraMaurotoWebSearchEngines,in«TheCartographicJournal»(©TheBritishCartographicSociety),specialissue,52/2(May2015),[publishedon26November2015],pp.159-167.Intheknowledgemanagementliterature,wefindtheclassificationofhumanawarenessintoadata,information,knowledge,andwisdom (DIKW)hierarchy(Ackoff,1989;Berlinger etal.,2004;Rowley,2007).AccordingtoAckoff (1989),dataaremerelysymbolsthatweassociatewithspecificfeaturesintheoutsideworld,informationiscontextualizeddatathatallowsustoanswerquestions,knowledgeisproceduralized informationthatallowsustoactonandsolveproblems,andwisdomisknowingunderwhichsituationstoact.Todowellintheworldwemustmoveupthishierarchyofknowing,andthegreatestchallengewefaceisthefragmentationofknowledgeandinformation.Inotherwords,theproblemwehavetoovercomeistheproblemofknowledgeaggregation,encounteredindecisionscience(Roy,2005),organizationallearning(Grant,1996;Grundspenkis,2007),andevenbioinformatics(Belleauetal.,2008;Miotto etal.,2008)andmedicine(Hahnetal.,1999;Malterud,2011;McDonagh etal.,2011).


TheSilkRoadasacasestudyforheritagescience

ANEWSCIENCEattheInterfaceof

(Digital)HUMANITIESand(Data)SCIENCEWheredataareTHEdata

(i.e.TreasureofHumanExperiencesdata)


THEVISION:Understanding

FROMWHEREwecomefromweunderstandWHOWEARE

UnderstandingWHEREweareNOWweMIGHTinfluence

WHATwewanttobecome


WhattheWorld’sEmptiestInternationalAirportSaysAboutChina’sInfluence,byBrookLarmer

Thefour-lane highwayleadingoutoftheSriLankantownofHambantotagetssolittletrafficthatitsometimesattractsmorewildelephantsthanautomobiles.Thepachydermsareintelligent— theyseemtousetheroadasajungleshortcut— butnotintelligentenough,alas,toappreciatethepuntheircourseembodies:Itlinkstogetheraseriesofwhiteelephants,i.e.boondoggles,builtandfinancedbytheChinese.Beyondthelonelyhighwayitself,thereisa35,000-seatcricketstadium,analmostvacant$1.5billiondeepwater portand,16milesinland,a$209millionjewelknownas“theworld’semptiestinternationalairport.”Mattala RajapaksaInternationalAirport,thesecond-largestinSriLanka,isdesignedtohandleamillionpassengersperyear.Itcurrentlyreceivesaboutadozenpassengersperday.Businessissoslowthattheairporthasmademoremoneyfromrentingouttheunusedcargoterminalsforricestoragethanfromflight-relatedactivities.Inoneburstofactivitylastyear,350securitypersonnelarmedwithfirecrackersweredeployedtoscareoffwildanimals,theairport’smostcommonvisitors.

TheNewYorkTimesMagazine,13Sept.201709/10/17

Immersive Interactive Knowledge Aggregation

09/10/17


AndreaNanettireceivedhisuniversityeducationinMedievalandRenaissancestudiesbetween1986and2000inItaly(UniversityofBologna),France(UniversityofParisI-SorbonneandParisXNanterre),Germany(UniversityofCologne),Greece(NationalHellenicResearchFoundation),andUSA(BrownUniversity),wherehehasbeeninstructedbyworld’sleadingprofessorstoworkonresearchquestionsandsolutionsthroughthecross-fertilizationofdifferentmethodologies(historical,philological,diplomatic,aesthetic,anthropological,andcomputational).Asascholar—whostartedhisresearchvocationinhistoricalstudiesattheadventofcomputeroperatingsystemswithgraphicaluserinterfaces—hehasalwaysbeenfascinatedbytheexponentialgrowthofinterdependenciesbetweenartificialactions(i.e.,madebyhumans)andcomputationaloperations(i.e.,completedbyelectronicdevicesabletostoreandprocessdata,typicallyinbinaryform,accordingtoinstructionsgiventotheminavariableprogram)intermsofbothquantityandquality.Withthisinterest,heisproposingthetheoreticalneedtodirecttraditionaldisciplinaryknowledgetowardsaformalscienceofheritageabletostudywhatkindofdataandinformation—nowencodedincomplexinteractionsofwritten,pictorial,sculptural,architectural,anddigitalrecords,oralmemories,practices,andperformedrituals(i.e.,thetreasureofhumanexperiences)—maybeinheritedbymachinelearningalgorithms.Dr. NanettiliveswithhisfamilyinSingapore,atNanyangTechnologicalUniversity,whereheisAssociateChair(Research)intheSchoolofArt,DesignandMedia,SeniorResearchTeammemberintheComplexityInstitute,withacourtesyappointmentintheHistoryProgramme.

Selectedpublications:AndreaNANETTI andSiewAnnCHEONG,ComputationalHistory:FromBigDatatoBigSimulations,inShu-Heng CHEN (Ed.),BigDatainComputationalSocialScienceandHumanities,SpringerSerieson“ComputationalSocialSciences”.InvitedforsubmissioninOctober2015.SubmittedforpublicationinJanuary2017.Forthcoming.WenYuan LIU,AndreaNANETTI,SiewAnnCHEONG.KnowledgeEvolutioninPhysicsResearch:AnAnalysisofBibliographicCouplingNetworks,in«arXiv preprint»,Vol.4/4(2017)arXiv:1704.00875,andinPLoS ONE12(9):e0184821.https://doi.org/10.1371/journal.pone.0184821.AndreaNANETTI,Chin-YewLIN,SiewAnnCHEONG.(2016).ProvenanceandValidationfromtheHumanitiestoAutomaticAcquisitionofSemanticKnowledgeandMachineReadingforNewsandHistoricalSourcesIndexing/Summary. TheAsianReviewofWorldHistories,4/1(Jan.2016),125-132.

interactive visual knowledge aggregation · chair (research) in the school of art, design and...

Documents