lawrence snyder university of washington, seattle

LawrenceSnyderUniversityofWashington,Seattle

© Lawrence Snyder 2004

Progress has been tremendous

  PizzapartyTuesdayinAllenHall(CSEbuilding)  Labsthisweekaredevotedtopairprogramming;itisaperfecttimetowork,butofcourse,youmayalsoneedtoworkoutsideofthosetimes

2/14/11 © 2011 Larry Snyder, CSE 2

  Lasttime,weemphasizedakeyfactofalgorithmdesign…

  Youmustbeabletoexplainwhyanalgorithmworks  It’sdifferentforeveryalgorithm  Youneedtoknow,butoftenyoumayalsohavetoexplainittosomeoneelse

  Ourillustrationwasexplainingwhytwosortingalgorithmsworked

2/14/11 © 2011 Larry Snyder, CSE 3

4

  TheinventorsofENIAC,1stcomputer,saidit“thinkswithelectricity”▪  Docalculators“think”?▪  Doesperformingarithmetic,whichisentirelyalgorithmic,requirethinking?▪  Once,performingarithmetic,wasthoughttobedivinelyormagicallyconferredability

5

  TheinventorsofENIAC,1stcomputer,saidit“thinkswithelectricity”▪  Docalculators“think”?▪  Doesperformingarithmetic,whichisentirelyalgorithmic,requirethinking?▪  Once,performingarithmetic,wasthoughttobedivinelyormagicallyconferredability

The Problem: Many human activities look like thinking until they are understood (to be algorithmic)

6

  A.M.Turing,computerpioneer,worriedaboutintelligenceinhumans&machines;proposedatest(1950)▪  Awarethatitisintelligenceuntilit’sunderstood,Turingdevisedatestwiththisexperimentalsetup:Acomputer(A)andaperson(B)areconnectedtoanexaminer,whocanaskquestionsusingtexttodeterminewhichiswhich

7

  Formulatequestionsapersoncananswerbutacomputercan’t

InterrogatorInthefirstlineofyoursonnetwhichreads'ShallIcomparetheetoasummer'sday',wouldnot'aspringday'doaswellorbetter?

ComputerItwouldn'tscan.InterrogatorHowabout'awinter'sday'?Thatwouldscanallright.ComputerYes,butnobodywantstobecomparedtoawinter'sday.InterrogatorWouldyousayMr.PickwickremindedyouofChristmas?ComputerInaway.InterrogatorYetChristmasisawinter'sday,andIdonotthinkMr

PickwickwouldmindthecomparisonComputerIdon'tthinkyou'reserious.Byawinter'sdayonemeansa

typicalwinter'sday,ratherthanaspecialonelikeChristmas.

2/14/11 © 2011 Larry Snyder, CSE 8

  CompletelyAutomatedPublicTuringTestToTellComputersandHumansApart  DevelopedatCMUbyLuisVanAhnandhisteam

2/14/11 © 2011 Larry Snyder, CSE 9

10

  JoelWeizenbaum’s“Doctor”[a\k\a“Eliza”]wasaprogramthatappearedintelligent

User:I’mdepressed.Doctor:Whyareyoudepressed?User:Mymotherisnotspeakingtome.Doctor:Tellmeaboutyourmother.User:Shedoesn’twantmetomajorinCS.Doctor:No?User:No,shewantsmetogointomedicine.

Doctor was basically scripted

11

  Thestudyofmakingcomputersactintelligently▪  Theyalreadyactintelligent…e.g.theycancorrectyourspellingmistakes▪  Isthisintelligentbehavior?MostAIresearcherswouldsay“no”…algorithmic▪  PlayinggrandmasterlevelchessinatournamentbecameanAIgoal(1952) ‐Minimizesrealworldknowledge ‐Cleargoal,formalsystem

12

  Chessisagame,soitusesagametree▪  Ateachnodeisa‘board’‐‐easilydigitized▪  Belowitareallboardscreatedin1move;belowthose,allboardsneedinganothermove

Anobjectivefunctionevaluates“goodness”oftheposition:goforhighest…opponentgoesforlowest

13

  AnIBMsystem,DeepBlue,playedworldchampionGaryKasparov▪  In1996Kasparovwon,butDeepBlueplayed1gamewell!!!Thiswasafirst.▪  InMay11,1997DeepBluewon3.5‐2.5

Deep Blue is a 32 processor parallel computer with 256 “chess processors” that can consider 200,000,000 chess positions per second + opens + ends

14

  DoesDeepBlue’sperformanceshowthatacomputercanbeintelligent?▪  No‐‐itrepeat’sitsdesignersintelligence(weakrebuttal)▪  Yes‐‐it’sbetterthananyoneintheworldatsomethingpeoplefindinterestingandfun▪  Maybe‐‐itshowsintelligenceinchess,butcanitapplyitsintelligenceelsewhere?

What do you think?

2/14/11 © 2011 Larry Snyder, CSE 15

  ComparedtoDeepBlue,Watsonismuchmoresophisticatedindesign,organization  runson~2,500parallelCPUs,eachcapableofupto33billionoperationsasecond;sizeofsmallRV

  crawledandorganized200millionpagesofdata  “expert”analyzers—morethan100differenttechniquesrunningconcurrentlytoanalyzenaturallanguage,appraisesources,proposehypotheses,mergeresultsandranktopguesses.

2/14/11 © 2011 Larry Snyder, CSE 16

  Itmaybeanticlimacticforthepublic,buttheCScommunityisalla‐buzzbecausethisisREALLYdifficulttechnically

It’stoughto“get”apun!

2/14/11 © 2011 Larry Snyder, CSE 17

  Chessseemsharder,butit’snot  Chesshasfixedrules,littlerealworlddataneeded  Jeopardy,morefreeformusingonlyrealdata

  Otherdifferences  Inchessthe“problem”isknownbeforehand,butinJeopardy,someoneelsesetsuptheproblem

  Inchess,decisionsarebasedonaformula,butinJeopardymanyformsofevaluationareneeded(aproblemsolvedbyprobabilities)

  Inchessthereisverylittlepre‐planning,butinJeopardy,organizingthedataisthekey

2/14/11 © 2011 Larry Snyder, CSE 18

19

  Computersdothingsdeemedcreativeinpast▪  CreatedesignsinthestyleofPietMondrian,JacksonPollackorJosefAlbers…

Is it Art? Is it Creative?

20

  Creativityhastwoforms:“flashoutoftheblue”and“incrementalrevision”▪  “Flash,”i.e.inspiration,israre;isitjustluck?▪  “Revision”,i.e.hardwork,iscommonandtoalargedegreealgorithmic

Advertising agencies are famous for creativity, but in a recent study, 89% of all award-winning ads were an application of one of six templates -- design algorithm

  AnexperimentattheU.ofOregon…composemusicinthestyleofBach

  Threeparticipants:Bach,UofOProfessor,EPIprogram

  Andthewinneris…

AudienceThought:Bach’s Professor’s EPI’s workwasworkwasworkwas ProfessorEPIprogramBach

2/14/11 © 2011 Larry Snyder, CSE 21

 WatsonlookstobeamajoradvanceinAIandabigsteptowardsansweringTuring’sTest

WhatisWatson?

2/14/11 © 2011 Larry Snyder, CSE 22