this movie was great! would watch again the movie was gross and …gdurrett/courses/sp2019/... ·...

2
ELMo ELMo Tasks: Sen.ment the movie was gross and overwrought, but I liked it this movie was great! would watch again this movie was not really very enjoyable + + Why are context-dependent embeddings useful here? Peters et al. (2018) ELMo Tasks: NER Barack Obama will travel to Hangzhou today for the G20 meeBng . PERSON LOC ORG B-PER I-PER O O O B-LOC B-ORG O O O O O Why are context-sensi.ve embeddings useful here? Peters et al. (2018) ELMo Tasks: SRL Iden.fy arguments of the verb Why are context-dependent embeddings useful here? Peters et al. (2018)

Upload: others

Post on 20-Feb-2021

4 views

Category:

Documents


0 download

TRANSCRIPT

  • ELMo

    ELMoTasks:Sen.ment

    themoviewasgrossandoverwrought,butIlikedit

    thismoviewasgreat!wouldwatchagain

    thismoviewasnotreallyveryenjoyable

    ++—

    ‣Whyarecontext-dependentembeddingsusefulhere?

    Petersetal.(2018)

    ELMoTasks:NER

    BarackObamawilltraveltoHangzhoutodayfortheG20meeBng.

    PERSON LOC ORG

    B-PER I-PER O O O B-LOC B-ORGO O O O O

    ‣Whyarecontext-sensi.veembeddingsusefulhere?

    Petersetal.(2018)

    ELMoTasks:SRL

    ‣ Iden.fyargumentsoftheverb

    ‣Whyarecontext-dependentembeddingsusefulhere?

    Petersetal.(2018)

  • ELMo

    ‣ SST5=sen.ment,SQuAD=QA(cominglater)

    Petersetal.(2018)

    ‣ Training:1BwordsoftexttakenfromMTdata(news,etc.)

    ‣ Largegainsacrossmanytasks

    ELMo

    Petersetal.(2018)

    ‣ Nearestneighborsofwordsincontext

    ELMo

    ‣ Highlyflexible:canuseasanembeddinglayerfornearlyanytask

    ‣ Canbebigandslow:bigLSTMscansuckupGPUmemory

    ‣ Strictlybe]erthanword2vecifyoucanaffordit

    ‣ AllenNLP:callingELMoisjustoneline,plentyofmodelsfordifferenttasksbuiltontopofit

    Petersetal.(2018)