Upload File

challenges in quality assurance for machine learning-based...

  • Home
  • Documents
  • Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
32

Upload: others

Post on 27-May-2020

2 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
mailto:[email protected]
http://research.nii.ac.jp/~f-ishikawa/en/
Page 2: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

◼

Page 3: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 4: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

Page 5: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

Page 6: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

Page 7: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

Page 8: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 9: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

Page 10: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 11: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

◼

◼

◼

Page 12: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

◼

◼

◼

◼

◼

◼

◼

◼

◼

Page 13: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

◼

◼

◼

◼

Page 14: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

◼

◼

Page 15: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 16: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

◼

◼

◼

◼

◼

Page 17: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 18: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 19: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 20: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

0 20 40 60 80 100

Architecture Design

Training Data

Operation

Project Management

Updates

Debugging

Testing & Quality Evaluation / Assurance

Decision Making with Customers

Page 21: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

◼

◼

Page 22: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 23: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

Page 24: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

Page 25: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

Page 26: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

Page 27: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

Page 28: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

Page 29: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

Page 30: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 31: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

Page 32: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼


Mobile Agents - research.nii.ac.jp

AstroSim: Collaborative Visualization of an …research.nii.ac.jp/~prendinger/papers/arturo-IEEE_CG...AstroSim: Collaborative Visualization of an Astrophysics Simulation in Second

manchesterhistory.org Evening Hearld... · 1982. 8. 24. · 20 — MANrHESTER HERALD. Mon., Aug, tt, 1.9K A hidden peril'to your pension BiWii * * ' -t,r» ’. •• ’•i-•

ICRC HITSZ at RITE: Leveraging Multiple Classifiers Voting ...research.nii.ac.jp/ntcir/workshop/Online... · Resources: Synonym, antonym, hyponym relations and polarity lexicons[7]

Bidirectional Transformations: A Cross-Discipline …research.nii.ac.jp/~hu/pub/ICMT09-grace.pdfBidirectional Transformations: A Cross-Discipline Perspective GRACE meeting notes, state

Higher-Order Fourier Analysis: Applications to Algebraic ...research.nii.ac.jp/~yyoshida/resources/Talks/2014-FOCS.pdf · Higher-Order Fourier Analysis: Applications to Algebraic

LNMR 2013 - research.nii.ac.jp

Spoken Document Retrieval Experiments for SpokenDoc at …research.nii.ac.jp/ntcir/workshop/OnlineProceedings9/... · 2011. 11. 27. · Spo-ken document retrieval (SDR) and spoken

Layout-conscious Random Topologies for HPC Off-chip ...research.nii.ac.jp/~koibuchi/pdf/hpca2013_slide.pdf · Layout-conscious Random Topologies for HPC Off-chip Interconnects

WASTE OIL DRAINERS / SPILLOLJETÖMMARE · B. Öppna avluftningsventilen (7.a), avlägsna pluggen i oljetråget och låt spilloljan rinna ner i skålen tills oljetråget är helt tömt

Extraction of Statistical Terms and Co-occurrence Networks ...research.nii.ac.jp/ntcir/workshop/OnlineProceedings6/...and “” tags also express names of statistics

Introduction to Computer Graphics Animation (1)research.nii.ac.jp/~takayama/teaching/utokyo-iscg-2016/slides/iscg-2016-05-animation1...Introduction to Computer Graphics ... •𝐯′:

Statistical Approaches to Patent Translation for PatentMT- …research.nii.ac.jp/ntcir/workshop/OnlineProceedings9/... · 2011-11-27 · very popular approach to machine translation

Aesthetic Quality Classification of Photographs Based on ...research.nii.ac.jp/~imarik/resources/papers/CVPR2012...presents three types of color harmony: ‘Contrast,’ which is

Ranking Retrieval Systems without ... - research.nii.ac.jp

UNITS OF MEASUREMENT By : Rinna Tarter. Weight and Mass Ounce - The ounce is used for measuring small quantities of mass. Compared to the metric system,

Binary-class and Multi-class Chinese Textural …research.nii.ac.jp/ntcir/workshop/OnlineProceedings9/...Binary-class and Multi-class Chinese Textural Entailment System Description

B 1 rinna and rinna

August 2019 SOCIAL MEDIA, APP- und WEB-Report · 2019. 8. 29. · Bastian Schweinsteiger 9.1M 165k 2.6k 178k Manuel Neuer 9.0M 89k 2.6k 106k Lukas Podolski 7.3M 109k 1.9k 118k Simon

ISTIC Statistical Machine Translation System for NTCIR-9 ...research.nii.ac.jp/ntcir/workshop/Online... · 2.2 Multiple translation systems We use phrase-based machine translation

UP Monograph: Virtual Environments (published jointly with ...research.nii.ac.jp/~prendinger/papers/up7-2Nischt.pdf · and Multimedia at the Augsburg University, Germany. Since 2001,

Depth Image Coding & Processing Part 3: Depth Image …research.nii.ac.jp/~cheung/2015/cost_training_part3_july2015.pdf · Depth Image Coding & Processing Part 3: Depth Image Processing

Affiliations/Collaborations...@Makeup_by_heather_yo 1.9k+ followers 65+ likes 3,198 impressions/month @Makeupbyheatheryo 6.7k+ followers 1k+ impressions per post 146 Subscribers 14k+

Beat of the Drum - Expressions Gallery - Berkeley,expressionsgallery.org/pdf/BEAT OF THE DRUM FLYER.pdf · elizabeth dante barbara de groot marge essel debbie fimrite rinna b. flohr

([DJJHUDWHG ,QIRUPDWLRQ LQ 0DUNHW &RPPHQWV …research.nii.ac.jp/ntcir/workshop/OnlineProceedings14/pdf/ntcir/01... · 2yhuylhz ri wkh 17&,5 )lq1xp7dvn)lqh *udlqhg 1xphudo 8qghuvwdqglqj

BiometricJammer: Method to Prevent Unauthorized …research.nii.ac.jp/~iechizen/official/BiometricJammerE_rev.pdf · BiometricJammer: Method to Prevent Unauthorized Capturing of Fingerprint

Introduction to Computer Graphics Animation (1)research.nii.ac.jp/~takayama/teaching/utokyo-iscg-2017/slides/iscg-2017-05-animation1...Introduction to Computer Graphics ... •𝐯′:

Spoken Term Detection Using Multiple Speech Recognizers’ Outputs …research.nii.ac.jp/ntcir/workshop/OnlineProceedings9/... · 2011-12-12 · Spoken Term Detection Using Multiple

Name index to books on Swedes in Washington€¦ · Hammarskog, Rinna (E) Tacoma Pierce WA 109:274 Anderson John E. 1878-10-30 Hammarskog, Rinna (E) ID 109:274 Anderson John E. 1878-10-30

Enhancing Mediated Interpersonal Communication through ...research.nii.ac.jp/~prendinger/papers/dzmitry_INTETAIN09.pdf · communication as sense of touch. To deliver emotions through

Question Answering Experiments at NTCIR-5: …research.nii.ac.jp/ntcir/workshop/OnlineProceedings5/...Question Answering Experiments at NTCIR-5: Acquisition of Answer Evaluation Patterns

Presentación Resultados 3Q2016 · ∆+1.5k M JV ADN ∆- 2.0k M Farallons ∆- 1.9k M CMO and Nuevo Dorado REAL2017 Vs. REAL2018 COP Millions 1 1 Revenues –Segment’sContribution

Aquafilta Inst Booklet - Xylem Inc.Låt vattnet rinna tills alla överflödiga svarta kolkorn har spolats bort. ¨ Cierre los grifos y encienda la bomba. … Deje correr el agua hasta

PRODUCT RECALLS - webforms.sgs.com · LOCK (ref. 00055691 and 80119260) and RINNA (ref. 00251319 y 20199250) Batch number/Barcode: Unknown DESCRIPTION: Circular ceiling lamp. COUNTRY

Supplementary Information for: Decline in Iceland … · Supplementary Information for: Decline in Iceland-Scotland ... range found in global climate models with a 1.9K ... changes