Upload File

challenges in quality assurance for machine learning-based...

  • Home
  • Documents
  • Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
32

Upload: others

Post on 27-May-2020

2 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
mailto:[email protected]
http://research.nii.ac.jp/~f-ishikawa/en/
Page 2: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

◼

Page 3: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 4: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

Page 5: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

Page 6: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

Page 7: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

Page 8: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 9: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

Page 10: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 11: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

◼

◼

◼

Page 12: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

◼

◼

◼

◼

◼

◼

◼

◼

◼

Page 13: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

◼

◼

◼

◼

Page 14: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

◼

◼

Page 15: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 16: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

◼

◼

◼

◼

◼

Page 17: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 18: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 19: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 20: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

0 20 40 60 80 100

Architecture Design

Training Data

Operation

Project Management

Updates

Debugging

Testing & Quality Evaluation / Assurance

Decision Making with Customers

Page 21: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

◼

◼

Page 22: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 23: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

Page 24: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

Page 25: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

Page 26: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

Page 27: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

Page 28: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

Page 29: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

Page 30: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan
Page 31: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼

◼

◼

◼

Page 32: Challenges in Quality Assurance for Machine Learning-based ...research.nii.ac.jp/~f-ishikawa/work/1904-MLST19.pdf · t_-1 1.9K @ms rinna Replying to @Windows_Japan 0 680 @Windows_Japan

◼

◼


Binary-class and Multi-class Chinese Textural …research.nii.ac.jp/ntcir/workshop/OnlineProceedings9/...Binary-class and Multi-class Chinese Textural Entailment System Description

UNITS OF MEASUREMENT By : Rinna Tarter. Weight and Mass Ounce - The ounce is used for measuring small quantities of mass. Compared to the metric system,

task. Many approaches to IR4QA introduce some extensions ...research.nii.ac.jp/ntcir/workshop/Online... · • More informative Less informative • Less robust More robust • We

Botanická 68a, 602 00 Brno, Czech Republic …research.nii.ac.jp/ntcir/workshop/OnlineProceedings10/...Botanická 68a, 602 00 Brno, Czech Republic Acknowledgements: This work was

Statistical Approaches to Patent Translation for PatentMT- …research.nii.ac.jp/ntcir/workshop/OnlineProceedings9/... · 2011-11-27 · very popular approach to machine translation

Enhancing Mediated Interpersonal Communication through ...research.nii.ac.jp/~prendinger/papers/dzmitry_INTETAIN09.pdf · communication as sense of touch. To deliver emotions through

Upgrade of the Horizontal Test Facility at FNAL · 2017. 8. 2. · Measurements (2 [3 ?] leads at 18 kA) and SSW (10 A) at 1.9K •Design, fabricate components, and assemble a Warm

B 1 rinna and rinna

ICRC HITSZ at RITE: Leveraging Multiple Classifiers Voting ...research.nii.ac.jp/ntcir/workshop/Online... · Resources: Synonym, antonym, hyponym relations and polarity lexicons[7]

August 2019 SOCIAL MEDIA, APP- und WEB-Report · 2019. 8. 29. · Bastian Schweinsteiger 9.1M 165k 2.6k 178k Manuel Neuer 9.0M 89k 2.6k 106k Lukas Podolski 7.3M 109k 1.9k 118k Simon

Spoken Document Retrieval Experiments for SpokenDoc at …research.nii.ac.jp/ntcir/workshop/OnlineProceedings9/... · 2011. 11. 27. · Spo-ken document retrieval (SDR) and spoken

Higher-Order Fourier Analysis: Applications to Algebraic ...research.nii.ac.jp/~yyoshida/resources/Talks/2014-FOCS.pdf · Higher-Order Fourier Analysis: Applications to Algebraic

EmoHeart:ConveyingEmotionsinSecondLifeBasedon ...research.nii.ac.jp/~prendinger/papers/alena-AHCI2010.pdfsocial life in terms of both interpersonal relationships and the character

Modelling A User Population for Designing Information ...research.nii.ac.jp/ntcir/workshop/Online...The Second International Workshop on Evaluating Information Access (EVIA), December

Aquafilta Inst Booklet - Xylem Inc.Låt vattnet rinna tills alla överflödiga svarta kolkorn har spolats bort. ¨ Cierre los grifos y encienda la bomba. … Deje correr el agua hasta

PRODUCT RECALLS - webforms.sgs.com · LOCK (ref. 00055691 and 80119260) and RINNA (ref. 00251319 y 20199250) Batch number/Barcode: Unknown DESCRIPTION: Circular ceiling lamp. COUNTRY

Presentación Resultados 3Q2016 · ∆+1.5k M JV ADN ∆- 2.0k M Farallons ∆- 1.9k M CMO and Nuevo Dorado REAL2017 Vs. REAL2018 COP Millions 1 1 Revenues –Segment’sContribution

manchesterhistory.org Evening Hearld... · 1982. 8. 24. · 20 — MANrHESTER HERALD. Mon., Aug, tt, 1.9K A hidden peril'to your pension BiWii * * ' -t,r» ’. •• ’•i-•

Name index to books on Swedes in Washington€¦ · Hammarskog, Rinna (E) Tacoma Pierce WA 109:274 Anderson John E. 1878-10-30 Hammarskog, Rinna (E) ID 109:274 Anderson John E. 1878-10-30

Affiliations/Collaborations...@Makeup_by_heather_yo 1.9k+ followers 65+ likes 3,198 impressions/month @Makeupbyheatheryo 6.7k+ followers 1k+ impressions per post 146 Subscribers 14k+

Beat of the Drum - Expressions Gallery - Berkeley,expressionsgallery.org/pdf/BEAT OF THE DRUM FLYER.pdf · elizabeth dante barbara de groot marge essel debbie fimrite rinna b. flohr

Overview’of’the’PatentMachine’ Translaon’Task’’ atthe ...research.nii.ac.jp/.../OVERVIEW/01-NTCIR10-PATENTMT... · Approximately 3.2million patent parallel’sentence’pairs

DIVINE PARTNERSHIP - Project Angel Food · Chaz Dean Angel Awards 2018 KTLA Reporter Gayle Anderson Angel Awards 2017 Lisa Rinna Angel Awards 2016 Marianne Williamson Angel Awards

LNMR 2013 - research.nii.ac.jp

Question Answering Experiments at NTCIR-5: …research.nii.ac.jp/ntcir/workshop/OnlineProceedings5/...Question Answering Experiments at NTCIR-5: Acquisition of Answer Evaluation Patterns

Ikki Fujiwara, Michihiro Koibuchi National Institute of ...research.nii.ac.jp/~koibuchi/pdf/ipdps2014-skywalk-print.pdfIkki Fujiwara, Michihiro Koibuchi National Institute of Informatics

Spoken Term Detection Using Multiple Speech Recognizers’ Outputs …research.nii.ac.jp/ntcir/workshop/OnlineProceedings9/... · 2011-12-12 · Spoken Term Detection Using Multiple

UP Monograph: Virtual Environments (published jointly with ...research.nii.ac.jp/~prendinger/papers/up7-2Nischt.pdf · and Multimedia at the Augsburg University, Germany. Since 2001,

Global Lab: an Interaction, Simulation, and ...research.nii.ac.jp/~prendinger/papers/anette-psivt2009.pdf · Global Lab: an Interaction, Simulation, and Experimentation Platform based

WASTE OIL DRAINERS / SPILLOLJETÖMMARE · B. Öppna avluftningsventilen (7.a), avlägsna pluggen i oljetråget och låt spilloljan rinna ner i skålen tills oljetråget är helt tömt

Supplementary Information for: Decline in Iceland … · Supplementary Information for: Decline in Iceland-Scotland ... range found in global climate models with a 1.9K ... changes

Layout-conscious Random Topologies for HPC Off-chip ...research.nii.ac.jp/~koibuchi/pdf/hpca2013_slide.pdf · Layout-conscious Random Topologies for HPC Off-chip Interconnects

AstroSim: Collaborative Visualization of an …research.nii.ac.jp/~prendinger/papers/arturo-IEEE_CG...AstroSim: Collaborative Visualization of an Astrophysics Simulation in Second

ISTIC Statistical Machine Translation System for NTCIR-9 ...research.nii.ac.jp/ntcir/workshop/Online... · 2.2 Multiple translation systems We use phrase-based machine translation

TECNOSS : A UNIQUE PROCESS THAT AND ......MAXILLARY SINUS AUGMENTATION: HISTOLOGIC AND HISTOMORPHOMETRIC ANALYSIS INT J ORAL MAXILLOFAC IMPLANTS, 2005 JUL-AUG; 20(4):519-25 RINNA C,