the open analytics platform - files.knime.com - bw... · •last year, we demonstrated the pmml to...
TRANSCRIPT
![Page 1: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/1.jpg)
© 2016 KNIME.com AG. All Rights Reserved.
What’s cooking
Bernd Wiswedel
![Page 2: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/2.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 2
Outline
Continued development of all products, including
• KNIME Server
• KNIME Analytics Platform
• KNIME Big Data Extensions (discussed after this session)
![Page 3: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/3.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 3
KNIME Server – What’s cooking
• Full server functionality via REST
• Admin Portal
• Distributed workflow executor (on Hadoop, …)
• Web Portal: Guided Analytics
• Social Workflow Repository
• PMML Scoring as a web service
![Page 4: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/4.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 4
Social Workflow Repository
- Patrick Winter -
- Alexander Fillbrunn -
![Page 5: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/5.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 5
Workflow Sharing Made Easy
Share, rate and discuss workflows on your KNIME Server
Instantly updated when new workflow is uploaded
Supports snapshot versioning
Responsive design → Works on all device types
![Page 6: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/6.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 6
The Start Page
Configurable lead text and news segment
Most recent, top rated and random workflows
![Page 7: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/7.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 7
The Workflow Search
Search workflows by title or author
Sort by title, author, rating or upload date
![Page 8: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/8.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 8
Workflow Details
Workflow description, image, rating and comments
List of required plugins
Download of all available workflow versions
![Page 9: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/9.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 9
Social Features
Rating: 1 to 5 stars
Comments
Markdown formatting supported
Release of new versions included in the comment timeline
![Page 10: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/10.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 10
![Page 11: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/11.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 11
PMML Scoring as a web service
- Alexander Fillbrunn -
![Page 12: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/12.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 12
PMML Compilation & Scoring
• Last year, we demonstrated the PMML to Java compiler
• Translates PMML to Java Virtual Machine Bytecode
• Can be used for faster scoring
• Now we make those compiled models much more powerful
![Page 13: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/13.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 13
Model Deployment
How can we reuse the model we just learned?
![Page 14: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/14.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 14
Compiled Model to Jar Writer
• Bytecode is exported as a Java Archive
• Includes custom metadata
– Lets other software know which class is the entry point
• Has no dependencies
– Run it anywhere, as long as a Java Virtual Machine is available
![Page 15: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/15.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 15
Compiled Models on KNIME Server
• Upload models to KNIME Server
• Immediately available as a RESTful Web Service – Update & Delete models
– Retrieve model metadata • Model type, Input & output fields
– Execution
• Data transferred via JSON
• Web Interface for management and testing
• Compatible with KNIME PMML models
![Page 16: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/16.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 16
Using Remote Compiled Models in KNIME
• Connects to any KNIME Server via REST interface
• Uploads the model‘s bytecode
• Works for predictive models and transformations
![Page 17: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/17.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 17
Using Remote Compiled Models in KNIME
• Models callable by an identifier set in the PMML Compiler
• Appends results to the original table
![Page 18: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/18.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 18
Model Management on KNIME Server
• Web management interface
• Responsive design
– Runs on Smartphones, Tablets and PCs
• Allows uploading, deleting and execution of models
![Page 19: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/19.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 19
![Page 20: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/20.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 20
KNIME Analytics Platform – What’s cooking
Enhanced analytics modules:
• Deeplearning4j integration
• Trees and tree ensembles
![Page 21: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/21.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 21
Deeplearning4j
• “Deeplearning4j is the first commercial-grade, open-source, distributed deep-learning library written for Java and Scala” [deeplearning4j.org]
• GPU integration
• Scalable on Hadoop, Spark
![Page 22: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/22.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 22
Deep Learning - Applications
• Face Recognition
(97,5%) Accuracy
![Page 23: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/23.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 23
Deep Learning - Applications
• Image Recognition (83% Top-5 Accuracy 1000 classes!)
![Page 24: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/24.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 24
Deeplearning4j - Workflow
![Page 25: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/25.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 25
Deeplearning4j - Workflow
![Page 26: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/26.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 26
Deeplearning4j - Example Networks
![Page 27: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/27.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 27
Deeplearning4j – KNIME Integration
• Easy network architecture design
• Modular
– Layerwise design of networks
• Model Import/Export
– Caffe Import
• Beginner friendly
– Import pretrained networks
• Highly configurable
![Page 28: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/28.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 28
Trees and Tree Ensembles
- Adrian Nembach-
![Page 29: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/29.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 29
Full workflow
![Page 30: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/30.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 30
Input table
![Page 31: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/31.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 31
Tree Ensemble Dialog
![Page 32: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/32.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 32
Similarity Search Dialog
![Page 33: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/33.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 33
Nearest Neighbors
![Page 34: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/34.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 34
Nearest Neighbors
![Page 35: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/35.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 35
Gradient Boosting Dialog
![Page 36: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/36.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 36
Gradient Boosting Results
![Page 37: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/37.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 37
Trees and Tree Ensembles: Changes “under the hood”
• Support of binary splits for nominal attributes
• Missing value handling
• Support of byte vector data (high-dimension count fingerprints)
• Code optimization
– Runtime
– Memory
![Page 38: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/38.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 38
Trees and Tree Ensembles: New nodes
• Gradient Boosting
– Also based on tree ensembles
– Boosting: Improving an existing model by adding a new model
– Shallow trees
• Random Forest Distance
– Distance measure induced by a random forest
– Based on proximity
![Page 39: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/39.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 39
![Page 40: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/40.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 40
Semantic Web Integration
• Access and manipulate semantic web resources e.g. DBpedia
• Execute semantic queries via SPARQL
• Usage model similar to database integration
![Page 41: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/41.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 41
KNIME Analytics Platform – What’s cooking
… there is more coming, including
• More preprocessing nodes (as needed)
• REST client nodes – forking KREST community extension
• More streaming-enabled nodes
• …
![Page 42: The Open Analytics Platform - files.knime.com - BW... · •Last year, we demonstrated the PMML to Java compiler •Translates PMML to Java Virtual Machine Bytecode •Can be used](https://reader033.vdocument.in/reader033/viewer/2022051508/5a9f9d327f8b9a71178cf59c/html5/thumbnails/42.jpg)
© 2016 KNIME.com AG. All Rights Reserved. 42
The KNIME® trademark and logo and OPEN FOR INNOVATION® trademark are used by KNIME.com AG under license from KNIME GmbH, and are registered in the United States.
KNIME® is also registered in Germany.