introducing uber’s open source - t&vs€¦ · introducing uber’s open source autonomous...
TRANSCRIPT
![Page 1: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/1.jpg)
Introducing Uber’s Open Source
Autonomous Visualization System
June 2019 | Xiaoji Chen | Sr Software Engineer, Uber Visualization
![Page 2: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/2.jpg)
01 What is AVS02 Components & Features03 Applications built with AVS04 Next Steps
Agenda
![Page 3: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/3.jpg)
![Page 4: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/4.jpg)
● Overwhelming volume of data
● Emerging subdivisions and use cases
● Rapidly evolving requirements
● Flexibility and maintainability
What is AVS?
The Challenges
![Page 5: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/5.jpg)
![Page 6: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/6.jpg)
AVS is a new standard for describing and
visualizing autonomous vehicle perception,
motion, and planning data, offering a
powerful web-first toolkit to build
applications for exploring, interacting and,
most critically, making important
development decisions with that data.
https://eng.uber.com/avs-autonomous-vehicle-visualization/
What is AVS?
A Unified Standard
![Page 7: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/7.jpg)
● Decouple presentation from platform
○ Time-based
○ Geometries, imageries, metrics, UI and data bindings
● Designed for best runtime performance
○ Binary optimized
○ Data format and styling aligned with GPUs
○ Object-data association
● Put data and control near the source
○ Server protocol
○ Multiple platform versions work in the same app
● Make visualization testable
○ Tools for verification and manipulation
Components & Features
XVIZ
![Page 8: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/8.jpg)
![Page 9: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/9.jpg)
The XVIZ Data Flow
![Page 10: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/10.jpg)
● Web-based toolkit that makes consuming and working with XVIZ easy
● Handles the hard problems out-of-the-box
○ Data buffering, synchronization, coordinate transforms, dynamic
styling, 3D scene rendering, objects & camera interaction
● A foundation of UI components for building sophisticated apps
○ Video, chart, table, popover, settings, HUD, playback control
○ Highly reusable & customizable
● Performance first
Components & Features
Streetscape.gl
![Page 11: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/11.jpg)
![Page 12: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/12.jpg)
Components & Features
WebGL-Powered Open SourceVisualization Frameworks
react-vis
React components for d3
react-map-gl
React components for mapbox-glMap Tiles © Mapbox | Data Attributions
deck.gl
GPU powered large-scale
visualization
luma.gl
WebGL2 framework
https://vis.gl
![Page 13: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/13.jpg)
CPU GPU
![Page 14: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/14.jpg)
Population of New York City
![Page 15: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/15.jpg)
![Page 16: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/16.jpg)
![Page 17: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/17.jpg)
Internally, Uber ATG’s autonomous vehicle
web platform enables log viewing, triaging,
simulation, debugging, to map editing,
and labeling of web-based applications.
We also work with external partners in the
industry to address their particular needs
and continuously improve AVS.
Production applications built with AVS at Uber and beyond
Applications
![Page 18: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/18.jpg)
![Page 19: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/19.jpg)
![Page 20: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/20.jpg)
![Page 21: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/21.jpg)
![Page 22: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/22.jpg)
https://foresight.ai/blogs/foresightai-big-data-visualization.html
![Page 23: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/23.jpg)
Towards a smarter transportation ecosystem for the future
What’s Nextv1.0 Release
● Stabilized XVIZ protocol
● Node.js builder pipeline
● Feature-complete visualizer and web
components
● Node.js server module
● ROS > XVIZ converter
● Interactive playground
SOON
● Point cloud compression
● New primitive types
● More examples and tutorials
On ROADMAP
● Protobuf support
● c++ builder & server
● Python builder & server
https://avs.auto
![Page 24: Introducing Uber’s Open Source - T&VS€¦ · Introducing Uber’s Open Source Autonomous Visualization System June ... A foundation of UI components for building sophisticated](https://reader036.vdocument.in/reader036/viewer/2022063013/5fcd0e8212e79c2618117a71/html5/thumbnails/24.jpg)
Thank you
Proprietary © 2018 Uber Technologies, Inc. All rights reserved. No part of thisdocument may be reproduced or utilized in any form or by any means,electronic or mechanical, including photocopying, recording, or by anyinformation storage or retrieval systems, without permission in writing fromUber. This document is intended only for the use of the individual or entity towhom it is addressed. All recipients of this document are notified that theinformation contained herein includes proprietary information of Uber, andrecipient may not make use of, disseminate, or in any way disclose thisdocument or any of the enclosed information to any person other thanemployees of addressee to the extent necessary for consultations withauthorized personnel of Uber.