quad-tree generation with rnn for efficient graph visualization€¦ · quad-tree generation with...

32
QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER

Upload: others

Post on 07-Jun-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION

RICHARD FORSTER

Page 2: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

AGENDA

• Graph generation

• Community Detection

• ForceAtlas

• Barnes-Hut Tree with RNN

• Future work

Page 3: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

GRAPH GENERATION

Page 4: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

GRAPH GENERATION

• This is a process required for every single graph by any user

• First, database returned data needs to be transformed

• Have to generate:

• Collaborations

• Nodes

• Edges

Page 5: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

GRAPH GENERATION

Silicon Database 3D CT

Collaborations 33,45 13,85 18,64 12,65

Nodes 0,69 0,65 2,48 0,38

Edges 1,48 1,87 0,71 0,69

Computation time for specific parts of the graph generation in seconds

Database Silicon 3DCT

Nodes 17832 24923 35763 53039Edges 113622 185594 192336

325490

Page 6: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

COMMUNITY DETECTION

Page 7: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

COMMUNITY DETECTION

• Used to reveal groups in real world data

• Louvain method

• Parallel heuristics

Page 8: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

LOUVAIN METHOD

• Multi-phase, iterative, greedy algorithm

• Monotonically increasing modularity

• Inherently sequential

Page 9: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

RESULTS(COMMUNITY DETECTION)

• Database: 4x

• Silicon: 4x

• 3D: 11x

• CT: 12x

Database Silicon 3D CT

Nodes 17832 24923 35763 53039

Edges 113622 185594 192336

325490

2,6613,513

10,803

18,117

0,635 0,858 0,977 1,481

0

5

10

15

20

Database Silicon 3D CTR

UN

TIM

E (S)

CPU vs GPU Performance

CPU

GPU

Page 10: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation
Page 11: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

FORCEATLAS

Page 12: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

FORCEATLAS

• Force-directed layout based on n-body simulation

• Repulsion-attraction

• Makes visual interpretation easier

• Result depends on starting state

Page 13: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

RESULTS(FORCEATLAS)

• Database: 4,31x

• Silicon: 6,65x

• 3D: 9x

• CT: 9,8x

Database Silicon 3D CT

Nodes 17832 24923 35763 53039

Edges 113622 185594 192336

325490

3,7 3,8 3,9 6,6

15,95

25,3

35,2

64,72

0

20

40

60

80

Database Silicon 3D CT

RU

NT

IME (S)

CPU vs GPU Performance

GPU CPU

Page 14: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

FORCEATLAS LAYOUT TYPES

Original layout Community based layout

Page 15: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

Page 16: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

• ht : hidden state in timestep t

• xt : input in timestep t

• ht-1 : hidden state in timestep t-1

• U: transformationmatrix

• Ф: activationfunction(logistic sigmoid, tanh)

Page 17: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

• Generation provides a quadratic

tree

• Plane is halved until only 1

node remains in a region.

• For RNN system is provided as

a time series

Page 18: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

• t: timestep

• x, y: coordinates of node in timestep t

• old_n_N: state generated in timestep t-1 (initially -1)

• new_n_N: state generated in timestep t (no -1 at the end)

• N: number of nodes

• Model trained for graphs with 1000 nodes: 94% accuracy.

t, x, y, old_n_1, old_n_2, old_n_3, …, old_n_N, new_n_1, new_n_2, …, new_n_N

Page 19: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

How to use this approach to increase the visual experience?

Page 20: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

Page 21: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

Page 22: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

Page 23: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

Page 24: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

• We would like toanalyse Medipix (rednode)

• This time the top right corner is the hot zone

Page 25: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

We move the red node, recompute the tree and store the state forfuture training

Page 26: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

Red node advancing

Page 27: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

Red node advancing tofinal position

Page 28: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

• States stored for one node (Medipix)

• Train a model for Medipix

• The model will move the node through the regions

Page 29: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

Graph preprocessedbased on Medipix (red) and mpgd (yellow)

Page 30: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

BARNES-HUT TREE WITH RNN

Page 31: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

FUTURE WORK

• Collecting more user interaction data

• Testing on more complex graphs

• Integrating the model into the system

Page 32: QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION€¦ · QUAD-TREE GENERATION WITH RNN FOR EFFICIENT GRAPH VISUALIZATION RICHARD FORSTER. AGENDA •Graph generation

THANK YOU