automated generation of various and consistent populations in multi-agent simulations
DESCRIPTION
In multi-agent based simulations, providing various and consistent behaviors for the agents is an important issue to produce realistic and valid results. However, it is difficult for the simulations users to manage simultaneously these two elements, especially when the exact influence of each behaviorial parameter remains unknown. We propose in this paper a generic model designed to deal with this issue: easily generate various and consistent behaviors for the agents. The behaviors are described using a normative approach, which allows increasing the variety by introducing violations. The generation engine controls the determinism of the creation process, and a mechanism based on unsupervised learning allows managing the behaviors consistency. The model has been applied to traffic simulation with the driving simulation software used at Renault, SCANeR 2, and experimental results are presented to demonstrate its validity.TRANSCRIPT
Automated generation of various and
consistent populations in multi-agent
simulations
Benoit Lacroix
University of Lille
Computer Science Dept.
LIFL (UMR CNRS 8022)
Practical Applications of Agents and Multiagent Systems 2012 (PAAMS’12)
Philippe Mathieu
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012
Context and motivations
Context
Design realistic scenarios in simulations
Introduce both various and consistent agents behaviors
Motivation
Assist the designer in the configuration tasks
Proposed approach
Based on a behavioral differentiation model
Automated configuration of the model from sample data
Automated generation of agents populations
2
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012
Outline
1. Behavioral differentiation model
2. Automated configuration of the model
3. Generation of agents populations
4. Experimental evaluation and results
3
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012 4
Behavioral differentiation model
Based on a social norm metaphor
Provide “behavioral patterns” during agents creation
Conformity control at runtime
Introduced in previous works (PAAMS’09)
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012 5
Parameters
Parameter
Finite definition domain
Default value
Probability distribution over the definition domain
Reference parameter
Distance function
Example : « normal maximal speed » of a vehicle
normal maximal speed
maximal speed
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012 6
Norms
Norm
Set of parameters
Properties
Violation rate
Maximal gap to the norm
Example : « normal » norm
« normal maximal speed » and « normal safety time »
France, highway
5%
3% normal maximal speed normal safety time
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012 7
Model Agents
Encapsulate the simulation agents
Technical constraints, allows for different processes
Model agents
Instantiate a norm
Reference norm
Set of parameters values
Example : model agent « Bob »
Belongs to the « normal » norm
Two parameters
Maximal speed: 126 km/h
Safety time: 1,8 seconds
“normal” norm
safety time:
[1.5,2.5] seconds
maximal speed:
[110,130] km/h
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012
Automated configuration of the model
Using sample data
Objectives
Ease the designer works
Facilitate the use of the model
Choices
Unsupervised learning
Limit configuration and user supervision
Kohonen neural networks
Distribution function estimation
8
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012
Principle of the algorithm
A neuron = a norm
Neuron weights values = norms parameters default values
For all the examples matching a neuron (i.e. in the same norm)
Maximal / minimal values
= bounds of the definition domain of the corresponding parameter
Distribution estimation
= probability distribution of the corresponding parameter
Result
Automated creation of a set of norms representing the sample data
Easy parameterization of the model
Reproduction of experimental settings based on recorded values
9
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012
Description of the algorithm
1. Train the neural network K
Rectangular topology, (d+1)² neurons, with d the size of the inputs
2. For each neuron k of K, create a norm n
n holds a parameter per dimension of the input vectors
Associate the weights of the neuron to the parameters default values
3. Classify the examples with K
For each example e, let k be the triggered neuron (norm n)
If needed, update the corresponding bounds of the domain
Add e to the distribution estimator for the corresponding parameter
Could be used with other clustering techniques
10
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012
Generation of agents populations
Objectives
Easily populate a database with agents
Specify precisely the composition of the population
Combination of profiles, time slices and generators
Profile
Reference norm
Set of characteristics
Examples
p1 of norm “normal”
p2 of norm “aggressive
11
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012
Time slice
Time slice
Set of profiles and their relative percentage in the population
Duration
Generation frequency (s-1)
Example: a time slice t1 “rush hour”
80% of profiles p1 (“normal”) and 20% of profiles p2 (“aggressive”)
Active from 7 a.m. to 9 a.m.
Generation frequency 1.0 (one agent created per second)
12
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012
Generator
Generator
Set of time slices
Function associating a position in space to an agent
Example: generator “morning traffic”
The time slice t1
A time slice t2
Active from 9 to 11 a.m. with 100% of profiles p1 and frequency 0.2
Creation at the position (0,0,0)
The “morning traffic”
A rush hour with aggressive drivers and a dense flow of 3600 veh/h
Followed by a quieter period with only normal driver and only 720 veh/h
13
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012
Generation mechanism properties
Flexible mechanism to introduce behaviors
High level definition, with low level specification
Based on the behavioral differentiation model
Automated configuration of the generators
Based on the inference mechanism
A profile per norm
Relative proportion = the proportion of matching examples
User only has to specify the position where to create the agents
14
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012
Application
Context
Commercial driving simulation software
SCANeR™ (http://scanersimulation.com)
Design studies, driving aid systems development…
Traffic simulation in SCANeR™
Based on a multi-agent architecture
Complex configuration steps
Involves manual configuration of each vehicle / parameter
Objective
Automate the simulation configuration
15
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012 16
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012
Evaluation
Highway database
Recording of vehicles data
Speed, safety time
Experimental protocol
Generation and recording of a population of vehicles
Pre-configured generators: 10% cautious and 10% aggressive drivers,
80% normal ones
Norm inference and construction of new generators
Generation and recording of a second population
Comparison of the two populations
17
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012
Results (1/2)
Norm inference
From the initial population
9 norms
Generator construction
1 time slice
9 profiles (one per norm)
Proportion = relative occurrence of the norm
Generation and recording of a new population
18
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012
Comparison the clusters for each population
At most 2.3% difference on the default value,
8.3% on the domain bounds,
and 10.2% on the repartition
Similar populations
Same behavioral
characteristics
But resulting population more “careful”
Results (2/2)
19
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012
Conclusion
Automated generation of populations
Description of agents using a social norm metaphor
Inference of the behavioral model parameters
Clustering and parameters distribution estimation
Agents generators
Flexible mechanism to introduce various and consistent behaviors
Application to traffic simulation
Creation of a population statistically close to the reference
Future works
Real world data
Norms representation improvement
20
Benoit Lacroix and Philippe Mathieu
University of Lille
Automated generation of various and consistent
populations in multi-agent simulations PAAMS 2012 21
Thank you for your attention