![Page 2: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/2.jpg)
Game metrics
Anything that can be recorded about gameplay
Used to understand how the game works, and how players experience it
Range of goals and techniques Qualitative, quantitative, game user experience, monetization
![Page 3: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/3.jpg)
Some types of game metrics
![Page 4: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/4.jpg)
Which player are the metrics about?
![Page 5: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/5.jpg)
Basic process
Choose variables to record Choose frequency of recording Store to a database
Run query/visualization later Aggregation, correlation, etc.
![Page 6: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/6.jpg)
Simple example
![Page 7: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/7.jpg)
Spatial, in-engine metrics
Record positions of interesting events
Visualize frequencies, relationships, etc. Usually by drawing on the map
One of the most commonly used kinds of metrics Easy to record, clear how to visualize
![Page 8: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/8.jpg)
Heatmap: HL2 deaths
![Page 9: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/9.jpg)
Heatmap: TR8 in-game help usage
![Page 10: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/10.jpg)
More in-depth spatial analysis
Heatmaps are 2d density estimates from samples
Can do other kinds of density estimates
Or, combine with qualitative data
![Page 11: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/11.jpg)
Binned heatmap
![Page 12: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/12.jpg)
Using a GIS?
Geographic Information System (GIS)
Used for aggregating spatial data in geography, urban planning, etc.
Some recent experiments with using GIS to analyze ”game geography”
![Page 13: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/13.jpg)
GIS overlays
![Page 14: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/14.jpg)
ArcGIS overlay (Hitman: Blood Money)
![Page 15: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/15.jpg)
In-engine/editor visualization
![Page 16: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/16.jpg)
Analytical metrics
Analyzing the game to extract information without player data, or as a supplement to player data
Examples: Reachability analysis Game-theory analysis of a combat system
Recent area of research M.J. Nelson (2011), ”Game Metrics Without Players”
![Page 17: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/17.jpg)
More on metrics
Annual conferences/workshops: Game User Experience
Engines increasingly come with their own metrics/viz infrastructure And extensions, e.g. in the Unity store
![Page 18: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/18.jpg)
Adaptation
Can we use metric data automatically?
Offline or online
![Page 19: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/19.jpg)
Dynamic difficulty adjustment
Adjust game based on player’s in-game behavior
But ”smarter” than classic rubber-banding style DDA
Information on what player does successfully/unsuccessfully, combined with a model of interestingness
![Page 20: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/20.jpg)
Experience-driven PCG
Use metrics information to generate levels or other game content
Offline: a kind of partially automated game design Online: game customization
Like a more ambitious DDA
Togelius & Yannakakis (2011). ”Experience-driven PCG”
![Page 21: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/21.jpg)
Final project
Project can be done individually or in a group Individually written reports in either case
Scope There are about 6 weeks left in the semester Depending on the project, leave ~2 weeks to write up a report
![Page 22: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/22.jpg)
Kinds of projects
Implementation projects
Scientific-experiment projects
Engine investigation projects
![Page 23: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/23.jpg)
Implementation projects
Examples Expand your software 3d renderer to do solid surfaces and lighting Implement a character AI/scripting API Write a Unity plugin to do something not currently supported
![Page 24: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/24.jpg)
Scientific investigation projects
Do an analysis/comparison of algorithms or techniques
Possibilities Implement several standard algorithms from a textbook (AI,
graphics, etc.) and compare them Implement something proposed in a research paper and try to
replicate or extend its results
![Page 25: Mark Nelson mjas@itu.dk Metrics and adaptation Fall 2013](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ee65503460f94bf5f2b/html5/thumbnails/25.jpg)
Engine investigation projects
Take an existing game engine and dive into a specific part of it (physics system, AI system, navigation system, …) to understand and characterize how it works.
Possible topics of investigation What were the design goals, if known? What does this support well and poorly? Benchmarks, etc.