28th of July 2005Learning in Strategy Games1 COMPSCI777 Computer Games Technology Learning in Strategy Games The University Of Auckland Thursday the 28th of July 2005 Learning in Strategy Games Team Members Clemens Berndt Jesse Wu Simon Gu Supervisor Ian Watson Team Members Clemens Berndt Jesse Wu Simon Gu Supervisor Ian Watson 28th of July 2005Learning in Strategy Games2 COMPSCI777 Computer Games Technology Agenda The University Of Auckland Thursday the 28th of July 2005 Agenda 1.Introduction 2.TIELT 3.Project Overview 4.Reference 5.Questions 1.Introduction 2.TIELT 3.Project Overview 4.Reference 5.Questions 28th of July 2005Learning in Strategy Games3 Introduction A fundamental Problem - not just in Games Introduction - Underlying Problem - AI in Games TIELT Project Overview References Questions Human players AI players Quickly learn how to play even complex games without being taught how to. Adapt well to changes in both Environment Opponents and allies behaviour Show significant improvement with experience. Dont ! 28th of July 2005Learning in Strategy Games4 Introduction AI in Games There are endless complaints about stupid AI on gaming forums. A common shortfall of game AI is in the area of constructing an effective base. Gamers woes Introduction - Underlying Problem - AI in Games TIELT Project Overview References Questions 28th of July 2005Learning in Strategy Games5 TIELT Introducing TIELT TIE LT A.k.a. the Testbed for Integrating and Evaluating Learning Techniques. Is a middleware architecture that allows AI tools and engines to interact with computer games. Essentially, makes it easy to create novel AI for existing games. Developed, maintained and supported by A handful of universities Two computer game companies DARPA and the U.S. Navy TIELT Introduction TIELT - Introducing TIELT - Architecture - Challenge Problems - Empire Earth - Wargus Project Overview References Questions 28th of July 2005Learning in Strategy Games6 TIELT TIELT - Architecture Introduction TIELT - Introducing TIELT - Architecture - Challenge Problems - Empire Earth - Wargus Project Overview References Questions 28th of July 2005Learning in Strategy Games7 TIELT TIELT - Challenge Problems Motivate interesting and novel AI research that may eventually also benefit games. Focus research efforts on currently relevant problems. Using computer games to verify existing AI techniques. The purpose of the challenge problems Introduction TIELT - Introducing TIELT - Architecture - Challenge Problems - Empire Earth - Wargus Project Overview References Questions 28th of July 2005Learning in Strategy Games8 TIELT Empire Earth II Challenge Problem The aim Learning to successfully play some particular aspect of the game (i.e. conquering city squares). Introduction TIELT - Introducing TIELT - Architecture - Challenge Problems - Empire Earth II - Wargus Project Overview References Questions 28th of July 2005Learning in Strategy Games9 TIELT Wargus Challenge Problem The aim Concerned with transfer learning of strategies for playing and winning a game of Wargus. Introduction TIELT - Introducing TIELT - Architecture - Challenge Problems - Empire Earth - Wargus Project Overview References Questions 28th of July 2005Learning in Strategy Games10 Project Overview Outlook The challenge problems are rather extensive and complicated. The goal of our project will be to solve some component of one of the challenge problems. We have yet to fully research the issues involved in both of the challenge problems. In any case we will implement an AI engine based around the TIELT framework to address one of the challenge problems. The road ahead Introduction TIELT Project Overview References Questions 28th of July 2005Learning in Strategy Games11 References Some useful Resources Ponsen, M. J. V., et al, Stratagus: An Open-Source Game Engine for Research in Real-Time Strategy Games, 2005 IJCAI Games Workshop Molineaux, M., et al, Defeating Novel Opponents in a Real- Time Strategy Game, 2005 IJCAI Games Workshop Spronck, P., et al, A model for Reliable Adaptive Game Intelligence, 2005 IJCAI Games Workshop Snchez-Pelegrn, R. and Daz-Agudo, B., An Intelligent Decision Module based on CBR for C-evo, 2005 IJCAI Games Workshop Papers Websites Introduction TIELT Project Overview References Questions 28th of July 2005Learning in Strategy Games12 Questions and Answers Thank you Any Questions? Introduction TIELT Project Overview References Questions