an approach to operationalize regulative norms in multiagent systems carolina howard felicíssimo...

An Approach to Operationalize

Regulative Norms in Multiagent Systems

Carolina Howard Felicíssimo

LES / PUC-Rio

Advisor: Prof. Carlos José Pereira de Lucena

Co-Advisor: Prof. Jean-Pierre Briot

August 13, 2008 2/35Carolina Howard Felicíssimo © LES/PUC-Rio

Agenda

1. Introduction

2. Background and Related Research

– Engineering of Multiagent Systems

– Norm Enforcement

3. Dynamic Contextual Regulation Information Provision

4. Contextual Norm Enforcement


Agenda

1. Introduction2. Background and Related Research3. Contextual Norm Information Provision4. Contextual Norm Enforcement

5. Applications of DynaCROM – Market Based Control – TV Broadcasting

6. Comparison with Related Work – OMNI – ISLANDER and AMELI – Moise+ and S-Moise+ – XMLaw

7. Dynamic Contextual Protocol Information Provision

8. Conclusion– Thesis Contributions – Future Work


Network

Link

Network Link

Introduction

- Heterogeneous agents will be able to acquire resources or services not found locally.

- Information Systems: goal-oriented problem-solving entities [Jennings et al., 1998]

- Web -> Semantic Web [Berners-Lee et al., 2001]

Open MAS

Network LinkOpen MAS Open MAS

Berners-Lee, T.; Hendler, J.; Lassila, O. The Semantic Web, Scientific Ameri-can. 284(5), p. 34–43, May 2001.

Jennings, N.; Sycara, K.; Wooldridge, M. A Roadmap of Agent Research and Development. JAMAS, 1998, 1, p. 7–38.


Introduction

Network Link

Open MAS Open MAS

Network LinkNormativeOpen MAS

NormativeOpen MAS

Norms


Background and Related Research

• Engineering of Multiagent Systems

– Modeling of Multiagent Systems

– Implementation of Multiagent Systems

• Norm Enforcement




– Modeling of Multiagent Systems

• Electronic Agent-Based Organizations – OMNI (Organizational Model for Normative Institutions) [Vázquez-Salceda et al., 2005]

– MOISE+ [Hannoun et al., 2000]

• Electronic Agent-Based Institutions (An organization restricted through the definitions of all the following: related roles, common

language, valid interactions and set of norms)

– ISLANDER [Esteva, 2003]

Vázquez-Salceda, J.; Dignum, V.; Dignum, F. Organizing Multiagent Systems. JAAMAS, 2005, 11 (3), p. 307–360.

Hannoun, M.; et al. MOISE: An organizational model for multi-agent systems. IBERAMIA/SBIA’2000, LNAI 1952, p. 152–161.

Esteva, M. Electronic Institutions: from specification to development. PhD thesis, Technical University of Catalonia, 2003.



Current Modeling Solutions for MAS Engineering:

rq.i. Explicitly Supports the Organizational Normative Dimension?

rq.ii. Has the Conceptual Model an Implemented Solution for It?

rq.iii. Supports the Management of Norms to be done at System Runtime?

rq.iv. Provides the way for Norm Representation with a Common Understanding for Heterogeneous Agents?

rq.v. Has an Editor, preferably a Graphical one, to Writte its Specifications?

rq.vi. Has a Semi-/Automatic Solution for the Verification of its Specifications?

rq.i rq.ii rq.iii

rq.iv rq.v rq.vi

OMNI V X – V X X

MOISE+ V V V V X X

ISLANDER X V V V V V




– Implementation of Multiagent Systems• The JADE Agent Platform [<http://jade.tilab. com>]

• The Agent Society Framework [Silva et al., 2004]

Silva, V. T. da; Cortês, M. I.; de Lucena, C. J. P. An Object-Oriented Framework for Implementing Agent Societies. PUC-Rio Technical Report, 2004.

Current Implementation Solutions for MAS Engineering:

rq.i. Permits the Mobility Property of Agents?

rq.ii. Supports the Direct Implementation of Agent Societies?

rq.iii. Is a Well-Known Platform for MAS Implementation?

rq.i rq.ii rq.iii

JADE V X V

ASF X V X



• Norm Enforcement

– Moses [Minsky and Ungureanu, 2000]

– AMELI [Esteva et al., 2004]

– S-MOISE+ [Hübner et al., 2006]

– SCAAR [Chopinaud et al., 2006]

– M-Law [Paes et al., 2007]

Hübner, J.F.; Sichman, J.S.; Boissier, O. S-MOISE+: a middleware for developing organised multi-agent systems. OOOP’2005, LNCS 3913, 2006.

Chopinaud, C.; et al. Prevention of harmful behaviors within cognitive and autonomous agents. ECAI’06, p. 205–209, 2006.

Paes, R. et al. Enhancing the Environment with a Law-Governed Service for Monitoring and Enforcing Behavior in Open Multi-Agent Systems. LNAI 4389, 2007, p. 221–238.

Esteva, M; et al. AMELI: An Agent-based Middleware for Electronic Institutions. AAMAS, 2004, p. 236–243.

Minsky, N.; Ungureanu, V. Law-Governed Interaction: A Coordination & Control Mechanism for Heterogeneous Distributed Systems. TOSEM, 9(3), p. 273–305, 2000.



Current Norm Enforcement Solutions: rq.i. Explicitly Supports the Implementation of an Organizational Normative

Dimension?

rq.ii. Has a Manager/Governor/Police Agent for Norm Enforcement?

rq.iii. Directly Enforces Prohibition Norms?

rq.iv. Makes Distinction Between the Implementation of an Organization Entity and a Group of Roles? I.e., is the Organization Concept an Explicit Entity in the Implementation?

rq.v. Can the Structure of the System (in any Dimension, e.g. the Normative one) Evolve at MAS Execution Time?

rq.vi. Has the Implementation a Conceptual Model to Guide its Specifications?

rq.i rq.ii rq.iii rq.iv rq.v rq.vi

Moses X V X X – X

AMELI X V X X X V

S-MOISE+ V V X X V V

SCAAR X X V – – X

M-Law X V X – – V


Contextual Norm Information Provision

• DynaCROM

– A Methodology for System Developers

– An Information Mechanism for Application Agents



• The DynaCROM Methodology for System Developers:

– Includes the Phases of Contextualization, Concretization, Representation and Compositions of Norms.

A(n Abstract) Payment Norm for Effecting a Negotiation: Negotiations are obliged to be paid by using the national currency of the seller’s country.

A Concrete Environment Norm for Effecting a Negotiation: Negotiations are obliged to be paid (i) in USA, with American dollars (USD); and, (ii) in Japan, with Japanese Yen (JPY).



(1)[DynaCROMRule_EnvWithOEnvNorms:(2) hasNorm(?Env,?OEnvNorms)(3) <- hasNorm(?OEnv,?OEnvNorms),(4) belongsTo(?Env,?OEnv)]

Missouri USA

OblToPayWithNationalCurrency



1

4

2

3

5

40Km

60Km

11

44

22

33

55

40Km40Km

60Km60Km


Contextual Norm Enforcement

• A Posteriori Norm Enforcement

• A Priori Norm Enforcement

• Norm Enforcement Based on the Agents’ External Behavior

• Norm Enforcement Based on the Agents’ Internal Behavior

DynaCROM: An Input Mechanism for Norm Enforcement Solutions



• DynaCROM as an Input Mechanism for Norm Enforcement Solutions

Agent Contexts

abcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcd

obligation

Applicable Norms

Agent Actions

abcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcd

obligation

Concretized Agent’s

Contextual Norms

Agent Contexts

Norm Enforcement

An Enforcer

Concretizing Agent’s Contextual Norms

abcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd abcdabcd

DynaCROM


Violated Norms


Violated Norms



• Norm Enforcement Based on the Agents’ External Behavior

MissourianManufacturer JapaneseSupplier

SupplierPoliceManufacturerPolice

CFP(computer,100)

PROPOSE(JPY,8000000)

getDynaCROMInfo(NationalCurrency)

INFORM(Nok,NationalCurrency)PROPOSE(JPY,8000000)X


Contextual Norm Enforcement - MOSES

(1) public void sent(…){ (2) if (message.startsWith(“PROPOSE")){…(3) doForward();(4) return; (5) }}

(6) public void arrived(…){(7) if (message.startsWith("PROPOSE")){…(8) doAdd(“proposedCurrency(“ + getMessageContent(message) + ")");(9) if “OblToPayWithNationalCurrency” isIn domainEnv.hasNorm{…(10) doImposeObligation("checkNationalCurrency",1,"sec")}; …(11) return; (12) }}

(13) public void obligationDue(Term obligationTerm){(14) if (obligationTerm.equals("checkNationalCurrency")){…(15) if (proposedCurrency.equals(getDynaCROMInfo(NationalCurrency))){(16) doForward();(17) doDeliver(CS.toString(),“INFORM(Ok)", sourceAddress); …}(18) else{(19) doDeliver(CS.toString(),“INFORM(Nok,NationalCurrency)", sourceAddress); …}(20) …}}


Contextual Norm Enforcement - SCAAR

• Norm Enforcement Based on the Agents’ Internal Behavior

(1) SCAARNorm_OblToPayWithNationalCurrency: (2) [OBLIGED (agt DO pay(agtCurrency) AND (agtCurrency == domainEnv.hasCurrency)) (3) IF (agt BE in Environment AND (agtEnv == domainEnv) (4) AND (“OblToPayWithNationalCurrency” isIn (domainEnv.hasNorm)))]

MissourianManufacturer JapaneseSupplier

CFP(computer,100)

PROPOSE(JPY,8000000)getDynaCROMInfo(NationalCurrency,

msg.sender) X


Applications of DynaCROM

• Market Based Control

Description Base price ( in USD) Supplier

CPU 750 Pintel

CPU 650 IMD

Motherboard 350 Macrostar

Motherboard 300 Basus

Memory 100 Macrostar

Memory 100 Basus

Hard disk 250 Macrostar

Hard disk 250 Basus

Organization Country State

Pintel USA Missouri

IMD USA Virginia

Basus Japan Osaka

BasusUSA USA California

Macrostar China Shanghai

MacrostarJapan Japan Hiroshima


Applications of DynaCROM – Market Based Control

• Concrete Interaction Norms for Providing Discounts: (a) Pintel and Macrostar suppliers are permitted to offer 15% discount if their products are bought in bundles; and, (b) IMD and Basus suppliers are permitted to offer 10% discount if their products are bought in bundles.

• A Concrete Role Norm for Accepting Placed Orders: (a) IMD suppliers are obliged to request a down payment of 10% for accepting placed orders.

• A Concrete Political Norm for Making Deals: American and Japanese organizations are prohibited from dealing with each other when their countries are undergoing political crisis.

• A Concrete Economical Norm for Operating in the Market: Chinese organizations are obliged to fix their prices for, at least, six months when their competing Japanese organizations are not operating in the market.


Applications of DynaCROM

• TV Broadcasting


Applications of DynaCROM – TV Broadcasting


Applications of DynaCROM – TV Broadcasting

(1) SCAARNorm_OblToPresentTVRatingInfo:

(2) [OBLIGED (agt DO screenATVProg(agtTVProg) AND

((agtTVProg.TVRatingInfo) isIn

((domainTVBT.hasTVContentRatingSystem).hasTVContentRating)))

(3) IF (agt BE in TVBroadcaster AND (agtTVBT == domainTVBT)

(4) AND (“OblToPresentTVRatingInfo” isIn (domainTVBT.hasNorm)))]

(2)…((agtTVProg.TVRatingInfo) isIn ((GTV).hasTVContentRatingSystem).hasTVContentRating))) … ((NineCRS).hasTVContentRating) … (NotSuitableForPeopleUnder15,NotSuitableForPeopleUnder18) …]

(1)[DynaCROMRule_TVBroadCWithContentRatSystem:

(2) hasTVContentRatingSystem(?TVBroadcaster,?TVCorpCRS)

(3) <- hasTVContentRatingSystem(?TVCorp,?TVCorpCRS),

(4) isMemberOf(?TVBroadcaster,?TVCorp)]


DynaCIP

• DynaCIP (Dynamic Contextual Protocol Information Provision)

[DynaCIPRule_RoleWithOrgProtocols: hasProtocol(?Role,?OrgProtocols) <- hasProtocol(?Org,?OrgProtocols), isPlayedIn(?Role,?Org)]

[DynaCIPRule_OrgWithEnvProtocols: hasProtocol(?Org,?OrgEnvProtocols) <- hasProtocol(?OrgEnv,?OrgEnvProtocols), isIn(?Org,?OrgEnv)]


Conclusion

• Three main assumptions underlie this research:

– Monolithic Architectures (based on Objects)

-> Distributed Ones (based on Agents);

– With the Advent of the Semantic Web

-> Agents will be able to process information from different sources;

-> Agents will be able to obtain resources and/or services not found locally.

-> Systems will be open.

– Openness without control leads to chaotic scenarios

-> Normative MAS.


Conclusion – Thesis Contributions

• A Top-Down Classification for Contextual Norms

– Facilitates the tasks of elucidation, organization and management of norm information;

• A Contextual Normative Ontology

– Explicitly represent the semantics of classified norms in a meaningful way (i.e., with a common understanding) for heterogeneous agents;

• A Norm Composition Process, based on Ontology-Driven Rules

– Makes it easy to update the system regulation by evolving norms in a unique resource (an ontology) and by customizing particular rules for different compositions of contextual norms;

• A Solution for Informing and/or Enforcing Contextual Norms.



Current Modeling Solutions for MAS Engineering:

rq.i. Explicitly Supports the Organizational Normative Dimension?

rq.ii. Has the Conceptual Model an Implemented Solution for It?

rq.iii. Supports the Management of Norms to be done at System Runtime?

rq.iv. Provides the way for Norm Representation with a Common Understanding for Heterogeneous Agents?

rq.v. Has an Editor, preferably a Graphical one, for its Specifications?

rq.vi. Has a Semi-/Automatic Solution for the Verification of its Specifications?


OMNI V X – V X X

MOISE+ V V V V X X

ISLANDER X V V V V V

DynaCROM V V V V V X



Current Norm Enforcement Solutions: rq.i. Explicitly Supports the Implementation of an Organizational Normative

Dimension?

rq.ii. Has a Manager/Governor/Police Agent for Norm Enforcement?

rq.iii. Directly Enforces Prohibition Norms?

rq.iv. Makes Distinction Between the Implementation of an Organization Entity and a Group of Roles? I.e., is the Organization Concept an Explicit Entity in the Implementation?

rq.v. Can the Structure of the System (in any Dimension, e.g. the Normative one) Evolve at MAS Execution Time?

rq.vi. Has the Implementation a Conceptual Model to Guide its Specifications?


DynaCROM_Moses V V X V V V

DynaCROM_SCAAR V X V V V V


Conclusion – Future Work

• DynaCROM does not encompass a Formal Method amenable to rigorous verification of the system developer’s specifications;

• DynaCROM is currently dealing with Regulative Norms. DynaCROM can also deal with constitutive, procedural and conditional norms;

• DynaCROM does not consider Time Restrictions in norms;

• DynaCROM can support the Implementation of the Legis Superior and Legis Specialis Strategies for conflict resolution;

• DynaCROM is not currently dealing with possible conflicts that exist among norms from different normative contexts;

• JADE behaviors are never interrupted -> DynaCROM should have a mechanism to Limit the Execution Time of JADE Behaviors.


Thesis Publications

• Two Book Chapters:– Post Proceedings of AOIS@AAMAS’06, LNCS 4898, p. 19–36, 2008;– Post Proceedings of COIN@AAMAS’06, LNCS 4386, p. 147–162, 2007.

• Full Paper in Two Conferences: – 23rd Annual ACM Symposium on Applied Computing (ACM SAC

2008);– 4th International Conference on Intelligent Environments (IE'08).

• Full Paper in Seven Workshops:– NorMAS@DEON'08, COIN@AAAI’08, COIN@AAMAS’06,

AOIS@AAMAS’06, SEAS@SBES’06a, SEAS@SBES’06b, SEAS@SBES’05.

• Two Short Papers in a Symposium:– AAAI Fall Symposium: Roles, an Interdisciplinary Perspective:

Ontologies, Programming Languages, and Multiagent Systems. 2005.

Thanks.

an approach to operationalize regulative norms in multiagent systems carolina howard felicíssimo...

Documents

related roles

norm representation

information systems

related work omni islander

mas engineering

mas implementation

managergovernorpolice

ameli moise