craig thompson, steve ford, tom bannon, paul pazandak object services and consulting, inc. main idea...

42
Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive technologies eGents - agents send messages over email AgentGram - menu-based natural language interface wrappers for resources WebTrader/DeepSearch - trader discovers ads for resources via search engines Grid - implications for the grid This presentation: http://www.objs.com/agility/ Dr. Craig Thompson [email protected] www.objs.com/agility 972-612-6998 January 31, 2001 1 © Copyright 2000 Object Services and Consulting, Inc. All rights reserved. © Copyright 2000 Object Services and Consulting, Inc. All rights reserved. Object Services and Consulting, Inc. Agents for the Masses

Upload: scot-terry

Post on 27-Dec-2015

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

Craig Thompson, Steve Ford, Tom Bannon, Paul PazandakObject Services and Consulting, Inc.

Main Idea - piggyback agent capabilities on already pervasive technologies• eGents - agents send messages over email• AgentGram - menu-based natural language interface wrappers for resources• WebTrader/DeepSearch - trader discovers ads for resources via search engines

Grid - implications for the grid

This presentation: http://www.objs.com/agility/

Dr. Craig Thompson [email protected] www.objs.com/agility 972-612-6998 January 31, 2001 11 © Copyright 2000 Object © Copyright 2000 Object Services and Consulting, Inc. All rights reserved. Services and Consulting, Inc. All rights reserved.

Object Services and Consulting, Inc.

Agents for the MassesAgents for the Masses

Page 2: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

ProblemProblem

ImpactImpact

ApproachApproach

• What exactly is an agent grid? How does it help us build and configure agile C4I applications? How does it make agent systems interoperable and agent services available? Is there one grid or many? Is the grid a kind of agent system? How does the grid enable sharing and assure system-wide properties? Is the grid globally scalable, decentralized, and reliable? How do we build a grid?

• Thesis: an architectural approach helps identify and answer these questions.

• Paper: “Characterizing the Agent Grid”, Handbook of Agent Systems (forthcoming) - identifies the questions above and begins to answer several of them.

Agent Grid ArchitectureAgent Grid Architecture

Server

Component

Service

Server

Data Service

AA

A

A

A

AA

A

A

A

A

A

A

A

AA

A

A

A

AA

A

A

A

A

A

A

A

A

A

AA

Server

Data Service

Server

Component

Service

Agents + the Global GridAgents + the Global Grid

Agent Grid - System Concept ViewAgent Grid - System Concept View

• A global agent grid overlaid on the Internet makes it possible to rapidly build scalable, survivable, robust, agile agent-based C4I applications.

Page 3: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

Implications for the GridImplications for the GridIn what we demonstrated, the grid was useful in various ways

• registration/discovery – WebTrader and AgentGram grid agents• interoperability – eGents-grid proxy• flexibility – augment grid with eGents-based transport layer

Grid extensions• each component can be viewed as a generic scalable grid extension

• eGents adds wireless disconnected agents, also adds an email-based asynchronous transport layer

• AgentGram adds general way to MBNLI-enable grid agents using a lightweight interface that operates across the web.

• WebTrader adds web-wide agent/resource discovery• Smart Data Channels adds information flow formalism

• at the same time, each is standalone and useful separately – open component-based agent architecture

Grid implications• several ways to conceptualize the grid - see our paper at www.objs.com to

appear in Bradshaw’s Handbook of Agent Technology• there might be no minimal agent grid - different subsets of the agent grid

are separately useful

Page 4: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

Agents communicating via EmailAgents communicating via Email

• Thesis: Integration of agent technology with pervasive Web-ORB-Email backplanes is a route to making agent technology open, pervasive and robust.

• eGents are agents which communicate over email. eGents leverages pervasive, robust email infrastructure, inherits support for disconnected operations, message queuing, mobile users, firewalls, filtering, logging, and security. eGents use FIPA or KQML Agent Communication Language (ACL) encoded in XML - no ACL parser needed. Status: Prototype, gridified via proxy and as comm. layer, on wireless Palm. NEO, MIATA, CoAX, JBI TIEs. Spec submitted to FIPA. In progress: as grid comm. layer, packaging, extensions.

ProblemProblem ImpactImpact

ApproachApproach

• Dynamic military situations are often disconnected and asynchronous. Need a scalable way to deliver agent messages to 1000’s of (wireless) platforms.

• Agent systems are often closed and require a lot of specialized agent technology. Email is a common denominator in coalition situations.

• Anyone with email can create an agent service that anyone else can use. New eGent apps can be downloaded to the field as situations change.

• Imagine eGents attached to sensors, actuators, people, equipment, and locations as pervasive observers & actors

In these eGents applications, each evacuees/troops/animals have a Personal Status Monitor, which measures location, vital signs, etc.

The PSM contains an eGent which intermittently communicates to subscribing entities using email protocols.

Liaison

Command Post

Family Member

Medevac

Evacuees/Troops/Wildlife/

Etc.

eGentsInside

Steve Ford [email protected] www.objs.com/agility 610-345-0290 January 31, 2001 44 © Copyright 2000 Object © Copyright 2000 Object Services and Consulting, Inc. All rights reserved. Services and Consulting, Inc. All rights reserved.

Theme:Everything

is alive

Page 5: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

Problem. Most agent systems rely on unique and extensive infrastructures that must be widely available if the systems are to be widely used. This is an obstacle to the widespread adoption of agent technology.

Objective. eGents demonstrates that agent technology can scale to global proportions by leveraging an existing infrastructure, rather than propagating a new one.

Approach. eGents is, basically, agents communicating over email. Email is pervasive and robust and already provides many functions an agent system needs - message queuing, encryption, filtering, firewall traversal, support for mobile users. The eGent platform is a multi-threaded Java app with access to an email account on an SMTP/POP3 server. Individual eGents are identified by their name and the email address of the platform, and are managed as threads in the eGent platform's process. Messages are in a subset of FIPA ACL (subscribe & inform), encoded in XML, and sent as the body of an email message.

Recent Progress: (a) We ported eGents to a wireless Palm using Sun's newly released Java for devices, KVM, a troublesome port because of KVM's bleeding-edge nature, lack of tools, and because most Java code will not run under KVM, including most of Sun's Java class libraries, and all of the third party code on which eGents depended. The result runs, but is slow. The main benefit is that it should port easily to other devices (set top boxes, smart phones). (b) We built the eGentGridAgent proxy which extends the grid by demonstrating interoperability of GridAgents with agents that are less "connected". We could have just made a proxy for the PSM demo, but spent a little more time coming up with a generic proxy. We didn't want the eGents platform or an individual eGent to know anything about the Grid, or vice versa. The only component of the system that knows anything about both is the eGentGridAgent, which is just an eGent to eGents and just a GridAgent to the Grid. We wanted to keep the protocol situation simple. We didn't want an eGent to have to know LAN protocols, like Jini or HTTP or RMI or anything that made the eGent less mobile, disconnected, and asynchronous. So, an eGent can be "on the Grid" without knowing anything about the Grid. (c) We installed the Java version of eGents on the 7x24 Grid including a documentation/installation page. (d) We explored another alternative for integrating eGents and the grid as a LAN-to-LAN bridge by extending the grid to provide multiple native communication protocols, e.g., not just RMI but also eGents. (e) We inserted eGents into the MIATA and CoAX TIEs.

Demonstrations. (a) The initial eGents demonstration was a technical report subscription service. (b) For the Science Fair, we developed an eGents demo for a NEO-like scenario. We assume that NEO evacuees have Personal Status Monitors (PSMs) that monitor location, medical status, threats, etc. These PSMs contain eGent platforms and periodically exchange status updates with subscribers, e.g., command posts, medevac units, state department monitors. (c) For the CoAX TIE, we modified the SciFair demo to show a bio-surveillance demo where elephants in Safari Park in the Binni fire zone are in possible danger which might require replanning CoAX operations. (d) For the MIATA TIE, we implemented Field eGents sending Damage Reports to J2/INTEL via email and the Grid.

Plans. (a) prepare a public release of the Java version, (b) speed up eGents on the Palm under KVM if possible, else port to C++, (c) prepare a public release of Palm version, (d) demonstrate email-based eGent installation, (e) integrate Java security and make eGents’ security policy easier for the user to understand and trust, (f) demonstrate eGent that cross firewall boundaries.

Technology Transition. (a) We participated in the TIEs mentioned above and plan an additional collaboration with Rome’s Joint Battle Infosphere. (b) The encoding of FIPA ACL in XML and the JavaMail/MAPI API are candidates for standards, so we submitted these to the FIPA-99 Call for Proposals.

System Requirements. (a) eGents should run on any Java platform, but has only been tested on Windows NT 4.0 SP3. It requires Sun's Java JDK 1.2.2, 5MB of free disk space, and an email (SMTP/POP3) account for each machine on which the eGents platform will run. (b) eGents also runs on KVM (J2ME CLDC 1.0 FCS) on the Palm Vx, the PalmOS Emulator 3.0a5, or under Windows NT. Wireless communications from the Palm is currently via the Novatel Minstrel V wireless modem, Omnisky's wireless Internet access, and AT&T's CDPD digital cellular network. (c) The eGentGridAgent has been tested with CoABS Grid v1.5.0 beta.

Page 6: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive
Page 7: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

eGent DEMO

Purpose• eGentGridAgent proxy is used to connect (wireless) eGents in the field to grid-accessible agents on

a LAN

Demo scenario• PSMs on troops updated with latest status information (geographic, health, threat, …)• other parties (PSM clients like command post or medevac) subscribe and receive inform messages

in response to changes

Displays• PSM Server is displayed in one Java window• DOS windows show activity of the eGentGridAgent proxy and Grid's log agent• PSM Grid Client is displayed in another Java window• Netscape Messenger shows the log of eGent messages

Demo step-through shows• registering the PSM Server eGent with the eGentGridAgent proxy which then registers it with the

Grid• switching to the PSM Client agent, which subscribes to the PSM Server by sending a lookup

message to the Grid Registry, which finds the proxy, which the client thinks is the PSM Server, and then sends a subscribe grid message to the proxy, which passes it along to the PSM Server

• then PSM Server sends back an inform message containing the subscribed values (and sends updates later if any values change)

• the messages thread their way back through the system to eventually be displayed on the client.• if you modify a value on the server, you can watch the update propagated back to the client• you can view the eGent message log with Netscape Messenger.

Page 8: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

eGents interoperating with each other and with an eGent-grid proxy

Machine 1installed on evacuee

PSM servereGent

eGentsplatform**

othereGents

Machine 2perhaps installed at

command post

eGentgrid

agentproxy

eGentsplatform*

othereGents

Machine 3perhaps installed at

medevac unit

PSM clienteGent

eGentsplatform

othereGentsGrid

PSM clientgrid agent

Email Server

subscribeinform

subscribe

inform

su

bs

crib

e

info

rm

info

rm

su

bs

crib

e

All eGents can share one Email server or they can each have their own or anything in between

* Java-based** KVM-based - runs on Palm uses J2ME CLDC 1.0 FCS (KVM), that is, Java for devices runs on a "wireless" palm over the CDPD digital cellular network

Might be on machine 2 or anywhere on LAN or on grid-connected LAN

Page 9: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

ProblemProblem ImpactImpact

ApproachApproach

• Dynamic military situations will require people to task and query agents using complex commands.

• Unconstrained natural language is still not tractable in many situations.

• Humans can task and query agents using complex but understandable commands in constrained natural language.

• This technology can mix pervasively into all applications, both on the desktop and the Web.

• Thesis: Natural language-enhanced user-to-agent communication will simplify basic human-agent interactions while making it possible for humans to formulate complex agent requests.

• Approach: Agents communicate with people and other agents using restricted languages for stating complex queries and commands

• How: AgentGram extends agents with natural language middleware wrappers, dynamically loads grammars, and uses menu-based natural language to query and task agents. Works over the web with many users, can auto-generate NLI interfaces to DBMS, works with speech, and is on the CoABS grid.

Natural Language I/F for AgentsNatural Language I/F for Agents

Dr. Craig Thompson [email protected] www.objs.com/agility 972-612-6998 January 31, 2001 99 © Copyright 2000 Object © Copyright 2000 Object Services and Consulting, Inc. All rights reserved. Services and Consulting, Inc. All rights reserved.

Page 10: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

Problem. Agent-based command and control systems offer real promise in flexibility and adaptability but it is not yet clear how they can be understood and controlled. It would be desirable if we could just talk to systems of agents - but how?

About Menu-based Natural Language Interfaces (MBNLI). Try typing or speaking to a system that has a conventional type-in or speech natural language interface (NLI). Most of your questions and commands will not be understood because they overshoot the capabilities of the NLI system or the underlying application it interfaces to. In addition, you won’t really know about some things you could ask (map or statistical queries?) so your questions and commands will also undershoot the capabilities of the NLI system. Menu-based Natural Language Interface (MBNLI) technology uses standard NLI technology but in a menu-directed completion-based way to restrict the language and guide the user to just the capabilities of the NLI and underlying system. The technology fills a large unfilled niche in user interface design enabling unskilled users to make complex queries and commands.

Objective. The AgentGram project addresses human-to-agent communication via agents that understand constrained MBNLI languages. Humans can task and query one or more agents using complex but understandable commands. This technology can mix pervasively into all applications, both on the desktop and the Web, providing NLI capabilities to not just agents but also information sources, services, and generally any accessible resource.

Approach. Like other NL technology, MBNLI technology uses attribute grammars and a predictive parser. The difference is in using the grammars to predict legal sentence completions and displaying these using menus.

Progress. MBNLI, using a client-server parser farm architecture, supports (a) web-based access, (b) multiple users, (c) multiple simultaneous grammars, (d) speech control via Java Speech Markup Language, (e) the ability to generate MBNLI interfaces to DBMS system given the DBMS schema (and to extract a schema from a DBMS, then generate the MBNLI interface), (f) a partitioning of MBNLI into client and stateless server so a very thin client can be downloaded (with no installation) only requiring JavaScript (alternatively, there’s an Java applets version), (g) LL descriptors on the web, discoverable by traders or the grid, (h) techniques for composing MBNLI grammars and interfaces, (i) ported to IE, (j) patent application. The AgentGram prototype explores the idea of attaching NL wrappers to agents to make it possible for people to query or task them. Sub-grammars of individual agents can be traversed on-the-fly to construct commands or queries which span several agents. The web prototype shows how to make MBNLI technology pervasive on the web.

Demonstrations. In the NEO TIE, the MBNLI component was agentized as an SRI OAA user interface agent (part of the SRI Multi-Modal Map) that translates natural language queries to SQL to be executed by an information access agent (ISI Ariadne). In OBJS demos shown at the Science Fair, MBNLI was used to query the DBMS of Enviro Conference attendees and also to visualize the XML-based grid log. The Boston AgentGram demo finds MBNLI-enabled agents using WebTrader and shows how the sub-grammars of one or more agents can be traversed to produce commands and queries. Our CoABS Grid demo illustrates one example of how our MBNLIGridAgent can be used to integrate MBNLI technology into the grid. In the demo the user is able to interact with the MBNLI web browser interface while the MBNLIGridAgent is able to provide current status regarding the interaction. The CoAX TIE demo shows MBNLI used to extract data on elephants from a bio-surveillance data source at Safari Park in the Binni fire zone area.

Plans. In the near term, we need to (a) develop a French MBNLI interface generator for CoAX; (b) interface AgentGram to agents and data sources in-the-wild (on the open Web and in DoD); (c) possible commercialization.

Technology Transition. A MBNLI agent was used in the Science Fair NEO application coupled to SRI OAA and ISI Ariadne, and modified for use with the CoAX TIE.

System Requirements. MBNLI web client requires Netscape browser; server requires WinNT, ODBC (Access, MySQL, Oracle), a cgi/php-capable web server.

Page 11: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive
Page 12: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

1. Register/deregister MBNLIGridAgentTester on the grid. 2. Lookup available MBNLIGridAgents - two are found (interfaces to NEO DAVCO DBMS and to grid

log). 3. Select one and get a session ID/URL.4. Launch a (Netscape) browser to interact with remote MBNLI (LLWeb) parser farm. At this point, you can

get the current state of the LLWeb interaction, whatever it is (state, translation of the state, or the url for the results [if you evaluate the url (in a browser) you will execute the query & the results will be returned.

Page 13: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

User

CoABS Grid

MBNLIGridAgent

MBNLIGridAgent

GridLogDB

EnviroConf DB MBNLI

Agent Tester

spawns

MBNLIWeb Interface

MBNLIParser System

Netscape

GridLog EnviroConf DB

ParserStateMgr

Store client state

Agents retrievestate

User- Parser

Interaction

MBNLI Grid Agent Demo Design

Page 14: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

ProblemProblem ImpactImpact

ApproachApproach

• If grid applications are to be assembled when needed, the parts must be found somewhere and probably not all will come from the local environment.

• How can we find building block resources (e.g., agents, services, channels, components, data sources) when we need them?

• Today, traders (matchmakers) are used for this purpose but these traders generally know only about closed worlds of resources of limited types (e.g., IDL).

• Anyone on the Web can advertise a resource (e.g., agent, service, data source) that anyone else can discover.

• Advertised resources can be located at runtime to dynamically extend the knowledge and/or capabilities of the client, as well as enable intelligent on-the-fly assembly and reconfiguration of distributed systems.

• WebTrader is a matchmaking service that locates XML-based advertisements for resources embedded in web pages indexed by industrial-strength search engines.

• WebTrader supports type-specific matcher algorithms, trader federation, and can access multiple search engines.

WebTrader: Agent DiscoveryWebTrader: Agent Discovery

OpenAgent

Architecture(SRI)

WebTraderAgent

Ariadne(ISI)

Agent World

Web World

SearchEngine

pageAD

pageAD

page

pageAD

pageAD

pageAD

page

pageAD

pageAD

page

pageAD

GeoCoder WhitePages

Services / Datasources

1

2

3

5

67

AgentGrid 4

WebTrader was used in the NEO TIE to locate evacuees and to find a geocoder.

Dr. Craig Thompson [email protected] www.objs.com/agility 972-612-6998 January 31, 2001 1414 © Copyright 2000 Object © Copyright 2000 Object Services and Consulting, Inc. All rights reserved. Services and Consulting, Inc. All rights reserved.

Page 15: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

Problem. Most agent systems contain some sort of trader (matchmaker or yellow pages) that they use to locate agents by description. This provides late binding of agents to some service provider but does not scale outside of the closed agent system. Also, the trader itself is usually an integral part of agent system implementations and not available separately.

Objective. Build a scalable robust trader component architected for the global grid.

Approach. WebTrader is a scalable trader that locates advertisements (represented in XML) stored on web pages that have been indexed by search engines. Query results allow clients to connect to the most suitable service. Advertisement types include agents, components, data sources, search engines, MBNLI grammars, other traders, channels, and other types. WebTrader leverages industrial strength Web search engines so it is scalable, lightweight, portable, and robust. WebTrader is extensible -- recent changes to WebTrader support adding specialized matchers for ads of specific types. DeepSearch is an application of WebTrader that recursively searches other search engines and traders (using a federation design pattern). This makes specialized Web pages (not indexed by many search engines) accessible to DeepSearch. Also keeps a search history.

Demonstrations. WebTrader was used in the Science Fair NEO application to locate data sources for the location of evacuees and to find a geocoder component. In the demo, ISI Ariadne uses SRI OAA to request WebTraderAgent to find these resources. WebTraderAgent consults the Grid to find a WebTrader service and then uses it to discover candidate resources which are returned to Ariadne via OAA. Other demonstrations show trader federation, service rebinding, and WebTrader used to locate agents that use natural language wrappers. The DeepSearch demonstration shows WebTrader locating ads for search engines on the web and recursively searching them, opening up parts of the web that are usually beyond the reach of general purpose crawlers. WebTraderQueryTool is a recent hybrid of WebTrader and DeepSearch that adds matching and better supports application composition. Patent application.

Plans. WebTrader is on hold as we are putting additional resources on eGents. Things that need doing: (a) harden WebTrader and make the design more open; (b) grow WebTrader ad populations by making it easier to create WebTrader ads manually using a GUI; (c) try to harvest ads from the web to automate the process of ad synthesis (a web-size ontology question); (d) make matching ad type open so specialized search and ranking algorithms can be plugged in.

Technology Transition. We led an effort of OMG Agent WG to review an Agent Resource Description and Discovery Service. We reviewed Agent UML. We are hardening WebTrader and DeepSearch getting ready for a public experiment and possible commercialization.

System Requirements: WebTrader Agent & WebTrader Grid Service require: MS Win NT 4.0 (pure Java programs), Apache (latest) web server, Webinator 2.5 search engine (from www.thunderstone.com) , Sun JDK 1.2.2, Sun XML TR-2 XML parser, GNU Make 3.75, tcsh. DeepSearch requires all of the above plus Netscape or IE, ActiveState Perl 5. Need connection to Internet (licensing quirk of local search engine used).

Page 16: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive
Page 17: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive
Page 18: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

Web Search Engine(s)

Web Trader Engine

Matching

Query (Client Advertisement)

Indexed by

Locates and returns candidate pages

Trading advertisements maybe distributed across some

part of the Web

4

97

3

10 12

8

6

5

WebTrader

11

14

13

WebTrader matches and returns

candidate advertisements

WebTrader Architecture

Web Page

Trader Advertisement2

1

Response

Page 19: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

WebTrader Demo: Discovery, Rebinding, Federation

WebTrader Demo: Discovery, Rebinding, Federation

Page 20: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

WebTrader Demonstration

This demonstration of the WebTrader illustrates

• service binding and rebinding

• trader federation

In the demo, trading ads exist for a variety of components (e.g., service agents, clients, and WebTraders). Metadata including color and cost is included in the ads. A Blue client, for example, asks the USA WebTrader to locate a Blue agent implementing a particular interface and with zero cost, if possible. One is found and bound, and the client makes use of the agent. When the agent unexpectedly dies, the WebTrader is consulted again by the client, in case the “state of the world” has changed. It gets back a new list of agents, sorts them by cost, and goes down the list trying each agent until it finds one that works. If the WebTrader fails to respond, the client can fall back on its cached list of previously found agents. When the Yellow client asks the USA WebTrader for Yellow agents, the WebTrader’s initial search turns up none, as it only consults a domain that indexes ads of Red, White, or Blue agents. However, it does find an ad for a WebTrader that knows about Yellow agents, and so passes on the original client query to the Euro WebTrader, which finds a Yellow agent, passes it back to the USA WebTrader, which passes it back to the client, which then uses it to connect to the agent.

At the right in the figure is shown a service advertisement in XML.

Page 21: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

WebTrader Application: DeepSearch

WebTrader Application: DeepSearch

Page 22: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

WebTrader Application: DeepSearch

DeepSearch is an application of the WebTrader. In this case, the advertisements of interest are service ads for search engines. Many web search engines only index top-level pages leaving the other half of the web unindexed except by these local search engines. So DeepSearch recursively (via federation) locates these local search engines and spawns deeper searches of these.

You start out with the main search page (shown on the right). You select your favorite initial search engines (any or all - e.g., this part just shows metasearching in parallel) and enter a search term like you do for any search engine and hit return. Then the side window pops up with the search results, and as you click on the links, the corresponding pages come up in the main browser window. Local search engines found during searching show up among the links - you can expand them to get the results of their searches, just like you can expand a directory in the Windows File Explorer.

Page 23: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

• Vast sea of information• Many formats supported• Distributed and decentralized failure tolerant• Independence of source format & rendering• Active and passive data (e.g., CGI scripts)

ProblemProblem ApproachApproach

WWW = Opportunity ... WWW = Opportunity ...

• Getting the right information, at the right time, in the right format.

• Smart Data Channels: Standards-based dynamic optimizable Web-based information supply chain where portals are declaratively personalized by type, content, format, data quality, cost, user needs, data source capabilities, and timing specs.

Smart Data ChannelsSmart Data Channels

Tactical Intelligence Repositories

ImpactImpact• Channels automatically deliver information to the

point of need.

Security

PSM

Map

PSM PSM

Map

Merge

Choose

Layer

Layer

Merge

Rescue

Filter

… + Limitations … + Limitations • Insufficient tools to represent, filter, aggregate, & index• Can’t tell when information change is significant• No user or location-specific parameterization• Platform & bandwidth limitations not handled• QoS not handled

Dr. Craig Thompson [email protected] www.objs.com/agility 972-612-6998 January 31, 2001 2323 © Copyright 2000 Object © Copyright 2000 Object Services and Consulting, Inc. All rights reserved. Services and Consulting, Inc. All rights reserved.

Page 24: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

Problem. The World Wide Web has greatly increased the amount of information available on-line, but obtaining the right information at the right time in the right format is still beyond the state of the art, since there is no higher-level Web-wide information model and existing Web tools do not adequately address the problems of filtering, aggregating and disseminating this information. Information must either be accepted "as is" or converted and delivered by manual means or a complex programming process requiring specialized skills. “Portal” or “channel” technology is intended to provide customized information delivery, but current technology has limited modeling and manipulation power, its centralized architecture does not make best use of network computing capabilities, the resultant channels are not resilient to denial of service attacks or component or network failure, and since channel composition is not exposed, collections of channels cannot be optimized to reduce processing and bandwidth costs.

Objective. Develop smart data channels (SDC) technology to allow the flexible and efficient creation of information channels through which information flows through the Web from data sources to information consumers.

Approach. SDC uses and augments existing Web technology and standards to reach the largest market at the least development cost and risk. In particular, SDC is based on XML and XSLT, with the current implementation being in the Java programming language. Details. In SDC, desired channel content is specified declaratively rather than procedurally. This allows the type of information flowing over the channel to be externally visible, which in turn makes it possible to define new channels in terms of existing channels, to use type matching to determine potential information sources for channels, to switch to alternate sources when primary sources become unavailable, and (ultimately) to optimize collections of channels to reduce processing and/or bandwidth costs. SDC operators move information and allow channels to be combined and tailored to individual needs. Flow control on a channel allows specification of update policies for the delivered pages (i.e., the conditions under which changed page content is delivered). Profiles allow customization of output and delivery based on the type of the display hardware. Channels can be automatically parameterized based on user characteristics such as location (e.g., deliver maps for where I am right now).

Demonstrations. SDC was initially demonstrated to the Space and Missile Defense Command under a Ballistic Missile Defense Command SBIR Phase I. A substantially improved XML-Java version was demonstrated to the DARPA CoAbs Program as part of the OBJS Agility project.

Grid. Developed mostly under SBIR, SDC is not currently tied to the CoABS grid. At present, it represents a different sort of grid/infrastructure implementation, also capable of interoperability with agents, the CoABS grid, or DAML.

Plans. (a) Improvements: performance and reliability, design and implement better interfaces for channel creation and subscription. (b) Define a more robust SDC algebra for specifying channels. (c) Integrate SDC with Traders to allow channels to be located and matched more effectively. (d) Develop optimization strategies to conserve system resources. (e) Upgrade from XML to DAML.

Technology Transition. SDC will be used as a test application for the DARPA DASADA program, possibly also as an architecture description configuration representation. NIMA has shown interest for routing map products through processing stations to DoD customers. We are also seeking commercial support for further development.

System Requirements. SDC makes use of Web standards such as browsers, Traders, Java and JavaScript, XML, XSL, and OBJS XML-to-Java parser, CGI scripts, servlets, and browser plug-ins.

Page 25: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

PSM5

PSM15

PSM31

PSM85

Rawsources

MakeChannel

MakeChannel

MakeChannel

MakeChannel

P5

P15

P31

P85

PSM.DTD

PSM.DTD

PSM.DTD

PSM.DTD

MergeChannels

SDC_PSM.DTD

SDC_PSM.DTD

ProjectChannels

SDC_PSM.DTD

X/Y

Merge

MapServer

MapServer.DTD MergeChannels

SDC_PSM.DTD

{provides overlay base}

{provides overlay layers, two layers/PSM}

RescueMake

Channel

MapServerSDC_MapServer.DTD

Example SDC Channel MeshExample SDC Channel Mesh

Page 26: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

SDC Channel Management Interface

Page 27: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

Merged PSM Channel

Page 28: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

Rescue Channel

Page 29: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

MIATA TIE

http://openmap.bbn.com/~burstein/miata/

Page 30: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

Field Agent on Palm transmits Damage Reports via Email and CoABS Grid to J2/Intel over the wireless and wired Internet.

OBJS eGent Field Agent

(TRAC) J2/INTEL

• eGents are agents which communicate over email.

• eGents leverages pervasive, robust email infrastructure, inherits support for asynchronous and disconnected operations, message queueing, mobile users, firewalls, filtering, logging, and security.

• eGent messages are FIPA Agent Communication Language (ACL) encoded in XML.

• eGents runs on Desktop and Palm over wired or cellular networks.

COTSEmail Server

eGentGrid

Proxy

Field Agent on wireless Palm

Steve Ford [email protected] www.objs.com/agility 610-345-0290 January 31, 2001 3030 © Copyright 2000 Object © Copyright 2000 Object Services and Consulting, Inc. All rights reserved. Services and Consulting, Inc. All rights reserved.

Page 31: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

CoAX TIE

http://www.aiai.ed.ac.uk/project/coax/

Page 32: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

W E

N

S

CapeVincent

CapeAmstado

Caca

KasoLagoon

Amisa

J acal

Pra

Ankobra

Tana

Ofin

Afr

am

Daka

Black Caca

Kapowa

White Caca

Mawli

LAKE CACA

Gaoforces

AgadezForces

False Agadezforces

FalseGao

forces

Gao deception is intended to displace firestorm

FIRESTORM

FIRESTORM

LA N

LA N

LA NGrid

DARPADARPACoABS GridCoABS Grid(GITI, ISX)(GITI, ISX)

• Show that an Agent-based C2 framework can support agile and robust Coalition operations

• Show Domain Management services can structure agent relationships and enforce coalition policies

• Show Intelligent Task and Process Management can improve agent collaboration

• Show that the CoABS Grid can be used to rapidly integrate a wide variety of agents and systems

Agent FrameworksAgent FrameworksKAoS Agents (Boeing, IHMC)KAoS Agents (Boeing, IHMC)NOMADS Mobile Agents (IHMC)NOMADS Mobile Agents (IHMC)EMAA/CAST Agents (LM ATL)EMAA/CAST Agents (LM ATL)D’Agents (Dartmouth)D’Agents (Dartmouth)eGents (OBJS)eGents (OBJS)

Agent Grid ServicesAgent Grid ServicesTask and Task and PrProcess Management (AIAI)ocess Management (AIAI)Domain Management Services (Boeing, IHMC)Domain Management Services (Boeing, IHMC)Asynchronous Wireless Connectivity (OBJS)Asynchronous Wireless Connectivity (OBJS)Plan Deconfliction (Michigan)Plan Deconfliction (Michigan)Exception Handling (MIT)Exception Handling (MIT)

Military Military SystemsSystemsCAMPS (AFRL,GITI, BBN)CAMPS (AFRL,GITI, BBN)MBP (DERA)MBP (DERA)……

Agents on the GridAgents on the GridAODB Agent (LM ATL)AODB Agent (LM ATL)Observer Agents (Dartmouth)Observer Agents (Dartmouth)eGents E-mail Agents (OBJS)eGents E-mail Agents (OBJS)Malicious Agents (IHMC, Boeing)Malicious Agents (IHMC, Boeing)Web Weather Agent (USC/ISI)Web Weather Agent (USC/ISI)……

DARPADARPA

Expected Results

Objectives

Accomplishments and Impact

Concept

• Demonstrated proof-of-concept C2 coalition architecture within a realistic coalition scenario

• Connected disparate stand-alone military systems while taking coalition concerns into account

• Agent organization, behavior, security and resources managed by explicit coalition policy control

• Potential influence on Joint Battle Infosphere, Joint Battlespace Digitisation, CINC 21, and Coalition Theatre Logistics perspectives

• Interest from additional nations in participating

Oct 2000

July 2001

July 2002

• Information gathering for MBP• 25 agents in 5 distinct domains• Binni coalition storyboard

• Planning and execution phases• 45 agents in 7 overlapping domains• Initial packaging of grid services• Realistic Binni Storyboard

• Dynamic event-driven workflow• Dynamic coalition formation• Dynamic coalition scenario• High-level re-usable tools

DARPA CoABS, AFRL, DERA, Edinburgh/AIAI, Boeing,Dartmouth, LM-ATL, MIT, OBJS, UMichigan, USC/ISI, UWF/IHMC

With support from BBN, GITI, ISX, MITRE, Schafer and Stanford Univ.

Coalition Agents eXperiment - CoAXCoalition Agents eXperiment - CoAX

Page 33: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

I see a tank!

Needfuel!

observations &subscriptions

orders & recommendations

OBJS eGents: Agents over Email

OBJS eGents: Agents over Email

Anythreats?

Theme:Everything

is alive

Page 34: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

Safari ParkAre the Safari Park elephants in danger?

• eGents monitor and transmit positions of the two elephant herds

• menu-based natural language queries determine the elephants are migrating out of the firestorm area

Elephant herd migrationsover the last 40 months

Current position of herd17.0N/ 34.4E - 2012/09/01 14:20

Theme:Everything

is alive

Dr. Craig Thompson [email protected] www.objs.com/agility 972-612-6998 January 31, 2001 3434

OBJS role in

CoAX TIE

OBJS role in

CoAX TIE

Page 35: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

CoAX Vignette: (CNN) Information Agents Save Endangered Elephants at Safari Park

In our upcoming 18-month scenario we are focusing on execution - so an opponent is now involved, things are going to change and we can expect the unexpected. Activities now focus on: execution; execution monitoring; dynamic plan review, maintenance and update (time-scale hours); combat assessment and battle damage assessment; 'information operations', media ops and support activities (logistics, medical personnel admin etc). The bottom line here is lots of complexity, intense dynamics, and small tactical events can have strategic effects, so ...

• The firestorm has been planned in part of Binni near the Laki Safari Park. The elephants in the Park were fitted with tags in 2009 as part of a WWF program to monitor the effect on the elephants of the climate/agricultural changes in the area. The tags report information on the elephants (position, etc) using eGents (part of the Everything is Alive pervasive computing grid).

• The media have heard about the firestorm mission and there has always been political disquiet about it - but they now get a 'leak' that the mission is near the Safari Park. The JTFC is ordered to monitor the Park and finds out about the WWF tags and uses the information from them to locate the elephants. MBP will show the position of the herd as a single icon which updates as eGents send in new position information.

• JTFC wants to find out more about the elephants and how far they roam. It uses MBNLI to access the WWF database of information collected by the tags over the last three years and finds that the elephants tend to move west in September - and information that the eGents are currently collecting shows that indeed that this is what is occurring.

• The firestorm is potentially compromised and a go / no-go decision has to made at the highest level as by now the aircraft will be about to take off and time on target is only 40 minutes away ....

The vignette shows off:

• OBJS eGents – agents communicating via email and the grid

• OBJS MBNLI – querying open data sources using menu based natural language interfaces

• DERA MBP – to gather and display issues and observations

Dr. Craig Thompson [email protected] www.objs.com/agility 972-612-6998 January 31, 2001 3535 © Copyright 2000 Object © Copyright 2000 Object Services and Consulting, Inc. All rights reserved. Services and Consulting, Inc. All rights reserved.

Page 36: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

eGents in CoAX Agents over EmaileGents in CoAX

Agents over Email• eGents enabled Digital Assistants

– PDAs and ADAs (autonomous DAs) including sensors, actuators, cameras, recorders, range finders, …

– are connected by wireless networking (cellular, radio) and– associated with soldiers, observers, NGOs, ... vehicles, weapon

systems, …, bridges, buildings, ...– to report status, make observations, take simple actions– can dynamically accept new or revised tasks

• In the demo, eGents is used in a bio-surveillance application to monitor wildlife in Safari Park and understand the environmental dangers posed to elephant herds by the Binni firestorm plan

• Next CoAX Step: Observations fed into battle-planning systems (e.g., process panel & MBP) through the CoABS Grid and orders & information fed back to the field.

Page 37: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

NEO TIE

Page 38: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

Example Hypotheses• Agents can monitor broad classes of

information sources and dynamically identify relevant events

• Humans can be kept in-the-loop by tailoring interface’s abstraction level to avoid information overload

Multiple Agents, Multiple InteractionsExperimental Methodology

Responding to the Unexpected:Autonomy and Intelligence Required

• Use live, externally controlled Internet sources to evaluate event coverage

• Incrementally expand complexity of interaction to test scalability of messaging and agent response times.

• Evaluate interface with human subjects to determine effect on cognitive load.

OBJSprototypes

NEO TIEIssues in Runtime Reactivity

NEO TIEIssues in Runtime Reactivity

Page 39: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

• NEO TIE Interactions - OBJS prototypes WebTrader and MBNLI (AgentGram) were used in TIE#2 Query 1 and 2

• Query 1– Human to MMM: speech - “Find all the Enviro Conference attendees and their locations”.– MMM to MBNLI: text string -- “Find all the Enviro Conference attendees and their locations”.– MBNLI to MMM: SQL Query– MMM to Ariadne: SQL Query– Ariadne to WebTraderAgent: requests trading (client) advertisement for Geocoder– WebTraderAgent to Grid: locate grid’s WebTrader– WebTrader to Ariadne: result of ad matching process (including Geocoder URL)– Ariadne to MMM: tuples (name, address, phone, lat, long)– MMM places addresses on map

• Query 2– Human to MMM: speech - “Find all of DAVOCO’s American employees and their locations”.– MMM to MBNLI: text string -- “Human to MMM: speech - “Find all of DAVOCO’s American employees and their locations”.– MBNLI to MMM: SQL Query– MMM to Ariadne: SQL query– Ariadne to WebTrader: trading (client) advertisement for Kuwait white pages– WebTrader to Ariadne: result of ad matching process (including white pages URL)– Ariadne to MMM: tuples (name, address, phone, lat, long)– MMM places addresses on map

Page 40: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

http://www.objs.com/agent/index.html

Meeting #13 - Irvine, CA, February 26-27, 2001

CoABS/DAML SPEAKERS NEEDED

OMG Agent SIG

Page 41: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

• Agility Project Homepage - http://www.objs.com/agility

• Agility Overview http://www.objs.com/agility/tech-reports/0101-CoABS-Agility-Miami/

poster/0101-Agility-poster.htm or .ppt (Office 2000)presentation/0101-Agility-CoABS-Miami.htm or .ppt (Office 2000)

• Prototypes• eGent: Agents over E-mail

http://www.objs.com/agility/tech-reports/9911-eGents.html• WebTrader: Discovery and Programmed Access to Web-Based Services

http://www.objs.com/agility/tech-reports/9904-WebTraderWWW8Poster.html• MBNLI sample screens

http://www.objs.com/agility/tech-reports/0101-CBNLI.doc

• Architecture• Characterizing the Agent Grid

http://www.objs.com/agility/tech-reports/000304-characterizing-the-agent-grid.doc• System-wide Grid Properties

http://www.objs.com/aits/9901-iquos.html• Strawman Agent Architecture

http://www.objs.com/agility/tech-reports/9808-agent-ref-arch-draft3.ppt

• OMG Agent WG Homepage - http://www.objs.com/agent/index.html - co-chair: Thompson

includes OMG Agent Technology Green Paper, RFI responses, liaison w FIPA, and minutes

References

Page 42: Craig Thompson, Steve Ford, Tom Bannon, Paul Pazandak Object Services and Consulting, Inc. Main Idea - piggyback agent capabilities on already pervasive

Object Services and Consulting, Inc.

OBJS Logo