flexible decision support in dynamic interorganizational networks

45
Introduction SBN Service Composition TAC SCM HAI Flexible Decision Support in Dynamic Interorganizational Networks Wolf Ketter, with John Collins and Maria Gini Department of Computer Science and Engineering University of Minnesota and Rotterdam School of Management Erasmus University WAI Seminar Vrije Universiteit Amsterdam, Monday, November 9 2009 Work done with: Andrew Nelson, and Dickens Nyabuti John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Network

Post on 19-Oct-2014

1.475 views

Category:

Technology


0 download

DESCRIPTION

An effective Decision Support System (DSS) should help its users improve decision-making in complex, information-rich, dynamic environments. We present a feature gap analysis of current decision support technologies, and we identify a set of DSS Desiderata, properties that can contribute both effectiveness and flexibility to users in such environments. We show that there is a gap between the features provided by current DSS technologies and the DSS Desiderata we aim for. We present a design-science approach that extends the boundaries of human decision-makers by creating a new and innovative artifact called ``evaluator service networks'' at the confluence of people, organizations, and technology. Our artifact enables users to compose decision behaviors from separate, configurable components, and allows dynamic construction of analysis and modeling tools from small, single-purpose evaluator services. The result is a network that can easily be configured to test hypotheses and analyze the impact of various choices for elements of decision processes. We have implemented and tested this design in an interactive version of the MinneTAC trading agent, an agent designed for the Trading Agent Competition for Supply Chain Management. We present an example of an evaluator service network that determines sales prices in a rich, dynamic trading environment. Additionally we describe visual interface elements that allow users to see and manipulate the configuration of the network, and to construct economic dashboards that can display the current and historical state of any node in the network.

TRANSCRIPT

Page 1: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Flexible Decision Support in DynamicInterorganizational Networks

Wolf Ketter, with John Collins and Maria Gini

Department of Computer Science and EngineeringUniversity of Minnesota

andRotterdam School of Management

Erasmus University

WAI SeminarVrije Universiteit Amsterdam, Monday, November 9 2009

Work done with: Andrew Nelson, and Dickens Nyabuti

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 2: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Motivation

Black Monday, October 1987

Motivation

The Dow Jones Industrial Averagedropped by over 22% in one day.Before the dust settled, marketshad dropped as much as 45%.

This was widely blamed on naive computer programs thatautomatically sold when prices fell.Two possible outcomes:

Ban automated trading.Learn how to build automated trading systems that exhibitrational behavior.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 3: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Motivation

Black Monday, October 1987

Motivation

The Dow Jones Industrial Averagedropped by over 22% in one day.Before the dust settled, marketshad dropped as much as 45%.

This was widely blamed on naive computer programs thatautomatically sold when prices fell.Two possible outcomes:

Ban automated trading.Learn how to build automated trading systems that exhibitrational behavior.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 4: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Motivation

Black Monday, October 1987

Motivation

The Dow Jones Industrial Averagedropped by over 22% in one day.Before the dust settled, marketshad dropped as much as 45%.

This was widely blamed on naive computer programs thatautomatically sold when prices fell.Two possible outcomes:

Ban automated trading.Learn how to build automated trading systems that exhibitrational behavior.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 5: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Motivation

Financial Crises, October 2008

Motivation

Credit crises became visible by thefall of Lehman brothers bank, andstarted a world-wide chainreaction in the economy.

Only partial network view.Risk management was based on individual perspectiveand not network perspective.Lessons learned:

Facilitate decision-making in complex business networks.Need to understand network structure that provides highcomplex products and services.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 6: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Motivation

Financial Crises, October 2008

Motivation

Credit crises became visible by thefall of Lehman brothers bank, andstarted a world-wide chainreaction in the economy.

Only partial network view.Risk management was based on individual perspectiveand not network perspective.Lessons learned:

Facilitate decision-making in complex business networks.Need to understand network structure that provides highcomplex products and services.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 7: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Motivation

Financial Crises, October 2008

Motivation

Credit crises became visible by thefall of Lehman brothers bank, andstarted a world-wide chainreaction in the economy.

Only partial network view.Risk management was based on individual perspectiveand not network perspective.Lessons learned:

Facilitate decision-making in complex business networks.Need to understand network structure that provides highcomplex products and services.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 8: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Motivation

The Tyranny of Choice

(Barry Schwartz, 2004)

Conventional wisdom

More choices make people happier, create greateropportunities for business.

Reality

People can be paralyzed by too many options. Online marketscan lead to a combinatorial explosion of possibilities.

Therefore, people need good decision support!

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 9: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Motivation

The Tyranny of Choice

(Barry Schwartz, 2004)

Conventional wisdom

More choices make people happier, create greateropportunities for business.

Reality

People can be paralyzed by too many options. Online marketscan lead to a combinatorial explosion of possibilities.

Therefore, people need good decision support!

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 10: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Motivation

Elements of Decision Support

Decision support depends on information and analysis

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 11: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Motivation

Evolution of Decision Support Systems (1)

Intra-organizational networks

There are many vendors and tools that promise to helpbuild decision support systems, such as ERP systems.

Most provide simple signals to make choices.

Static inter-organizational networks

Traditional supply-chains.

Static decision support systems.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 12: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Motivation

Evolution of Decision Support Systems (1)

Intra-organizational networks

There are many vendors and tools that promise to helpbuild decision support systems, such as ERP systems.

Most provide simple signals to make choices.

Static inter-organizational networks

Traditional supply-chains.

Static decision support systems.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 13: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Motivation

Evolution of Decision Support Systems (2)

Dynamic Inter-organizational networks

Smart Business Networks viewIncreasing modularity of business processes andproducts/servicesQuick-connect and disconnect capability

Many choices and opportunities are available.

.. but choosing requires decision support that can adapt tothe changing network structure, and learn from users.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 14: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

A New Vision for Smart Business Networks

Requires infrastructure changes:

Everything has an IP address!

Standardization

Demand side management (bottom-up instead top-down)

Economic incentives

Automated trading markets

Self-organization

Advanced user interfaces (Economic Dashboards)

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 15: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Flexible and Personalized Decision SupportDesiderata (1)

Decision Sciences

Ability to play out hypothetical scenarios.

Transparency

Smart Business Networks

Network structure visualization

Quick connect and disconnect

Goal directed service composition

Flexible dashboard architecture

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 16: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Flexible and Personalized Decision SupportDesiderata (2)

Software Engineering

Appropriate separation of concerns.

User configurability

User-defined abstractions.

Easy to experiment and test.

Robustness, reliability, availability, etc.

Scalability.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 17: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Decision Support Systems: A feature gap analysis (1)

Five technologies commonly used for building DSS capabilities

Enterprise Resource Planning (ERP) Systems

Data Warehouse (DW) Systems

Spreadsheets (SS)

Expert Systems (ES)

Mash-ups (MU)

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 18: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Decision Support Systems: A feature gap analysis (2)

Desired property DSS TechnologyERP DW SS ES MU

1. Appropriate separation of concerns + + + − −

2. User configurability 0 0 ++ + ++3. User-defined abstractions – – – – − − +4. Easy to experiment and test − − ++ 0 +5. Robustness + 0 − 0 −

6. Scalability ++ ++ − 0 +7. Structure visualization − 0 − + −

8. Quick connect, disconnect – – – – – – − +9. Service composition – – – – – – 0 +

10. Flexible dashboard 0 0 0 0 +11. Transparency − − − + −

12. Hypothetical scenarios + – – ++ + – –

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 19: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Filling the gap (1)

Evaluator Service Networks

Small single-purpose analysis modules:compose into dataflow networksconnect inputs to compatible outputs

Each evaluator has inputs, parameters, process, output,constraints.

Evaluators refer to each other by name rather than directreference.Evaluator names are configurable through:

XML configuration filesUser interface

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 20: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Filling the gap (2)

An evaluator service with its inputs, transform, and output.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 21: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Example: Sales Evaluators

Basic idea1 Determine quantity QX of product X to sell2 Set a price ΦX such that when offered on all demand DX

for X , moves QX units in expectation.3 etc.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 22: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Service Composition

A pipe-and-filter model

Restrict services to dataflow components that can becomposed into directed graphs.

Abstractions can be composed from subgraphs.

Add rich semantic descriptions to components.

Process annotations to ensure that composed graphs haveconsistent semantic descriptions.

Assist user in finding and understanding data.

Assist user in composing graph modifications.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 23: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Service Semantics (1)

Dataflow restriction simplifies annotation.

Connection from component A to component B is possibleif output of A can be mapped to an input of B.

Semantic mappings propagate from input to output of B.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 24: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Service Semantics (2)

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 25: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Trading Agents

MinneTACA highly flexible research tool

The MinneTAC agent is a general architecture forautonomous decision-making agents.

Evaluator Service Networks are at the core and strungtogether at runtime.

A typical configuration contains between 60 and 80 ofthese services.

3rd place in the 2009 TAC SCM competition.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 26: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Trading Agents

What is a Trading Agent?as opposed to an “Agent”

Definition of an autonomous agent(Wooldridge & Jennings 1995)

1. Autonomy

Agent has persistent identity, operates without direct control.

2. Social ability

Agent interacts with other agents and/or human users.

Most communication is negotiation or otherwise related totrading - requests, offers, orders, shipments, payment, etc.

Agents often do not communicate directly with theircompetitors.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 27: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Trading Agents

What is a Trading Agent?as opposed to an “Agent”

Definition of an autonomous agent(Wooldridge & Jennings 1995)

1. Autonomy

Agent has persistent identity, operates without direct control.

2. Social ability

Agent interacts with other agents and/or human users.

Most communication is negotiation or otherwise related totrading - requests, offers, orders, shipments, payment, etc.

Agents often do not communicate directly with theircompetitors.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 28: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Trading Agents

What is a Trading Agent? (2)

3. Reactivity

Agent perceives its environment, responds appropriately.

Tracks prices, supply and demand,

Updates internal models (learning),

Makes offers, accepts orders.

4. Proactivity

Agent exhibits goal-directed behavior, takes initiative.

Uses models and market signals to “buy low, sell high.”

Engages in strategic behavior.

Evaluates it’s own market power, drives market in desirabledirections.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 29: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Trading Agents

What is a Trading Agent? (2)

3. Reactivity

Agent perceives its environment, responds appropriately.

Tracks prices, supply and demand,

Updates internal models (learning),

Makes offers, accepts orders.

4. Proactivity

Agent exhibits goal-directed behavior, takes initiative.

Uses models and market signals to “buy low, sell high.”

Engages in strategic behavior.

Evaluates it’s own market power, drives market in desirabledirections.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 30: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Trading Agents

TAC SCMOverview – Dynamic Business Network Testbed

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 31: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Trading Agents

TAC SCMWhy a simulated testbed?

Enabling research

The problem is too complex for a game-theory solution.

It’s hard to do experiments with real organizations.

Evaluation is needed to validate solutions.

The “Game”

An abstraction of a simple three-tier supply chain (Dell).

Balance between real-world complexity & ease of analysis.

Data can be collected and analyzed, experiments can berepeated.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 32: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Trading Agents

TAC SCMWhy a simulated testbed?

Enabling research

The problem is too complex for a game-theory solution.

It’s hard to do experiments with real organizations.

Evaluation is needed to validate solutions.

The “Game”

An abstraction of a simple three-tier supply chain (Dell).

Balance between real-world complexity & ease of analysis.

Data can be collected and analyzed, experiments can berepeated.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 33: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Trading Agents

TAC SCM

Lessons learned

Businesses don’t trust fullyautonomous agents.

Human preferencesmatter.

Decision support vs.decision automation.

Actor vs. networkdecisions.

Flexible agent architecture.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 34: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Proposed Human-Agent Interaction in TAC SCM

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 35: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Human Agent Interaction

Radically rethink user-agent interaction by

Offering just-in-time information.

Highly relevant to a unique user and his/her current focusof attention.

In a non-disruptive, easily accessible, privacy protectingway.

Essential steps

1 User preference modeling.2 Decision recommendation.3 Feedback.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 36: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Using an Advocate Agent

Enhanced functionality

Multiple user roles

Alerts

Control appliances

Control batteries

Adapting to the user

Learn preferences

Reduce cognitive load

Focus on humanjudgement

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 37: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Decision Support vs. Decision Automation

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 38: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Evaluator Service Networks with Advocate Agents

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 39: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

User roles

We find it useful to distinguish among three classes of usersand decision makers:

Strategic users

Tactical users

Operational users

Each class needs tools to support their reasoning.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 40: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Strategic Dashboard

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 41: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Tactical Dashboard

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 42: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Operational Dashboard

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 43: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Summary

Highly configurable, transparent decision processes thatare described in terms that end users can understand.

MinneTAC design shows how decision processes can becomposed from networks of analysis and modeling tools.

Teaching tool and research framework.

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 44: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Questions?

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks

Page 45: Flexible Decision Support in Dynamic Interorganizational Networks

IntroductionSBN

Service CompositionTAC SCM

HAI

Contact

Email: [email protected]: www.ketter.wsURL: large.rsm.nl

Join us!

John Collins, Wolf Ketter, Maria Gini Flexible Decision Support in Dynamic Interorganizational Networks