Seminar on Intelligent Systems,

Interaction and Multimedia

Eugénio Oliveira and Daniel Silva MIEIC Edition 2016-2017

Institucional Web Site Specífic Web Site

Objectives

-  Usually in non-traditional Informatics Application Domains -  Application Domains charaterized as DDD or of great complexity (quantity or sophistication)

• Intelligent Systems :

• Computational Systems, based on:

•  Knowledge (not only Data or fixed algorithms) •  having features like: Adaptation/ Evolution/ Learning/ Knowledge Extraction

Syllabus

Subjects to be presented:

- Communities and Dynamics in Social Networks - Simulation and Development of Multi-Agent Systems

-  Electronic Institutions and B2B Contracting - Models (Trust, Norms/ Neworks (Companies, Social...)

- Teams Coordination (Joint Missions) -  Intelligent Transportation Systems

Syllabus

-  Information Visualization -  Introduction to “Text Mining” -  Search and discovery in the health domain

Subjects to be presented:

- Introduction to Cloud Computing -  Intelligent Robotics - HCI, “Gamification” and Serious Games

-  Others

Assessment •  Attending and participating in the classes 15% •  Work assignment about one of the presented subjects:

•  Write a scientific Article OR Report OR/AND •  implement a system and write Report

•  Intermediate “Extended Abstract” 10% •  Final Oral presentation 25%

•  Final Article/Report (may include Demo) 50%

Joint Mission Execution by Heterogeneous Autonomous Vehicles

•  Outline – Autonomous vehicles – Joint mission execution by teams of

heterogeneous vehicles – The platform

developed at LIACC •  Architecture and

components •  Main features

and applications

Daniel Silva COORDINATION

Joint Mission Execution by Heterogeneous Autonomous Vehicles

•  Possible topics for course work –  Improve the current agent

communication platform •  Polling -> event-driven messaging •  Add security layer

•  Improvements to the existing platform

•  Adapt air traffic control to water / land traffic

•  Real-time visualization and monitoring

•  Disturbance simulation and management

•  …

Air Traffic Flow Management using Multi-Agent Systems

•  Outline

– World Air Traffic Control – Simulation Environment – Air Traffic Flow Management – Some Developed Projects – Project Proposals

MSc. Álvaro Câmara

MASDIMA

•  Coordination and Applications of Multi-Agent Systems: – Disruption Management in Airline Operations

Control: An Intelligent Agent-Based Approach

Ana Paula Rocha

MASDIMA •  Proposals: •  Study of strategies to solve problems in Airline Operational

Control Centers (OCC) –  To solve the problems that arise in airline OCCs (flight delays,

missing crewmember, etc.) by trying diverse solutions using: •  Ant Colony Optimization •  Particle Swarm Optimization (PSO) •  Genetic Algorithms •  Others....

•  Learning in Negotiation applied to OCCs –  Give existing agents a learning mechanism used in proposal

formulation during negotiation. –  The learning method to use is Q-Learning. –  Q-Learning can be used to:

•  Learn the best actions to use (domain operators) in problem solving..

-  Multi-Agent Systems Cooperation: Disruption Management in Airline Operations Control An Intelligent Agent-Based Approach Ana Paula Rocha (LIACC)

Communities and Dynamics in Social Networks

•  Social Network and Complex Systems Analysis – Networks and Graphs – Metrics – Community Detection

Francisco Restivo

Communities and Dynamics in Social Networks

•  Outline – Networks are everywhere

•  Social, biological, financial, etc.

– Complex networks – Communities reveal properties of networks – Communities vs. clusters – Software tools – Some project ideas

Pedestrian Simulation and Evacuation

•  Outline – Basic concepts – Pedestrian modelling /simulation / behavior – Agent-based Modelling and Simulation – Test, validation and calibration of pedestrian

models – Development of a simulation project

João Almeida

Simulation and Development of Multi-Agent Systems

•  MAS Simulation vs Development – Multi-Agent based Simulation (MABS)

•  Computer simulation where entities are modeled and implemented as agents

•  Agent-based simulation tools – Multi-Agent System

•  System composed of autonomous, intelligent and interacting agents

•  Development tools

– MABS can be useful while developing MAS applications

Henrique Cardoso

Simulation and Development of Multi-Agent Systems

•  SAJaS+MASSim2Dev – Bridge simulation and development of MAS

•  Develop high-performance simulations using MAS development features: “MAS-like MABS”

– Approach •  Simple API for JADE-based Simulations (SAJaS)

–  Light implementation of most JADE features –  Integration with simulation framework (e.g. Repast)

•  MAS Simulation to Development (MASSim2Dev) –  Eclipse plugin conversion tool: JADE ↔ SAJaS

Electronic Institution Platform

for B2B Contracting

•  Negotiation, Contracts and monitoring in Networks (Models and Environments)

•  Applications to Enterprise Networks and “Electronic Institutions”

Ana Paula Rocha

ANTE Platform

ANTE PLATFORM FOR B2B CONTRACTING

ANTE- Agreement Negotiation in Normative and Trust enabled Environments

An institutional normative environment includes:• a flexible and expansible

normative framework that facilitates contract establishment

• a contract monitoring service

• enforcement mechanisms

Agent-based automatic negotiation includes:• negotiation protocols for

partner selection• ontology-mapping tools• negotiation-mediation

service with information privacy

• reputation-aware contract negotiation

A Computational Trust and Reputation (CTR) system that takes into account:• the dynamics of trust

building• the contextual fitness of

business partners to a specific business opportunity

..

.

Electronic Institution Platform

for B2B Contracting •  Electronic Institutions:

– Reliable entity whose purpose is to facilitate interactions between entities (agents) defining and imposing rules that:

•  define standard interactions, establish obligations and sanctions, prevent undesirable situations, …

– Topics to include: •  Negotiation between participants (in the business) •  Argumentation and learning in negotiation •  Trust in other participants •  Definition of participant profiles

Interest in the Electronic Business scenario, but not only on that...

Computational Trust Model

•  Computational Trust Model as a social and contextual construct

•  CTM for social networks, e-commerce, telecom and Distributed Systems

•  SOLUM Situation-aware and sOciaL computational TrUst Model framework developed at LIACC

Theme: Computational Trust Modelling

–  P1: Survey: how trust is being modelled and used in social networks: a critical analysis

–  P2: you need to test one or more computational trust algorithms proposed in the literature to be used in Twitter and Facebook in order to verify if they really are measuring trust or something else

–  P3: you need to test the Contextual Fitness algorithm (which was developed at LIACC to adapt measurement of trust to the specific context of the application domain) in real applications. A proposal of improvement is expected

–  P4: you are expected to propose specific implementations of one or more of the functionalities of SOLUM

–  In all projects, you are supposed to write a scientific article to be submitted to an international conference or journal

Information Visualization

•  Agenda – Why Information Visualization? – Brief History – Current Trends – Rules for Creating Good Graphics – Tools and Websites

Daniel Silva The importance of Interfaces understandability

Text Mining @ SAPO

•  Introduction to Text Mining •  Web applications with

analysis of corporate repositories of text in Portuguese: – Verbatim / VOXX / “Time Machine”

•  Extraction of relations and their semantics from text in Social Networks

Jorge Teixeira Pedro Saleiro

Text Mining @ SAPO

•  Information Extraction (IE) –  Identification of Mentioned Entities –  Extraction of micro-biografies –  Extraction of quotes –  Identification of topics in news –  News clustering –  Creation of “histories” throughout time –  Extraction of relations between nodes (persons) in

(social) Networks •  Machine Learning (ML) Applications

–  News Categorization –  Recognition of Mentioned Entities (RME) –  Clustering; Similarity

Text Mining @ SAPO

•  Connecting Dots Between News "… larger and larger amounts of news content is published every day. With this much data, it is often easy to miss the big picture.” (Shahaf and Guestrin, 2010)

•  Objective: – Automatically aggregate similar news and build news chains

•  Scientific Challenges – Similarity:

•  What news data are important for the similarity process? •  Which methods to use in this process? How to evaluate the process?

– Keywords extraction: •  Can any word be considered a keyword? •  Can a news be described by a simple word? a compound word? or an

entity? How to extract useful keywords from the news? – News Chains:

•  How to aggregate news clusters? What fields need to be considered ?

Text Mining @ SAPO

•  Natural Language Processing (NLP) – Tokenization – Normalization – Authorship identification – Detection of paraphrases

•  Information Visualization (InfoViz) – Twittómetro – Mundo Visto Daqui interativo (MVDi) – Twitteuro

Search and discovery in the health domain

•  Brief Summary: –  “I will introduce information retrieval

from an health perspective and will refer to the use of the Internet to learn about health. More specifically, I will focus on ways to make health information more accessible to lay people and how we can discover new health facts and phenomena from online information.”

Dr.ª Carla Lopes

Search and discovery in the health domain

•  Work Assignments: – T1: Using an eye-tracker to detect users

proficiency in the English language – T2: Assessing and comparing the readability

of online topics – T3: The use of Social Network Analysis to

understand behavior dynamics in online health forums: state of the art

– T4: Automatic text simplification in the health domain: state of the art

A View of Cloud Computing:

Concepts and Challenges

•  Agenda: •  Part I: Basic Concepts

–  Introduction and Principals Overview •  Part II: Challenges

– Fault Tolerance – Energy optimization – Quality of Service (QoS) – Multi-criteria approach

•  Part III: Current Research

Dr. Jorge Barbosa

A View of Cloud Computing:

Concepts and Challenges

•  Hot Topics in Cloud Research: •  Fault tolerance

–  Business continuity and service availability –  Autonomic Computing

•  Energy efficiency –  Optimize energy consumption (ex.: maximize Mflop /

Joule) –  Green cloud computing - minimize operational costs but

also reduce the environmental impact •  Quality of Service

–  Performance unpredictability (ex.: due to sharing of resources among co-located VMs)

MASDIMA

•  Coordination and Applications of Multi-Agent Systems: – Disruption Management in Airline Operations

Control: An Intelligent Agent-Based Approach

Dr.ª Ana Paula Rocha

MASDIMA

•  Proposals: •  Problem Resolution Strategies Applied on Airline

Operations Control Centers (MASDIMA): –  New best strategies (through the use of heuristics or meta-

heuristics) to solve the problems that appear during daily operations and integrate it in our negotiation protocol.

–  Possible methods to use: Ant Colony Optimization (ACO), Particle Swarm Optimization (PSO), Genetic Algorithms (GA), others …

–  Include Argumentation during Communication

–  Additional Information: This work can be used totally or partially on the dissertation: “Studies of Evolutionary Computation applied on Operational Control Centers”, presented by LIACC/NIADR

Intelligent Robotics, Coordination and MAS

•  IntellWheels: Realistic Simulation of an Intelligent Wheelchair, Profiling and Adapted Command Languages: –  Intellwheels Simulator – Serious game with the goal of helping patients

learning to drive the wheelchair. Elicitation of user profiles

– Command Language for driving the wheelchair – Results of tests with actual patients with

cerebral palsy from APPC.

Luís Paulo Reis

Gamification

•  Games are fun and engaging… Why aren’t our lives / work / school

that fun and engaging?

António Coelho

Gamification

What is Gamification?

“The the use of game design elements in non-game contexts.” + “game design techniques”

Intelligent Transportation Systems

•  Goals – To present the field of

Intelligent Transportation Systems (ITS), in which Computer Science, Informatics Engineering and Telecommunications play an imperative and crucial role;

– To introduce basic concepts of ITS, and the role of modelling and simulation in fields such as traffic control, autonomous driving and pedestrian simulation;

Dr. Rosaldo Rossetti

Physical Computing and Interaction Design

•  Agenda –  Importance of Human-Computer Interaction (HCI)

as a strong area of research –  Resources required to research HCI –  Skills and manufacturing capabilities needed to achieve

the required combinations of sensors, actuators and controllers

–  Recent technologies in the areas of sensors, actuators and controllers

–  Introduction to the area of Physical Computing –  New ways of interacting with data, in terms of operations

and the impact results of such operations can have on the physical world

–  Common tools, platforms and applications

Rui Rodrigues

Combinatorial games - what they are and why you shoud play them

•  Brief Summary – The talk is devoted to combinatorial game

theory, a fairly new mathematical subject with interest to computer scientists. The subject deals with two-person games with no chance involved and with perfect information. It sheds new light on the AI approach to game programming. Most of the problems considered are NP-hard.

Prof. Stanislaw Goldstein

Computer Games Immersion and player’s interaction

•  Psychophysiological Affective Response Models For Digital Videogames

Trabalhos / projetos / artigos

“…the need for accurate real-time emotion detection and – primarily – to systems capable of learning from each user's reactions, so that they are able to trigger the most adequate emotional states in a logical, coherent and timely manner.

“…systems capable of dynamically altering their content coherently.”

“The proposed methodology enables the correlation of human-computer interaction events to emotional responses, from which a computational user affective model can be extracted. This model can then be used to simulate and predict the result of future interactions, thus determining the most adequate course to achieve the desired affective experience. “

Programa

Temas a apresentar: - Multimodal Interfaces

Aplicações: •  IntellWheels: Realistic Simulation of an Intelligent Wheelchair, Profiling and Adapted Command Languages (Mónica Faria, Luis Paulo Reis)

Programa

Tema específicos a apresentar: - Automatic Software Debugging: A model-free, Bayesian-based reasoning approach

TEMAS DE TRABALHOS: T1: What is the impact of the prior probability in the diagnostic ranking? T2: How robust is Barinel to the Maximum Likelihood Estimation Method? Can we do better?

Trabalhos Áreas de Trabalhos propostos: T1: Simulação de Sistemas Inteligentes (Tráfego, peões) T2: "Text Mining“ T3: Instituições Electrónicas T4: Coordenação e Sistemas Multi-Agente T5: Experimentação de Ferramentas de análise de Redes Sociais T6: Análise de Dados de “data sets” publicamente disponíveis T7: HCI, Interação e Jogos T8: Outros de acordo com os temas apresentados

THE END

•  THANKS for paying attention