david vernon short intro to robotics and ai

Upload: subham-dalmia

Post on 07-Apr-2018

223 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    1/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    2/79

    Copyright 2007 David Vernon (www.vernon.eu)

    A Short Introduction to

    Robotics and AI

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    3/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Learning Objectives

    Nature of robotics

    Robotic applications

    Principal engineering issues

    Principal AI issues The future of robotics

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    4/79

    Copyright 2007 David Vernon (www.vernon.eu)

    The Word Robot

    Robot is derived from a Czech word meaningforced labor

    First appeared in a 1920 play R.U.R.(Rossums Universal Robots)

    by Czech playwright Karel Capek.

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    5/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Definitions

    "A reprogrammable, multifunctional manipulator designedto move material, parts, tools, or specialized devicesthrough various programmed motions for theperformance of a variety of tasks

    Robot Institute of America

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    6/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Types of Robot

    Manipulators

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    7/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Unimate Puma Robot

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    8/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Adept's SCARA robots,images courtesy ofAdept Technology

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    9/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Stubli's RX130manipulators, images

    courtesy of Stubli

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    10/79

    Copyright 2007 David Vernon (www.vernon.eu)

    CRS' F3 robot testing amobile phone, image

    courtesy of CRS

    Robotics

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    11/79

    Copyright 2007 David Vernon (www.vernon.eu)

    BH8-260 Hand from Barrett Technology,

    image courtesy of Barrett

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    12/79

    Copyright 2007 David Vernon (www.vernon.eu)

    The Space Station Remote Manipulator System (SSRMS)

    Canadarm - Robot arm on every Space Shuttle, image courtesy of

    the Canadian Space Agency

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    13/79

    Copyright 2007 David Vernon (www.vernon.eu)

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    14/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Types of Robot

    Manipulators

    Mobile robots

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    15/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Urban Robot Platform - image courtesy of

    NASA JPL

    Urban Robot Platform - image courtesy of NASA JPL

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    16/79

    Copyright 2007 David Vernon (www.vernon.eu)

    iRobot-LE - imagecourtesy of iRobot

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    17/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Oberon - underwater robot developed by the

    Australian Centre for Field Robotics

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    18/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Dante II robot, imagecourtesy of NASA

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    19/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Mars Sojourner, image courtesy of NASA

    Urban Robot Platform - image courtesy of NASA JPL

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    20/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Mars Sojourner, image courtesy of NASA

    Urban Robot Platform - image courtesy of NASA JPL

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    21/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Honda's P1 HumanoidRobot

    (controlled via tether)

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    22/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Honda's P3 Robot

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    23/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Honda's ASIMO Robot

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    24/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Honda's ASIMO Robot

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    25/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Types of Robot

    Manipulators

    Mobile robots

    Entertainment

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    26/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Sony's 1st Generation

    Aibo Robot Dog

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    27/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    28/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    29/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    30/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    31/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    32/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    33/79

    Copyright 2007 David Vernon (www.vernon.eu)

    MIT AI Lab COG

    (with Rodney Brooks)

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    34/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    35/79

    Copyright 2007 David Vernon (www.vernon.eu)

    iCub

    (www.iCub.org)

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    36/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    37/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Robotic Applications Parts handling

    Assembly Painting

    Surveillance

    Security (bomb disposal really telechericsrather than robotics)

    Home help (grass cutting, nursing)

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    38/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    39/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    40/79

    Copyright 2007 David Vernon (www.vernon.eu)

    CMU Nursebot project

    FLO

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    41/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    42/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    43/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Exploration

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    44/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    45/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Mechanical Construction

    ControllerArm

    Drive

    End Effectors

    SensorPlease click over the picture

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    46/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    47/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    48/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    49/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Trajectory Generation

    Cartesian space vs. Joint Space

    Manipulator kinematics (given joint angles, find positionand orientation of end effector)

    Inverse kinematics (given position and orientation ofend effector, find joint angles)

    Dynamics

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    50/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    51/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Trajectory Generation

    Problems with Cartesian space interpolation

    Unreachable configurations

    Multiple solutions

    Task Specification & World

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    52/79

    Copyright 2007 David Vernon (www.vernon.eu)

    as Spec cat o & o d

    Modelling

    Specification of orientation:

    Use transformation matrices and Eulerangles or Roll-Pitch-Yaw convention

    +

    +

    =

    =

    ccscs

    sccssccssscs

    sscsccsssccc

    cs

    sc

    cs

    sc

    cs

    sc

    RXYZ

    A

    B

    0

    0

    001

    0

    010

    0

    100

    0

    0

    ),,(

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    53/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    54/79

    Copyright 2007 David Vernon (www.vernon.eu)

    AI & Robotics

    Interaction with the environment

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    55/79

    Copyright 2007 David Vernon (www.vernon.eu)

    The Real World

    Uncertain, Incomplete, Time-varying

    From Introduction to AI Robotics, Robin Murphy

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    56/79

    Copyright 2007 David Vernon (www.vernon.eu)

    AI &Robotics

    Agent based examples taken from:Q. Tipu, University of Southern California

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    57/79

    Copyright 2007 David Vernon (www.vernon.eu)

    AI & Robotics How to represent knowledge about the world?

    How to react to new perceived events? How to integrate new percepts to past experience?

    How to understand the user?

    How to optimize balance between user goals & environment constraints? How to use reasoning to decide on the best course of action?

    How to communicate back with the user?

    How to plan ahead? How to learn from experience?

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    58/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    59/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    60/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    61/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    62/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Agent Types

    We can split agent research into two main strands:

    Distributed Artificial Intelligence (DAI) Multi-Agent Systems (MAS) (1980 1990)

    Much broader notion of "agent"(1990s present) interface, reactive, mobile, information

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    63/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Towards Autonomous Vehicles

    http://iLab.usc.edu

    http://beobots.org

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    64/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Interacting Agents

    Lane Keeping Agent (LKA) Goals: Stay in current lane

    Percepts: Lane center, lane boundaries

    Sensors: Vision Effectors: Steering Wheel, Accelerator, Brakes

    Actions: Steer, speed up, brake

    Environment: Freeway

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    65/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Interacting Agents

    Collision Avoidance Agent (CAA) Goals: Avoid running into obstacles

    Percepts: Obstacle distance, velocity, trajectory

    Sensors: Vision, proximity sensing

    Effectors: Steering Wheel, Accelerator, Brakes, Horn, Headlights

    Actions: Steer, speed up, brake, blow horn, signal (headlights)

    Environment: Freeway

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    66/79

    The Right Thing =

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    67/79

    Copyright 2007 David Vernon (www.vernon.eu)

    The Rational Action Rational Action: The action that maximizes the

    expected value of the performance measure given

    the percept sequence to date

    Rational = Best ?

    Rational = Optimal ? Rational = Omniscience ?

    Rational = Clairvoyant ?

    Rational = Successful ?

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    68/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    69/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Behavior and performance of IAs

    Perception (sequence) to Action Mapping: f: P* A

    Ideal mapping: specifies which actions an agent ought to take at anypoint in time

    Description: Look-Up-Table vs. Closed Form

    Performance measure: a subjectivemeasure to characterize how

    successful an agent is (e.g., speed, power usage, accuracy, money,etc.)

    (degree of) Autonomy: to what extent is the agent able to make

    decisions and actions on its own?

    How is an Agent different from other

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    70/79

    Copyright 2007 David Vernon (www.vernon.eu)

    software?

    Agents are autonomous, that is they act on behalf of the user Agents contain some level of intelligence, from fixed rules to learning

    engines that allow them to adapt to changes in the environment

    Agents don't only act reactively, but sometimes also proactively

    Agents have social ability, that is they communicate with the user, thesystem, and other agents as required

    Agents may also cooperate with other agents to carry out more complextasks than they themselves can handle

    Agents may migrate from one system to another to access remote

    resources or even to meet other agents

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    71/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Agent types Reflex agents

    Reflex agents with internal states Goal-based agents

    Utility-based agents

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    72/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Reflex agents

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    73/79

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    74/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Reflex agents w/ state

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    75/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Goal-based agents

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    76/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Utility-based agents

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    77/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Anticipate

    AssimilateAdapt

    Action Perception

    Cognition

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    78/79

    simulated sensory signals

    Perturbation

  • 8/6/2019 David Vernon Short Intro to Robotics and AI

    79/79

    Copyright 2007 David Vernon (www.vernon.eu)

    Phylogenetic self-organizingperceptuo-motor skills

    Modulation circuit:homeostatic action selection

    by disinhibition of perceptuo-motor skills

    Motivation(Amygdala)

    Auto-associativeMemory

    (Hippocampus)

    ActionSelection

    (Basal Ganglia)

    Motor/SensoryAuto-associative

    Memory

    Sensory/MotorAuto-associative

    Memory

    simulated motor signals

    Prospection by

    action simulation

    Perturbation