Slide 1

1 Final Conference, 19th 23rd January 2015 Geneva, Switzerland A Macro-Micro Visual Servoing Controller for Mobile Manipulation Research Package(RP): 10 ESR: Mohammad M. Aref Supervisor: Jouni Mattila Organization: Tampere University of Technology Project: 06/2011 06/2014 Presented by: Reza Ghabcheloo

Slide 2

2 Final Conference, 19th 23rd January 2015 Geneva, Switzerland Background Information

Slide 3

3 Final Conference, 19th 23rd January 2015 Geneva, Switzerland Project results & Learning outcome System engineering concepts for mobile manipulation in scientific infrastructures Control system architecture and fault tolerance Visual servoing other relevant skills through numerous PURESFAE workshops

Slide 4

4 Final Conference, 19th 23rd January 2015 Geneva, Switzerland in details Research on mobile manipulators: Sensor fusion and fault tolerance Visual servoing and base manipulator coordination Several SE documents as part of the PURESAFE project deliverables: System Requirement Document for Mobile Manipulation in CERN infrastructures. Architectural Design Document of the iMoro Mobile Manipulator. Detailed Design Description Document of the iMoro Mobile Manipulator. Integration and Acceptance Test Document of the iMoro Mobile Manipulator. A highly maneuverable Modular Mobile Manipulator System (MMMS) Designed and built at IHA/TUT, based on the statement of need (PURESAFE ANNEX ) Based on the requirements gathered and presented in the project requirements document and approved by the project partners. Test platform for verifying reliable high performance motion controller for the mobile platforms Mechatronics design and system integration of iMoro:

Slide 5

5 Final Conference, 19th 23rd January 2015 Geneva, Switzerland Research use cases Finnish center of excellence: Generic Intelligent Machines Research (2008-2013) Future intelligent mobile working machines and field robots. GIM Development of mobile manipulation technology for ionizing radiation environments

Slide 6

6 Final Conference, 19th 23rd January 2015 Geneva, Switzerland GIM machine pallet picking Challenges Rough terrain Inaccurate actuators Big dimensions (resolution, calibration) Exception handling Coordinated motion

Slide 7

7 Final Conference, 19th 23rd January 2015 Geneva, Switzerland Micro Macro control system architecture Macro (platform) Steering and drive Micro (manipulator) boom, telescope, fork

Slide 8

8 Final Conference, 19th 23rd January 2015 Geneva, Switzerland Architecture in some details

Slide 9

9 Final Conference, 19th 23rd January 2015 Geneva, Switzerland Main objective F F* Error space two orthogonal spaces: F F* and B B* Micro control assuming Macro errors are small: B=B* Control in some details

Slide 10

10 Final Conference, 19th 23rd January 2015 Geneva, Switzerland Local localization smoothens the vision output (vision: every 300ms) provides 20Hz pose estimate, negligible delays works even when markers in shadow or lost Macro-Micro coordination and exception handling Macro waits for Micro (no need for tight coordination) Terminate/replan in case of delayed detection Redundancy resolution, Detection and filtering (local localization)

Slide 11

11 Final Conference, 19th 23rd January 2015 Geneva, Switzerland

Slide 12

12 Final Conference, 19th 23rd January 2015 Geneva, Switzerland Experiments

Slide 13

13 Final Conference, 19th 23rd January 2015 Geneva, Switzerland Experiments

Slide 14

14 Final Conference, 19th 23rd January 2015 Geneva, Switzerland Publications M. M. Aref, R. Oftadeh, R. Ghabcheloo, and J. Mattila, Fault Tolerant Control Architecture Design for Mobile Manipulation in Scientific Facilities, International Journal of Advanced Robotic Systems, InTech, December 2014. M. M. Aref, R. Ghabcheloo, J. Mattila, A Macro-Micro Controller for Pallet Picking by an Articulated-Frame-Steering Hydraulic Mobile Machine, IEEE International Conference on Robotics and Automation, ICRA2014 (May 31-June 5, 2014), Hong Kong Convention and Exhibition Center, Hong Kong. R. Oftadeh, M. M. Aref, R. Ghabcheloo, and J. Mattila, System Integration for Real-time Mobile Manipulation, International Journal of Advanced Robotic Systems, vol 11, no. 51, InTech, 2014.

Slide 15

15 Final Conference, 19th 23rd January 2015 Geneva, Switzerland Publications M. M. Aref, R. Ghabcheloo, A. Kolu, M. Hyvnen, J. Mattila, K. Huhtala, "Position Based Visual Servoing for Pallet Picking by an Articulated- frame-steering Hydraulic Mobile Machine", The 6th IEEE International Conference on Robotics, Automation and Mechatronics, RAM2013 (November 12-15, 2013), Manila, Philippines. R. Oftadeh, M. M. Aref, R. Ghabcheloo, and J. Mattila, Mechatronic Design of a Four Wheel Steering Mobile Robot with Fault-Tolerant Odometry Feedback in the proceedings of The 6th IFAC Symposium on Mechatronic Systems (Mechatronics '13) Zhejiang University, Hangzhou, China, April 10-12, 2013. R. Oftadeh Mohammad M. Aref, Reza Ghabcheloo, Jouni Mattila,Unied Framework for Rapid Prototyping of Linux based Real-Time Controllers with Matlab and Simulink, Accepted to present in the 2012 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), KaoHsiung, Taiwan.

Slide 16

16 Final Conference, 19th 23rd January 2015 Geneva, Switzerland Currently working on Extension of these ideas to iMoro, a four wheel steering mobile manipulator with 6 DOF arm. Macro-Micro coordination Sensor fusion: vision IMU / body kinematic constraint / object motion constraint Addressing manipulator torque limits in tracking performance: aggressive maneuvers

Slide 17

17 Final Conference, 19th 23rd January 2015 Geneva, Switzerland Much remains to be done

Slide 18

18 Final Conference, 19th 23rd January 2015 Geneva, Switzerland THANK YOU for your attention Our YouTube Channel