![Page 1: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/1.jpg)
Design Industrial Robotics Applications
with MATLAB and Simulink
Presenter Name Here
![Page 2: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/2.jpg)
Trends in Industrial Robotics
2
Cobots Grow fastest in shipment terms
with CAGR of 20% from 2017 - 2023
Growing trend toward compact robots
Increasing share of units shipped in 2023 will be payload <10kg
40% of
Articulated Robots
80% of
SCARA Robots
82% of
Cobots
Source: Interact Analysis
![Page 3: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/3.jpg)
Human
Assistant
- Automation
Evolution of Industrial Robotics Technologies
Partial Autonomy
Conditional
Autonomy
High Autonomy
Full Autonomy
1961
No Automation
Traditional Industrial Robots
AI-enabled robots
Cobot
Unimate at GM, 1961
2008 2019-
UR5 1st Cobot at Linatex, 2008 1961
3
![Page 4: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/4.jpg)
Autonomous Industrial Robotics Systems WorkflowOperates independently, without explicit instructions from a human
Plan (Decide)
Obstacle
Avoidance
Localization
Path Planning
Sense (Observe)
Proximity Sensors
Encoder Camera
Contact
Switches
Force/Torque
Sensor
Connect/Deploy Code Generation ROS
Platform
Physical Model Actuation Model
Prototype HW
Environ ModelProduction HW
Autonomous Algorithms
Control (Act)
Trajectory Control
Feedback Controls
Decision Logic
Gain Scheduling
S1
S2S3
Perceive (Orient)
Object
Detection/Tracking
Environment
Understanding
4
![Page 5: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/5.jpg)
What we’ll discuss today
01Challenges in Industry
Robot System Design 02Model-Based Design
for Autonomous System
Concluding Remarks
04
Case Study: Pick-and-
Place Manipulation
Application
03
5
![Page 6: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/6.jpg)
What we’ll discuss today
01Challenges in Industry
Robot System Design 02Model-Based Design
for Autonomous System
Concluding Remarks
04
Case Study: Pick-and-
Place Manipulation
Application
03
6
![Page 7: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/7.jpg)
Traditional Software Development Cycle
* AspenCore - EETimes, “2019 embedded markets study,” EETimes, Tech. Rep., 2019
Only 6% Of Design/Development
Time is Spent on Simulation*a
b
c
Design Concept
Handwritten Code
Embedded System
7
![Page 8: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/8.jpg)
Common Challenges of Industrial Robotics Systems Development
Multidomain
Expertise
Complexity of
Algorithms
End-to-End
workflows
Technical Depth
and System
Stability
8
![Page 9: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/9.jpg)
Key Takeaways
In this talk, you will learn
Reference workflow for industrial robot development
Multi-domain functional areas of Platform, Sensing, Perception,
Planning and Control
MATLAB and Simulink capabilities to develop new robot algorithms
» Kinematic and dynamic models of robots
» Perception algorithm design using deep learning
» Gazebo co-simulation for sensor models and environment simulation
» Path planning with obstacle avoidance
» Supervisory logic and control using Stateflow / RL
» C/C++ code / ROS nodes generation
9
![Page 10: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/10.jpg)
What we’ll discuss today
01Challenges in Industry
Robot System Design 02Model-Based Design
for Autonomous System
Concluding Remarks
04
Case Study: Pick-and-
Place Manipulation
Application
03
![Page 11: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/11.jpg)
Key to developing robust autonomous system
Modeling &
Simulation
Code
Generation
Test &
Verification Need: An end-to-end development solution
that includes modeling & simulation, code
generation and test & verification.
Complete Model-Based
Design Workflow
Simulate First and Simulate
Often!
11
![Page 12: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/12.jpg)
Platform
Full Model-Based Design Workflow
Autonomous Algorithms
for Manipulators
Connect / Deploy
Perceive
Sense
Plan &
Decide
Control
Platform
Connect
/Deploy
12
![Page 13: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/13.jpg)
What we’ll discuss today
01Challenges in Industry
Robot System Design 02Model-Based Design
for Autonomous System
Concluding Remarks
04
Case Study: Pick-and-
Place Manipulation
Application
03
13
![Page 14: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/14.jpg)
Robot Arm Demo
Pick-and-Place Manipulators
Model-Based Design
Deep Learning for detecting an object
Path planning with collision avoidance
14
![Page 15: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/15.jpg)
Mechanical ModelingAutomatic import from CAD Tools
Co
nn
ect
& D
ep
loy Sense
Perceive
Plan &
Decide
Control
Simscape
Multibody
Model
CAD ModelPlatform
15
![Page 16: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/16.jpg)
Co
nn
ect
& D
ep
loy Sense
Perceive
Plan &
Decide
Control
ActuatorsEvaluating motor requirements – actuator sizing
Platform
16
Simscape
Robotics System
Toolbox
![Page 17: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/17.jpg)
Environment ModelingConnect to an external robotics simulator
Robot arm simulation with Gazebo
Gazebo: Physics-based simulator with
sensors and noise
17
ROS Toolbox
Robotics System
Toolbox
![Page 18: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/18.jpg)
Intel® RealSense™RGB-D camera
Colorized point cloud Detect table
Point clouds of objects Remove noise and cluster
SensingPoint cloud processing for pose estimation
Perceive
Plan &
Decide
Control
Co
nn
ect
& D
ep
loy Sense
Platform
18
Computer Vision
Toolbox
![Page 19: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/19.jpg)
• Support for Common Sensors
• Image analysis
• Image enhancement
• Visualizing Point Clouds
• Apps
Perceive
Plan &
Decide
Control
Co
nn
ect
& D
ep
loy Sense
Platform
SensingCommon sensors and sensing functionalities for autonomous systems
19
Image Processing
Toolbox
Computer Vision
Toolbox
![Page 20: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/20.jpg)
PerceptionDeep learning for object classification
•••
Object detector using Deep
Learning (YOLO v2)
Platform
Sense
Perceive
Plan &
Decide
Control
Co
nn
ect
& D
ep
loy
20
Deep Learning
Toolbox
![Page 21: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/21.jpg)
PerceptionObject Classification
Platform
Sense
Perceive
Plan &
Decide
Control
Co
nn
ect
& D
ep
loy
21
![Page 22: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/22.jpg)
Motion Planning
Joint positions
Follow & track trajectory
Reach waypoints
Interact with environment
Manage gripper actions
X(t0)
X(tf)
q(t2)
q(t3)
q(t1)
q(t0)
q(tf)
Motion
Planner
Initial Pose X(t0)
Final Pose X(tf)
Joint Limits
Obstacles
Joint Trajectories
Q(t)
Platform
Sense
Perceive
Plan &
Decide
Control
Co
nn
ect
& D
ep
loy
22
![Page 23: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/23.jpg)
Motion Planning
Path Planning + Trajectory Gen + Trajectory Following
Platform
Sense
Perceive
Plan &
Decide
Control
Co
nn
ect
& D
ep
loy
23
Model Predictive
Control Toolbox
Robotics System
Toolbox
![Page 24: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/24.jpg)
Motion ControlDecision Logic
Supervisory Control
Platform
Sense
Perceive
Plan &
Decide
Control
Co
nn
ect
& D
ep
loy
24
Stateflow
![Page 25: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/25.jpg)
Advanced Control: Reinforcement LearningGrasping an object with image inputs
AGENT
Reinforceme
nt Learning
Algorithm
Policy
ENVIRONMENT
ACTION
REWARD
STATE
Policy update
25
Reinforcement
Learning Toolbox
![Page 26: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/26.jpg)
Application
Sense1 Sense2 Simulator
Act1 HMI1 HMI2
Middleware
Platform
Sense
Perceive
Plan &
Decide
Control
Hardware ConnectivityCode Generation Support
Co
nn
ect
& D
ep
loy
26
ROS Toolbox
![Page 27: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/27.jpg)
Hardware ConnectivityCode Generation Support
Ethernet
Jetson Xavier (Ubuntu 18.04)
Simulink to ROS2
stand-alone node
deployment
(Bouncy)
Node1Kinova
System
ObjectKortex API
Node2User Application
Node3User Application
Use publisher/subscriber
capabilities in Simulink to
connect to ROS topics
Allows multi-thread,
multi-core and
pseudo real-time
Platform
Sense
Perceive
Plan &
Decide
Control
Co
nn
ect
& D
ep
loy
27
Stateflow
![Page 28: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/28.jpg)
Use the same reference workflowFor warehouse pick-and-place (storage shelf)
This workflow example highlights the use of Robotics System Toolbox
collision-checking algorithms, nonlinear MPC, and Stateflow for
MATLAB
28
![Page 29: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/29.jpg)
Use the same reference workflowFor warehouse pick-and-place (storage shelf)
With obstacle avoidance ON
(obstacle shown in blue)
With obstacle avoidance OFF
(obstacle shown in black for
reference)
29
![Page 30: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/30.jpg)
Sense
Perceive
Plan &
DecideControl
Connect
Platform
Use the same reference workflowFor Delta robot for automated parts sorting
![Page 31: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/31.jpg)
What we’ll discuss today
01Challenges in Industry
Robot System Design 02Model-Based Design
for Autonomous System
Concluding Remarks
04
Case Study: Pick-and-
Place Manipulation
Application
03
31
![Page 32: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/32.jpg)
Platform
Full Model-Based Design Workflow
Autonomous Algorithms
Sensor Fusion and
Tracking Tbx
Computer Vision
Toolbox
Model Predictive
Control Toolbox
Reinforcement
Learning Toolbox
Stateflow
Navigation
Toolbox
Robotics System
Toolbox
Connect / Deploy
ROS Toolbox
Perceive
Sense
Plan &
Decide
Control
Connect
/Deploy
Deep Learning
Toolbox
MATLAB / SimulinkPlatform Simscape
32
![Page 33: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/33.jpg)
Resources to get started with
33
![Page 34: Design Industrial Robotics Applications with MATLAB and Simulink · Trends in Industrial Robotics 2 Cobots Grow fastest in shipment terms with CAGR of 20% from 2017 - 2023 Growing](https://reader034.vdocument.in/reader034/viewer/2022051814/60381c099c3a6647a240c001/html5/thumbnails/34.jpg)
Concluding Remarks
Challenges
in industrial robot
application
development
Develop Software
with Model-Based
Design
Fast Iterations
Strong Focus
on Simulation
Complexity of
Algorithms
Multi-domain
Expertise
End-to-End
workflows
End-to-end workflow
for industry robot
applications
development
Perceive
Sense
Plan &
Decide
Control
Platform
Technical Depth and
System Stability
34