harvard hkust 2015 - final presentation
TRANSCRIPT
![Page 1: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/1.jpg)
Mobile-Controlled Drone Autonomous Delivery System
Harvard-HKUST International Design Experience 2015
Brian Krentz, Mayank Kumar, Yixing Liu (Eva), Vinh Nguyen,KamFai Tsang (Elvis), Erin Walk, Billie Wei, Ruilin Wen (Gary)
1
![Page 2: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/2.jpg)
2
What? Why? Who? How?Does
it work?
What is
next?
![Page 3: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/3.jpg)
3
Starting Point
DJI Flamewheel 450 Pixhawk Autopilot
![Page 4: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/4.jpg)
4
Reliable
Fu
nct
ion
al R
eq
uir
em
en
ts
Safe
UserFriendlyAffordable
![Page 5: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/5.jpg)
5
400gPayload
1 mile
> 5 m/s
Technical Specifications
![Page 6: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/6.jpg)
6
1 mileCommunication
20 minBattery Life
0.2% loss rate
Technical Specifications
![Page 7: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/7.jpg)
7
Customer & Vendor Surveys
$3.66
63.6%0-2 miles
59.5 minutes
Small items
Low weight delivery
Most deliveries ≤ 1 mile
*Taken from survey of 33 users and 10 businesses.
CustomerVendor
ReliableReliable
Fast & affordableFast & affordable
![Page 8: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/8.jpg)
8Long Wait for Delivery Unpredictable Delivery Time
Customer & Vendor Surveys
![Page 9: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/9.jpg)
9
What? Who? How?Does
it work?
What is
next?
What? Why?
![Page 10: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/10.jpg)
10
imag
e c
ou
rte
sy o
f A
maz
on
![Page 11: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/11.jpg)
11
Flirtey drone
![Page 12: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/12.jpg)
12DJI Phantom 3
![Page 13: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/13.jpg)
13
Mobile-Controlled Drone Autonomous Delivery System
![Page 15: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/15.jpg)
15
What? How?Does
it work?
What is
next?
What? Who?Why?
![Page 16: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/16.jpg)
16
Young Professionals Local Business Owners
Our Users
![Page 17: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/17.jpg)
Design Process
17
ResearchUser &
BusinessSurveys
PrototypingTesting, User
Feedback, Design Iteration
Design ProcessDesign Process
![Page 18: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/18.jpg)
18
Does it
work?
What is
next?
What? How?Why? Who?
![Page 19: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/19.jpg)
Drone Delivery System
19
customers
place order
track drone
vendor
view orders
send drone out
successful delivery
Operations Flow Chart
![Page 20: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/20.jpg)
20
Hardware&
FirmwareSoftware Mechanical
Key Technical Points
![Page 21: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/21.jpg)
21
VendorInterface
Customer Interface
Application Backend
GPS System
Rotors
Application
Order Information
MAVLink(Protocol)
Address Address
Current State
Current State
Command Command
Serial Port (Interface)
Current Location
Current Location
Radio Frequency(Hardware)
Sensors
UAVController
Communication UAV
Gripper
![Page 22: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/22.jpg)
22
Hardware&
FirmwareSoftware Mechanical
Key Technical Points
![Page 23: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/23.jpg)
23
Qt Creator - Powerful cross-platform GUI design tool
MAVLink - Micro Air Vehicle Communication Protocol
Deployable to Android devices and potentially to iOS
![Page 24: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/24.jpg)
24
User Interface
Functions & Logic
Communication MAVLink
Application Structure
QML
Serial Port (radio) WiFi
Page Handlers Functions
QtLocation & QtPositioning APIs
C/C++
Responsive Design
![Page 25: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/25.jpg)
25
User Interface: Paper Prototyping
![Page 27: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/27.jpg)
27
Predicted vs. Actual Flight Path
Predicted
Actual Path
60
mStart
End
![Page 28: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/28.jpg)
28
QtPositioning & QtLocation APIs
Customer Interface
Address
GeoCodeModel
(Lat
, Lo
ng
)
Open Street Maps (OSM)
Plugin
VendorInterface
MapItemViewMap Data
(map image)
MapCircle
(addresses)
Map Polyline(trajectory)
(Lat, Long)
(Lat, Long)
![Page 29: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/29.jpg)
29
UAV
Communication Network
Android Application (TCP Client)
Computer Ground Control Station
(TCP Server)
Flight Control Commands
GPS & Battery
Information
WiFi
433 MHz Telemetry
Flight information
mode switch
safety control
flight control command
![Page 30: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/30.jpg)
30
MAVLink
To reduce latency, we tried to limit the transmission datastream by making smart choices of messages. We picked 9 out of more than 200 MAVLink messages:
#1 heartbeat: time information #2 system status: battery voltage and percentage #30 attitude: row, pitch, yaw and attitude rates #32 local position: x, y, z, 3-axis velocity and 3-axis acceleration #33 global position: latitude, longitude, relative altitude #105 high resolution IMU #253 status text: drone flight log #69 manual_control: direct flight commands and mode switch #76 long command: arm and disarm
![Page 31: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/31.jpg)
31
Features
Computer Ground Control Station (GCS) has● a serial port for radio telemetry to communicate with UAV● a TCP server to connect the Android app and UAV together● a flexible mode switch panel● a display of real-time flight data● a console to display flight log● four sliders for manual control of row, pitch, yaw, throttle and fast key
Android Application has: ● a TCP client to connect to the server via IP address and port number● functional manual control in the local area network (LAN)
![Page 34: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/34.jpg)
34
User Experience Survey (Application)
Summary of the User Experience Survey Results, Survey Size N=12
Average Score (out of 10) Standard Deviation
Ease of ordering (Customer) 8.8 1.1
Usefulness of the Map (Customer) 7.8 2.3
Ease of delivering (Vendor) 9.2 0.7
Ease of checking pending orders (Vendor)
9.7 0.6
Ease of checking battery status (Vendor)
8.6 1.4
Overall 8.8 /
![Page 35: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/35.jpg)
Key Technical Points
35
Hardware&
FirmwareSoftware Mechanical
![Page 36: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/36.jpg)
36
Delivery
Object Avoidance
Gripper
![Page 37: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/37.jpg)
37
![Page 38: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/38.jpg)
38
● Firmware onboard is consisted of multiple processes ● uORB stands for “Micro Object Request Broker”
● Is a mechanism for processes onboard to “communicate”
● Data packed into C structs and published/subscribed to relevant “topics”
Inter-Process Communication——uORB
![Page 39: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/39.jpg)
Inter-Process Communication——uORB
39
Sensor Process Attitude Controller Process
topic 3(irrelevant)
topic 2(manual control)
topic 1(sensor values )
![Page 40: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/40.jpg)
40
Inter-Process Communication——Advantage
publisher process
subscriber process
topic 3
uORB topic 2
topic 1
myProcess
myTopic (parameters we need)
![Page 41: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/41.jpg)
41
Controlling by Mobile/PC Terminal
How the Radio Controller works
● Radio signal is decoded into several values including: Roll, Pitch, Yaw and Throttle
● Then published to the MANUAL_CONTROL_SETPOINT topic
● Subscribed by the Position Controller Process
● Position Controller Process maneuvers the drone
Transmit Decode RollPitch Yaw
Throttle
Publish Position Controller
Process
MANUAL_CONTROL_
SETPOINT topic
Subscribe
![Page 42: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/42.jpg)
42
Controlling by Mobile/PC Terminal
How our PC/Mobile Control works:
Instead of going through the decoding procedure, we send desired Roll, Pitch, Yaw, and Throttle information directly to the mainboard using MAVlink Protocol
Mavlink
RollPitch Yaw
Throttle
Position Controller
Process
MANUAL_CONTROL_
SETPOINT topic
SubscribePublish
![Page 43: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/43.jpg)
Delivery Route
3. Descend
2. Fly to Destination
5. Return Home
6. Shutoff 4. Dropoff
Launch Site
navigation_main.cpp
commander.cpp
MAIN_STATE_DELIVERY
NAVIGATION_STATE_DELIVERY
delivery.cpp
DeliveryAddress
1. Preflight
![Page 44: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/44.jpg)
Proximity Sensor Specs
● Using the MB-1240 ultrasonic proximity sensor to detect barrier
● Accurate sensing range from 20cm to 600cm
● Sensor gives out analog output ranging from 0-3.3V
● ADC sampling function runs in System Ticks
● Sample rate of 100Hz
44
Barrier Avoidance Feature
![Page 45: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/45.jpg)
45
Barrier Avoidance Feature
commander.cpp
adc.cpp
ADC_PROX uORB
MAIN_STATE_POSCTL
mc_pos_control.cpp
Publish a thrust informationBarrier Detected Stop Ascend till
barrier avoided
![Page 46: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/46.jpg)
Gripper Control
servo_ctl.c
delivery.cpp
turn_servo uORB
drv_pwm_output.h
46
Torque1.8 kg*cm
![Page 47: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/47.jpg)
47
Hardware&
FirmwareSoftware Mechanical
Key Technical Points
![Page 48: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/48.jpg)
48
Gripper
Landing Gear
Shell
![Page 49: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/49.jpg)
49
Retractable-wire pulley
Efficient deliveryLess power consumed
Fragile
Servo controlled Jaw
SimpleRobust
Gripper Design
![Page 50: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/50.jpg)
Mechanical Design Evolution
50
Landing Gear: Design Analysis
More bending at all 4 cornersCause UAV to toppleRedundant central part
Styrofoam supports at the four endsExtended out for better balanceEasy attachment
![Page 51: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/51.jpg)
Mechanical Design Evolution
51
Beautiful and robust heavy: 600gcomplex: hard to 3d print and manufacture
Simpler, less complex, still heavy: 250g easy to manufacture but fragile
Simpler, robust,light (weight: 70g)easy to manufacture,And beautiful!
UAV Shell: Design Evolution
![Page 52: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/52.jpg)
52
What is
next?
What?
Does it
work?Why? Who? How?
![Page 54: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/54.jpg)
54
Performance Testing
Flight Speeds on a 57 m Trajectory
Trial Time in Flight (s)
Mean Speed (m/s)
1 8.5 6.7
2 8.3 6.8
3 7.8 7.3
Average 8.2 6.9
Battery Life Testing
Trial 3300mAh (320g)
5000mAh (541g)
1 (Min:Sec) 15:20 20:43
2 (Min:Sec) 15:21 20:09
Average 15:21 20:26
![Page 55: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/55.jpg)
55
400gpayload
1 mile
> 5m/s
Technical Specifications
450g 1.25 miles 7 m/s
![Page 56: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/56.jpg)
56
1 mileCommunication
20 minBattery Life
0.2% loss rate
Technical Specifications
1.25 miles20:26 0%
![Page 57: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/57.jpg)
57
What?
What’s next?
Why? Who? How?Does
it work?
![Page 58: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/58.jpg)
● Increasing payload to 1 kg (~ the weight of 15” pizza)● Optimizing battery usage for 30 minutes● Increasing delivery mileage to 3 km
○ Improving the communication system range● Improving accuracy of drone tracking for door deliveries● Developing more comprehensive object avoidance
○ More than just ascending
58
Future Work
![Page 59: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/59.jpg)
Acknowledgements
● Evelyn Hu, Ling Shi, and Kei May Lau, thank you for creating and nurturing the Harvard-HKUST program. Without you, none of us would be here right now enjoying this enriching experience of international collaboration.
● Many thanks to our mentors Chris, Daniela, Avi, Lina, Xuan, and Bing, We greatly appreciated your advice, guidance, and all those cross-time-zone Skype sessions. We couldn’t have done it without your support!
● Sarah and Patricia, thank you for ensuring all of our needs were met in Cambridge and Hong Kong and going above and beyond in taking care of us.
● The Harvard-HKUST Design Team is grateful for the financial support of Harvard alumnus Xiang Dong “XD” Yang and Nancy Yang, the Harvard School of Engineering and Applied Sciences, the Hong Kong University of Science and Technology, and the Harvard President’s Innovation Fund for International Experiences.
59
![Page 60: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/60.jpg)
Q&A
60
![Page 61: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/61.jpg)
Connect With Us
Website
http://projects.iq.harvard.edu/h2sp
https://www.facebook.com/hkustharvard
61
![Page 62: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/62.jpg)
Design Team 2015
Brian Krentz
Mayank Kumar
Yixing Liu (Eva)
Vinh Nguyen
KamFai Tsang (Elvis)
Erin Walk
Billie Wei
Ruilin Wen (Gary)
62
![Page 63: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/63.jpg)
Fin
63
![Page 64: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/64.jpg)
Appendix I - Flight Safety Concern
64
Flight Certification
PreflightChecklist
![Page 65: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/65.jpg)
Appendix II
http://www.gizmag.com/flirtey-drones-deliver-medicine-in-us-first/38102/● The citizens of Wise County, Virginia lack access to proper healthcare● Previously, medical supplies were delivered each year to the area by truck● CEO Sweeney says, "they said that if there was a way they could receive the
medication quicker that would help" ● Sweeney hopes this proof of concept whereby the benefits of drone delivery are
realized, albeit on a small scale, will act as a catalyst for the delivery of everyday items.
65
![Page 66: Harvard HKUST 2015 - Final Presentation](https://reader033.vdocument.in/reader033/viewer/2022050719/587913631a28ab6f658b7459/html5/thumbnails/66.jpg)
Appendix III
http://www.forbes.com/sites/gregorymcneal/2015/02/15/the-drones-are-coming-heres-what-president-obama-thinks-about-privacy/
● Drones are expected to create 70,000 jobs with an economic impact of more than $13.6 billion in the first three years after their integration into U.S. skies.
66