introduce about sensor using in robot nao department: fti-fho-fpt presenter: vu hoang dung
TRANSCRIPT
![Page 1: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/1.jpg)
Introduce about sensor using in Robot NAO
Department: FTI-FHO-FPT
Presenter: Vu Hoang Dung
![Page 2: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/2.jpg)
OUTLINE
Introduce Sensors1
Audio2
Vision3
Other Sensors4
![Page 3: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/3.jpg)
Introduce Sensors Sensor is a converter that measures a physical quantity and converts
it into a signal which can be read by an observer or by an instrument. A sensor’s sensitivity indicates how much the sensor’s output changes when the measured quantity changes.
Senses of the NAO, the physical devices in robots that sense the environment are called sensor.
NAO sensors can divide into 3 types main sensors: Audio: include devices which listen to sound and play to sound
from microphone.(Example TTS and STT) Vision: include devices which capture image from camera.
(Example Face detect, Hand detect, Line detect …) Other sensor: include devices which get value from environment.
(Example touch sensor, battery sensor, infrared sensor, laser sensor, sonar sensor).
![Page 4: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/4.jpg)
Introduce Sensors
![Page 5: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/5.jpg)
Audio
Audio NAO has 4 microphones built into its head that it uses to listen to sound around it
Module in Audio
Audio Device: manage audio inputs and outputs Audio Player: play audio file on the robot Audio Recorder: record audio file on the robot Sound Detection: detect sound events Audio Source Localization: localize sounds detected Speech Recognition: make the robot understand what a human says Text To Speech: make the robot speak
![Page 6: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/6.jpg)
Audio
Example
Sound detection and source localization
Value return:• Number of sounds detected• Index of the sound start(=1), sound
end(= 0)• Detection time• Gives an estimate of the probability[0,1]
that the sound detected by the module corresponds to a real sound
![Page 7: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/7.jpg)
Vision
Vision NAO has two cameras in its head. The cameras are vision sensors andprovide camera images for the NAO’s computer to process. This is differentfrom the human “sensor of sight” as sight would include processing the imageTo understand what the robot sees
![Page 8: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/8.jpg)
Vision
Module in Vision Backlighting: enables to check if the image of the camera is backlit. Darkness: gives NAO the ability to detect if it is in a dark environment. Face detection: gives NAO the ability to detect and recognize human faces. Landmark detection: gives NAO the ability to detect specific visual landmarks. Movement detection: gives NAO the ability to detect some movement and tell
where it comes from. Photo capture: provides tools to take pictures and save them on disk. Red ball detection: gives NAO the ability to detect red and circular objects. Video device: manages video inputs. Video recorder: provides video recording tools. Vision recognition: provides learning and recognition capabilities of visual
patterns. Visual compass: gives NAO the ability to use an image as a compass. Beside: Hand detection, line detection, flashcard….
![Page 9: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/9.jpg)
Vision
Example
Landmark detection: use to get position of NAO with environment around
Value return:• Landmark ID• Landmark’s location in
camera angles• The Landmark’s size in
camera angles• Landmark’s is oriented
about the vertical axis with NAO’s head
![Page 10: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/10.jpg)
Vision
Example
Red ball detection:
Value return:• CenterX, centerY are
center of the ball in angles
• SizeX, sizeY are the ball “horizontal and vertical radius”
• Position of the camera in Torso frame
• Position of the camera in robot frame
![Page 11: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/11.jpg)
Other Sensors
Besides above sensors, NAO also uses other sensors as touch, press, balance for robot, measure level power in robot
Sensors: deals with bumpers, tactile hands, tactile head and press chest button. Battery: manage level power and warn the user Fsr: generates the event whenever the foot contact changes Infrared: allows IR communication with NAO Laser: retrieve data sent by the Laser head(optional device) Sonar: retrieves ultrasonic sensor.
Module in other Sensors
![Page 12: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/12.jpg)
Other Sensors
Example
Sensor: get value follow bumper, tactile, chest button
Bumper• Left bumper• Right bumper
Tactile head• Front• Back• Rear
Tactile hand• Back• Left• Right
Chest button• Simple click• Double click• Triple click
![Page 13: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/13.jpg)
Other Sensors
Example
Sonar: 2 emitters, 2 receives
Mode operation
• Frequency: 40kHz• Sensitivity: -86dB• Resolution: 1cm• Detection range: 0.25 – 2.55• Effective cone: 60o
![Page 14: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/14.jpg)
Other Sensors
Example
Event sensor :
• Sonar Left Detected• Sonar Right Detected• Sonar Left Nothing Detected• Sonar Right Nothing Detected• Sonar Left Nothing Detected and
Sonar Right Nothing Detected
![Page 15: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/15.jpg)
Other Sensors
Example
IR:
Use case• Use NAO as a remote
control• Set NAO to receive
orders from a remote control
• Make several NAOs communicate together
![Page 16: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/16.jpg)
Other Sensors
Example
Led Sensor : allows you to control NAO’s LEDs
![Page 17: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/17.jpg)
Example - Subscribe
Example
Subscribe event:
![Page 18: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/18.jpg)
Example - Subscribe
Example
Subscribe event:
![Page 19: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/19.jpg)
Example - Subscribe
Example
unSubscribe event:
![Page 20: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/20.jpg)
Example - Subscribe
Example
Get value:
![Page 21: Introduce about sensor using in Robot NAO Department: FTI-FHO-FPT Presenter: Vu Hoang Dung](https://reader036.vdocument.in/reader036/viewer/2022081515/56649dab5503460f94a99d34/html5/thumbnails/21.jpg)
Questions and Comments
Thank for Your Attention