travi-navi : self-deployable indoor navigation system
DESCRIPTION
Travi-Navi : Self-deployable Indoor Navigation System. Y uanqing Zheng, Guobin (Jacky) Shen , Liqun Li, Chunshui Zhao, Mo Li, Feng Zhao. Indoor navigation is yet to come. Navigation := Localization/Tracking + Map. Navigation := Localization+ Map. Localization accuracy? - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/1.jpg)
Travi-Navi: Self-deployable Indoor Navigation System
Yuanqing Zheng, Guobin (Jacky) Shen, Liqun Li, Chunshui Zhao, Mo Li, Feng Zhao
![Page 2: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/2.jpg)
Indoor navigation is yet to come
Navigation := Localization/Tracking + Map
![Page 3: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/3.jpg)
Navigation := Localization+ Map
• Localization accuracy?• Map availability?• Crowdsourcing?
• Lacking of (no confidence in finding) killer apps!
Chicken & Egg problem!
How to incentivize?
![Page 4: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/4.jpg)
Our perspective
• Self-motivated users Shop owners Early comers
• Make it easy to build and deploy– Minimum assumption (e.g., no map)
• Immediate value proposition
![Page 5: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/5.jpg)
Trace-driven vision-guided Navigation System
• Guide with pre-captured the traces– Multi-modality– Navigate within traces
• Embrace human vision system
• Give up the desire of absolute positioning• Low key the crowdsourcing nature– Potential to build full-blown map and IPS
![Page 6: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/6.jpg)
Travi-Navi illustration: Navigate to McD
![Page 7: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/7.jpg)
Travi-Navi illustration: Guider
![Page 8: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/8.jpg)
Travi-Navi illustration: Follower
![Page 9: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/9.jpg)
Travi-Navi: Usage scenario and UI
• Directions– Pathway image– Remaining steps– Next turn– Instant heading– Dead-reckoning trace
• Updated every step– IMU, WiFi, Camera
![Page 10: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/10.jpg)
Design challenges
1. Efficient image capture– Reduce capture/processing cost
2. Correct and timely direction– Synchronized with user’s progress
3. Identify shortcut– From independent guiders’ traces
![Page 11: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/11.jpg)
Design goals & challenges
1. Efficient image capture– Reduce capture/processing cost
2. Correct and timely direction– Synchronized with user’s progress
3. Identify shortcut– From independent guiders’ traces
![Page 12: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/12.jpg)
Image capture problems
6 images taken during 1 step (6fps)
2~3h battery life Blurred images
![Page 13: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/13.jpg)
• After stepping down, body vibrates and image qualities drop• Then, it stabilizes! Good shooting timing• Motion hints (accel/gyro): predict stable shooting timing
Step down
Image quality
Motion hints from IMU sensors
![Page 14: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/14.jpg)
Motion hints help
Avoid “capturing and filtering”: Energy efficiency
![Page 15: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/15.jpg)
Key images
• Many redundant images– Fewer images on straight pathways
• Key images: before/after turns– Turns inferred from IMU dead-reckoning
![Page 16: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/16.jpg)
Design goals & challenges
1. Efficient image capture– Reduce capture/processing cost
2. Correct and timely direction– Synchronized with user’s progress
3. Identify shortcut– From independent guiders’ traces
![Page 17: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/17.jpg)
Correct and timely direction
• Which image to present?• Different walking speeds, step length, pause• Track user’s progress on the trace
![Page 18: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/18.jpg)
Step detection & Heading
• Filter out noises, and detect rising edges
![Page 19: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/19.jpg)
Step detection & Heading
• Heading: sensor fusion (gyro, accel, compass) [A3][A3 ] Pengfei Zhou, Mo Li, Guobin Shen, “Use It Fee: Instantly Knowing Your Phone
Attitude”, MobiCom’14
• Compass: electric appliances, steel structure
![Page 20: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/20.jpg)
Tracking: particle filtering
• Use particles to approximate user’s position– Centroid of particles
![Page 21: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/21.jpg)
Tracking: particle filtering
• Use particles to approximate user’s position– Centroid of particles
• Update positions– Noise: step length, heading– Errors accumulate
• Measurements to weight and resample particles– Magnetic field and WiFi information
![Page 22: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/22.jpg)
Distorted but stable magnetic field
30m
30m 5m
![Page 23: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/23.jpg)
Weigh w/ magnetic field similarity
30m
30m 5m
![Page 24: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/24.jpg)
Weigh w/ magnetic field similarity
30m
30m 5m
![Page 25: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/25.jpg)
Weigh w/ correlation of WiFi signals
Guider location
User location
Particle
• User’s WiFi measurement: • Compute: , guider’s WiFi fingerprints
�⃗�𝒊𝒔𝐠𝐞𝐨𝟏 �⃗�𝒊𝒔𝐠𝐞𝐨
𝟐
![Page 26: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/26.jpg)
Weigh w/ correlation of WiFi signals
�⃗�𝒊𝒔𝐠𝐞𝐨𝟏 �⃗�𝒊𝒔𝐠𝐞𝐨
𝟐
Guider location
User location
Particle
• User’s WiFi measurement: • Compute: , guider’s WiFi fingerprints
![Page 27: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/27.jpg)
Design goals & challenges
1. Efficient image capture– Reduce capture/processing cost
2. Correct and timely direction– Synchronized with user’s progress
3. Identify shortcut– From independent guiders’ traces
![Page 28: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/28.jpg)
• Identify shortcut
Navigate to multiple destinations
![Page 29: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/29.jpg)
Identify shortcut: overlapping segment
![Page 30: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/30.jpg)
Identify shortcut: overlapping segment
Dynamic Time Warping
![Page 31: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/31.jpg)
• WiFi distances exhibit V-shape trends mutually
Identify shortcut: crossing point
![Page 32: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/32.jpg)
Merge traces to increase coverage
![Page 33: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/33.jpg)
Design goals & Summary1. Efficient image capture– Reduce capture/processing cost
– Motion hints to trigger image capture
2. Correct and timely direction– Synchronized with user’s progress
– Track user’s progress on the trace: sensor fusion
3. Identify shortcut– Identifying overlapping segments, crossing points
Vision-guided Indoor Navigation
![Page 34: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/34.jpg)
• Implementation & Setup– 6k lines of Java/C on Android platform (v4.2.2)– OpenCV (v2.4.6): 320*240 images, 20kB– 5 models: SGS2, SGS4, Note3, HTC Desire, HTC Droid– 2 buildings: 1900m2 office building, 4000m2 mall– Traces: 12 navigation trace, 2.8km– 4 volunteer followers, 10km
• Experiments– User tracking– Deviation detection– Trace merging– Energy consumption
Evaluation
![Page 35: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/35.jpg)
A
60m
B
E
F
C
D
• Record ground truth at dots, measure tracking errors • Results: within 4 walking steps
1) User tracking
![Page 36: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/36.jpg)
A
60m
B
E
F
C
D
• Users deviate following red arrows• Results: within 9 steps
2) Deviation detection
![Page 37: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/37.jpg)
• 100 walking traces with different overlapping segments• >85% detection accuracy, when overlapping segment >6m• 100%, when overlapping seg >10m
3) Identify shortcut: overlapping seg
![Page 38: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/38.jpg)
A
60m
B
E
F
C
D
CP-C CP-D
CP-A
CP-B
• For “+” crossing point, >95% detection rate (1sample/1m)• For “T” point, no mutual trends. Become overlapping seg
3) Identify shortcut: crossing point
![Page 39: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/39.jpg)
4) Energy consumption
• 1800mAh Samsung Galaxy S2
Power monitor
![Page 40: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/40.jpg)
4) Energy consumption
Power monitor
• 1800mAh Samsung Galaxy S2
![Page 41: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/41.jpg)
4) Energy consumption
• Battery life with different battery capacity
Power monitor
![Page 42: Travi-Navi : Self-deployable Indoor Navigation System](https://reader030.vdocument.in/reader030/viewer/2022032414/5681334a550346895d9a4aa9/html5/thumbnails/42.jpg)
Thank you!&
Questions