sharecam: interface, system architecture, and implementation of a collaboratively controlled robotic...
Post on 21-Dec-2015
220 views
TRANSCRIPT
![Page 1: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/1.jpg)
ShareCam: Interface, System Architecture, and Implementation of a
Collaboratively Controlled Robotic Webcam
Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)
IEEE/RSJ International Conference on Intelligent Robots and SystemsFinalist for New Technology Foundation (NTF) Award for
Entertainment Robots and Systems
![Page 2: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/2.jpg)
Teleoperation: Related Work• Tesla, 1898• Goertz, ‘54• Mosher, ‘64• Tomovic, ‘69• Salisbury,Bejczy, ‘85• Ballard, ’86• Volz, ’87-• Sheridan, ‘92• Sato, ’94• Goldberg, ’94-• Presence Journal ‘92-• O. Khatib, et al. ’96
![Page 3: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/3.jpg)
Internet
![Page 4: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/4.jpg)
![Page 5: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/5.jpg)
![Page 6: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/6.jpg)
![Page 7: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/7.jpg)
![Page 8: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/8.jpg)
networkedrobot:
![Page 9: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/9.jpg)
Taxonomy (Tanie, Matsuhira, Chong 00)
Multiple Operator, Single Robot (MOSR):
Single Operator, Single Robot (SOSR):
Single Operator, Multiple Robot (MOSR):
![Page 10: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/10.jpg)
Pan, Tilt, Zoom robotic video camera
sharecam
![Page 11: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/11.jpg)
Entertainment Applications
![Page 12: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/12.jpg)
Playing Games
![Page 13: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/13.jpg)
Related Work• Networked robots
– Tanie, K., Chong, N. et al(01)– Jia, S. and K. Takase (01)– Hu, H., Yu, L., Tsui, P., Zhou, Q (01)– Safaric, R. et al. (01)– Goldberg and Siegwart (02)– Coppin, P. and Wagner, M.D. (02)– Konukseven, I., Erkmen, A. et al (02)
• SOSR– Siegwart, R. and Saucy P. (99)– Paulos, E. and Canny, J. (99)– Tanie, K., Arai, H. et al. (00)– Lynch, K. and Liu, C. (00)– Fong, T., Thorpe, C., et al(01)
![Page 14: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/14.jpg)
Related Work• SOMR
– Hu, Yu, Tsui, Zhou (01) – Jia, Takase (01)
• MOMR– Fukuda, Xi, Liu, Elhajj et al. (00,02)– Tanie, Chong, et al. (00)
• MOSR– Cinematrix (91)– Cannon, McDonald, et al. (97) – Goldberg, Chen, et al. (00, 01)
![Page 15: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/15.jpg)
Sharecam: System Architecture
Users
Internet
ShareCam Server
Video Server
![Page 16: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/16.jpg)
Sharecam Software
TCP/IP
TCP/IP
User database
RegistrationCore (with shared memory segments)
Apache module
Apache module
Apache module
Communication
Console/Log Login CGI
ShareCam web server
ShareCam applet InetCam applet
Client
RS232C
HTTP
Camera control
Calibration
Panoramic image generation
InetCam server
Video server
Canon VC-C3 Camera
Java
Gnu C++
PERL
MySQL
![Page 17: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/17.jpg)
frame selection problem: given n requests, find optimal frame
![Page 18: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/18.jpg)
Problem Definition
Requested frames: i=[xi, yi, zi], i=1,…,n
![Page 19: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/19.jpg)
Problem Definition• “Satisfaction” for frame i: 0 Si
1
Si = 0 Si = 1
= i = i
![Page 20: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/20.jpg)
•Symmetric Difference
•Intersection-Over-Union
SDArea
AreaIOU
i
i
1)(
)(
)(
)()(
i
ii
Area
AreaAreaSD
Similarity Metrics
Nonlinear functions of (x,y)
![Page 21: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/21.jpg)
Intersection over Maximum:
),(
)(
),max(
)1,)/min(()/(),(
i
i
i
i
biiii
Max
Area
aa
p
zzaps
Requested frame i , Area= ai
Candidate frame
Area = api
![Page 22: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/22.jpg)
• global satisfaction:
n
iii
n
i
biii
yxpyxS
zzapS
1
1
),(),(
)1,)/min(()/()(
for fixed z
find * = arg max S()
![Page 23: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/23.jpg)
approximation
n)dd
whgO(
spacing resolution :
spacing lattice :
z2
zd
d x
y
d
Compute S(x,y) at lattice of sample points:
w, h : width and height,g: size range
![Page 24: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/24.jpg)
error bound
run time:O(n / 3 )
c* Optimal frame
Optimal at latticec~
Smallest frame on lattice that encloses c*
c
)ˆ()~()( * cscscs
)(
)ˆ(
)(
)~(1
** cs
cs
cs
cs
zdz
z
2...
min
min
1
![Page 25: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/25.jpg)
Processing Zoom Type Complexity
Centralized Discrete Exact O(n2)
Centralized Discrete Approx O(nk log(nk)), k=(log(1/ε)/ε)2
Centralized Contin. Exact O(n3)
Centralized Contin. Approx O((n + 1/3) log2 n)
Distributed Discrete Exact O(n), Client: O(n)
Distributed Contin. Approx O(n), Client O(1/3)
frame selection algorithms
![Page 26: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/26.jpg)
ShareCam Application:Game based learning : global environment
![Page 27: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/27.jpg)
![Page 28: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/28.jpg)
![Page 29: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/29.jpg)
![Page 30: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/30.jpg)
robotic video cameras
motion sensors
timed checks
sensor networks
humans: amateurs and profs.
Collaborative Observatories for Natural Environments (CONEs)
![Page 31: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/31.jpg)
Frank van der Stappen (CS, Utrecht)Vladlen Koltun (EECS, UC Berkeley)George Bekey (CS, USC)Karl Bohringer (CS, UW)Anatoly Pashkevich (Informatics, Belarus) Judith Donath (Media Lab, MIT) Eric Paulos (Intel Research Lab, Berkeley)Dana Plautz (Intel Research Lab, Oregon)Sariel Har-Peled (CS, UIUC)
Thank you.ShareCam: Interface, System Architecture, and Implementation of a
Collaboratively Controlled Robotic Webcam
![Page 32: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/32.jpg)
![Page 33: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/33.jpg)
Satellite Imaging
![Page 34: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/34.jpg)
![Page 35: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/35.jpg)
MIT Press, 2002
![Page 36: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/36.jpg)
Networked Robots
• Tele-Operation• Internet Tele-Operation• Collaborative Tele-Operation• Tele-Actor• Co-Opticon• Co-Opticon Algorithms
www.ken.goldberg.net
![Page 37: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/37.jpg)
![Page 38: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/38.jpg)
Infiltrate
![Page 39: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/39.jpg)
![Page 40: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/40.jpg)
![Page 41: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/41.jpg)
![Page 42: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/42.jpg)
![Page 43: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/43.jpg)
![Page 44: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/44.jpg)
NetworkedRobots
![Page 45: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/45.jpg)
internettele-robot:
![Page 46: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/46.jpg)
RoboMotes: Gaurav S. Sukhatme, USC
![Page 47: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/47.jpg)
Smart Dust: Kris Pister, UCB (Image: Kenn Brown)
![Page 48: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/48.jpg)
NetworkedCameras
![Page 49: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/49.jpg)
Where to look?
![Page 50: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/50.jpg)
Sensornet detects activity• “Motecams”
• Other sensors:audio, pressure switches,
light beams, IR, etc
• Generate bounding boxes
and motion vectors
• Transmit to PZT camera
Activity localization
![Page 51: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/51.jpg)
1. Network Standards: HTML, Browsers, Java
2. Infrastructure: Backbone, Routers, ADSL
3. Public Adoption
4. Bandwidth: 10 Mbps, 100Mbps, Gbps
5. Video/Audio Compression: MP2,3,4
![Page 52: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/52.jpg)
Networked robots Systems that couple communication to control of one or more robots in a network that often includes sensors and remote human operators.
Two subclasses : 1) Tele-operated, where human supervisors send commands
and receive feedback via the network. Such systems support research, education, and public awareness by making valuable resources accessible to broad audiences.
2) Autonomous, where robots and sensors exchange data via the network. In such systems, the network extends the effective sensing range of individual robots.
![Page 53: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/53.jpg)
Challenges:
1. Variable Time Delays, Congestion
2. Latency
3. Access Control, Security, Interfaces
4. Protocol Design
5. Noise, Error Detection and Recovery
6. Deployment, Dynamic Routing
7. Power Management
8. Hybrid Architectures
![Page 54: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/54.jpg)
Conventional Security Cameras
• Immobile or Repetitive Sweep• Low resolution
![Page 55: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/55.jpg)
Future Work
• Continuous zoom (m=)• Multiple outputs:
– p cameras – p views from one camera
• “Temporal” version: fairness– Integrate si over time: minimize accumulated
dissatisfaction for any user
• Network / Client Variability: load balancing
• Obstacle Avoidance
![Page 56: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/56.jpg)
Outline
• Collaborative Teleoperation
• Cinematrix• Co-opticon• Tele-Twister
![Page 57: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/57.jpg)
![Page 58: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/58.jpg)
"In times of terror, when everyone is something of a conspirator,everyone will be in a situation where he has to play detective." -- Walter Benjamin (1938)
![Page 59: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/59.jpg)
Statistics of Satellite Imaging
• 2.5 Billion Market in 2003• Increasing 300% per year
since 1999• Major clients
– Government / Military– Oil exploration– Weather Prediction– Agriculture
Ikonos, 1999
![Page 60: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/60.jpg)
Intersection over Maximum: si( ,i)
si = 0.20 0.21 0.53
Requested frame i
Candidate frame
![Page 61: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/61.jpg)
• Staircase Approximation– Exact algorithm O(n3/2 log3 n) [data
structure]
– Approximation Algorithm O(nk log(nk)), k=(log(1/ε)/ε)2
• Staircase approximation, large constant factors
![Page 62: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/62.jpg)
![Page 63: ShareCam: Interface, System Architecture, and Implementation of a Collaboratively Controlled Robotic Webcam Dezhen Song (TAMU) and Ken Goldberg (UC Berkeley)](https://reader035.vdocument.in/reader035/viewer/2022081515/56649d545503460f94a310ea/html5/thumbnails/63.jpg)