optimal distributed state estimation and control, in the presence of communication costs nuno c....
TRANSCRIPT
![Page 1: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/1.jpg)
Optimal Distributed State Estimation and Control, in the Presence of Communication Costs
Nuno C. [email protected]
AFOSR, MURI Kickoff Meeting, Washington D.C., September 29, 2009
Department of Electrical and Computer EngineeringInstitute for Systems Research
University of Maryland, College Park
![Page 2: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/2.jpg)
• Setup is a network whose nodes might comprise of: Linear dynamic systems
Sensors with transmission capabilities
Receivers including state estimator
A Simple Configuration:
Introduction
![Page 3: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/3.jpg)
• Setup is a network whose nodes might comprise of: Linear dynamic systems
Sensors with transmission capabilities
Receivers including state estimator
A Simple Configuration:
Applications:
-Tracking of stealthy aerial vehicles via (costly) highly encrypted channels.
Introduction
![Page 4: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/4.jpg)
• Setup is a network whose nodes might comprise of: Linear dynamic systems
Sensors with transmission capabilities
Receivers including state estimator
A Simple Configuration:
Applications:
-Tracking of stealthy aerial vehicles via (costly) highly encrypted channels.
-Distributed learning and control over power limited networks.
NSF CPS: Medium 1.5M
Ant-Like Microrobots - Fast, Small, and Under ControlPI: Martins, Co PIs: Abshire, Smella, Bergbreiter
Introduction
![Page 5: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/5.jpg)
• Setup is a network whose nodes might comprise of: Linear dynamic systems
Sensors with transmission capabilities
Receivers including state estimator
A Simple Configuration:
Applications:
-Tracking of stealthy aerial vehicles via (costly) highly encrypted channels.
-Distributed learning and control over power limited networks.
- Optimal information sharing in organizations.
Introduction
![Page 6: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/6.jpg)
• Setup is a network whose nodes might comprise of: Linear dynamic systems
Sensors with transmission capabilities
Receivers including state estimator
A Simple Configuration:
Ultimately, we want to tackle generalinstances of the multi-agent case.
![Page 7: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/7.jpg)
Major results:Nonlinear, non-convex.Optimality was a long standing open problem.
Solution is provided in:
G. M. Lipsa, N. C. Martins, “Certifying the Optimality of a Distributed State EstimationScheme via Majorization Theory”, submitted to TAC, 2009
Optimal solution:
timeErasure
Transmit
Transmit
A New Method for Certifying Optimality
![Page 8: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/8.jpg)
Major results:Nonlinear, non-convex.Optimality was a long standing open problem.
Solution is provided in:
G. M. Lipsa, N. C. Martins, “Certifying the Optimality of a Distributed State EstimationScheme via Majorization Theory”, submitted to TAC, 2009
Optimal solution:
timeErasure
Transmit
Transmit
Numerical method to computeOptimal thresholds
A New Method for Certifying Optimality
![Page 9: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/9.jpg)
Major results:Nonlinear, non-convex.Optimality was a long standing open problem.
Solution is provided in:
G. M. Lipsa, N. C. Martins, “Certifying the Optimality of a Distributed State EstimationScheme via Majorization Theory”, submitted to TAC, 2009
Optimal solution (a modified Kalman F.):
Erasure?yes
no
Execute K.F.
A New Method for Certifying Optimality
![Page 10: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/10.jpg)
Major results:Nonlinear, non-convex.Optimality was a long standing open problem.
Solution is provided in:
G. M. Lipsa, N. C. Martins, “Certifying the Optimality of a Distributed State EstimationScheme via Majorization Theory”, submitted to TAC, 2009
Past work:
A New Method for Certifying Optimality
![Page 11: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/11.jpg)
Frigyes Riesz
Issai Schur
Major results:Nonlinear, non-convex.Optimality was a long standing open problem.
Solution is provided in:
G. M. Lipsa, N. C. Martins, “Certifying the Optimality of a Distributed State EstimationScheme via Majorization Theory”, submitted to TAC, 2009
Past work:
Key to our proof is the useof majorization theory.
A New Method for Certifying Optimality
![Page 12: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/12.jpg)
…
Tandem Topology
Recent Extensions
![Page 13: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/13.jpg)
…
Tandem Topology
OptimalModified K.F.Threshold policy Memoryless forward
Recent Extensions
![Page 14: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/14.jpg)
…
Tandem Topology
OptimalModified K.F.Threshold policy Memoryless forward
Control with communication costs (Lipsa, Martins, Allerton’09)
Recent Extensions
![Page 15: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/15.jpg)
Multiple-stage Gaussian test channel
Problems with Non-Classical Information Structure
![Page 16: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/16.jpg)
Multiple-stage Gaussian test channel
Lipsa and Martins, CDC’08
Problems with Non-Classical Information Structure
![Page 17: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/17.jpg)
Major results:Nonlinear, non-convex.Optimality was a long standing open problem.
Solution is provided in:
G. M. Lipsa, N. C. Martins, “Certifying the Optimality of a Distributed State EstimationScheme via Majorization Theory”, submitted to TAC, 2009
Extensions:
…
Future directions:
-More General Topologies, Including Loops
Summary and Future Work
![Page 18: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/18.jpg)
Major results:Nonlinear, non-convex.Optimality was a long standing open problem.
Solution is provided in:
G. M. Lipsa, N. C. Martins, “Certifying the Optimality of a Distributed State EstimationScheme via Majorization Theory”, submitted to TAC, 2009
Extensions:
…
Future directions:
-More General Topologies, Including Loops
-Optimal Distributed Function Agreement with Communication Costs and Partial Information
Summary and Future Work
![Page 19: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/19.jpg)
Major results:Nonlinear, non-convex.Optimality was a long standing open problem.
Solution is provided in:
G. M. Lipsa, N. C. Martins, “Certifying the Optimality of a Distributed State EstimationScheme via Majorization Theory”, submitted to TAC, 2009
Extensions:
…
Future directions:
-More General Topologies, Including Loops
-Optimal Distributed Function Agreement with Communication Costs and Partial Information
-Game convergence and performance analysis
Summary and Future Work
![Page 20: Optimal Distributed State Estimation and Control, in the Presence of Communication Costs Nuno C. Martins nmartins@umd.edu AFOSR, MURI Kickoff Meeting,](https://reader035.vdocument.in/reader035/viewer/2022062515/56649d1f5503460f949f32ba/html5/thumbnails/20.jpg)
Major results:Nonlinear, non-convex.Optimality was a long standing open problem.
Solution is provided in:
G. M. Lipsa, N. C. Martins, “Certifying the Optimality of a Distributed State EstimationScheme via Majorization Theory”, submitted to TAC, 2009
Extensions:
…
Future directions:
-More General Topologies, Including Loops
-Optimal Distributed Function Agreement with Communication Costs and Partial Information
-Include Adversarial Action (Game Theoretic Approach)
Summary and Future Work
Thank youThank you