VRVS Next Development (1/2) Session Introduction: P. Galvez; 5 Current and New Collaborative Architecture (From VRVS to EVO): P. Galvez; 15 MonALISA (A Monitoring Agents Using Large Integrated Services Architecture) I. Legrand; 15 (by Video) Advanced Collaborative End Applications: P. Farkas; 15 Demonstration: 20 EVO: a End-to-End Secure and Self-Adaptive Real-Time Collaboration Infrastructure We will try to break the system !, auto recovery, redundancy, Questions: 5 Next Generation Grid Enable Collaborative System VRVS worldwide collaborative production service From VRVS to EVO Philippe Galvez California Institute of Technology I2 Spring Meeting, May 4th, 2005 VRVS Next Development (1/2) VRVS: Background Information VRVS Deployment; VRVS Usage and Statistics From VRVS To EVO: An End-to-End Self Managed RTC Infrastructure Outlines u VRVS is a realtime distributed system which provides a scalable communication infrastructure for large collaboration dispersed all over the world. u Different technologies and protocols are supported (and mixed) and allow users to connect their preferred videoconference. u Supports Mbone, H.323, SIP, QuickTime, Access Grid, JMF and MPEG2. u The system is composed of 1 main server and several reflectors (network servers) spread around the world. VRVS: What it is ? u Unified Web User Interface to schedule and join/leave a meeting independently of the application. u Multi-platform: Windows, Linux, MacOS and Unix. u Easy to use: Everybody knows how to click on a web page today. u Virtual Room Concept, Scheduling; Create a virtual space were people can exchange real-time information. u Join or Leave a Collaborative session anytime. Do not need to know in advance how many participants and booked ports capacity. Just announce the meeting and people will join from anywhere. u Full Documentation and Tutorial u Self service: Dont need a technician or expert to organize and join a conference. VRVS Web Service Design VRVS Reflectors Deployment World Wide VRVS registered users and current usage until May 4th, 2005 USA3573Spain1741 France1157 Italy Switzerland, Germany, Brazil, UK, Slovakia, Taiwan, Chile, Greece, Argentina, Japan, Russia, Canada, etc 15,700 different Users Registered 120 Countries from 120 CountriesWorkshops/Conferences Since 2004/01/01 Workshop257 Lecture33 Conference256 Seminar156 Tutorial38 Average of 1100 world wide meetings involving more than 4500 users (total 6000 hours) per month VRVS National Research and Education Network (NREN) Communities: Internet2 (U.S), GEANT2/DANTE (Europe), RedIRIS (Spain), RNP (Brazil), REUNA (Chile), RENATER (France), SANET (Slovakia), INFN (Italy), FUNET (Finland), REACCIUN2 (Venezuela) and AMPATH (America). Others are in process. Internet2 (U.S), GEANT2/DANTE (Europe), RedIRIS (Spain), RNP (Brazil), REUNA (Chile), RENATER (France), SANET (Slovakia), INFN (Italy), FUNET (Finland), REACCIUN2 (Venezuela) and AMPATH (America). Others are in process. VRVS Disciplines communities: HENP, ASTRO, FUSION, MEDICAL VRVS Particular Project Communities: VRVS TEAM, ACCESSGRID,.. VRVS Worldwide Collaboration The VRVS team collaborates with Research and Education Networks and major Research Projects around the globe to provide the academic community with a unique and reliable real-time infrastructure supporting all protocols for advanced collaboration 9 10 Whats Next ? 11 Main critical RTC issues: Manageability Reliability Scalability Security Functionality / Usability From VRVS To EVO: End-to-End Self Managed RTC Infrastructure Developing/Deploying a Very Robust and Scalable Real-Time Collaborative (RTC) Infrastructure is a real problem that no- one was able to fix yet ! 12 Whats wrong ? Why can we not achieve total reliability/robustness when deploying a RTC Infrastructure ? From VRVS To EVO: End-to-End Self Managed RTC Infrastructure The Real-Time Collaborative environment is a living environment, constantly changing, evolving. In addition devices/domains/nodes are managing by several independent technical and administrative entities 13 By creating a living RTC Infrastructure capable to react/adapt to the change of the environment in real-time transparently to the end-user Solutions ? 14 Building a Scalable RTC Infrastructure Multicast Network: It is not any more a global solutionMulticast Network: It is not any more a global solution After more than 10 years of development/deployment, It reaches its maximum level of reliability/robustness It is just a transport mechanism No QoSNo QoS No awareness of the Application levelNo awareness of the Application level No data processing as required by the some application (mixing audio, select video streams, .)No data processing as required by the some application (mixing audio, select video streams, .) Extremely difficult to troubleshot because it crosses several administrative domains Todays solution: Building an Overlay Network by deploying intelligent Software Agents communicating using Unicast connections and capable of using Multicast transport when it makes more sense 15 Directory Services Notification to others members Send Monitoring Information in real-time CPU, Memory, Network Status, Packet loss, Latency/Jitter with its peers, number of clients connected, etc.. Send Alarms to Administrators: Packet lost, CPU high, etc.. Access Monitoring Information and Remote Administrated the Different Services Register the Service offered GUI for Monitoring Building a Core RTC Infrastructure Overlay Network built using Intelligent Software Agent: Panda Monitoring Service 16 Outlines 17 Directories Services RTC Core Infrastructure (1) Give me the best Panda nodes available: Best network connectivity Best latency/jitter no packet lost minimum of client clients connected (load balancing) (2) 3 best nodes provided (3) Check network quality (Latency, jitter, packet lost) and select the best one Local Monitoring Agent Provides information in real-time: CPU, Memory, Network Status, Packet loss, Latency/Jitter to/from its connected Panda Send Alarms: Packet lost, CPU high, etc.. AND takes automatic actions to correct the problem (5) Publish local monitoring information IM H.323 Mbon e SIP MPEG Koala: A Software Agent running In Computer End-User End-to-End RTC Self Managed Infrastructure (4) Connect to the best node Building an End-to-End Self Managed RTC Infrastructure 18 Directories Services IM H.323 Mbon e SIP MPEG Local Computer End-to-End RTC Self Managed Infrastructure IM, Chat, Presence, Control Packet VideoAudio Possibility to Encrypt IM, Chat, Presence message AND/OR Video packet AND/OR Audio packet All Communication channels are tunneled via ONE port (UDP or TCP). Crossing Firewall and NAT environment !! Possibility to Encrypt communication between Panda nodes Logging and scheduling packets information communication done via the tunneled connection with the Panda Building an End-to-End Self Managed RTC Infrastructure 19 Connection to the Panda Automatic Time Zone Adjustment On-Going meetings, click to join Multi-Languages Support Presence Chat Bookings The Koala Client (Java) 20 Messenger -SIP H.323 MCU AG H.323 EVO EVO: End-to-End Self Managed and Secure RTC Infrastructure 21 Demonstration: Lets break the System ! X X X Breaking a core node and automatic topology reconnection 2 - Breaking a Panda node where Users are connected and automatic reconnection to a new Panda node 3- Overloading the user machine and see automatic actions to adjust the problem 22 Thank you 23 Additional Slides 24 It will provide communication channel not only for audio/video but also for shared applications, Instant Messaging. also for shared applications, Instant Messaging. Dynamic registration to high level directory services Dynamic registration to high level directory services Automatic re-activation of components and services Automatic re-activation of components and services Automatic and secure code update Automatic and secure code update Continuous monitoring of network quality (packet loss, jitter, Continuous monitoring of network quality (packet loss, jitter, latency) between its peers and its possible peers latency) between its peers and its possible peers Automatic rerouting to obtain the best performance/quality Automatic rerouting to obtain the best performance/quality Encryption between reflectors and between reflector and VRVS Encryption between reflectors and between reflector and VRVS clients clients Automatic Alarm notifications when monitored parameters Automatic Alarm notifications when monitored parameters (system or network) go beyond a preset threshold (system or network) go beyond a preset threshold Dynamically provides services (video, audio, data,..) that matches Dynamically provides services (video, audio, data,..) that matches the current resources/capabilities to the end users/applications the current resources/capabilities to the end users/applications Provides access to real-time and historical data Provides access to real-time and historical data Panda Software Agent functionalities 25 New Java-based VRVS client that will perform Dynamic Registration to high level directory services (Multi-OS support) Registration to high level directory services (Multi-OS support) Automatic detection of the system parameters (CPU, Memory,..) Automatic detection of the system parameters (CPU, Memory,..) hardware components (Audio card, video card, ), services hardware components (Audio card, video card, ), services capabilities (video, audio, ), network environment and capabilities (video, audio, ), network environment and capabilities (wireless environment, DSL, available bandwidth, ) capabilities (wireless environment, DSL, available bandwidth, ) Dynamically gets services (video, audio, data,..) that matches the Dynamically gets services (video, audio, data,..) that matches the current resources/capabilities to end users/applications current resources/capabilities to end users/applications Continuous monitoring of network quality (packet loss, jitter) Continuous monitoring of network quality (packet loss, jitter) latency) and Automatic rerouting of packets latency) and Automatic rerouting of packets Automatic Alarm notifications when monitored parameters Automatic Alarm notifications when monitored parameters (system or network) go beyond a preset threshold. (system or network) go beyond a preset threshold. Koala Software Agent Functionality 26 GUI: Koala Software Agent 27 Admin GUI with Panda and Koala nodes 28 Monalisa / EVO GUI 29 Additional Admin. GUI Snapshot