building content and service oriented networks overview of the terena technical programme

Building Content and Service Oriented Networks

Overview of the TERENA Technical Programme

Yuri Demchenko

Project Development Officer, TERENA

<[email protected]>

http://www.terena.nl/

Building Content and Service Oriented NetworksSlide_2

Building Content and Service Oriented NetworksPresentation Outlines

• TERENA Technical Programme– Main areas of interests

• Middleware Coordination Activity for Europe• Content Delivery Networks• TERENA Portal

– Concept

– Goals

– Development

• Portal Components– REIS – REsearch Index Service for Europe

– Multimedia Information in Research and Education

• Research Agenda for the TERENA Portal Initiative


The TERENA Technical Programme

• TERENA - The Trans-European Research and Education Networking Association

– Association of National Research and Education Networks • + Industry associated members

• Technical Programme priority areas– Lower Layers Technologies (IPv6, MPLS, VPNs etc.)– Service Oriented Networks (QoS, DiffServ, Policy based networks)– Videoconferencing and streaming– Content delivery, indexing and searching– Middleware– [Mobility]

• Organised through task forces, projects, workshops and an annual conference

– Task Forces – TF-Stream, TF-LSD, TF-CSIRT, TF-TANT– Major projects, minor projects, external projects


Lower Layer Technologies and Service Oriented Networks

• TF-TANT - Testing and evaluation of lower-layer technologies– Jointly organised by TERENA and DANTE (QTP)

• November 1998 - October 2000• Follow-on activity is being discussed• http://www.terena.nl/task-forces/tf-tant/

– Test programme includes:• Differentiated Services• Multicast• Traffic and Route Monitoring• MPLS (Multi-Protocol Label Switching)• IPv6• Policy Control

• Quality of Service (QoS) and DiffServ


Content Delivery Networks

• Caching, replication, network storage• TF-CACHE - http://www.terena.nl/task-forces/tf-cache/

– Recently concluded

• Projects, already finished:– Extended Cache Statistics

– FTP Mirror Tracker

• Project currently under discussion– Far Network CDN by Alexei Novikov

• Combining caching, mirror tracking and other technologies

• Collaboration with I2-DSI - http://dsi.internet2.edu/


Videoconferencing and Streaming

• TF-Stream (Real-Time Multimedia Applications) http://www.terena.nl/task-forces/tf-stream/

– Audio-video conferencing for European research community, promoting sources of content, coordinating initiatives, assisting pilot project

• TF Stream Deliverables– glossary of terms

– policy for publishing audio/video in public domain

– Web repository of audio/video material

– Clearinghouse for multicast monitoring tools

– Metadata for audio/video content


Middleware Coordination for Europehttp://www.terena.nl/middleware/

• IETF Middleware Workshop – December 1998– RFC 2768 - http://www.ietf.org/rfc/rfc2768.txt

• Early Harvest – Internet2 Middleware Workshop – September 1999– http://middleware.internet2.edu/earlyharvest/– Draft Best Practices - http://middleware.internet2.edu/best-practices.html

• European Middleware Wokshop - 19-20 June 2000, Leiden– Organised by the Telematics Institute and TERENA in collaboration with the

Internet2 Middleware Initiative and SURFnethttp://www.terena.nl/middleware/

• Focusing on the middleware components and services for content and service oriented networks


Middleware Services (according to Internet2 MI) http://middleware.internet2.edu/overview/

• Core Middleware services– Identifiers

– Authentication

– Directories

– Authorisation

– Certificates and PKI

• Lower middleware - networking-oriented middleware– Secure multicast

– Bandwidth brokering

• Upper middleware– Services for ubiquitous computing/persistent presence

– Support for research computing/computer grids

– Support for administrative computing/transactions and messaging


Middleware concept – Generic services

• Upper layer routing services for – query routing

– resource/services and policy (description)

– routing of active components

• Resolution services for – network (and security) policy

– resource description/discovery and metadata

– service access (AAAArch)

– assurance infrastructure (trust relations management/resolution)

• Resource/services management – access

– services

– resources


TF-LSD (LDAP Service Deployment)

Directory is an important component of modern concept of service and content oriented networks

• Started from the LDAP BoF on 12 May 2000 in Amsterdam

• Follow-on of the DIRECT project on DIrectory REplication CoordinaTion

• TF-LSD main goals and deliverables– Directory indexing implementations based on the Common Indexing Protocol (CIP)– Definition of a European wide White Pages index service– Referencing between X.521 and DC-naming for distribution of knowledge information

between LDAP servers– Pilot service for publishing, distributing, and validating certificates

• LDAP based storing, distributing and validating certificates

– New evolving directory related standards (DSML, DEN, etc.)


TERENA Portal Project/Initiative

• Answer to vital needs of R&A community in specific Information service

• Platform for developing and piloting services for the European research and academia community

– Showcase for new technology– Platform for NRN research activities combined with industry– Combines expertise of TERENA community in indexing/searching,

caching/storage, streaming

• Started with REIS Initiative in June 1999

• Currently being discussed with potential partners from industry– Opportunity with IBM Internet2 Centre in Zoetermeer / NL

• Work on common research objectives• Facilities with excellent connectivity (155Mbps to SURFnet)

– Inktomi– AltaVista


Portal components

• Research Indexing service– Indexing/Searching tools/engine

– Cross-Searching Automatic Indexes and human-made Subject Gateways

• Directory services and Metadata– Automatic Classification

– Metadata Registry

• Video-on-Demand and Streaming (plus hosting)• Content Replication

• Portal as an access point to all what’s behind the Portal– All what community uses, develops and needs

– Multilsite and multihome for services• Collaborative vs Distributed vs Centralised


The TERENA Portal Concept

•Discovering Authoritative Source of Information

CommercialPortals

SubjectInformationGateways

VideoArchives Institutional

Web Pages

SingleService Access

Point


REsearch Indexing Service for Europe (REIS)

• REIS Initiative - started from BoF at TNNC’99http://www.terena.nl/projects/reis/– Main goal - to build pilot service for Research and Education community in

Europe

• Specific REIS features– Comprehensive coverage of Research-on-the-web

– Both searchable and browsable by subject

– Interactive search refinement • Finding Authoritative Resources - ”Topic Distillation”

– Adaptive crawling and automatic (pre-)classification of gathered data

– Attribute (metadata) searching • Dublin Core metadata search capability

– Multilinguality and cross-language searching • Multilingual support in interface


TERENA Portal goals

• Community oriented Portal– Binding and assisting specific community

– Virtual community with its Knowledge accumulation and domain specific resources

– Instant communication and IA / VPP

• Research diversification and knowledge accumulation• Services/tools to assist Researchers and Educators

– building authorities in new domains

– discovering knowledge/resources in European/worldwide Internet

– R&E Multimedia information

• Cooperation with industry– to help research community

– to provide feedback and input from research community


What do people need from Research oriented Portal?Discussed on the Panel at WebIndexing Workshop in Delft May 2000

• Information in specific research area– new and diverse areas not covered by existing classification and Subject

Gateways

• (Virtual) Community interaction– Possibility to talk to expert (become bound into community)

– to communicate with people

– to find colleagues

• Video/audio materials – personalised experience

• Build personal profiles and exchange of experience and findings – Shared bookmark - to accumulate highly professional experience

• Access to Open Research area– Information discovery and expert tools

– Automatic classification and knowledge mining


TERENA Portal as Community Oriented Portal

• To build successful Portal you need to find/build proper community– Community membership creates willingness to cooperate in resources and

services creation and development

• Bottom-up vs Top-down approach• Possibility to communicate between people (community members)

– create cooperative environment

– virtual (point of) presence

• Finding relevant resources in diverse areas• Starting with specific area and specific services in general concept• Ask and propose to users

– user needs driven approach


TERENA Portal Value-Added Services

• Combined with communication between researchers– to explore common findings

– building virtual community/presence

• Knowledge Accumulation and Dissemination• Quality Information Resources enabled by “web-of-trust”• Advertisement from and linkage to the Scientific publishers


Research oriented vs Commercial Portals - Conceptual

• Old Portal receipt – LSD – Logo-Search-Directory

• New flavors– myportal service and personal Mail address– Image search – Link to e-commerce

• TERENA Portal differences from commercial– Professional and Educational information

• Community oriented service • Information consistency

– Limited (professional) communities of trust• Strong Authentication and Confidence• Secure real-time communication – video and audio

– Video and Audio• Lectures, Seminars and Conferences

– Intelligent Agent – like ancient “Librarian”


Multimedia/Visual Information in Education and Research

• Conferences video archives vs Conference Proceedings– Q&A – Parallel sessions – (Parallel conferences)

• Dedicated lectures/seminars – Ad Hoc topics– Lectures by expert specialists

– Exchange with both teacher and auditorium

• Distance Education and Training– Courses on demand

– Hands-on and practical lessons (e.g., surgery, fiber cabling, etc.)

– Virtual classroom

• Distinctive features– Live video/speech

– Information humanisation/impersonalisation

– Still paper-like information vs train-of-thought

– Virtual presence


Visual materials Cataloguing/Browsing/Searching/Indexing

• Textual description• Content/background/etc. Indexing/Searching

– Image patterns• Image layers/Image decomposition

– Video snapshots

• Embedded/linked description?– Metadata

– MPEG7


Research and Deployment Problems in TP

• REIS – size of the problem– 30-50 Mln documents in designated communities for Europe– Frequent update

• Metadata– Metadata consistency and trust– Metadata registry and access– LDAP Schema for DC

• Multilinguality– Cross-Language Searching

• Network Access problems– Different speed of access among TERENA members– Distributed vs Centralised vs Cooperative Service– WAP-profile

• Binding community– Instant communication and Persistent presence– Authentication and web-of-trust


Needs and topics for cooperation with industry

• Current situation– Commercial Search and Indexing services is extending

• Site search service from AltaVista, Google

• Research Index – Lease or Buy• SE Industry needs trial of new services• Metadata for R&A trial deployment


TERENA previous experience in the area

• DESIRE II– Web Indexing, Directories, Metadata

• Streaming and Video-on-Demand in the frame of TF-STREAM• LDAP Services Deployment

– LDAP based PKI piloting

• GNRT – Information Resource for the TERENA community• Caching and Network Storage in the framework of TF-CACHE• Multilingual Mail Agents Testing – Pilot Project

– Multilingual Applications in WWW/Internet - http://www.terena.nl/multiling/

• CHIC-Pilot on cooperative Indexing


Where are we going today?

• TERENA organises Workshop on Research oriented Portal for Europe in early February 2001 – place TBD– Establish TF-level activity

• Initiate discussion among NRENs on cooperation/coordination issues in building national R&A Portal services

• Promote use of Video and Streaming services/archives – Among universities and research institutions and in in knowledge

rich/generating areas

– Maintain Directory of available resources• First try - http://www.terena.nl/projects/reis/mmis/

– Develop cataloguing/indexing tools for visual/audio information

• Extend searching for cooperative contacts with industry


Additional Information


TERENAthe Trans-European Research and Education Networking Association

TERENA membership 2000• 35 national members

(the NRENs of 35 countries in and around Europe)

• 3 international members(CERN, ECMWF, ESA)

• 7 associate members(including industries)

• 1 observer(the European Commission)


GNRT

• ‘2000 Edition’ published in October 1999

• New version has been reviewed

• To be published on the Web towards the end of the yearhttp://www.terena.nl/libr/gnrt/

• Translated into – Croatian– Slovenian– Turkish


Educational Video and Streaming Resources on the Internet - Europe

• European archive– FUNET-TV - http://tv.funet.fi/index-en.html

– SURFnet • Video and Streaming hosting - http://stream.surfnet.nl/

– Live Video broadcast at BELNET - http://sunsite.belnet.be/events/

– University of Namur Educational materials - http://www.info.fundp.ac.be/~infonet/coursenligne/

– Israel - http://www.internet-2.org.il/vod.html • University of Haifa - Weizmann Institute of Science - Ben Gurion University

– More – to be discovered!


Educational Video and Streaming resources on the Internet - USA

• Internet2 Video Development Initiative - http://www.vide.net/ • ResearchChannel - http://www.researchchannel.com/

– Collaboration to experiment with high bandwidth modes of delivery and exchange in educational and research-oriented information

• Multi-University Research Laboratory Seminar Series - http://murl.microsoft.com/

• MREN/CIC Digital Video Streaming - http://videocharger.mcs.anl.gov/demo.html

• University of Washington - ResearchTV - http://www.washington.edu/researchtv/

• EE380 Colloquium at Stanford University Computer Systems Laboratory - http://www.stanford.edu/class/ee380/

• Berkley Multimedia Research Center - http://bmrc.berkeley.edu/index.html

building content and service oriented networks overview of the terena technical programme

Documents