building content and service oriented networks overview of the terena technical programme

Building Content and Service Oriented Networks

Overview of the TERENA Technical Programme

Yuri Demchenko

Project Development Officer, TERENA

<demchenko@terena.nl>

http://www.terena.nl/

Building Content and Service Oriented NetworksSlide_2

Building Content and Service Oriented NetworksPresentation Outlines

• TERENA Technical Programme– Main areas of interests

• Middleware Coordination Activity for Europe• Content Delivery Networks• TERENA Portal

– Concept

– Goals

– Development

• Portal Components– REIS – REsearch Index Service for Europe

– Multimedia Information in Research and Education

• Research Agenda for the TERENA Portal Initiative

Building Content and Service Oriented NetworksSlide_3

The TERENA Technical Programme

• TERENA - The Trans-European Research and Education Networking Association

– Association of National Research and Education Networks • + Industry associated members

• Technical Programme priority areas– Lower Layers Technologies (IPv6, MPLS, VPNs etc.)– Service Oriented Networks (QoS, DiffServ, Policy based networks)– Videoconferencing and streaming– Content delivery, indexing and searching– Middleware– [Mobility]

• Organised through task forces, projects, workshops and an annual conference

– Task Forces – TF-Stream, TF-LSD, TF-CSIRT, TF-TANT– Major projects, minor projects, external projects

Building Content and Service Oriented NetworksSlide_4

Lower Layer Technologies and Service Oriented Networks

• TF-TANT - Testing and evaluation of lower-layer technologies– Jointly organised by TERENA and DANTE (QTP)

• November 1998 - October 2000• Follow-on activity is being discussed• http://www.terena.nl/task-forces/tf-tant/

– Test programme includes:• Differentiated Services• Multicast• Traffic and Route Monitoring• MPLS (Multi-Protocol Label Switching)• IPv6• Policy Control

• Quality of Service (QoS) and DiffServ

Building Content and Service Oriented NetworksSlide_5

Content Delivery Networks

• Caching, replication, network storage• TF-CACHE - http://www.terena.nl/task-forces/tf-cache/

– Recently concluded

• Projects, already finished:– Extended Cache Statistics

– FTP Mirror Tracker

• Project currently under discussion– Far Network CDN by Alexei Novikov

• Combining caching, mirror tracking and other technologies

• Collaboration with I2-DSI - http://dsi.internet2.edu/

Building Content and Service Oriented NetworksSlide_6

Videoconferencing and Streaming

• TF-Stream (Real-Time Multimedia Applications) http://www.terena.nl/task-forces/tf-stream/

– Audio-video conferencing for European research community, promoting sources of content, coordinating initiatives, assisting pilot project

• TF Stream Deliverables– glossary of terms

– policy for publishing audio/video in public domain

– Web repository of audio/video material

– Clearinghouse for multicast monitoring tools

– Metadata for audio/video content

Building Content and Service Oriented NetworksSlide_7

Middleware Coordination for Europehttp://www.terena.nl/middleware/

• IETF Middleware Workshop – December 1998– RFC 2768 - http://www.ietf.org/rfc/rfc2768.txt

• Early Harvest – Internet2 Middleware Workshop – September 1999– http://middleware.internet2.edu/earlyharvest/– Draft Best Practices - http://middleware.internet2.edu/best-practices.html

• European Middleware Wokshop - 19-20 June 2000, Leiden– Organised by the Telematics Institute and TERENA in collaboration with the

Internet2 Middleware Initiative and SURFnethttp://www.terena.nl/middleware/

• Focusing on the middleware components and services for content and service oriented networks

Building Content and Service Oriented NetworksSlide_8

Middleware Services (according to Internet2 MI) http://middleware.internet2.edu/overview/

• Core Middleware services– Identifiers

– Authentication

– Directories

– Authorisation

– Certificates and PKI

• Lower middleware - networking-oriented middleware– Secure multicast

– Bandwidth brokering

• Upper middleware– Services for ubiquitous computing/persistent presence

– Support for research computing/computer grids

– Support for administrative computing/transactions and messaging

Building Content and Service Oriented NetworksSlide_9

Middleware concept – Generic services

• Upper layer routing services for – query routing

– resource/services and policy (description)

– routing of active components

• Resolution services for – network (and security) policy

– resource description/discovery and metadata

– service access (AAAArch)

– assurance infrastructure (trust relations management/resolution)

• Resource/services management – access

– services

– resources

Building Content and Service Oriented NetworksSlide_10

TF-LSD (LDAP Service Deployment)

Directory is an important component of modern concept of service and content oriented networks

• Started from the LDAP BoF on 12 May 2000 in Amsterdam

• Follow-on of the DIRECT project on DIrectory REplication CoordinaTion

• TF-LSD main goals and deliverables– Directory indexing implementations based on the Common Indexing Protocol (CIP)– Definition of a European wide White Pages index service– Referencing between X.521 and DC-naming for distribution of knowledge information

between LDAP servers– Pilot service for publishing, distributing, and validating certificates

• LDAP based storing, distributing and validating certificates

– New evolving directory related standards (DSML, DEN, etc.)

Building Content and Service Oriented NetworksSlide_11

TERENA Portal Project/Initiative

• Answer to vital needs of R&A community in specific Information service

• Platform for developing and piloting services for the European research and academia community

– Showcase for new technology– Platform for NRN research activities combined with industry– Combines expertise of TERENA community in indexing/searching,

caching/storage, streaming

• Started with REIS Initiative in June 1999

• Currently being discussed with potential partners from industry– Opportunity with IBM Internet2 Centre in Zoetermeer / NL

• Work on common research objectives• Facilities with excellent connectivity (155Mbps to SURFnet)

– Inktomi– AltaVista

Building Content and Service Oriented NetworksSlide_12

Portal components

• Research Indexing service– Indexing/Searching tools/engine

– Cross-Searching Automatic Indexes and human-made Subject Gateways

• Directory services and Metadata– Automatic Classification

– Metadata Registry

• Video-on-Demand and Streaming (plus hosting)• Content Replication

• Portal as an access point to all what’s behind the Portal– All what community uses, develops and needs

– Multilsite and multihome for services• Collaborative vs Distributed vs Centralised

Building Content and Service Oriented NetworksSlide_13

The TERENA Portal Concept

•Discovering Authoritative Source of Information

CommercialPortals

SubjectInformationGateways

VideoArchives Institutional

Web Pages

SingleService Access

Point

Building Content and Service Oriented NetworksSlide_14

REsearch Indexing Service for Europe (REIS)

• REIS Initiative - started from BoF at TNNC’99http://www.terena.nl/projects/reis/– Main goal - to build pilot service for Research and Education community in

Europe

• Specific REIS features– Comprehensive coverage of Research-on-the-web

– Both searchable and browsable by subject

– Interactive search refinement • Finding Authoritative Resources - ”Topic Distillation”

– Adaptive crawling and automatic (pre-)classification of gathered data

– Attribute (metadata) searching • Dublin Core metadata search capability

– Multilinguality and cross-language searching • Multilingual support in interface

Building Content and Service Oriented NetworksSlide_15

TERENA Portal goals

• Community oriented Portal– Binding and assisting specific community

– Virtual community with its Knowledge accumulation and domain specific resources

– Instant communication and IA / VPP

• Research diversification and knowledge accumulation• Services/tools to assist Researchers and Educators

– building authorities in new domains

– discovering knowledge/resources in European/worldwide Internet

– R&E Multimedia information

• Cooperation with industry– to help research community

– to provide feedback and input from research community

Building Content and Service Oriented NetworksSlide_16

What do people need from Research oriented Portal?Discussed on the Panel at WebIndexing Workshop in Delft May 2000

• Information in specific research area– new and diverse areas not covered by existing classification and Subject

Gateways

• (Virtual) Community interaction– Possibility to talk to expert (become bound into community)

– to communicate with people

– to find colleagues

• Video/audio materials – personalised experience

• Build personal profiles and exchange of experience and findings – Shared bookmark - to accumulate highly professional experience

• Access to Open Research area– Information discovery and expert tools

– Automatic classification and knowledge mining

Building Content and Service Oriented NetworksSlide_17

TERENA Portal as Community Oriented Portal

• To build successful Portal you need to find/build proper community– Community membership creates willingness to cooperate in resources and

services creation and development

• Bottom-up vs Top-down approach• Possibility to communicate between people (community members)

– create cooperative environment

– virtual (point of) presence

• Finding relevant resources in diverse areas• Starting with specific area and specific services in general concept• Ask and propose to users

– user needs driven approach

Building Content and Service Oriented NetworksSlide_18

TERENA Portal Value-Added Services

• Combined with communication between researchers– to explore common findings

– building virtual community/presence

• Knowledge Accumulation and Dissemination• Quality Information Resources enabled by “web-of-trust”• Advertisement from and linkage to the Scientific publishers

Building Content and Service Oriented NetworksSlide_19

Research oriented vs Commercial Portals - Conceptual

• Old Portal receipt – LSD – Logo-Search-Directory

• New flavors– myportal service and personal Mail address– Image search – Link to e-commerce

• TERENA Portal differences from commercial– Professional and Educational information

• Community oriented service • Information consistency

– Limited (professional) communities of trust• Strong Authentication and Confidence• Secure real-time communication – video and audio

– Video and Audio• Lectures, Seminars and Conferences

– Intelligent Agent – like ancient “Librarian”

Building Content and Service Oriented NetworksSlide_20

Multimedia/Visual Information in Education and Research

• Conferences video archives vs Conference Proceedings– Q&A – Parallel sessions – (Parallel conferences)

• Dedicated lectures/seminars – Ad Hoc topics– Lectures by expert specialists

– Exchange with both teacher and auditorium

• Distance Education and Training– Courses on demand

– Hands-on and practical lessons (e.g., surgery, fiber cabling, etc.)

– Virtual classroom

• Distinctive features– Live video/speech

– Information humanisation/impersonalisation

– Still paper-like information vs train-of-thought

– Virtual presence

Building Content and Service Oriented NetworksSlide_21

Visual materials Cataloguing/Browsing/Searching/Indexing

• Textual description• Content/background/etc. Indexing/Searching

– Image patterns• Image layers/Image decomposition

– Video snapshots

• Embedded/linked description?– Metadata

– MPEG7

Building Content and Service Oriented NetworksSlide_22

Research and Deployment Problems in TP

• REIS – size of the problem– 30-50 Mln documents in designated communities for Europe– Frequent update

• Metadata– Metadata consistency and trust– Metadata registry and access– LDAP Schema for DC

• Multilinguality– Cross-Language Searching

• Network Access problems– Different speed of access among TERENA members– Distributed vs Centralised vs Cooperative Service– WAP-profile

• Binding community– Instant communication and Persistent presence– Authentication and web-of-trust

Building Content and Service Oriented NetworksSlide_23

Needs and topics for cooperation with industry

• Current situation– Commercial Search and Indexing services is extending

• Site search service from AltaVista, Google

• Research Index – Lease or Buy• SE Industry needs trial of new services• Metadata for R&A trial deployment

Building Content and Service Oriented NetworksSlide_24

TERENA previous experience in the area

• DESIRE II– Web Indexing, Directories, Metadata

• Streaming and Video-on-Demand in the frame of TF-STREAM• LDAP Services Deployment

– LDAP based PKI piloting

• GNRT – Information Resource for the TERENA community• Caching and Network Storage in the framework of TF-CACHE• Multilingual Mail Agents Testing – Pilot Project

– Multilingual Applications in WWW/Internet - http://www.terena.nl/multiling/

• CHIC-Pilot on cooperative Indexing

Building Content and Service Oriented NetworksSlide_25

Where are we going today?

• TERENA organises Workshop on Research oriented Portal for Europe in early February 2001 – place TBD– Establish TF-level activity

• Initiate discussion among NRENs on cooperation/coordination issues in building national R&A Portal services

• Promote use of Video and Streaming services/archives – Among universities and research institutions and in in knowledge

rich/generating areas

– Maintain Directory of available resources• First try - http://www.terena.nl/projects/reis/mmis/

– Develop cataloguing/indexing tools for visual/audio information

• Extend searching for cooperative contacts with industry

Building Content and Service Oriented NetworksSlide_26

Additional Information

Building Content and Service Oriented NetworksSlide_27

TERENAthe Trans-European Research and Education Networking Association

TERENA membership 2000• 35 national members

(the NRENs of 35 countries in and around Europe)

• 3 international members(CERN, ECMWF, ESA)

• 7 associate members(including industries)

• 1 observer(the European Commission)

Building Content and Service Oriented NetworksSlide_28

GNRT

• ‘2000 Edition’ published in October 1999

• New version has been reviewed

• To be published on the Web towards the end of the yearhttp://www.terena.nl/libr/gnrt/

• Translated into – Croatian– Slovenian– Turkish

Building Content and Service Oriented NetworksSlide_29

Educational Video and Streaming Resources on the Internet - Europe

• European archive– FUNET-TV - http://tv.funet.fi/index-en.html

– SURFnet • Video and Streaming hosting - http://stream.surfnet.nl/

– Live Video broadcast at BELNET - http://sunsite.belnet.be/events/

– University of Namur Educational materials - http://www.info.fundp.ac.be/~infonet/coursenligne/

– Israel - http://www.internet-2.org.il/vod.html • University of Haifa - Weizmann Institute of Science - Ben Gurion University

– More – to be discovered!

Building Content and Service Oriented NetworksSlide_30

Educational Video and Streaming resources on the Internet - USA

• Internet2 Video Development Initiative - http://www.vide.net/ • ResearchChannel - http://www.researchchannel.com/

– Collaboration to experiment with high bandwidth modes of delivery and exchange in educational and research-oriented information

• Multi-University Research Laboratory Seminar Series - http://murl.microsoft.com/

• MREN/CIC Digital Video Streaming - http://videocharger.mcs.anl.gov/demo.html

• University of Washington - ResearchTV - http://www.washington.edu/researchtv/

• EE380 Colloquium at Stanford University Computer Systems Laboratory - http://www.stanford.edu/class/ee380/

• Berkley Multimedia Research Center - http://bmrc.berkeley.edu/index.html