scientific collaboration cyberspace for china state key labs
DESCRIPTION
Scientific Collaboration Cyberspace for China State Key Labs. TieJian Luo Ph.D [email protected]. Graduate University of Chinese Academy of Sciences. Agenda. Research Models Challenges & Collaboration Services Scientific research Projects Lessons from the SCC development. - PowerPoint PPT PresentationTRANSCRIPT
TieJian Luo [email protected]
Graduate University of Chinese Academy of Sciences
Scientific Collaboration Cyberspace
for China State Key Labs
2
Agenda
• Research Models
• Challenges & Collaboration Services
• Scientific research Projects
• Lessons from the SCC development
3
New Science Paradigms
• Thousand years ago: Experimental Science
- description of natural phenomena• Last few hundred years:
Theoretical Science - Newton’s Laws, Maxwell’s Equations …
• Last few decades: Computational Science
- simulation of complex phenomena• Today:
e-Science or Data-centric Science - unify theory, experiment, and simulation - using data exploration and data mining– Data captured by instruments – Data generated by simulations– Processed by software– Scientist analyzes databases/files(Credit to Jim Gray)
2
22.
3
4
a
cG
a
a
2
22.
3
4
a
cG
a
a
4
The Problem for the e-Scientist
• Data ingest
• Managing a petabyte
• Common schema
• How to organize it?
• How to reorganize it?
• How to coexist & cooperate with others?
• Data Query and Visualization tools
• Support/training
• Performance– Execute queries in a minute
– Batch (big) query scheduling
Experiments &Instruments
Simulationsfacts
facts
answers
questions
?Literature
Other Archives facts
facts
5
Basic Research Paradigm
extract information
data
simulation
Data mining
deduce
model
idea
Scientific computing
result
Verify model( 1 ) problem model
( 2 ) experiment, data collectio
n
( 3 ) get computing resource
( 4 ) computing, verify model
Deduce natural law( 1 ) identify problem domain( 2 ) experiment, data collection ( 3 ) get computing resource( 4 ) analyze data , deduce law
6
Scenario
Site F: Sechedule
Site C : Raw data Site D : Storage
1
2
3
Site E : Computer( simulation, data mining )
4
5
6
7
8
9
cerficiation
Site A userSite B user
10
7
Collaboration Interactive Model and its Service• People to People
– Communication
– Groupware Service
• Access to Facilities– Interaction with the
Physical World
– Access to Instrument online
– Access to Applications
• Access to Information– Digital Libraries, E-Pub
– Search Service
Collaboration Interactive Model
8
What is a scientific Collaboration ?
• Definition• Two or more people work together to create or achieve the same
thing. • Key points
• Different or same discipline scientists• Form a Virtual Team• Need a agreement• Have a common research theme• Divide task into several works• Discuss problems, use instruments and share information• Goal: create new knowledge
9
Collaboration Technologies
• Access to• People
• Instruments
• Stored information
• Synchronous vs asynchronous• Chat, video conferencing, audio streaming
• Shared objects of conversation (like data)
• Threaded discussions
• Electronic notebooks
• Transitions between them
• They are limited to address users’ problems!
10
Primary services for SCC
• Virtual Team
• Access Instrument
• Sharing Data / Expertise
• Activity Management
• Online Discuss
11
Overview of China State Key Labs
SKL disciplines coverage
Total number is 162-----------------------------------------
Disciplines Number
----------------------------------
Chemistry 22
Math and Physics 15
Geognosy 18
Biology 38
Information 26
Material 18
Engineering 25
---------------------------------- Target users more than 100k Potential connected large instruments more than 6k
12
Physical Resources and Virtual Team
people
deviceKnow how
data
SKL A
Info
people
deviceKnow how
data
SKL B
info
people
deviceKnow how
data
SKL D
Info
people
deviceKnow how
data
SKL C
Info
Virtual team C
Virtual team A
Virtual team B
13
Strategy to Create the SCC
• State of the art ---Some efforts of science communities• UK : e-Science• EuroGrid• USA: Cyberinfrastructure---Globus Toolkits• Japan : ITBL ( IT Based Laborarory )• China Grid initiative
• IT and commercial product• Netmeeting Polycom WebEx• Middleware: Workplace 、 SharePoint 、 WebLogic • Platform: .NET , J2EE• Forum and whiteboard , etc.
• Strategy: Choose the mature and simpler technology to address users’ problem.
14
Scie
ntifi
c Colla
bora
tion
Cybersp
ace
Che
Network Infrastructure
LDAPACLAuth SSL
Task
Know How Expert
Network com
Team
Instrument Acc
Pub/Search
Project Metrics
Semantic Data
Phy Math
……
InstrumentsInstruments Data ResourceData ResourceComputingComputing Instrumen
tInstrument
Archie Archie DataData Multimedia Multimedia Raw data Raw data Physical
Network
Services
Collaboration ‘game rules’
SitesResources JointManagement
Mat EngBio Geo
……Services
Domain
15
Virtual Team management
SCC Portal
Set up Project
Support management
Project1 Project2 Project n
Form a team
Collaboration actions
Set up Project
Support management
Form a team
Collaboration actions
Set up Project
Support management
Form a team
Collaboration actions
…… ……
AttributesnamegoaldomainPI infoResource planning ……
Optimize team
Task assignment
Know how
Information share
Instrument using
Online discuss
Optimize team
Task assignment
Know how
Information share
Instrument using
Online discuss
Optimize team
Task assignment
Know how
Information share
Instrument using
Online discuss
16
Virtual team
Registration
[no pass]
[pass]
usersystem PI: Primary Investigator
PHProject Head
Apply create project space
Got space
Verify member
Set up permit
Assign task
Manage task
[pass]
Apply form a team
Team set up
set up PH permit
verify PH
17
Support Roles
• SSC• Project
• PI • Team member• Team leader ( adm ):• Web Site adm ( adm ):• Web site designer• …
• visitors• experts
• Roles :• Visitors, members 、 discuss participant 、 web design 、 adm 、 content adm
18
Virtual Team management
• Problems• Compromise the free and restrict jointing • Contradiction on distribution and centre control• Trust
• solutions• AAA technology (Authentication Authorization
Accounting) • Online registration • Trust metrics• Portal
19
Access to instruments
Logon SSC
[no pass]
[pass]
user
system
Instrument owner
Instrument user
registration
Instrument adm
[pass]
apply
success
using
Schedule
Accounting log
verify
Project HeadAssign adm
20
Access to Instruments
• Problems• Instrument description, registration, publishing,
finding and using • Accounting and Fee
• Solutions• Web Service • LDAP and light weigh instrument access protocol
21
Data sharing
Logon SKLCRE
[link]user
system
Data owner
Data user
Data registration
[push]
find
publishUsing data
Accounting log
[pull]
DownLoad data UpLoad data
Capture result
Up load data
22
Data Sharing
• Problems• Large scale scientific data two-way transfer• Accounting and Fee
• solutions• DBMS support data publish on Internet • Fast FTP automatic re-transfer
23
Online Discuss
Logon SKLCRE
usersystem Conf. host participant
Invite conf.
Text messageConf mem Conf mem
Enter conf.
Audio/vedio
Pub conf notice
reply
Set up conf.
Exit conf
Conf bro
End of conf
Exp. participant
Connect to monitor
reservation
collabortion
Record process
member
participating
24
• Problems• Multi-group’s participants joint the meeting at sam
e time• Co-laboratory environment
• solutions• Software based video and audio tech. • Light weigh desktop sharing tech.• Wiki• Forum
Online Discuss
25
Activity management
Logon SSC
user Data onwerPI Project head
achivement tasks
Personal achivement
member
progress
activity
Instrument adm
Pub info
Device usage
Data usage
Personal time
Personal usage
26
Activity management
• Problems• Global monitor the whole process• Contents index and statistic• Individual performance assessment
• solutions• Access control and monitor • DBMS and Data mining • Rating model
27
SSC Applications
• Project1 : Soil Carbon recycle mechanism database (CNSF,973,863-- grant)• 100+research units• Distribute data across mainland of China• More than 1K scientists
• Project2 : FACE ( Free Air CO2 Enrichment ) (CNSF,973--grant)• Experiment site and office at different place• Raw data, model software share• Many Sub tasks
• Project3 : China neutron experiment center (973,863,MoST -- grant)• Protect the staff from radiation• Monitor the experiment process• Inter-discipline field
• Project4 : Collaboration for Bio-Safety Level 3( MoST – grant)• 6+ institutes • Monitor the experiment process• Inter-discipline field
• Project5 : Collaboration for large scale instruments center (MoST – grant) • 10+ large scientific instruments• Data and expertise sharing• Remote control instruments
28GUCAS/ZGC---Server Farm
GUCAS/YQL---Distance Backup
科技部网络
SKL 1 SKL 162
CSTNet
CERNet
ChinaNet
10M
100M
1G
10M backup
MOST
2.5 G
10 GIPv6
Internet
SCC Network Architecture
29
Web Architecture
Benefits Adaptable
More than 10 different science subjects templates
Scalability Dynamic growing VT does not affect platform performance
ExtensibilityEasy plug in the a new service to the platform
30
SSC for China Key Labs
31
Requirement of FACE project
• FACE ( Free Air CO2 Enrichment )
• Find out the mechanism for the rice growing when the CO2 climate change
• 15 Collaboration org.• 9 national orgs ( 3SKLs ), 7 international , 10
0+ research staff.
• Invest 100m RMB, only one in China
• 30 mini projects
32
Contribution to the FACE science research
• Monitor the farm site by video
• Automatic upload the raw data
• Real time display control pane by Browser
33
FACE Project deployment
34
FACE Project
• New• 5 collaborations use case• Run more than one year• English version is ongoing
• Old• Only one function • Info pub
35Neutron emission facility
Remote monitor in Browser
36Data analysis software
Neutron diffraction remote control interface in Browser
37
·Å ÖÃʵÑéÑùÆ·Set s am p le
ºË ·´ Ó¦ ¶Ñn u clear react o r
ÑùÆ·Ðýת ÒÇs am p le circu m gy rat e d ev ice
ÖÐ×ÓÊøB eam o f n eu t ro n
Æ×ÒÇp ed igree d ev ice
Êý ¾Ý²É ¼¯
Êý ¾Ý²É ¼¯
Êý ¾Ý²É ¼¯
Êý ¾Ý²É ¼¯
ʵÑéÔËÐмà¿Ø»ú co m p u t er fo r m o n it o r exp erim en t s t at u s
ʵ Ñé ÊÒ Lab
Ô¶³Ì ¼à¿Ø·þ Îñ Æ÷M o n it o r Serv er
Éã Ïñ Í·cam era
ʵÑé ¹ý ³Ì ¼à¿Ø»ú co m p u t er fo r m o n it o r exp erim en t p ro ces s
ʵÑé¼à¿Ø´ú Àí »úm o n it o r p ro xy
In t ern et
.......
¼à¿ØʵÑéÔËÐÐm o n it o r exp erim en t s t at u s
¼à¿ØʵÑé¹ý ³Ìm o n it o r exp erim en t p ro ces s
¼à¿ØʵÑéÔËÐÐm o n it o r exp erim en t s t at u s
Benefit 1 staff are isolated from experiment site 2 remote real time monitor the process 3 scientists online discuss
Deployment of neutron diffraction remote access
38
Collaboration for Bio-Safety Level 3
39
Collaboration for Bio-Safety Level 3
40
Collaboration for large instruments center
41
Collaboration for large instruments center
42
BSL3 Lab of FUDAN University
43
BSL3 setting
办公区
生物安全柜
倒置显微镜
监控视频服务器
麦克风
控制输入
摄像机带云台的摄像头
实验室 控制及演播室
交换机
C CC
操控服务器
视频服务器
2M带宽到互联网
防火墙
Mini Camera
44
SSC Portal
user
Org.A
Org.B Org.C Org.D Org.E
Org.F
Portal model
Benefits:Trust access path Single sign-on Delegate permits and Proxy Interoperate
45
Expertise Share Model
Collaboration Cyberspace
Labs
Outside labs
Buy ruleBuy rule
Agreement (1,n)(1,m)
3
Extra members
1.contribution 2.get Knowledge 3.oversee
21
1 2
(1,p)(1,q)
Members
22
ParticipantManagement Agency
Affiliate org
E-community
Instrument
Data storage
Platform
Behavior
ConstraintsInfo flowCapital flow
Data Flow
Communicate
Management
{活动描述}
{规则名称}
LegendEnsure a fair collaboration game !
46
Video and audio interactive component
Benefits1. Multi node access2. Plug in SSC3. Security and efficiency
Benefits1. Multi node access2. Plug in SSC3. Security and efficiency
47
Lessons Learned
• How to address the user’s application simpler? • System development is less and less about coding than
about using things and gluing them together.• Create a flexible enough architecture to allow for
changes.• Customers will not be able to elucidate at the start what
they want; only by using the system will they be able to tell you what you should have done. (Semantic gaps)
• SSC 1.0 rely on MS SharePoint ; SSC 2.0 open source • Individual performance assessment model and fair
agreements (win-win business model). • Future concerns should be e-community trust metrics.
48
Acknowledge
• Dec.2005--Dec.2007, China Bio-Safe Level 3 Labs Collaborative Cyberspace, Grant from MOST of China
• Dec.2005--Dec.2007, China Large Scientific Instruments Collaborative Cyberspace, Grant from MOST of China
• Jul.2005--Jul.2008, EU-Asia Link Programme HPC-Grid Computing Course Model, Grant from EU
49
• URL:• http://crewiki.gucas.ac.cn/• http://cec.gucas.cn/• http://cbl.gucas.cn/• http://co-lab.chinalab.gov.cn/
• Questions?• Comments?