Millennium Executive Committee Meeting

David E. Culler

Computer Science Division

culler@cs.berkeley.edu

http://www.cs.berkeley.edu/~culler

Exec Comm 8/20/98 Millennium 2

MM Proposed Cluster of Clusters

Gigabit Ethernet

SIMS

C.S.

E.E.

M.E.

BMRC

N.E.

IEORC. E. MSME

NERSC

Transport

Business

Chemistry

Astro

Physics

EconomyMath

Exec Comm 8/20/98 Millennium 3

Committments

• Intel provides 6 M$ in equipment

• Sun provides all Solaris x86 software

• Microsoft provides all NT software

• Campus provides staff to support the core infrastructure, networking

• CS will try to raise funds for the network and campus cluster infra.

• Departments provide 1/2 of system admin for own side and 20 K$ for group cluster

– racks, network, software, ...

Exec Comm 8/20/98 Millennium 4

Where are we?

• Hardware deployment

• Software availability

• Cluster Environment

• Grants

• Networking

Exec Comm 8/20/98 Millennium 5

Current Environment• All projects have servers and several desktops

– last few in current shipment

• millennium.berkeley.edu domain established

• solaris shared servers with 60GB disks– www.millennium.berkeley.edu, MM.millennium.berkeley.edu

– imap, ...

• solaris/x86 sww served from CS servers

• NT domain server with 60 GB disks– MMNT.millennium.berkeley.edu

– exchange, file, ...

• First cluster ready for use

• NSF SimMillennium grant to cover network

• Two of three Millennium staff hired

Exec Comm 8/20/98 Millennium 6

Hardware DeploymentDept. Total

Cluster Server DesktopEECS/Geology 1 0 5Geology/Geophys 0 1 5ME/NE/IEOR 0 1 5CE/MSME 0 1 4Biology 0 2 5Math/Econ 0 1 0Econ 0 0 1Math 0 0 10ITS 0 1 3Astro./Physics 1 1 5Physics 0 1 15NERSC 0.5 0 0SIMS 0 1 17BMRC 0 0 6Business 0 1 7Chemistry 0 1 5Exec 0 0 3Theory 0 0 5EECS 0 0 4Millennium Infrastructure 0 5 9System architecture 2 0 5Total 4.5 17 119

Exec Comm 8/20/98 Millennium 7

Basic Software Tools

• Standard Unix Tools /usr/sww/bin– 484 packages

• GNU Tools– gcc, g++ (version 2.8.1), gdb, g...

• Sun ProWorks– workshop “development environment”

– C, C++, F77

– Debugger

• Sun Performance Library/usr/sww/lib

• Sun Math Library

Exec Comm 8/20/98 Millennium 8

Cluster Developments

• 4 x 4 PentiumPro Cluster ready

• Full NOW environment– Glunix, MPI, Active Messages, Split-C

– titanium protoype

• Transfering to Cory to debug deployment

• CS / Civil Eng. Consortium has been shaking it out

– petc graph partitioner, finite element classes, …

– ScaLapack (???)

• Have parts for three 8x2 Pentium II clusters– AstroPhysics

– Soda Solaris x86 to be shipped out

– Soda NT cluster

Exec Comm 8/20/98 Millennium 9

Grants

• NSF CISE Research Infrastructure grant– cluster networking

– inter-cluster networking (campus mgmt)

– computational economy staff support

– visualization

– devoted to CS research with disciplinary applns

• Bay Networks 70% discount up to 5 M$– gigabit networks

• IBM SUR disk towers

• IBM CS extension to PDA access

• NSF Science and Tech. Centers in process

• … any more???

Exec Comm 8/20/98 Millennium 10

Networking

• Campus using Millennium to drive planning

• CNS is working closely with us.

• Testing gigabit ethernet

• Campbell, Evans, Davis moving forward

• CS will be able to cover the intracluster network (Myrinet) and gigabit switch in the group clusters

– frees up some of the committed resources

Exec Comm 8/20/98 Millennium 11

Going forward

• Roll out group clusters over next few quarters

• Roll out gigabit interconnect

• Build up the cluster programming tools

• Intel Merced pushed out– campus cluster delayed

– utilize NOW as an alternative

– combine with NPACI infrastructure

• Exploring cluster technology– VIA

– Synfinity, ServerNet, Gigabit Ethernet

• Exploring NT

Exec Comm 8/20/98 Millennium 12

Exec Comm 8/20/98 Millennium 13

Holes (in my view)

• Sense of community

• Fertile exchange and collaboration

• Definition of Computational Science Challenges

• Clear commitment to programming models

• Orderly, informed software environment

• Clear information exchange– who do you call

• Well organized mailing list

• Low overhead management, progress reports, …

• Really exciting web site