scaleability scale up and scale out
DESCRIPTION
Scaleability Scale Up and Scale Out. SMP. Super Server. Departmental. Server. Personal. System. Grow Up with SMP 4xP6 is now standard Grow Out with Cluster Cluster has inexpensive parts. Cluster of PCs. Thesis Many little beat few big. 3. 1 MM. 10 nano-second ram. - PowerPoint PPT PresentationTRANSCRIPT
-
NT Scalability EffortsJim Gray (Microsoft Research)My 7 standard slidesData Gravity: Smart devicesClusters: Packs and CrowdsSome cluster projects I am doing
-
ScaleabilityScale Up and Scale OutGrow Up with SMP4xP6 is now standard
Grow Out with Cluster
Cluster has inexpensive parts
Clusterof PCs
-
There'll be Billions Trillions Of ClientsEvery device will be intelligentDoors, rooms, carsComputing will be ubiquitous
-
Billions Of ClientsNeed Millions Of ServersMobile clientsFixed clients ServerSuperserverClientsServersAll clients networked to serversMay be nomadic or on-demandFast clients want faster serversServers provide Shared DataControlCoordinationCommunicationTrillionsBillions
-
ThesisMany little beat few bigSmoking, hairy golf ballHow to connect the many little parts?How to program the many little parts?Fault tolerance & Management?$1 million$100 K$10 KMainframeMiniMicroNano14"9"5.25"3.5"2.5"1.8"1 M SPECmarks, 1TFLOP
106 clocks to bulk ram
Event-horizon on chip
VM reincarnated
Multi-program cache,On-Chip SMPPico Processor10 pico-second ram100 TB1 TB10 GB1 MB100 MB
-
4 B PCs (1 Bips, .1GB dram, 10 GB disk 1 Gbps Net, B=G) The Bricks of CyberspaceCost 1,000 $Come with NTDBMSHigh speed NetSystem managementGUI / OOUI ToolsCompatible with everyone elseCyberBricks
-
Super Server: 4T MachineArray of 1,000 4B machines1 b ips processors1 B B DRAM 10 B B disks 1 Bbps comm lines1 TB tape robotA few megabucksChallenge:ManageabilityProgrammabilitySecurityAvailabilityScaleabilityAffordabilityAs easy as a single systemFuture servers are CLUSTERSof processors, discs
Distributed database techniquesmake clusters workCyber Bricka 4B machine
-
Cluster VisionBuying Computers by the SliceRack & StackMail-order componentsPlug them into the clusterModular growth without limitsGrow by adding small modulesFault tolerance: Spare modules mask failuresParallel execution & data searchUse multiple processors and disksClients and servers made from the same stuffInexpensive: built with commodity CyberBricks
-
Computers shrink to a pointDisks 100x in 10 years 2 TB 3.5 driveShrink to 1 is 200GBDisk is super computer!
This is already true of printers and terminalsKiloMegaGigaTeraPetaExaZettaYotta
-
Data Gravity Processing Moves to TransducersMove Processing to data sourcesMove to where the power (and sheet metal) is Processor inModemDisplayMicrophones (speech recognition) & cameras (vision)Storage: Data storage and analysisSystem is distributed (a cluster/mob)
-
Disk = Nodehas magnetic storage (100 GB?)has processor & DRAMhas SAN attachment has execution environment OS KernelSAN driverDisk driverFile System RPC, ...ServicesDBMS Applications
-
Microsoft.com: ~150x4 nodes: a crowd(3)
-
HotMail: ~400 Computers Crowd
-
DB Clusters (crowds)16-node Cluster64 cpus2 TB of diskDecision support45-node Cluster140 cpus14 GB DRAM4 TB RAID diskOLTP (Debit Credit)1 B tpd (14 k tps)
-
Windows NT Versus UNIXBest Results on an SMP: SemiLog plot shows 3x (2 year) lead by UNIX Does not show Oracle/Alpha Cluster at 100,000 tpmCAll these numbers are off-scale huge (20,000 active users?)
Chart5
2454.97485.88
3066.072660.03
3641.179414.06
551711456.13
684313646.17
7128.214176.61
7521.1314285.87
807018438.7
911623143.65
10665.5331147.04
10665.5331147.04
11055.739469.47
11327.4751871.62
13089.352117.8
12030.4757053.8
10854.2489500
14501
13391.13
13391.13
16101.27
14144.27
16216.1
16257.2
27383.4
18127.4
17700.43
18154
18322.67
17715.9
18893.43
18528.97
19241.66
20563
h
Unix
NT
tpmC
tpmC vs Time
Scaleup vs time graphs
NEW RESULTS OR PRICE CHANGES
SUBMITTED JULY 21-25, 1997
Date(tpmC)Company(tpmC)$/tpmCTotal .Cost ($)DBOScpusDate
Mar-95486IBM486$654317,781SybaseAIX134770
May-952,660Bull2,660$5301,409,965InformixAIX8May-95
May-951,563Bull1,563$549858,266InformixAIX4May-95
May-952,660Bull2,660$5601,490,086InformixAIX8May-95
May-951,563Bull1,563$584912,331InformixAIX4May-95
Jun-951,470IBM1,470$666979,231DB2AIX1Jun-95
Jun-951,438IBM1,438$492707,470DB2AIX4Jun-95
Jun-951,438IBM1,438$510733,487DB2AIX4Jun-95
Jul-95874SNI874$364318,441InformixSNI Unix1Jul-95
Aug-951,416DG1,416$656928,744InformixDG/UX8Aug-95
Oct-952,455Compaq2,455$242593,216MS SQLNT4Oct-95
Oct-95735IBM735$378278,029SybaseAIX1Oct-95
Oct-959,414Digital9,414$3162,972,726OracleDigitalUNIX8Oct-95
Nov-956,314Tandem6,314$4933,115,351InformixIRIX16Nov-95
Nov-953,921SNI3,921$4951,939,674InformixSNI Unix8Nov-95
Nov-952,023Unisys2,023$463937,366InformixSVR45Nov-95
Dec-953,406DG3,406$240816,031OracleDG/UX7Dec-95
Dec-9511,456Digital11,456$2863,274,110OracleDigitalUNIX8Dec-95
Dec-953,516Compaq3,516$186651,647OracleSCO4Dec-95
Dec-953,226Compaq3,226$207665,806OracleSolaris4Dec-95
Dec-9511,014Sybase11,014$2222,445,319SybaseDigitalUNIX10Dec-95
Jan-966,270SNI6,270$4732,963,608InformixSNI Unix16Jan-96
Jan-963,066Compaq3,066$198606,539OracleNT4Jan-96
Jan-961,333Sun1,333$208276,559SybaseSolaris1Jan-96
Jan-963,849Compaq3,849$161619,445OracleSCO4Jan-96
Jan-963,513Bull3,513$270946,649OracleAIX8Jan-96
Feb-964,939HP4,939$2321,144,200OracleHPUX4Feb-96
Feb-964,886HP4,886$2601,272,020OracleHPUX4Feb-96
Mar-961,084Compaq1,084$197212,920MS SQLNT1Mar-96
Mar-963,631IBM3,631$2891,049,656OracleAIX8Mar-96
Mar-963,631IBM3,631$2961,075,443OracleAIX8Mar-96
Mar-961,880IBM1,880$168315,490DB2NT4Mar-96
Mar-9613,646Digital13,646$2773,778,989InformixDigitalUNIX10Mar-96
Mar-963,112Compaq3,112$152470,198SybaseNT4Mar-96
Apr-963,641Compaq3,641$148537,508MS SQLNT4Apr-96
Apr-9611,466Sun11,466$1902,174,979SybaseSolaris12Apr-96
Apr-9611,466Sun11,466$1882,152,254SybaseSolaris12Apr-96
Apr-963,513Motorola3,513$274960,792OracleAIX8Apr-96
Jun-964,925Bull4,925$2311,134,364OracleAIX8Jun-96
Jun-963,119IBM3,119$237740,627DB2AIX8Jun-96
Jun-963,119IBM3,119$242756,018DB2AIX8Jun-96
Jun-965,517Digital5,517$122669,344MS SQLNT4Jun-96
Jun-966,185Compaq6,185$111683,514SybaseSCO4Jun-96
Jun-963,810DG3,810$129490,181SybaseDG/UX2Jun-96
Jul-9614,177Digital14,177$1992,812,287SybaseDigitalUNIX10Jul-96
Jul-965,740Digital5,740$117671,204MS SQLNT4Jul-96
Jul-966,253Unisys6,253$3041,899,743OracleUnixWare10Jul-96
Jul-961,691Digital1,691$159267,586SybaseDigitalUNIX1Jul-96
Aug-966,662Sun6,662$1521,013,031DB2Solaris6Aug-96
Sep-961,676Intergraph1,676$103171,496MS SQLNT1Sep-96
Sep-967,561SNI7,561$3722,810,223InformixSNI Unix18Sep-96
Sep-965,822HP5,822$148857,852SybaseHPUX2Sep-96
Sep-965,774IBM5,774$1981,143,858SybaseAIX8Sep-96
Sep-965,774IBM5,774$2031,169,995SybaseAIX8Sep-96
Oct-968,311Compaq8,311$96792,738SybaseSCO4Oct-96
Oct-966,843Compaq6,843$100681,754InformixNT4Oct-96
Nov-966,713Digital6,713$66437,418MS SQLNT4Nov-96
Nov-967,304Bull7,304$1961,429,252SybaseAIX8Nov-96
Nov-961,333Sun1,333$164218,545SybaseSolaris1Nov-96
Nov-963,107Sun3,107$116360,488DB2Solaris2Nov-96
Dec-9614,286IBM14,286$2263,225,073OracleAIX8Dec-96
Dec-9614,286IBM14,286$2293,270,909OracleAIX8Dec-96
Dec-963904.00HP3904.00$110430,835MS SQLNT2Dec-96
Dec-967,128Compaq7,128$80568,730MS SQLNT4Dec-96
Dec-964,248Fujitsu4,248$81343,313MS SQLNT2Dec-96
Dec-966,393Compaq6,393$109694,417OracleNT4Dec-96
Dec-969,524SNI9,524$2972,833,151InformixSNI Unix22Dec-96
Dec-966,680IBM6,680$88587,986OracleSolaris4Dec-96
Jan-9718,439Sun18,439$1402,566,159SybaseSolaris20Jan-97
Jan-9714,286Bull14,286$2363,357,571OracleAIX8Jan-97
Jan-977,352HP7,352$80584,286MS SQLNT4Jan-97
Feb-9714,227Digital14,227$2533,586,486OracleVMS8Feb-97
Feb-9715,462Sun15,462$1352,077,487InformixSolaris14Feb-97
Feb-974,040Compaq4,040$69278,513MS SQLNT2Feb-97
Feb-973,961Intergraph3,961$64250,927MS SQLNT2Feb-97
Feb-972,300Intergraph2,300$67152,748MS SQLNT1Feb-97
Feb-977,063SNI7,063$69484,578MS SQLNT4Feb-97
Feb-972,301SNI2,301$181417,575OracleSNI Unix1Feb-97
Feb-976,768Digital6,768$119804,063SybaseDigitalUNIX2Feb-97
Feb-977,521Compaq7,521$78584,205MS SQLNT4Feb-97
Feb-972,503Compaq2,503$72179,396MS SQLNT1Feb-97
Feb-9714,739HP14,739$1331,949,237SybaseHPUX4Feb-97
Mar-977,693Dell7,693$43327,234MS SQLNT4Mar-97
Mar-9723,144Sun23,144$1192,734,009OracleSolaris16Mar-97
Mar-977,650Compaq7,650$83629,668SybaseNT4Mar-97
Mar-977,407Unisys7,407$63464,052MS SQLNT4Mar-97
Mar-977,573Amdahl7,573$79593,988MS SQLNT4Mar-97
Apr-978,028HP8,028$73581,896MS SQLNT4Apr-97
Apr-978,070Compaq8,070$58465,382MS SQLNT4Apr-97
Apr-977,368NCR7,368$77560,276MS SQLNT4Apr-97
Apr-976,044NCR6,044$81484,582MS SQLNT4Apr-97
Apr-977,407ALR7,407$58427,949MS SQLNT4Apr-97
Apr-977,308IBM7,308$100725,823SybaseAIX4Apr-97
Apr-973,265Digital3,265$61198,873MS SQLNT1Apr-97
Apr-9725,309SGI25,309$1403,519,012InformixIRIX28Apr-97
Apr-974,865Compaq4,865$63304,046MS SQLNT2Apr-97
Apr-979,029Compaq9,029$79705,818SybaseSCO4Apr-97
May-979,165IBM9,165$98895,035SybaseAIX8May-97
May-979,165IBM9,165$99905,767SybaseAIX8May-97
May-978,142IBM8,142$95765,626SybaseAIX4May-97
May-9710,350Digital10,350$1251,288,102SybaseDigitalUNIX4May-97
May-975,008Compaq5,008$87432,736OracleNT2May-97
Jun-979,116NCR9,116$86778,970MS SQLNT4Jun-97
Jun-978,146Digital8,146$49396,521MS SQLNT4Jun-97
Jun-972,605Compaq2,605$94244,154OracleNT1Jun-97
Jun-9731,147Sun31,147$1093,391,878OracleSolaris24Jun-97
Jul-9710,666Unisys10,666$54569,844MS SQLNT6Jul-97
Jul-979,198HP9,198$50456,389MS SQLNT4Jul-97
Jul-9710,666ALR10,666$49513,001MS SQLNT6Jul-97
Jul-9711,503SNI11,503$1681,934,106InformixSNI Unix8Jul-97
Jul-979,223Unisys9,223$53485,057MS SQLNT4Jul-97
Trend linesBest
Date(tpmC)OSDate(tpmC)OS
Mar-95486AIXMar-95486AIXMar-99Mar-99
May-952,660AIXMay-952,660AIXMay-99May-99
May-951,563AIXOct-959,414DigitalUNIXMay-99Oct-99
May-952,660AIXDec-9511,456DigitalUNIXMay-99Dec-99
May-951,563AIXMar-9613,646DigitalUNIXMay-99Mar-00
Jun-951,470AIXJul-9614,177DigitalUNIXJun-99Jul-00
Jun-951,438AIXDec-9614,286AIXJun-99Dec-00
Jun-951,438AIXJan-9718,439SolarisJun-99Jan-01
Jul-95874SNI UnixMar-9723,144SolarisJul-99Mar-01
Aug-951,416DG/UXJun-9731,147SolarisAug-99Jun-01
6/23/9731,147
9/15/9739,469
10/3/9751,872
2/13/9852,118
2/18/9857,054
Nov-9889,500
Oct-952,455
Jan-963,066
Apr-963,641
Jun-965,517
Aug-966,843
Dec-967,128
Feb-977,521
Apr-978,070
Jun-979,116
Oct-95735AIXJul-9710,666NTOct-99Oct-99
Oct-959,414DigitalUNIX7/7/9710,666NTOct-99Jan-00
Nov-956,314IRIX10/13/9711,056NTNov-99Apr-00
Nov-953,921SNI Unix10/22/9711,327NTNov-99Jun-00
Nov-952,023SVR411/6/9713,089NTNov-99Aug-00
Dec-953,406DG/UX11/21/9712,030NTDec-99Dec-00
Dec-9511,456DigitalUNIX12/1/9710,854NTDec-99Feb-01
Dec-953,516SCO12/1/9714,501NTDec-99Mar-01
Dec-953,226Solaris2/5/9813,391NTDec-99May-01
Dec-9511,014DigitalUNIX2/5/9813,391NTDec-99Jul-01
Jan-966,270SNI Unix3/2/9816,101
Jan-961,333Solaris3/18/9814,144
Jan-963,849SCO3/18/9816,216
Jan-963,513AIX3/30/9816,257
Feb-964,939HPUX4/9/9827,383
Feb-964,886HPUX6/26/9818,127
Mar-963,631AIX6/29/9817,700
Mar-963,631AIX7/16/9818,154
Mar-9613,646DigitalUNIX8/5/9818,323
Apr-9611,466Solaris9/11/9817,716
Apr-9611,466Solaris9/14/9818,893
Apr-963,513AIX9/28/9818,529
Jun-964,925AIX10/13/9819,242
Jun-963,119AIX11/6/9820,563
Jun-963,119AIX
Jun-966,185SCO
Jun-963,810DG/UX
Jul-9614,177DigitalUNIX
Jul-966,253UnixWare
Jul-961,691DigitalUNIX
Aug-966,662Solaris
Sep-967,561SNI Unix
Sep-965,822HPUX
Sep-965,774AIX
Sep-965,774AIX
Oct-968,311SCO
Nov-967,304AIX
Nov-961,333Solaris
Nov-963,107Solaris
Dec-9614,286AIX
Dec-9614,286AIX
Dec-969,524SNI Unix
Dec-966,680Solaris
Jan-9718,439Solaris
Jan-9714,286AIX
Feb-9715,462Solaris
Feb-972,301SNI Unix
Feb-976,768DigitalUNIX
Feb-9714,739HPUX
Mar-9723,144Solaris
Apr-977,308AIX
Apr-9725,309IRIX
Apr-979,029SCO
May-979,165AIX
May-979,165AIX
May-978,142AIX
May-9710,350DigitalUNIX
Jun-9731,147Solaris
Jul-9711,503SNI Unix
Oct-952,455NT
Jan-963,066NT
Mar-961,084NT
Mar-961,880NT
Mar-963,112NT
Apr-963,641NT
Jun-965,517NT
Jul-965,740NT
Sep-961,676NT
Oct-966,843NT
Nov-966,713NT
Dec-963904.00NT
Dec-967,128NT
Dec-964,248NT
Dec-966,393NT
Jan-977,352NT
Feb-974,040NT
Feb-973,961NT
Feb-972,300NT
Feb-977,063NT
Feb-977,521NT
Feb-972,503NT
Mar-977,693NT
Mar-977,650NT
Mar-977,407NT
Mar-977,573NT
Apr-978,028NT
Apr-978,070NT
Apr-977,368NT
Apr-976,044NT
Apr-977,407NT
Apr-973,265NT
Apr-974,865NT
May-975,008NT
Jun-979,116NT
Jun-978,146NT
Jun-972,605NT
Jul-9710,666NT
Jul-979,198NT
Jul-9710,666NT
Jul-979,223NT
&CTPC RESULTS AS OF JULY 25, 1997
Scaleup vs time graphs
485.88
2660.03
1562.93
2660.03
1562.93
1470.06
1438.04
1438.04
874.13
1416.33
2454.97
735.27
9414.06
6313.78
3921.17
2023.23
3406.21
11456.13
3516.27
3225.5
11014.1
6269.67
3066.07
1332.5
3849.17
3512.97
4939.11
4886.07
1083.9
3631.47
3631.47
1879.8
13646.17
3112.43
3641.17
11465.93
11465.93
3512.97
4925.02
3119.16
3119.16
5517
6184.9
3809.7
14176.61
5740
6253.32
1691.04
6662.47
1675.53
7560.93
5822.33
5774.07
5774.07
8311.43
6842.7
6712.53
7303.67
1332.5
3107.17
14285.87
14285.87
0
7128.2
4247.6
6393.2
9524.47
6679.5
18438.7
14285.87
7351.5
14227.25
15461.87
4039.83
3961
2300.03
7063.07
2301.38
6767.8
7521.13
2502.5
14739.03
7693.03
23143.65
7650.37
7407.05
7573
8028
8070
7368
6043.93
7407.05
7308.1
3264.86
25309.2
4864.97
9028.67
9165.13
9165.13
8142.4
10350.16
5008.47
9116
8145.6
2604.77
31147.04
10665.53
9198.37
10665.53
11503.03
9223.43
tpmC
tpmC vs Time
485.882454.97
2660.033066.07
1562.931083.9
2660.031879.8
1562.933112.43
1470.063641.17
1438.045517
1438.045740
874.131675.53
1416.336842.7
735.276712.53
9414.060
6313.787128.2
3921.174247.6
2023.236393.2
3406.217351.5
11456.134039.83
3516.273961
3225.52300.03
11014.17063.07
6269.677521.13
1332.52502.5
3849.177693.03
3512.977650.37
4939.117407.05
4886.077573
3631.478028
3631.478070
13646.177368
11465.936043.93
11465.937407.05
3512.973264.86
4925.024864.97
3119.165008.47
3119.169116
6184.98145.6
3809.72604.77
14176.6110665.53
6253.329198.37
1691.0410665.53
6662.479223.43
7560.93
5822.33
5774.07
5774.07
8311.43
7303.67
1332.5
3107.17
14285.87
14285.87
9524.47
6679.5
18438.7
14285.87
15461.87
2301.38
6767.8
14739.03
23143.65
7308.1
25309.2
9028.67
9165.13
9165.13
8142.4
10350.16
31147.04
11503.03
h
h
Unix
NT
tpmC
tpmC vs Time
485.882454.97485.882454.97
2660.033066.072660.033066.07
1562.931083.99414.063641.17
2660.031879.811456.135517
1562.933112.4313646.176843
1470.063641.1714176.617128.2
1438.04551714285.877521.13
1438.04574018438.78070
874.131675.5323143.659116
1416.336842.731147.0410665.53
735.276712.53
9414.060
6313.787128.2
3921.174247.6
2023.236393.2
3406.217351.5
11456.134039.83
3516.273961
3225.52300.03
11014.17063.07
6269.677521.13
1332.52502.5
3849.177693.03
3512.977650.37
4939.117407.05
4886.077573
3631.478028
3631.478070
13646.177368
11465.936043.93
11465.937407.05
3512.973264.86
4925.024864.97
3119.165008.47
3119.169116
6184.98145.6
3809.72604.77
14176.6110665.53
6253.329198.37
1691.0410665.53
6662.479223.43
7560.93
5822.33
5774.07
5774.07
8311.43
7303.67
1332.5
3107.17
14285.87
14285.87
9524.47
6679.5
18438.7
14285.87
15461.87
2301.38
6767.8
14739.03
23143.65
7308.1
25309.2
9028.67
9165.13
9165.13
8142.4
10350.16
31147.04
11503.03
h
Unix
NT
tpmC
tpmC vs Time
Chart5
2454.97485.88
3066.072660.03
3641.179414.06
551711456.13
684313646.17
7128.214176.61
7521.1314285.87
807018438.7
911623143.65
10665.5331147.04
10665.5331147.04
11055.739469.47
11327.4751871.62
13089.352117.8
12030.4757053.8
10854.2489000
14501
13391.13
13391.13
16101.27
14144.27
16216.1
16257.2
27383.4
18127.4
17700.43
18154
18322.67
17715.9
18893.43
18528.97
19241.66
20500
h
Unix
NT
tpmC
tpmC vs Time
Scaleup vs time graphs
NEW RESULTS OR PRICE CHANGES
SUBMITTED JULY 21-25, 1997
Date(tpmC)Company(tpmC)$/tpmCTotal .Cost ($)DBOScpusDate
Mar-95486IBM486$654317,781SybaseAIX134770
May-952,660Bull2,660$5301,409,965InformixAIX8May-95
May-951,563Bull1,563$549858,266InformixAIX4May-95
May-952,660Bull2,660$5601,490,086InformixAIX8May-95
May-951,563Bull1,563$584912,331InformixAIX4May-95
Jun-951,470IBM1,470$666979,231DB2AIX1Jun-95
Jun-951,438IBM1,438$492707,470DB2AIX4Jun-95
Jun-951,438IBM1,438$510733,487DB2AIX4Jun-95
Jul-95874SNI874$364318,441InformixSNI Unix1Jul-95
Aug-951,416DG1,416$656928,744InformixDG/UX8Aug-95
Oct-952,455Compaq2,455$242593,216MS SQLNT4Oct-95
Oct-95735IBM735$378278,029SybaseAIX1Oct-95
Oct-959,414Digital9,414$3162,972,726OracleDigitalUNIX8Oct-95
Nov-956,314Tandem6,314$4933,115,351InformixIRIX16Nov-95
Nov-953,921SNI3,921$4951,939,674InformixSNI Unix8Nov-95
Nov-952,023Unisys2,023$463937,366InformixSVR45Nov-95
Dec-953,406DG3,406$240816,031OracleDG/UX7Dec-95
Dec-9511,456Digital11,456$2863,274,110OracleDigitalUNIX8Dec-95
Dec-953,516Compaq3,516$186651,647OracleSCO4Dec-95
Dec-953,226Compaq3,226$207665,806OracleSolaris4Dec-95
Dec-9511,014Sybase11,014$2222,445,319SybaseDigitalUNIX10Dec-95
Jan-966,270SNI6,270$4732,963,608InformixSNI Unix16Jan-96
Jan-963,066Compaq3,066$198606,539OracleNT4Jan-96
Jan-961,333Sun1,333$208276,559SybaseSolaris1Jan-96
Jan-963,849Compaq3,849$161619,445OracleSCO4Jan-96
Jan-963,513Bull3,513$270946,649OracleAIX8Jan-96
Feb-964,939HP4,939$2321,144,200OracleHPUX4Feb-96
Feb-964,886HP4,886$2601,272,020OracleHPUX4Feb-96
Mar-961,084Compaq1,084$197212,920MS SQLNT1Mar-96
Mar-963,631IBM3,631$2891,049,656OracleAIX8Mar-96
Mar-963,631IBM3,631$2961,075,443OracleAIX8Mar-96
Mar-961,880IBM1,880$168315,490DB2NT4Mar-96
Mar-9613,646Digital13,646$2773,778,989InformixDigitalUNIX10Mar-96
Mar-963,112Compaq3,112$152470,198SybaseNT4Mar-96
Apr-963,641Compaq3,641$148537,508MS SQLNT4Apr-96
Apr-9611,466Sun11,466$1902,174,979SybaseSolaris12Apr-96
Apr-9611,466Sun11,466$1882,152,254SybaseSolaris12Apr-96
Apr-963,513Motorola3,513$274960,792OracleAIX8Apr-96
Jun-964,925Bull4,925$2311,134,364OracleAIX8Jun-96
Jun-963,119IBM3,119$237740,627DB2AIX8Jun-96
Jun-963,119IBM3,119$242756,018DB2AIX8Jun-96
Jun-965,517Digital5,517$122669,344MS SQLNT4Jun-96
Jun-966,185Compaq6,185$111683,514SybaseSCO4Jun-96
Jun-963,810DG3,810$129490,181SybaseDG/UX2Jun-96
Jul-9614,177Digital14,177$1992,812,287SybaseDigitalUNIX10Jul-96
Jul-965,740Digital5,740$117671,204MS SQLNT4Jul-96
Jul-966,253Unisys6,253$3041,899,743OracleUnixWare10Jul-96
Jul-961,691Digital1,691$159267,586SybaseDigitalUNIX1Jul-96
Aug-966,662Sun6,662$1521,013,031DB2Solaris6Aug-96
Sep-961,676Intergraph1,676$103171,496MS SQLNT1Sep-96
Sep-967,561SNI7,561$3722,810,223InformixSNI Unix18Sep-96
Sep-965,822HP5,822$148857,852SybaseHPUX2Sep-96
Sep-965,774IBM5,774$1981,143,858SybaseAIX8Sep-96
Sep-965,774IBM5,774$2031,169,995SybaseAIX8Sep-96
Oct-968,311Compaq8,311$96792,738SybaseSCO4Oct-96
Oct-966,843Compaq6,843$100681,754InformixNT4Oct-96
Nov-966,713Digital6,713$66437,418MS SQLNT4Nov-96
Nov-967,304Bull7,304$1961,429,252SybaseAIX8Nov-96
Nov-961,333Sun1,333$164218,545SybaseSolaris1Nov-96
Nov-963,107Sun3,107$116360,488DB2Solaris2Nov-96
Dec-9614,286IBM14,286$2263,225,073OracleAIX8Dec-96
Dec-9614,286IBM14,286$2293,270,909OracleAIX8Dec-96
Dec-963904.00HP3904.00$110430,835MS SQLNT2Dec-96
Dec-967,128Compaq7,128$80568,730MS SQLNT4Dec-96
Dec-964,248Fujitsu4,248$81343,313MS SQLNT2Dec-96
Dec-966,393Compaq6,393$109694,417OracleNT4Dec-96
Dec-969,524SNI9,524$2972,833,151InformixSNI Unix22Dec-96
Dec-966,680IBM6,680$88587,986OracleSolaris4Dec-96
Jan-9718,439Sun18,439$1402,566,159SybaseSolaris20Jan-97
Jan-9714,286Bull14,286$2363,357,571OracleAIX8Jan-97
Jan-977,352HP7,352$80584,286MS SQLNT4Jan-97
Feb-9714,227Digital14,227$2533,586,486OracleVMS8Feb-97
Feb-9715,462Sun15,462$1352,077,487InformixSolaris14Feb-97
Feb-974,040Compaq4,040$69278,513MS SQLNT2Feb-97
Feb-973,961Intergraph3,961$64250,927MS SQLNT2Feb-97
Feb-972,300Intergraph2,300$67152,748MS SQLNT1Feb-97
Feb-977,063SNI7,063$69484,578MS SQLNT4Feb-97
Feb-972,301SNI2,301$181417,575OracleSNI Unix1Feb-97
Feb-976,768Digital6,768$119804,063SybaseDigitalUNIX2Feb-97
Feb-977,521Compaq7,521$78584,205MS SQLNT4Feb-97
Feb-972,503Compaq2,503$72179,396MS SQLNT1Feb-97
Feb-9714,739HP14,739$1331,949,237SybaseHPUX4Feb-97
Mar-977,693Dell7,693$43327,234MS SQLNT4Mar-97
Mar-9723,144Sun23,144$1192,734,009OracleSolaris16Mar-97
Mar-977,650Compaq7,650$83629,668SybaseNT4Mar-97
Mar-977,407Unisys7,407$63464,052MS SQLNT4Mar-97
Mar-977,573Amdahl7,573$79593,988MS SQLNT4Mar-97
Apr-978,028HP8,028$73581,896MS SQLNT4Apr-97
Apr-978,070Compaq8,070$58465,382MS SQLNT4Apr-97
Apr-977,368NCR7,368$77560,276MS SQLNT4Apr-97
Apr-976,044NCR6,044$81484,582MS SQLNT4Apr-97
Apr-977,407ALR7,407$58427,949MS SQLNT4Apr-97
Apr-977,308IBM7,308$100725,823SybaseAIX4Apr-97
Apr-973,265Digital3,265$61198,873MS SQLNT1Apr-97
Apr-9725,309SGI25,309$1403,519,012InformixIRIX28Apr-97
Apr-974,865Compaq4,865$63304,046MS SQLNT2Apr-97
Apr-979,029Compaq9,029$79705,818SybaseSCO4Apr-97
May-979,165IBM9,165$98895,035SybaseAIX8May-97
May-979,165IBM9,165$99905,767SybaseAIX8May-97
May-978,142IBM8,142$95765,626SybaseAIX4May-97
May-9710,350Digital10,350$1251,288,102SybaseDigitalUNIX4May-97
May-975,008Compaq5,008$87432,736OracleNT2May-97
Jun-979,116NCR9,116$86778,970MS SQLNT4Jun-97
Jun-978,146Digital8,146$49396,521MS SQLNT4Jun-97
Jun-972,605Compaq2,605$94244,154OracleNT1Jun-97
Jun-9731,147Sun31,147$1093,391,878OracleSolaris24Jun-97
Jul-9710,666Unisys10,666$54569,844MS SQLNT6Jul-97
Jul-979,198HP9,198$50456,389MS SQLNT4Jul-97
Jul-9710,666ALR10,666$49513,001MS SQLNT6Jul-97
Jul-9711,503SNI11,503$1681,934,106InformixSNI Unix8Jul-97
Jul-979,223Unisys9,223$53485,057MS SQLNT4Jul-97
Trend linesBest
Date(tpmC)OSDate(tpmC)OS
Mar-95486AIXMar-95486AIXMar-99Mar-99
May-952,660AIXMay-952,660AIXMay-99May-99
May-951,563AIXOct-959,414DigitalUNIXMay-99Oct-99
May-952,660AIXDec-9511,456DigitalUNIXMay-99Dec-99
May-951,563AIXMar-9613,646DigitalUNIXMay-99Mar-00
Jun-951,470AIXJul-9614,177DigitalUNIXJun-99Jul-00
Jun-951,438AIXDec-9614,286AIXJun-99Dec-00
Jun-951,438AIXJan-9718,439SolarisJun-99Jan-01
Jul-95874SNI UnixMar-9723,144SolarisJul-99Mar-01
Aug-951,416DG/UXJun-9731,147SolarisAug-99Jun-01
6/23/9731,147
9/15/9739,469
10/3/9751,872
2/13/9852,118
2/18/9857,054
Nov-9889,000
Oct-952,455
Jan-963,066
Apr-963,641
Jun-965,517
Aug-966,843
Dec-967,128
Feb-977,521
Apr-978,070
Jun-979,116
Oct-95735AIXJul-9710,666NTOct-99Oct-99
Oct-959,414DigitalUNIX7/7/9710,666NTOct-99Jan-00
Nov-956,314IRIX10/13/9711,056NTNov-99Apr-00
Nov-953,921SNI Unix10/22/9711,327NTNov-99Jun-00
Nov-952,023SVR411/6/9713,089NTNov-99Aug-00
Dec-953,406DG/UX11/21/9712,030NTDec-99Dec-00
Dec-9511,456DigitalUNIX12/1/9710,854NTDec-99Feb-01
Dec-953,516SCO12/1/9714,501NTDec-99Mar-01
Dec-953,226Solaris2/5/9813,391NTDec-99May-01
Dec-9511,014DigitalUNIX2/5/9813,391NTDec-99Jul-01
Jan-966,270SNI Unix3/2/9816,101
Jan-961,333Solaris3/18/9814,144
Jan-963,849SCO3/18/9816,216
Jan-963,513AIX3/30/9816,257
Feb-964,939HPUX4/9/9827,383
Feb-964,886HPUX6/26/9818,127
Mar-963,631AIX6/29/9817,700
Mar-963,631AIX7/16/9818,154
Mar-9613,646DigitalUNIX8/5/9818,323
Apr-9611,466Solaris9/11/9817,716
Apr-9611,466Solaris9/14/9818,893
Apr-963,513AIX9/28/9818,529
Jun-964,925AIX10/13/9819,242
Jun-963,119AIX11/6/9820,500
Jun-963,119AIX
Jun-966,185SCO
Jun-963,810DG/UX
Jul-9614,177DigitalUNIX
Jul-966,253UnixWare
Jul-961,691DigitalUNIX
Aug-966,662Solaris
Sep-967,561SNI Unix
Sep-965,822HPUX
Sep-965,774AIX
Sep-965,774AIX
Oct-968,311SCO
Nov-967,304AIX
Nov-961,333Solaris
Nov-963,107Solaris
Dec-9614,286AIX
Dec-9614,286AIX
Dec-969,524SNI Unix
Dec-966,680Solaris
Jan-9718,439Solaris
Jan-9714,286AIX
Feb-9715,462Solaris
Feb-972,301SNI Unix
Feb-976,768DigitalUNIX
Feb-9714,739HPUX
Mar-9723,144Solaris
Apr-977,308AIX
Apr-9725,309IRIX
Apr-979,029SCO
May-979,165AIX
May-979,165AIX
May-978,142AIX
May-9710,350DigitalUNIX
Jun-9731,147Solaris
Jul-9711,503SNI Unix
Oct-952,455NT
Jan-963,066NT
Mar-961,084NT
Mar-961,880NT
Mar-963,112NT
Apr-963,641NT
Jun-965,517NT
Jul-965,740NT
Sep-961,676NT
Oct-966,843NT
Nov-966,713NT
Dec-963904.00NT
Dec-967,128NT
Dec-964,248NT
Dec-966,393NT
Jan-977,352NT
Feb-974,040NT
Feb-973,961NT
Feb-972,300NT
Feb-977,063NT
Feb-977,521NT
Feb-972,503NT
Mar-977,693NT
Mar-977,650NT
Mar-977,407NT
Mar-977,573NT
Apr-978,028NT
Apr-978,070NT
Apr-977,368NT
Apr-976,044NT
Apr-977,407NT
Apr-973,265NT
Apr-974,865NT
May-975,008NT
Jun-979,116NT
Jun-978,146NT
Jun-972,605NT
Jul-9710,666NT
Jul-979,198NT
Jul-9710,666NT
Jul-979,223NT
&CTPC RESULTS AS OF JULY 25, 1997
Scaleup vs time graphs
485.88
2660.03
1562.93
2660.03
1562.93
1470.06
1438.04
1438.04
874.13
1416.33
2454.97
735.27
9414.06
6313.78
3921.17
2023.23
3406.21
11456.13
3516.27
3225.5
11014.1
6269.67
3066.07
1332.5
3849.17
3512.97
4939.11
4886.07
1083.9
3631.47
3631.47
1879.8
13646.17
3112.43
3641.17
11465.93
11465.93
3512.97
4925.02
3119.16
3119.16
5517
6184.9
3809.7
14176.61
5740
6253.32
1691.04
6662.47
1675.53
7560.93
5822.33
5774.07
5774.07
8311.43
6842.7
6712.53
7303.67
1332.5
3107.17
14285.87
14285.87
0
7128.2
4247.6
6393.2
9524.47
6679.5
18438.7
14285.87
7351.5
14227.25
15461.87
4039.83
3961
2300.03
7063.07
2301.38
6767.8
7521.13
2502.5
14739.03
7693.03
23143.65
7650.37
7407.05
7573
8028
8070
7368
6043.93
7407.05
7308.1
3264.86
25309.2
4864.97
9028.67
9165.13
9165.13
8142.4
10350.16
5008.47
9116
8145.6
2604.77
31147.04
10665.53
9198.37
10665.53
11503.03
9223.43
tpmC
tpmC vs Time
485.882454.97
2660.033066.07
1562.931083.9
2660.031879.8
1562.933112.43
1470.063641.17
1438.045517
1438.045740
874.131675.53
1416.336842.7
735.276712.53
9414.060
6313.787128.2
3921.174247.6
2023.236393.2
3406.217351.5
11456.134039.83
3516.273961
3225.52300.03
11014.17063.07
6269.677521.13
1332.52502.5
3849.177693.03
3512.977650.37
4939.117407.05
4886.077573
3631.478028
3631.478070
13646.177368
11465.936043.93
11465.937407.05
3512.973264.86
4925.024864.97
3119.165008.47
3119.169116
6184.98145.6
3809.72604.77
14176.6110665.53
6253.329198.37
1691.0410665.53
6662.479223.43
7560.93
5822.33
5774.07
5774.07
8311.43
7303.67
1332.5
3107.17
14285.87
14285.87
9524.47
6679.5
18438.7
14285.87
15461.87
2301.38
6767.8
14739.03
23143.65
7308.1
25309.2
9028.67
9165.13
9165.13
8142.4
10350.16
31147.04
11503.03
h
h
Unix
NT
tpmC
tpmC vs Time
485.882454.97485.882454.97
2660.033066.072660.033066.07
1562.931083.99414.063641.17
2660.031879.811456.135517
1562.933112.4313646.176843
1470.063641.1714176.617128.2
1438.04551714285.877521.13
1438.04574018438.78070
874.131675.5323143.659116
1416.336842.731147.0410665.53
735.276712.53
9414.060
6313.787128.2
3921.174247.6
2023.236393.2
3406.217351.5
11456.134039.83
3516.273961
3225.52300.03
11014.17063.07
6269.677521.13
1332.52502.5
3849.177693.03
3512.977650.37
4939.117407.05
4886.077573
3631.478028
3631.478070
13646.177368
11465.936043.93
11465.937407.05
3512.973264.86
4925.024864.97
3119.165008.47
3119.169116
6184.98145.6
3809.72604.77
14176.6110665.53
6253.329198.37
1691.0410665.53
6662.479223.43
7560.93
5822.33
5774.07
5774.07
8311.43
7303.67
1332.5
3107.17
14285.87
14285.87
9524.47
6679.5
18438.7
14285.87
15461.87
2301.38
6767.8
14739.03
23143.65
7308.1
25309.2
9028.67
9165.13
9165.13
8142.4
10350.16
31147.04
11503.03
h
Unix
NT
tpmC
tpmC vs Time
-
Bottleneck AnalysisDrawn to linear scaleTheoreticalBus Bandwidth422MBps = 66 Mhz x 64 bitsMemory Read/Write~150 MBpsMemCopy~50 MBpsDisk R/W~9MBps
-
Bottleneck AnalysisNTFS Read/Write 18 Ultra 3 SCSI on 4 strings (2x4 and 2x5) 3 PCI 64 ~ 155 MBps Unbuffered read (175 raw)~ 95 MBps Unbuffered writeGood, but 10x down from our UNIX brethren (SGI, SUN)
155 MBps
-
PennySortHardware266 Mhz Intel PPro64 MB SDRAM (10ns)Dual Fujitsu DMA 3.2GB EIDE SoftwareNT workstation 4.3NT 5 sortPerformancesort 15 M 100-byte records (~1.5 GB)Disk to diskelapsed time 820 sec cpu time = 404 sec
Chart3
351
144
94
278
72
99
69
PennySort Machine (1107$ )
Sheet1
JamesPTNDeltaPriceWatch
1System Assembly2590
1ASUS P2L97 Mother Board145
1Intel P2-266360495
164MB SDRAM133
1CPU FAN764570964
1Mini Tower Case w/235W Power Supply436017
1Mitsumi 24X CD ROM DRIVE5773
2QUANTUM 2160A 2.1GB U/ATA 10ms 128k 5400rpm270290
1INTEL 8465 Etherexpress PCI Pro/10048557
1Triton PCI video card23
1Mouse PS25
1shipping - UPS Ground - ~$30, Air ~90$90133
1206
extras200
Base price1006real diff88
1System Assembly w/one Year Warranty9LAB-ASSE-01-0389.9589.9590
1Barebone (P2L97+P2-266+64MB SDRAM+FAN) - 1 Year WarrantyBARE-PARA-P2-10709.95709.95590
1ENLIGHT 6552 Mini Tower Case w/200W Power SupplyCASE-ENLI-MI-0259.9559.9560
1SONY 24X CD ROM DRIVERCDRM-SONY-24-0172.9572.95-
2QUANTUM 2160A 2.1GB U/ATA 10ms 128k 5400rpmHDEI-QUAN-21-08144.95289.9
1INTEL 8460 Etherexpress PCI Pro/100 (OEM)NETW-INTE-86-0154.9554.9555
1shippingFedX 1 day133133
1410.65
System I bought1436
shipping105
CD72
Ethernet55
1204
1Assembly25
1Barebone (P2L97+P2-266+FAN) - 1 Year Warranty495
164MB SDRAM (10ns)94
1Mini Tower Case w/235W Power Supply & fan47
1floppy drive18
2Fujitsu MPS3032UA 3.1 GB U/ATA 10ms 128k 5400rpm278
1INTEL 8465 Etherexpress PCI Pro/10048
1Virage 3D w/2MB EDO33
1NT Workstation69
1107
cpu351
board144
Memory94
Disk278
Cabinet + Assembly72
Network, Video, floppy99
Software69
1107
days in 3 years1095
seconds/day86400
seconds/3 years94608000
PennySort Machine cost1107
seconds/penny on Pennysort855
Sheet1
PennySort Machine (1107$ )
Sheet2
-
Sandia/Compaq/ServerNet/NT SortSort 1.1 Terabyte (13 Billion records) in 47 minutes68 nodes (dual 450 Mhz processors) 543 disks, 1.5 M$ 1.2 GBps network rap (2.8 GBps pap)5.2 GBps of disk rap (same as pap)(rap=real application performance, pap= peak advertised performance)
-
Progress on Sorting: NT now leads both price and performanceSpeedup comes from Moores law 40%/yearProcessor/Disk/Network arrays: 60%/year (this is a software speedup).
Chart1
166.666666666718292.6829268293
277.7777777778
38461.5384615385
142857.142857143
3125
12048.1927710843
17241.3793103448
111111.111111111
285714.285714286
196078.431372549
1000000
1550000
862068.965517241
18292.6829268293
35000000
Ordinal+SGI
Sort Records/second vs Time
Bitton M68000
Cray YMP
IBM 3090
Tandem
Kitsuregawa Hardware Sorter
Sequent
Intel HyperCube
IBM RS6000
NOW
Alpha
PennyNTsort
Sandia/Compaq/NT
Sort Results
yearMB/secGB/$secboxprice M$cpus
19850.020.0536000M68000.031
19860.030.0093600tandem0.33
19873.850.05226Cray YMP71
199114.290.5417IBM 30902.51
19900.310.148320Kitsuregawa0.21
19931.200.11483Sequent132
19941.720.16358IPSC/Wisc132
199411.115.2569Alpha0.21
199528.572.7033.5SGI/Ordinal116
199519.6137.1015.1IBM0.051
1996100.0015.76860NOW0.632
1997155.007.33260Now 1002100
199786.216.27458SGI/Ordinal1.314
19981.83144.220820NTsort0.00121
1998391.00238.0002814Sandia/CompaqNT Sort1.4968
seconds in 3 years94608000
SortSpeedup
yearrec/secsecboxprice M$Processors$/sGB/sGB/$
19851.7E+026000M68000.0313.17E-041.7E-055.3E-02
19862.8E+023600tandem0.333.17E-032.8E-058.8E-03
19873.8E+0426Cray ymp717.40E-023.8E-035.2E-02
19911.4E+057IBM 30902.512.64E-021.4E-025.4E-01
19903.1E+03320Kitsuregawa0.212.11E-033.1E-041.5E-01
19931.2E+0483Sequent1321.06E-021.2E-031.1E-01
19941.7E+0458IPSC1321.06E-021.7E-031.6E-01
19941.1E+059Alpha0.212.11E-031.1E-025.3E+00
19952.9E+053.5SGI3.0E+061161.06E-022.9E-022.7E+00
19952.0E+055.1IBM0.051Ramesh Agrawal5.28E-042.0E-023.7E+01
19961.00E+0660NOW0.6326.34E-031.0E-011.6E+01
19971.55E+0660Now 10021002.11E-021.6E-017.3E+00
19979.E+0558Ordinal1.3141.37E-028.6E-026.3E+00
1998.21.83E+04820NTsort0.001211.27E-051.8E-031.4E+02
1998.93.50E+072814Sandia/Compaq/NT1.49681.57E-020.3912.5E+011.099Tb /2184 sec 8 byte key, 80 byte recs333MBps
sec/3 years94608000
&F
Page &P
SortSpeedup
&F
Page &P
Ordinal+SGI
Sort Records/second vs Time
Bitton M68000
Cray YMP
IBM 3090
Tandem
Kitsuregawa Hardware Sorter
Sequent
Intel HyperCube
IBM RS6000
NOW
Alpha
PennyNTsort
Sandia/Compaq/NT
BellPrize
&A
Page &P
Records Sorted per SecondDoubles Every Year
GB Sorted per DollarDoubles Every Year
Sandia/Compaq/NT
NT/PennySort
Speed
2/87 0.45 800 0.03
2/88 1.0 1,000 0.05
2/89 6.0 11,000 0.5
2/9014153
1991-1-1
11/92-2-1-1
11/9364 507.5(3) 1.8 ($22M)
11/94140230
11/9518050
11/96330(3)144
Peak Gf/sPrice K$Gf/s/$MGf/s/$M
1987.160.458000.030.02
1988.1611,0000.050.03
1989.16611,0000.50.20
1990.16141531.30.47
199130-1.00
1992.950-1.67
1993.964507.52.13
1994.91402302.64.67
1995.9180503.66.00
1996.93301446.311.00
1997.9600401512.00
1998.913006021.666666666722
000
000
000
000
000
000
000
000
000
000
000
000
&A
Page &P
Peak Gf/s
Gf/s/$M
Gf/s/$M
Chart2
277.77777777780.0525618292.6829268293
38461.53846153850.00876
142857.1428571430.0519824176
31250.5406171429
12048.19277108430.147825
17241.37931034480.1139855422
111111.1111111110.1631172414
285714.2857142865.256
196078.4313725492.7030857143
100000037.1011764706
155000015.768
862068.9655172417.33212
18292.68292682936.2737400531
35000000144.2195121951
1998.924.8266630872
Records Sorted per SecondDoubles Every Year
GB Sorted per DollarDoubles Every Year
Sandia/Compaq/NT
NT/PennySort
Speed
Sort Results
yearMB/secGB/$secboxprice M$cpus
19850.020.0536000M68000.031
19860.030.0093600tandem0.33
19873.850.05226Cray YMP71
199114.290.5417IBM 30902.51
19900.310.148320Kitsuregawa0.21
19931.200.11483Sequent132
19941.720.16358IPSC/Wisc132
199411.115.2569Alpha0.21
199528.572.7033.5SGI/Ordinal116
199519.6137.1015.1IBM0.051
1996100.0015.76860NOW0.632
1997155.007.33260Now 1002100
199786.216.27458SGI/Ordinal1.314
19981.83144.220820NTsort0.00121
1998391.00238.0002814Sandia/CompaqNT Sort1.4968
seconds in 3 years94608000
SortSpeedup
yearrec/secsecboxprice M$Processors$/sGB/sGB/$
19851.7E+026000M68000.0313.17E-041.7E-055.3E-02
19862.8E+023600tandem0.333.17E-032.8E-058.8E-03
19873.8E+0426Cray ymp717.40E-023.8E-035.2E-02
19911.4E+057IBM 30902.512.64E-021.4E-025.4E-01
19903.1E+03320Kitsuregawa0.212.11E-033.1E-041.5E-01
19931.2E+0483Sequent1321.06E-021.2E-031.1E-01
19941.7E+0458IPSC1321.06E-021.7E-031.6E-01
19941.1E+059Alpha0.212.11E-031.1E-025.3E+00
19952.9E+053.5SGI3.0E+061161.06E-022.9E-022.7E+00
19952.0E+055.1IBM0.051Ramesh Agrawal5.28E-042.0E-023.7E+01
19961.00E+0660NOW0.6326.34E-031.0E-011.6E+01
19971.55E+0660Now 10021002.11E-021.6E-017.3E+00
19979.E+0558Ordinal1.3141.37E-028.6E-026.3E+00
1998.21.83E+04820NTsort0.001211.27E-051.8E-031.4E+02
1998.93.50E+072814Sandia/Compaq/NT1.49681.57E-020.3912.5E+011.099Tb /2184 sec 8 byte key, 80 byte recs333MBps
sec/3 years94608000
&F
Page &P
SortSpeedup
&F
Page &P
Ordinal+SGI
Sort Records/second vs Time
Bitton M68000
Cray YMP
IBM 3090
Tandem
Kitsuregawa Hardware Sorter
Sequent
Intel HyperCube
IBM RS6000
NOW
Alpha
PennyNTsort
Sandia/Compaq/NT
BellPrize
&A
Page &P
Records Sorted per SecondDoubles Every Year
GB Sorted per DollarDoubles Every Year
Sandia/Compaq/NT
NT/PennySort
Speed
2/87 0.45 800 0.03
2/88 1.0 1,000 0.05
2/89 6.0 11,000 0.5
2/9014153
1991-1-1
11/92-2-1-1
11/9364 507.5(3) 1.8 ($22M)
11/94140230
11/9518050
11/96330(3)144
Peak Gf/sPrice K$Gf/s/$MGf/s/$M
1987.160.458000.030.02
1988.1611,0000.050.03
1989.16611,0000.50.20
1990.16141531.30.47
199130-1.00
1992.950-1.67
1993.964507.52.13
1994.91402302.64.67
1995.9180503.66.00
1996.93301446.311.00
1997.9600401512.00
1998.913006021.666666666722
000
000
000
000
000
000
000
000
000
000
000
000
&A
Page &P
Peak Gf/s
Gf/s/$M
Gf/s/$M
-
The Microsoft TerraServer HardwareCompaq AlphaServer 84008x400Mhz Alpha cpus10 GB DRAM324 9.2 GB StorageWorks Disks3 TB raw, 2.4 TB of RAID5STK 9710 tape robot (4 TB)WindowsNT 4 EE, SQL Server 7.0
-
TerraServer: Lots of Web HitsA billion web hits!1 TB, largest SQL DB on the Web100 Qps average, 1,000 Qps peak877 M SQL queries so far
-
SQL 7 TerraServer AvailabilityOperating for 4 months: 3,133 hrsUnscheduled outage: 36.5 minutes: 99.98% scheduled upScheduled outage: 60 minutesAvailability: 99.95% overall upNo NT failures (ever)One SQL7 Beta2 bugNo failures in Aug, Oct
Chart2
0.02543981480.0416435185130.4842821759
Up
Unscheduled
Scheduled
up
TotalTime (Hours)
Sheet1
date & timeoff lineon lineeventcause
6/30/98 18:08startupcrashed in the middle of the night and nobody was thereTotal time
6/30/98 18:190:11:43onAval
7/1/98 18:3424:14:39stopset the database to Read-only to get more speed / stability
7/1/98 18:38startup
7/1/98 18:380:04:15on
7/8/98 15:47165:08:40Shutdownre-set DB to Read / write.
7/8/98 15:47startup
7/8/98 15:50shutdown
7/8/98 15:50startup
7/8/98 15:500:03:05on
7/30/98 16:55529:04:54terminatingData load Query hung, timeout errors
7/30/98 17:25startupup3131:37:22
7/30/98 17:27onUnscheduled0:36:38
7/30/98 17:270:00:18stopScheduled0:59:58
7/30/98 17:28on
7/30/98 17:28startup
7/30/98 17:280:32:29on
7/31/98 7:53ShutdownData Load Query hung
7/31/98 8:3315:04:18stop
7/31/98 8:340:01:04startup
7/31/98 8:34Startup
9/9/98 3:15954:40:41Shutdown for upgrade
9/9/98 3:590:44:00startup
11/8/98 8:591445:00:28Still up
Total Time1:36:363133:13:58
% up time99.949%
Unscheduled down0:36:38
Unscheduled %99.9805%
Sheet1
Scheduled
Un Scheduled
Unscheduled
Scheduled
Down Time (Hours:minutes)
130.4842821759
Up
Unscheduled
Scheduled
up
TotalTime (Hours)
-
Backup / Restore
Gazetteer
TerraServer Gazetteer TablesGEO Gazetteer
CountryNameStateNamePlaceNameAltPlaceGEO_EntityGEO_Name
0CountryId I4StateId I4PlaceId I4AltNameId I40Lashed_YN bitNameId I4
1UNCode C4CountryId I4ImgFlag I1AlternateName VC1281GeoId I4GeoId I4
2CountryName VC128StateName VC128CountryId I4PlaceId I42DefCtxtId I4SortName vc128
3CountrySGML VC255StateSGML VC255StateId I4ImgFlag I13SourceId I2SGMLName vc200
WWFeatureId I4TypeId I44GECid I2LocaleId b2
GazSrcId I4CountryId I45LanguageId b1LanguageId b1
AltCountryAltStateTypeId I4StateId I46GeoRelevId I1RoleId I1
0CountryId I4StateId I4Longitude D7.47DescName vc128PublisherId I2
1ContinentId I4CountryId I4Latitude D7.48PublisherId I2Published SDT
2WWFeatureId I4WWFeatureId I4Name VC1289Published SDTTimeStamp ts
3GazSrcId I4GazSrcId I4SGMLName VC20010TimeStamp ts
4Name VC128Name VC128ZGridId I4GazateerSource
5AlternateName VC128AlternateName VC128DoqDate DTGazSrcId I40LKP_GeoEntityClassGEO_PointGeometry
6SGMLName VC200SGMLName VC200SpinDate DTGazDesc VC2551GECidGeoId I4
DegreeId I42GECParentId I2Lat float
UGridId I43GeoValid_YN b1Long float
Population I4DegreePopulation4POIValid_YN b1MOBBGrid I4
CountryId I45Description vc60GPCid I2
DegreeId I46Definition vc255PrimSrcId I2
FeatureTypeWordWheelFeatureGECID_To_FeatureTypeUNCode2 C47Retired_YN bit 1
0TypeId I4WWFeatureId I4WWFeatureId I4Population I4
1Name VC255Name VC255TypeId I4Rate D8.4
2
Country are GECid =14,16,90,138,140,207
States are GECid =22, 226
Don't pick up Lashed_YN = 1
TerraServer DB Tables
ImgMetaThemeTileMetaThemeJumpImgNoImageDOQOrigMetaSpinOrigMeta
0ImgMetaId I4TileMetaId I4ThemeThumbImgImgData imgOrigMetaId I4OrigMetaId I4
1OrigMetaId I4ImgMetaId I4ThemeBrowseImgSrcId I4SrcId I4
2SrcId I4OrigMetaId I4ImgMetaId I4MCGridGridX I4GridX I4
3ImgTypeId I4SrcId I4ZGridId I4XMCGrid I4GridY I4GridY I4
4XGridId I2ImgTypeId I4UGridId I4YMCGrid I4CutsWide I4CutsWide I4
5YGridId I2XGridId I2SrcId I4SpinRowCount I4CutsHigh I4CutsHigh I4
6ZGridId I4YGridId I2ImgTypeId I4SpinImgMb I4ImageWidth I4ImageWidth I4
7UtmZone I2ZGridId I4EncryptKey I4USGSRowCount I4ImageHeight I4ImageHeight I4
8XUtmId I2UtmZone I2ImgDate DTUSGSImgMbUpperLongitude D15.10UpperLongitude D15.10
9YUtmId I2XUtmId I2ZTileGridId I4TotalRowCount I4UpperLatitude D15.10UpperLatitude D15.10
10UGridId I4YUtmId I2FileName VC255TotaImgMb I4LowerLatitudeD15.10LowerLatitude D15.10
11ThumbPixWidth I4UGridId I4ImgData ImgLowerLongitude D15.10LowerLongitude D15.10
12ThumbPixHeight I4ImgStatus I2MSGridUpperGridLong D15.10UpperGridLong
13BrowsePixWidth I4ImgDate DTThemeTileImg1XMCGrid I4UpperGridLat D15.10UpperGridLat
14BrowsePixHeight I4CutRow I2TileMetaId I4YMCGrid I4XPixelsPerDegree I4XPixelsPerDegree
15JumpPixWidth I4XTileGridId I2ZGridId I4SpinRowCount I4YPixelsPerDegree I4YPixelsPerDegree
16JumpPixHeight I4YTileGridId I2UGridId I4SpinImgMb I4DiscardRowPixels I4DiscardRowPixels
17ImgStatus I2ZTileGridId I2SrcId I4USGSRowCount I4DiscardColumnPixels I4DiscardColumnPixels
18ImgDate DTTilePixWidth I4ImgTypeId I4USGSImgMbColorValue I4ColorValue
19CutRow I2TilePixHeight I4EncryptKey I4TotalRowCount I4ColorPerCent I4ColorPerCent
20CutCol I2EncryptKey I4ImgDate DTTotaImgMb I4InMetaname VC255InMetaname
21MidLat D15.10MidLat D15.10TileZGridId I4InFilename VC255InFilename
22MidLong D15.10MidLong D15.10FileName VC255ThemeJumpHitQuadName C38SunAngle D10.6
23NWLat D15.10NWLat D15.10ImgData ImgImgMetaId I4Quadrant C2ShootingHeight D15.5
24NWLong D15.10NWLong D15.10ImageHit I4DataSetName VC255PixelSize D6.4
25NELat D15.10NELat D15.10SpinFrameMetaDataSetName2 VC255FrameNumber C60
26NELong D15.10NELong D15.10ImgMetaId I4ThemeThumbHitCountry C10SpinImgDate DT
27SWLat D15.10SWLat D15.10ZGridId I4ImgMetaId I4States C12SpinGMT C12
28SWLong D15.10SWLong D15.10ImgStatus I2ImageHit I4Producer C24CameraSystem C24
29SELat D15.10SELat D15.10ImgDate DTWestLongitude D15.10Copyright C80
30SELong D15.10SELong D15.10PercentBlank I4ThemeBrowseHitEastLongitude D15.10
31FrameId c10ImgMetaId I4NorthLatitude D15.10
32FrameSection C2ImageHit I4SouthLatitude D15.10
33FrameQuarter C2RasterOrder C24
34ThemeTileHitNbrLines I4
35TileMetaId I4NbrSamples I4
36ImageHit I4BandContent C20
37BandOrganization C12
PrimaryHorizontalDatum I2
CountryNameStateNamePlaceAltPlaceSecondaryHorizontalDatum I2
0CountryId I4StateId I4PlaceId I4AltNameId I4CoordinateSystem C10
1UNCode C4CountryId I4ImgFlag I1AlternateName VC128CoordinateZone I4
2CountryName VC128StateName VC128CountryId I4PlaceId I4HorizontalUnits C20
3CountrySGML VC200StateSGML VC200StateId I4ImgFlag I1HorizontalResolution D6.4
WWFeatureId I4TypeId I4BitsPerPixel I2
GazSrcId I4CountryId I4SW_Xprimary D24.15
AltCountryAltStateTypeId I4StateIdSW_Yprimary D24.15
0CountryId I4StateId I4Longitude D7.4NW_Xprimary D24.15
1ContinentId I4CountryId I4Latitude D7.4NW_Yprimary D24.15
2WWFeatureId I4WWFeatureId I4Name VC128NE_XPrimary D24.15
3GazSrcId I4GazSrcId I4SGMLName VC200NE_Yprimary D24.15
4Name VC128Name VC128ZGridId I4SE_Xprimary D24.15
5AlternateName VC128AlternateName VC128DoqDate DTSE_Yprimary D24.15
6SGMLName VC200SGMLName VC200SpinDate DTSW_Xsecondary D24.15
DegreeId I4SW_Ysecondary D24.15
GazateerSourceUGridId I4NW_Xsecondary D24.15
GazSrcId I4Population I4NW_Ysecondary D24.15
GazDesc VC255DegreePopulationNE_Xsecondary D24.15
CountryId I4NE_Ysecondary D24.15
FeatureTypeWordWheelFeatureGECID_To_FeatureTypeDegreeId I4SE_Xsecondary D24.15
0TypeId I4WWFeatureId I4WWFeatureId I4UNCode2 C4SE_Ysecondary D24.15
1Name VC255Name VC255TypeId I4Population I4XOriginPrimary D24.15
2Rate D8.4YOriginPrimary D24.15
XOriginSecondary D24.15
GridSysImgSourceImgTypeImgCounterYOriginSecondary D24.15
0GridSysId I4SrcId I4ImgTypeId I4LastImgMetaId I4RMSE_XY D24.15
1ImgXVal I2ImgTypeId I4ImgFileExt C3LastOrigMetaId I4ProductionSystem C24
2ImgYVal I2GridSysId I4ImgFileDesc VC255LastTileMetaId I4ProductionDate DT
3TileXVal I2SrcName C10MimeStr VC255LastUpdated DTImageSource C24
4TileYVal I2SrcTblName C10SourcePhotoId C24
5MinX I2SrcDesc VC255SourcePhotoDate DT
6MinY I2Compression C20
7MaxX I2MetaDataDate DT
8MaxY I2DataFileSize I4
9GridDesc VC255HeaderByteCount I4
StandardVersion C10
Agency C60
Log tables are not implementedSourceDEMDate DT
0LogAccessLogCoordLogImgMetaIdLogPlace
0LogImgCount I4LogCoordCount I4RemoteAddress C16RemoteAddress C16
1RemoteAddress C16RemoteAddress C16SrcId I1PlaceName VC255
2SrcId I4SrcId I4ImgSizeId I1PlaceType I4
3ImgSizeId I1OriginType I1ImgMetaId I4PlaceState VC255
4OriginType I1Longitude D15.10TileMetaId I4PlaceCountry VC255
5MetaId I4Latitude D15.10CreateDate DTRowsFound I4
6Direction I4HitFlag I1InsertTimeStamp DT
7CreateTimeStamp DT
8
0Pick
0Name VC255
1Link VC255
2Description VC255
3PickDate DT
4
5
0PlaceGridExternalLinkExternalSourceCountryName
0ZGridId I4ZGridId I4ExternalSrcId I4CountryId I4
1ZclosestGridId I4ExternalSrcIdDisplayFlag I4UNCode2 C4
2Xdistance I4GraphicsSrcFile vc255Name VC255Name VC255
3Ydistance I4GraphicsPixWidth I4BaseRef VC255
4Direction I4GraphicsPixHeight I4GraphicsSrcFile vc255
5BestTypeId I4AlternateSrc vc255GraphicsPixWidth I4
6BestFeatId I4URLTemplate vc255GraphicsPixHeight I4
7BestCountryId I4AlternateSrc vc255
8BestStateId I4URLTemplate vc255
9BestPlaceId I4
10Float1 D14.3
11Float2 D14.3
12BestPlaceName vc255
13
14
15
&L&A&C&BMicrosoft Confidential&B&RPage &P
<om Barclay&R&D
Tom Barclay:In Terra-Server V1.0, there were a total of 31 ThemeTileImg tables (62 total). This was to increase the amount of parallel loading. Conceptually we would prefer to collapse this to 1 table. What are the issues if we do this?
Tom Barclay:In Terra-Server V2.0, we are displaying images by date rather than by type. Therefore, we have one ImgMeta table containing records of all types. Alternatively, we could have another table containing all types pointing to this table.
Tom Barclay:GraphicsSrcFile, GraphicsPixWidth, GraphicsPixHeight, AlternateSrc, and URLTemplate contain default information to be used if the related ExternalLink row contains null data for the same fields. The logic inside the application SP is:
Note, this does mean that a vendor could send us a different graphics file for every link but one URLTemplate and vice-versa.
T2B2 Indices
TableIndexTypeFields
ImgTypepkImgTypeUniqClusImgTypeId
ImgSourcepkImgSourceUniqClusSrcId
GridSyspkGridSysUniqClusGridSysId
GazetteerSourcepkGazetteerSourceUniqClusGazSrcId
AltCountryAkAltCountryUAAlternateName
AltCountryAkAltCountryUCCountryId
AltPlaceAkAltPlacePPlaceId
AltPlaceAkAltPlaceFAIPImgFlagAlternateNameAltNameIdPlaceId
AltPlaceAkAltPlaceFCAIPImgFlagCountryIdAlternateNameAltNameIdPlaceId
AltPlaceAkAltPlaceFCSAIPImgFlagCountryIdStateIdAlternateNameAltNameIdPlaceId
AltPlaceAkAltPlaceFTAIPImgFlagTypeIdAlternateNameAltNameIdPlaceIdPlaceId
AltPlaceAkAltPlaceFTCAIPImgFlagTypeIdCountryIdAlternateNameAltNameIdPlaceId
AltPlaceAkAltPlaceFTCSAIPImgFlagTypeIdCountryIdStateIdAlternateNameAltNameIdPlaceId
AltPlaceAkAltPlaceIAltNameId
CountryNamePkCountryNameCiClusCountryId
CountryNameAkCountryNameCnCountryName
AltStateAkAltStateUSiUniqClusStateId
AltStateAkAltStateUAnAlternateName
StateNamePkStateNameSiClusStateId
StateNameAkStateNameSnStateName
DegreePopulationpkDegreePopulationUniqClusDegreeIdCountryId
DoqJumpHitpkDoqJumpHitUniqueImgMetaId
SpinJumpHitpkSpinJumpHitUniqueImgMetaId
DoqThumbHitpkDoqThumbHitUniqueImgMetaId
SpinThumbHitpkSpinThumbHitUniqueImgMetaId
DoqBrowseHitpkDoqBrowseHitUniqueImgMetaId
SpinBrowseHitpkSpinBrowseHitUniqueImgMetaId
DoqTileHitpkDoqTileHitUniqueImgMetaIdTileMetaId
SpinTileHitpkSpinTileHitUniqueImgMetaIdTileMetaId
PlaceNamePK__PlaceNameU_16CE6296UniqClusPlaceId
PlaceNameAkPLaceNameUITCSNPImgFlagTypeIdCountryIdStateIdNamePlaceId
PlaceNameAkPlaceNameUITCNPImgFlagTypeIdCountryIdNamePlaceId
PlaceNameAkPlaceNameUICSNPImgFlagCountryIdStateIdNamePlaceId
PlaceNameAkPlaceNameUICNPImgFlagCountryIdNamePlaceId
PlaceNameAkPlaceNameZGridIdZGridId
PlaceNameAkPlaceNameUGridIdImgFlagAlternateNamePlaceIdCountryIdStateIdTypeId
ImgMetapkImgMetaUniqueImgMetaId
ImgMetaakImgMeta1ZGridIdSrcIdImgDate
ImgMetaakImgMeta2UGridIdSrcId
DoqOrigMetapkDoqOrigMetaUniqueOrigMetaId
SpinOrigMetapkSpinOrigMetaUniqueOrigMetaId
DoqTileMetapkDoqTileMetaUniqueTileMetaId
DoqTileMetaakDoqTileMeta1UGridIdZTileGridId
SpinTileMetapkSpinTileMetaUniqueTileMetaId
SpinTileMetaakSpinTileMeta1ZGridIdZTileGridIdImgDate
DoqJumpImgpkDoqJumpImgUniqueUGridId
SpinJumpImgpkSpinJumpImgZGridIdImgDate
DoqThumbImgpkDoqThumbImgUniqueUGridId
SpinThumbImgpkSpinThumbImgZGridIdImgDate
DoqBrowseImgpkDoqBrowseImgUniqueUGridId
SpinBrowseImgpkSpinBrowseImgZGridIdImgDate
DoqTileImg1pkDoqTileImg1UniqueTileMetaId
SpinTileImg1pkSpinTileImg1UniqueTileMetaId
SpinFrameMetaakSpinFrameMetaZIdZGridIdImgMetaId
SpinFrameMetaakSpinFrameMetaImImgMetaId
&L&A&C&"Arial,Bold"Microsoft Confidential&RPage &P
<om Barclay&R&D
SupportContacts
1stRobert EberlRobert EberlMark Walling
Pager:(800)603-4206(800)603-4206(888)786-7192
Home:(425)881-6597(425)881-6597
E-Mail:robertebroberteba-markwa
2ndKen MartinKen MartinRobert Eberl
Pager:(800)592-1831(800)592-1831(800)603-4206
Home:(425)881-0516(425)881-0516(425)881-6597
E-Mail:kenmkenmroberteb
3rdTom BarclayTom BarclayTom Barclay
Pager:(888)983-9921(888)983-9921(888)983-9921
Home:(925)736-1266(925)736-1266(925)736-1266
E-Mail:tbarclaytbarclaytbarclay
WebServers
SQL Server Performance
ProcessorMaxThreads>>56789101112
Current
ModelNodeIPCPUProc. Max ThreadTotal Threads
CompaqCPMSRWBA01207.46.142.29402024283236404448
CompaqCPMSRWBA02207.46.142.30402024283236404448
CompaqCPMSRWBA07207.46.142.91402024283236404448
CompaqCPMSRWBA08207.46.142.88402024283236404448
CompaqCPMSRWBA09207.46.142.89402024283236404448
CompaqCPMSRWBA10207.46.142.90402024283236404448
Maximum Connections24120144168192216240264288
Launch
ModelNodeIPCPUProc. Max ThreadTotal Threads
CompaqCPMSRWBA01207.46.142.29402024283236404448
CompaqCPMSRWBA02207.46.142.30402024283236404448
AlphaCPMSRWBA03207.46.142.85201012141618202224
AlphaCPMSRWBA04207.46.142.126201012141618202224
AlphaCPMSRWBA05207.46.142.100402024283236404448
AlphaCPMSRWBA06207.46.142.101301518212427303336
CompaqCPMSRWBA07207.46.142.91402024283236404448
CompaqCPMSRWBA08207.46.142.88402024283236404448
CompaqCPMSRWBA09207.46.142.89402024283236404448
CompaqCPMSRWBA10207.46.142.90402024283236404448
Maximum Connections35175210245280315350385420
6/24 - 6/30SQL7 could only handle 175 simultaneous collections before hitting the performance knee
7/2/98Removed CPMSRWBA03 and CPMSRWBA04 from DNS
7/15/98Removed CPMSRWBA05 and CPMSRWBA05 from DNS
7/27/98Removed CPMSRWBA03 thru CPMSRWBA06 from the IDC
WebSiteMap
TerraServer Web Site
PathSizeDescription
InetPub
TerraServer1.00 MBHTM, ASP, .Class, Inc, Fnc, Sub, Txt, and Global.Asa
CoverageMap9.63 MB.GIF for CoverageMap system
DigitalBackyard0.10 MBUSGS HTM pages
Images1.31 MBLogos and main GIF and JPG files
AlphaServer0.04 MBDEC/Compaq Alpha Server images
DigitalImages0.76 MBDEC Images
Graphics0.03 MBMiscellaneous
Graphs0.29 MBDiagrams and Graphs
Map0.01 MBGraphics that go around the image
MS0.00 MBMicrosoft Toolbar
MsNav0.00 MBMicrosoft Toolbar (Duplicate)
Placeholder6.50 MBInside TerraServer Images
ServerImage0.06 MBServer Images
Subheads0.03 MB[Obsolete Headers]
Toolbars0.01 MBImage Toolbar (grey buttons)
Library11.10 MBWhitepaper
SetPick0.02 MB
Total Size30.88 MB
IIS Configuration
Tasks performed
Machine Name
ASP Performance
Script Engine Cache10001000
Default Site
Web SiteIntelAlpha
Drive Pathe:\c:\
TCP Port8080
Limit Connections400400
Connection TimeOut6060
LogFilese:\logfilese:\logfiles
LogFormatMS IISMS IIS
Operators
Administrators
Performance
Pages per Day> 100,000> 100,000
Bandwidth(Open)(Open)
HTTP Keep-Alives Enabled(Checked)(Checked)
ISAPI Filters
None
Directories
RootE:\C:\
Access Checked:Read Log IndexRead Log Index
Permissions CheckedExecute + ScriptExecute + Script
Library directory PermissionsNoneNone
Tuning Script(s)
Run MakeFre15.bat in \Program Files\Common Files\System\Ado
Web Site Performancec:\Settings\k2tune.cmd
Registry Settingsc:\Settings\iis4Tune.reg
Change IIS4 Machine setting for ScriptEngineCache to 1000
Change Log File format to W3SVC Extended. Add URI, Bytes Sent, Time Taken
Install Steps
1Copy tree from CD or WinZip floppy to \InetPub\TerraServer
2Copy over top of these files new replacements (delta changes)
3Make sure ImageServer.dll is correct platform (default is Intel, get the Alpha disk)
4Edit ImgSrv.reg. Make sure paths to noimage path and Log Path are valid and exist
5Examine global.asa, make sure BaseRef is dns name of server, e.g. http://terraserver.microsoft.com
6Create ODBC DSNs:
NameServerProtocolUIDPassword
0TerraServerTerraServerTCP/IPt2b2_dbo
0TerraBackupTerraServerTCP/IPt2b2_dbo
0ImageServerTerraServerTCP/IPt2b2_dbo
0ImageBackupTerraServerTCP/IPt2b2_dbo
7Run imgsrv.reg (RegEdit imgsrv.reg)
8Examine library\wp.exe, make sure its right version
9Run k2tune.cmd (c:\settings\k2tune)
10Run iis4tune.reg (regedit iis4tune.reg)
11Change ScriptEngineCache to 1000
12Set Web Site, Performance, and Home Directory per the above spec.
13Run MakeFre15.bat in \Program Files\Common Files\System\Ado
14Run Perfmon with c:\settings\web.pmc
15Counters:
0ASPRequests Executing
0ASPRequests Wait Time
0ASPRequest Execution Time
ASPRequest Rejected
Web ServiceCurrent Connections
Web ServiceGet Request/sec
Web ServiceConnect Attempts / Sec
Active Server Pages
Parameters
Page Name (*.asp)12345678910
ClickOnCoveragePPDRCDsizeClickAt
ClickOnMacPPDRCDsizeClickAt
CoverageListRCDsize
CoverageSearchPPDRCDsizeClickAt
GetImageByXYXidYidSrcIdImgDateImgSize
GetNext10PlaceImgFlagQueryIdNameStateIdCountryIdTypeLastPlacePlaceIdDsize
GetOrigMetaOrigMetaIdSrcIdWidthHeightImgSizeDSize
GetPageByCoordLongLatAltMapNameDsize
GetPageByGridIdGridIdSrcIdImgDateImgSizeDsize
GetPageByLatLonLongitudeLatitudeAltitudeDsize
GetPageByPlace
GetPageByXYXidYidSrcIdImgDateImgSizeDsize
GetPickPageDSize
GetSearchByMapLongitudeLatitudeAltitudePanXPanYDSize
GetSearchByPlaceDsize
GetTileByClickXidYidSrcIdImgDateImgSizeClickAt
GetTileListByXYXidYidTileXTileYSrcIdImgDateDsize
GetTilesByXYXidYidTileXTileYSrcIdImgDateDsize
GetTileXYXidYidTileXTileYSrcIdImgDate
SpinOrderViewXidYidSrcIdImgDateImgSizeDsize
USGSDownloadXidYidTileXTileYSrcIdImgDateDsize
USGSEntryXidYidTileXTileYSrcIdImgDateDsize
USGSOrderViewXIdYidSrcIdImgDateImgSizeDSize
USGSTileViewXidYidTileXTileYSrcIdImgDateDsize
DisplayImageViewXidYidSrcIdImgDateImgSizeDsizeXY
DisplayTileViewXidYidTileXTileYSrcIdImgDateImgSizeDsizeXY
Page Name (*.asp)Calls Support File (*.inc, *.sub, *.txt)
ClickOnCoverageDisplayImageToolbarOutputErrorMsgGetConnectionHtmlHeader
CoverageSearchLeftNav_searchToolbarOutputErrorMsgHtmlHeaderSponsorsTableFunctions
GetImageByXYGetConnection
GetNext10PlacePlaceSearchToolbarOutputErrorMsgGetConnectionHtmlHeader
GetOrigMetaLeftNav_searchToolbarOutputErrorMsgGetConnectionHtmlHeaderSponsorsTableFunctions
GetPageByCoordDisplayImageToolbarOutputErrorMsgGetConnectionHtmlHeaderSponsors
GetPageByGridIdDisplayImageToolbarOutputErrorMsgGetConnectionHtmlHeaderSponsors
GetPageByLatLongDisplayImage
GetPageByPlacePlaceSearchToolbarOutputErrorMsgGetConnectionHtmlHeader
GetPageByXYDisplayImageToolbarOutputErrorMsgGetConnectionHtmlHeaderSponsors
GetPickPageLeftNav_searchToolbarOutputErrorMsgGetConnectionHtmlHeaderSponsors
GetSearchByMapLeftNav_searchToolbarOutputErrorMsgMapFunctionsHtmlHeaderSponsorsTableFunctions
GetSearchByPlaceSponsorsToolbar
GetTileByClickDisplayTileTableToolbarOutputErrorMsgGetConnectionHtmlHeaderTileFunctionsTableFunctionsDisplayTileApplet
GetTileListByXYTileFunctions
GetTilesByXYDisplayTileTableToolbarOutputErrorMsgGetConnectionHtmlHeaderTileFunctionsTableFunctionsDisplayTileApplet
GetTileXYGetConnection
SpinOrderView
USGSDownload
USGSEntryGetDoqOrigMetaIdToolbarOutputErrorMsgGetConnectionDisplayImgTblMakeSKUTileFunctions
USGSOrderView
USGSStoreOutputErrorMsg
USGSTileViewTileFunctions
DisplayImageView
DisplayTileViewTileFunctions
DisplayImgTableLeftnav_searchHtmlHeaderSponsorsTableFunctions
PlaceSearchSponsors
&L&A&C&BMSFT Confidential&B&RPage &P
<om Barclay&R&D
SQL Stored Procedures
Parameters
Method123456789
spDelLoadSetDatabaseThemeLowImgMetaIdNumImgMetaIdLowTileMetaIdNumTileMetaIdLowOrigMetaIdNumOrigMetaIdPartitionId
spFindByGridIdGridIdSrcIdImgDate
spFileGridIdGridIdSrcIdCellsImgDate
spFindLatestByCoordLongitudeLatitude
spFindLatestByXYGridIdXGridIdYGridId
spFindLatestCoordLongitudeLatitudeCells
spFindLatestGridIdXGridIdYGridIdCells
spFindStickyCoordLongitudeLatitudeCellsSrcIdImgDate
spFindPlaceByUGridIdUGridId
spFindPlaceByZGridIdZGridId
spFindTileMetaXIdYIdTileXTileYSrcIdImgDate
spGetDupFieldsXYXIdYIdSrcIdImgDate
spGetFieldsXYXIdYIdSrcIdszImgDate
spGetImageIdIdSrcIdImgDateImgSize
spGetImageXYXIdYIdSrcIdszImgDateImgSize
spGetImageRectXidYIdSrcIdCellsImgDate
spGetLastIdLoadedPartitionIdLowIdNumIdTableTypeTableName
spGetMetaFieldsXYXIdYIdSrcIdszImgDate
spGetMGridSizesPPDRowColDsize
spGetTileRectXIdYIdTileXTileYSrcIdCellsImgDate
spGetTileXYXIdYIdTileXTileYSrcIdImgDate
spImageExistsXIdYIdSrcIdszImgDate
spOtherImageXYXidYidSrcIdszImgDate
spQueryGazetteerImgFlagQueryTypePlaceNamePlaceTypeStateIdCountryIdLastPlaceNameLastPlaceId
spQueryGazFirstPlaceNamePlaceTypeIdStateNameCountryName
spQueryGazNextQueryTypeImageFlagLastPlaceIdLastPlaceNamePlaceNameStateNameCountryNamePlaceTypeIdRowCount
spTargetTileFactorImgDateXGridIdYGridIdXTileIdYTileIdTargetXTargetYTargetTileX
TargetTileY
spTileExistsXIdYIdTileXTileYSrcIdImgDate
spUpdatePlaceDateZidDoqDateSpinDate
spZTranXIdYId
Obsolete
&L&A&C&BMSFT Confidential&B&RPage &P
<om Barclay&R&D
ASP File Sizes
Active Server Page File Size
ASP FilesSupport Files
FileLinesBlank LinesBytesInclude BytesTotal LinesFileLinesBlank LinesBytes
ClickOnCoverage.asp16347210BeginTable.inc3632951
ClickOnMac.asp15947264CoverageTable.inc2292815437
CoverageList.asp8963060DisplayImage.inc2831014937
CoverageSearch.asp3162315469DisplayTileApplet.inc2201012311
GetImageXY.asp3751410DisplayTileTable.inc214412720
GetNext10Place.asp5112586HtmlHeader.inc182983
GetOrigMeta.asp2501415549LeftNav_Search.inc3992199
GetPageByCoord.asp14726444MapFunctions.inc1651910530
GetPageByGridId.asp14625978PlaceNameTable.inc90565
GetPageByLatLon.asp14626149PlaceSearch.inc13488328
GetPageByPlace.asp4212017Sponsors.inc110897
GetPageByXY.asp14826906TableFunctions.inc2522714222
GetPickPage.asp7873417DisplayImgTbl.sub6953838
GetSearchByLatLon.asp7282871GetDOQOrigMetaId.sub15096363
GetSearchByMap.asp187209797OutputErrorMsg.txt111480
GetTileByClick.asp15036829TileFunctions.txt3601439
GetTileListByXY.asp12045990toolbar.txt141205128
GetTilesByXY.asp13626528
GetTileXY.asp3951501
SpinOrderView.asp195512243
usgsbuydoq.asp12156218
USGSDownload.asp10855124
usgsentry.asp119126887
USGSOrderView.asp19249567
USGSTileView.asp206210874
2513766716Average1711996666
3417148167888Totals2017155113328
ASP SP Xref
SQL Stored Procedures
Active Server PagesandExecutablesspFindGridIdspFindLatestCoordspFindLatestGridIdspFindStickyCoordspGetFieldsXYspFindTileMetaspGetImageRectspGetImageXYspGetLastIdLoadedspGetMetaFieldsXYspGetMGridSizesspGetTileRectspGetTileXYspImageExistsspQueryGazFirstspQueryGazNextspSetupSpinInsertsspSetupUSGSInsertsspGetTargetTilespTileExistsspUpdatePlaceDate
ClickOnCoverage
ClickOnMac
CoverageList
CoverageSearch
DisplayImageView.asp
DisplayImgTable.inc
DisplayTileApplet.inc
DisplayTileTable.inc
DisplayTileView.asp
GetConnection.inc
GetImageByXY.asp
GetNext10Place.asp
GetOrigMeta.asp
GetPageByCoord.asp
GetPageByGridId.asp
GetPageByLatLon.asp
GetPageByPlace.asp
GetPageByXY.asp
GetPickPage.asp
GetSearchByMap.asp
GetSearchByPlace.asp
GetTileByClick.asp
GetTileListByXY.asp
GetTilesByXY.asp
GetTileXY.asp
OutputErrorMsg.txt
PlaceSearch.inc
SpinOrderView
Sponsors.inc
Toolbar.txt
USGSDownload
USGSEntry
USGSOrderView
USGSStore
USGSTileView
GetDOQOrigMetaId.sub
MakeSKU.fnc
LoadManager.exe
TerraLoader.exe
TerraUpdate.exe
&L&A&C&BMSFT Confidential&B&RPage &P
<om Barclay&R&D
Equipment
TerraServer Equipment Specs
SystemComponentQtyHeightWidthDepthWeightPowerPlugBTU/Hr
TerraServer PrimaryDEC Alpha 84001170.0 cm (67.0 in)80.0 cm (31.5 in)87.5 cm (34.4 in)545 kg (1200 lb.)120/208 V50-60 Hz3-Phase star30ANEMA L21-30R15,700 Btu/hr, 4,600 W
ESA-10000(Disk Cabinets)7170.0 cm (67.0 in)60.0 cm (23.75 in)90.0 cm (35.5 in)295 kg (650 lb.)220-240V 60 Hz 30A Single Phase3 Wire NEMA No. L6-30P6,140 Btu/hr, 1,800 W
StorageTek 97101184.6 cm (72.0 in)148.2 cm (57.8 in)101.5 cm (39.6 in)450 kg (1000 lb.)6A @ 120 volts,Nema 5-20P1,650 BTU/hour
TerraServer BackupDEC Alpha 41001170.0 cm (67.0 in)60.0 cm (23.75 in)90.0 cm (35.5 in)350 kg (772 lb.)200-240V50-60 Hz24ASingle PhaseNEMA L6-30P16,382 Btu/hr,
SW8003170.0 cm (67.0 in)80.0 cm (31 in)87.5 cm (34.5 in)454 kb (1000 lb)120/208 V50-60 Hz3-Phase star24ANEMA L21-309,976 Btu/Hr., 2,923 W
StorageTek 9714143 in.26 in.36 in.380 lbs (empty)430 lbs (100 tapes)Single Phase 120 VAC 47-63 Hz. 6A Service,Standard 3 Wire520 Btu/Hr, 150 W
JavaApplets
Spin View Applet
A012345678910
S1iDisplayWidthiDisplayHeightiColumnWidthiPlaceDateHeightiFontSizeiType33RecsszBaseRef
S33iRow#iCol#iWidthiHeightiEncryptKeyszImageUrliClickActionszClickURL
S99EOF
Image View, Image Save, and Rags Records and Fields
A012345678910
A1iDisplayWidthiDisplayHeightszBaseRefiColoriType2RecsiType3RecsiType4RecsiType7RecsiType6Recs
A2iXLocationiYLocationiWidthiHeightiColor
A3iXlocationiYLocationszImgURLiClickActionszClickURLbDrawPhase
A4iXlocationiYLocationiClickActionszClickURLszFontiSizeiColoriStyleszTextbDrawPhase
I5iXlocationiYLocationiWidthiHeightiColor
I6Row#Col#iWidthiHeightiEncryptKeyszImageUrliClickActionszClickURL
A7iStartXiStartYiEndXiEndYbLineBooliPixWidthiColorbFilliFillColor
s8szSuccessURLszSuccessTextszFailureText
R10iXLocationiYLocationiWidthiHeightiColoriMaxRec11
R11iXRelLoc10iYRelLoc10iColoriDelaymsiDrawTypeiWidthiHeight
R12iDelaymsbClearszRagsURL
99EOF
Applet Key
AImage View, Image Save and Rags View
SSpin View only
IImage View and Image Save only
sImage Save only
RRags only
FieldNamesDataTypeDescription
iDisplayWidthintWidth in pixels
iDisplayHeightintHeight in pixels
iXLocationintAbsolute pixel address starting from 0,0 in upper left hand corner
iYLocationintAbsolute pixel address starting from 0,0 in upper left hand corner
iClickActionint0 = "not clickable", 1 = "click to URL handled by this applet", 2 = "click to external URL"
szxxxxUrlcharURL to go to
szBaseRefcharBeginning of URL's that are internal (iClickAction = 1, images)
iColorint24-bit RGB value
szFontcharFont name, e.g. "Arial"
iSizeintFont size in points
bDrawPhaseint0 = before images, 1 = after images are drawn (control on-top-ness)
iWidthintWidth in pixels
iHeightintHeight in pixels
iStartXintStart position in absolute pixels
iStartYintStart position in absolute pixels
iEndXintEnd position in absolute pixels
iEndYintEnd position in absolute pixels
bLineBoolint0 = don't draw a line, 1= draw line
bFillint0 = don't fill, 1 = fill object
iFillColorint24-bit RGB value
iMaxRec11intTotal number of record type 11's that may ever be sent to the applet
iType2RecsintTotal number of record type 2's that may ever be sent to the applet
iType3RecsintTotal number of record type 3's that may ever be sent to the applet
iType4RecsintTotal number of record type 4's that may ever be sent to the applet
iType6RecsintTotal number of record type 6's that may ever be sent to the applet
iType7RecsintTotal number of record type 7's that may ever be sent to the applet
iDrawTypeint0 = Pixel, 1 = FillFlag, 2= Rect, 3 = FillRect, 4 = Oval, 5 = Fill Oval
iXRelLoc10intPixel location relative to start of Record 10
iYRelLoc10intPixel location relative to start of Record 10
bClearint0 = Don't clear record 10 array; 1 = re-draw record 10 rectangle.
TerraServer Admin ASP
TerraServer Administration System Active Server Pages
Parameters
Page Name (*.asp)12345678910
ShowPickPageDSize
ChangePickPageNameDsize
DeletePickEntryNameDsize
InsertPickEntryDsize
ModifyPickEntryDsize
Page Name (*.asp)Calls Support File (*.inc, *.sub, *.txt)
ChangePickPageToolbarOutputErrorMsgSponsors
DeletePickEntryToolbarOutputErrorMsgSponsors
InsertPickEntryToolbarOutputErrorMsgSponsors
ModifyPickEntryToolbarOutputErrorMsgSponsors
ShowPickPageToolbarOutputErrorMsgSponsors
Sheet2
Java Applet Compatibility
SpinViewMapViewImageViewImageSave
NT/98/95 IE4.0OkOkOkOk
NT/98/95 IE4.0OkOkOkOk
NT/98/95 IE3.02OkOkOkNot Supported
NT/98/95 NS3.0Doesn't workDoesn't workOkNot Supported
Linux NS4.0OkOkMissing File DialogMissing File Dialog
MacOS8 IE4OkOkOkMissing File Dialog
MacOS8 IE3.02Doesn't workDoesn't workDoesn't workDoesn't work
MacOS8 NS4.0OkOkOkDoesn't work
TerraServer V1.0 DB Tables
ThemeImgMetaThemeTileMetaThemeThumbImgThemeThumbHitDOQOrigMeta
0ImgMetaId I4TileMetaId I4ImgMetaId I4ImgMetaId I4OrigMetaId I4
1OrigMetaId I4ImgMetaId I4ZGridId I4ImgHit I4QuadName C38
2SrcId I4OrigMetaId I4SrcId I4Quadrant C2
3ImgTypeId I4SrcId I4ImgTypeId I4Filename VC255
4XGridId I2ImgTypeId I4FileName VC255Country C4
5YGridId I2XGridId I2ImgData ImgStates C12
6ZGridId I4YGridId I2State1County C20
7ThumbPixWidth I4ZGridId I4ThemeBrowseImgThemeBrowseHitState2County C20
8ThumbPixHeight I4ImgStatus I2ImgMetaId I4ImgMetaId I4State3County C20
9BrowsePixWidth I4ImgDate DTZGridId I4ImgHit I4State4County C20
10BrowsePixHeight I4XTileGridId I2SrcId I4Producer C4
11ImgStatus I2YTileGridId I2ImgTypeId I4DataOrder I2
12ImgDate DTZTileGridId I2FileName VC255NbrLines I4
13MidLat D7.4TilePixWidth I4ImgData ImgNbrSamples I4
14MidLong D7.4TilePixHeight I4BandTypes I2
15NWLat D7.4MidLat D7.4ThemeTileImgThemeTileHitElevationType I2
16NWLong D7.4MidLong D7.4TileMetaId I4TileMetaId I4BandElevation i2
17NELat D7.4NWLat D7.4ZGridId I4ImageHit I4VerticalDatum I2
18NELong D7.4NWLong D7.4SrcId I4PrimaryHorizontalDatum I2
19SWLat D7.4NELat D7.4ImgTypeId I4SecondaryHorizontalDatus I2
20SWLong D7.4NELong D7.4FileName VC255GroundXYSystem I2
21SELat D7.4SWLat D7.4ImgData ImgGoundPlanimetricSystem I4
22SELong D7.4SWLong D7.4GroundPlanimetricUnits I4
23PlaceName VC255SELat D7.4AngleRotation D24.15
24SELong D7.4SW_Xprimary D24.15
25PlaceName VC255SW_Yprimary D24.15
26NW_Xprimary D24.15
NW_Yprimary D24.15
NE_XPrimary D24.15
NE_Yprimary D24.15
SE_Xprimary D24.15
SE_Yprimary D24.15
A_Primary D24.15
B_Primary D24.15
C_Primary D24.15
D_Primary D24.15
E_Primary D24.15
F_Primary D24.15
CountryStatePlaceGazateerSourceXC_Primary D24.15
0CountryId I4StateId I4PlaceId I4GazSrcId I4YC_Primary D24.15
1UNCode C4StateName VC255CountryId I4GazDesc VC255SW_Xsecondary D24.15
2CountryName VC255StateId I4SW_Ysecondary D24.15
3WWFeatureId I4NW_Xsecondary D24.15
4CountrySearchStateSearchGazSrcIdDegreePopulationNW_Ysecondary D24.15
5CountryId I4StateId I4TypeId I4CountryId I4NE_Xsecondary D24.15
6ContinentId I4CountryId I4Longitude D7.4DegreeId I4NE_Ysecondary D24.15
7WWFeatureId I4WWFeatureId I4Latitude D7.4UNCode2 C4SE_Xsecondary D24.15
8GazSrcId I4GazSrcId I4Name VC255Population I4SE_Ysecondary D24.15
9Name VC255Name VC255AlternateName VC255Rate D8.4A_secondary D24.15
10AlternateName VC255AlternateName VC255ZGridId I4B_secondary D24.15
11DoqDate DTC_secondary D24.15
12FeatureTypeWordWheelFeatureSpinDate DTD_secondary D24.15
13TypeId I4WWFeatureId I4DegreeId I4E_secondary D24.15
14Name VC255Name VC255F_secondary D24.15
15XC_secondary D24.15
YC_secondary D24.15
0GridSysImgSourceImgTypeImgCounterSW_XIntPrimary I4
1GridSysId I4SrcId I4ImgTypeId I4LastImgMetaId I4SW_YIntPrimary I4
2ImgXVal I2ImgTypeId I4ImgFileExt C3LastOrigMetaId I4NW_XIntPrimary I4
3ImgYVal I2GridSysId I4ImgFileDesc VC255LastTileMetaId I4NW_YIntPrimary I4
4TileXVal I2SrcName C10MimeStr VC255LastUpdated DTNE_XIntPrimary I4
5TileYVal I2SrcTblName C10NE_YIntPrimary I4
6MinX I2SrcDesc VC255SE_XIntPrimary I4
7MinY I2SE_YIntPrimary I4
8MaxX I2SW_XIntPrimary I4
9MaxY I2SW_YIntPrimary I4
10GridDesc VC255SE_XIntPrimary I4
SE_YIntPrimary I4
FirstPixelPrimaryX D24.15
0HTMLPageHTMLPageParamsHtmlStrHtmlFmtStrFirstPixelPrimaryY D24.15
1PageName C40PageName C40SectionName C40StrName VC255FirstPixelSecondaryX D24.15
2SectionName C40SectionName C40LineNbr I4FmtStr VC255FirstPixelSecondaryY D24.15
3SectionOrder I4PageParamNbr I4ParamNbr I4ElevationUnits I2
4SecParamNbr I4HtmlText VC255MinPhotoElevation D10.3
5MaxPhotoElevation D10.3
XPixelResDEM D12.6
YPixelResDEM D12.6
0LogAccessLogCoordLogImgMetaIdLogPlaceZPixelResDEM D12.6
1LogImgCount I4LogCoordCount I4RemoteAddress C16RemoteAddress C16XPixelResDOQ D12.6
2RemoteAddress C16RemoteAddress C16SrcId I1PlaceName VC255YPixelResDOQ D12.6
3SrcId I4SrcId I4ImgSizeId I1PlaceType I4ZPixelResDOQ D12.6
4ImgSizeId I1OriginType I1ImgMetaId I4PlaceState VC255MaxPrimaryContourInterval I4
5OriginType I1Longitude D7.4CreateDate DTPlaceCountry VC255MaxPrimaryContourUnits I2
6MetaId I4Latitude D7.4RowsFound I4SuspectCode I2
7Direction I4HitFlag I1InsertTimeStamp DTHorizontalAccuracy D6.1
8CreateTimeStamp DTVerticalAccuracy D6.1
9HorizontalTestPoints I2
PixelAlgorithm I2
0PickProductionSystem C24
1Name VC255ProductionDate DT
2Link VC255FilmType C24
3SourcePhotoId C24
4MosaicCode I2
5LeafOffFlag C2
6SourcePhotoDate DT
CameraFocalLength D8.3
0PlaceCacheConfigPlaceListCachePlaceRowCacheCountryNameFlyingHeight I4
1MaxSize I4Ticket I4Ticket I4CountryId I4ScannerType C24
2SetSize I4DateCreated DTRowNumber I4UNCode2 C4ScannerResolutionX D6.2
3NextTicket I4SummaryPlaceName VC255Longitude VC10Name VC255ScannerResolutionY D6.2
4LifeTime I4SummaryState VC255Latitude VC10ScannerSampleResX D6.2
5SummaryCountry VC255SourceName VC10ScannerSampleResY D6.2
6PlaceName VC255URLPlaceName VC50RadiometricRes I2
7PlaceTypeStr VC10PlaceTypeStr VC10ResampledRes D6.2
8State VC255URLState VC50CompressionFlag C1
9Country VC255URLCountry VC50CompressedFileSize I4
10SrcIdStr VC10PlaceName VC255CompressionAlgorithm C20
11NumResults VC255State VC255CompressionType C1
12Country VC255CompressionFactor I2
13DOQOrigMeta_DataTypeZGridId I4
14DOQOrigMeta_InternalCoordinatesDoqDate DT
15DOQOrigMeta_LocationSpin2Date DT
16DOQOrigMeta_PrimaryCoordinates
DOQOrigMeta_Production
DOQOrigMeta_Resolution
DOQOrigMeta_SecondCoordinates
&L&A&C&BMicrosoft Confidential&B&RPage &P
<om Barclay&CPage &P&R&D
DBFileSize
TotalSize1000Restore Speed (MB/Minute)
FileCountGB/FileMB/Sec54321
5020.0068.2785.33113.78170.67341.33
4522.2275.8594.81126.42189.63379.26
4025.0085.33106.67142.22213.33426.67
3528.5797.52121.90162.54243.81487.62
3033.33113.78142.22189.63284.44568.89
2540.00136.53170.67227.56341.33682.67
2050.00170.67213.33284.44426.67853.33
1566.67227.56284.44379.26568.891137.78
10100.00341.33426.67568.89853.331706.67
5200.00682.67853.331137.781706.673413.33
&A
Page &P
FieldColumnNames
ImgMetaId I4OrigMetaId I4SrcId I4ImgTypeId I4XGridId I2YGridId I2ZGridId I4ThumbPixWidth I4ThumbPixHeight I4BrowsePixWidth I4BrowsePixHeight I4JumpPixWidth I4JumpPixHeight I4ImgStatus I2ImgDate DTCutRow I2CutCol I2MidLat D15.10MidLong D15.10NWLong D15.10NELat D15.10NELong D15.10SWLat D15.10SWLong D15.10SELat D15.10SELong D15.100000000
TileMetaId I4ImgMetaId I4OrigMetaId I4SrcId I4ImgTypeId I4XGridId I2YGridId I2ZGridId I4ImgStatus I2ImgDate DTCutRow I2XTileGridId I2YTileGridId I2ZTileGridId I2TilePixWidth I4TilePixHeight I4EncryptKey I4MidLat D15.10MidLong D15.10NWLat D15.10NELat D15.10NELong D15.10SWLat D15.10SWLong D15.10SELat D15.10SELong D15.100000000
ImgMetaId I4ZGridId I4UGridId I4SrcId I4ImgTypeId I4EncryptKey I4ImgDate DTFileName VC255ImgData Img
00UGridId I4000ImgDate DT00
00UGridId I4000ImgDate DTZGridId I4ImgStatus I2
TileMetaId I4ZGridId I4UGridId I4SrcId I4ImgTypeId I4EncryptKey I4ImgDate DTFileName VC255ImgData Img
OrigMetaId I4SrcId I4GridX I4GridY I4CutsWide I4CutsHigh I4ImageWidth I4ImageHeight I4UpperLongitude D15.10UpperLatitude D15.10LowerLatitudeD15.10LowerLongitude D15.10UpperGridLong D15.10UpperGridLat D15.10XPixelsPerDegree I4YPixelsPerDegree I4DiscardRowPixels I4DiscardColumnPixels I4ColorValue I4ColorPerCent I4InMetaname VC255InFilename VC255QuadName C38Quadrant C2DataSetName VC255DataSetName2 VC255Country C10States C12Producer C24WestLongitude D15.10EastLongitude D15.10NorthLatitude D15.10SouthLatitude D15.10RasterOrder C24NbrLines I4NbrSamples I4BandContent C20BandOrganization C12PrimaryHorizontalDatum I2SecondaryHorizontalDatum I2CoordinateSystem C10CoordinateZone I4HorizontalUnits C20HorizontalResolution D6.4BitsPerPixel I2SW_Xprimary D24.15SW_Yprimary D24.15NW_Xprimary D24.15NW_Yprimary D24.15NE_XPrimary D24.15NE_Yprimary D24.15SE_Xprimary D24.15SE_Yprimary D24.15SW_Xsecondary D24.15SW_Ysecondary D24.15NW_Xsecondary D24.15NW_Ysecondary D24.15NE_Xsecondary D24.15NE_Ysecondary D24.15SE_Xsecondary D24.15SE_Ysecondary D24.15XOriginPrimary D24.15YOriginPrimary D24.15XOriginSecondary D24.15YOriginSecondary D24.15RMSE_XY D24.15ProductionSystem C24ProductionDate DTImageSource C24SourcePhotoId C24SourcePhotoDate DTCompression C20MetaDataDate DTDataFileSize I4HeaderByteCount I4StandardVersion C10Agency C60SourceDEMDate DT
OrigMetaId I4SrcId I4GridX I4GridY I4CutsWide I4CutsHigh I4ImageWidth I4ImageHeight I4UpperLongitude D15.10UpperLatitude D15.10LowerLatitude D15.10LowerLongitude D15.10UpperGridLongUpperGridLatXPixelsPerDegreeYPixelsPerDegreeDiscardRowPixelsDiscardColumnPixelsColorValueColorPerCentInMetanameInFilenameSunAngle D10.6ShootingHeight D15.5PixelSize D6.4FrameNumber C60SpinImgDate DTSpinGMT C12CameraSystem C24Copyright C80
Use the above rows to format the columns when verifying the meta data .BCP files
The first row is the ImgMeta table. Second is TileMeta. Third is JumpImg.
Fourth is ThumbImg. Fifth is BrowseImg. Sixth is Tile Img.
Seventh is DOQ Original meta. Eigth is Spin Meta
&A
Page &P
Spin-2 Store
Spin-2 Image Sizes
1.561.56161672
KMKMFullFullThumbThumbAverage
NameWidthHeightPixWidthPixHeightPixWidthPixHeightTable Height x Width
Small1.51.687596210829410561152
Medium33.37519232163188211142304
Large4.254.7827243064266299203168
Tom Barclay:This value is displayed to the user on the SPIN-2 Page as the width in Km to be purchased.
Tom Barclay:Height in KM displayed to the user in the SPIN-2 store pages.
Tom Barclay:Number of wide pixels at full resolution. Depends on pixels per square meter in row 2.
DownloadTime
Page Size by Image Type Table600x400500
800x600700
Image TypeHTML Text SizeGraphics Size (Total)HTML and Gif SizeJpeg SizeAvg Width1024x768900
Jump15,0005458269,5821,000561152x8821000
Thumb12,0005458266,5822,5001131280x10241100
Browse9,5005458264,08210,000225
Tile8,5005458263,08210,000225
Pages Per
60%Effective Throughput
100200300400
Mbits/secMbits/secMbits/secMbits/sec
Second75150225300
Hour270,000540,000810,0001,080,000
Day4,860,0009,720,00014,580,00019,440,000
DownLoad Time Calculations
2880028800560005600015000001500000
Image TypeWindow SizeMax Image WidthTiles Per PageTotal Size (Bytes)Kbps Total Time1st Image TimeKbps Total Time1st Image TimeKbps Total Time1st Image Time
Jump600x400500647900027.43s24.51s14.11s12.60s0.53s0.47s
Thumb600x400500165200018.06s23.99s9.29s12.34s0.35s0.46s
Browse600x40050044950017.19s25.72s8.84s13.23s0.33s0.49s
Tile600x40050044850016.84s25.38s8.66s13.05s0.32s0.49s
Average5000017.36s8.93s0.33s
Jump800x60070014415900055.21s24.51s28.39s12.60s1.06s0.47s
Thumb800x6007003610200035.42s23.99s18.21s12.34s0.68s0.46s
Browse800x60070099950034.55s25.72s17.77s13.23s0.66s0.49s
Tile800x60070099850034.20s25.38s17.59s13.05s0.66s0.49s
Average10000034.72s17.86s0.67s
Jump1024x76890025627100094.10s24.51s48.39s12.60s1.81s0.47s
Thumb1024x7689004913450046.70s23.99s24.02s12.34s0.90s0.46s
Browse1024x7689001616950058.85s25.72s30.27s13.23s1.13s0.49s
Tile1024x7689001616850058.51s25.38s30.09s13.05s1.12s0.49s
Average15750054.69s28.13s1.05s
Jump1152x8821000289304000105.56s24.51s54.29s12.60s2.03s0.47s
Thumb1152x88210006417200059.72s23.99s30.71s12.34s1.15s0.46s
Browse1152x88210001616950058.85s25.72s30.27s13.23s1.13s0.49s
Tile1152x88210001616850058.51s25.38s30.09s13.05s1.12s0.49s
Average17000059.03s30.36s1.13s
Jump1280x10241100361376000130.56s24.51s67.14s12.60s2.51s0.47s
Thumb1280x102411008121450074.48s23.99s38.30s12.34s1.43s0.46s
Browse1280x102411001616950058.85s25.72s30.27s13.23s1.13s0.49s
Tile1280x102411001616850058.51s25.38s30.09s13.05s1.12s0.49s
Average18416763.95s32.89s1.23s
OverheadImages/Sec
100005,000,000.001500
&LMicrosoft Terra-Server&C&"Arial,Bold"&A&R&D&T
<om Barclay&RPage &P
GraphicsFileSizes
Graphics File Sizes
Graphics FileSize (Bytes)
alex-logo.gif2424
anibkoffice.gif15856
bktomap.gif470
buyme.gif2281
database.gif1279
diglogo.gif480
east.gif483
hardware.gif1237
help.gif1028
image.gif1107
imagery.gif1201
info.gif1005
Line.gif816
map.gif1015
msftlogo.gif358
name.gif1074
north.gif471
northeast.gif442
northwest.gif446
nozomap.gif1598
picks.gif1071
scalekm.gif1200
scalemi.gif1200
search.gif1144
south.gif471
southeast.gif453
southwest.gif462
spinlogo.gif1913
storageworks.gif3162
tslogosm.gif2006
usgslogo.gif1077
usgslogo.gif1077
west.gif472
year.gif300
zinomap.gif1576
zinozomap.gif1927
Total Size54582
&A
Page &P
MapGridSizeTables
Database Size Tables
MCGridIdMSGridId
XMCGridId i4XMSGridId i4
YMCGridId i4YMSGridId i4
SpinRowCount i4SpinRowCount i4
SpinImgMb