ldbc social network benchmark - full disclosure report...
TRANSCRIPT
LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015
Social Network Benchmark Interactive Workload Full Disclosure Report Moritz Kaufmann
20/04/2015
LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT <DATE>
Table of Contents
3
4
5 5 5 5 6
7 7
7 Error! Bookmark not defined. Error! Bookmark not defined. 7
Error! Bookmark not defined. 7
8 8 8 8 Error! Bookmark not defined.
9
11
12
13
Preface
This is the Full Disclosure Report for the LDBC SNB interactive audit results for Sparksee 5.1.1 by Sparsity Technologies, Scale Factor SF30 on a single server configuration.
General Terms Test sponsor of this benchmark is Sparsity Technologies, Spain. Sparsity technologies is a leading provider of graph database and applications that use the graph to add value to our customers. Our high end technologies, based on top research, combine the experience of University researchers and Industrial professionals. We have a vast Industrial experience to push your development to a more competitive customer solution. Sparsity was created based on the technologies developed at DAMA-UPC, and have successfully provided solutions to clients such as Barclays, Acceso, CA Technologies, MPG and contributed to leading European Projects such as LDBC and CoherentPaaS. This report contains an audited LDBC benchmark run. The results have been gathered by an independent and impartial auditor, who has validated the implementation of the queries and the overall system's configuration conform to the description of the benchmark and his strict requirements.
1. System Description
1.1 Database System
Vendor Name Sparsity Technologies
Database Name Sparksee
Version No 5.1.1
Table 1: DBMS Characteristics
1.2 Database Engine Configuration
Cache Configuration Default
Transaction Isolation Level/Model Serializable
Special settings sparksee.io.rollback=false sparksee.io.recovery=true sparksee.io.recovery.checkpointTime=0
Table 2: Database Engine Configuration
1.3 Platform Description
Table 3: System Configuration
Model
Processors 2X INTEL XEON E5-2630 V3
Memory 8X 32GB LRDIMM, 2133 MT/S
No Disks/Type/Storage Configuration
2X80GB SSD SATA MLC 6GB/S IN HOT-PLUG
DRIVE 1X2TB SATA 6GB/S 7,2K RPM 3,5" HDD
Network Adapters BROADCOM 5720
Operating System DEBIAN GNU/LINUX 7.8 (WHEEZY)
File System EXT4
No Threads 32
No Cores 16
Memory 256 GB
Total Disks Capacity 2.16 TB
Storage Intel Corporation Wellsburg 6-Port SATA Controller
RAID/HBA controller Not installed
Table 4: No Disks/Type/Storage/Configuration
1.4 Network Infrastructure Information
Model Not applicable
Network Switches Not applicable
Wiring Information Not applicable
Table 5: Network Infrastructure Information
2. Data Generation & Loading
2.1 Dataset Information
2.1.1 Description
Scale Factor 30
Data Format CSV
Data Generator Version v.0.2.0
Time Compression ratio 0.61
Table 6: Dataset characteristics
2.1.2 Data Generator Parameters
ldbc.snb.datagen.generator.scaleFactor: 30
ldbc.snb.datagen.serializer.compressed:false
ldbc.snb.datagen.serializer.personSerializer: ldbc.snb.datagen.serializer.snb.interactive.CSVPersonSerializer
ldbc.snb.datagen.serializer.invariantSerializer: ldbc.snb.datagen.serializer.snb.interactive.CSVInvariantSerializer
ldbc.snb.datagen.serializer.personActivitySerializer: ldbc.snb.datagen.serializer.snb.interactive.CSVPersonActivitySerializer
ldbc.snb.datagen.generator.numThreads:4
ldbc.snb.datagen.serializer.updateStreams:true
2.3. Bulk Loading
Loading Time 216min 48s
Table 7: Bulk Loading Time
3. Benchmark Test Driver
3.1. Basic test driver configuration details
No of worker threads 16
No of write streams 8
Table 8: Basic Test Driver Configuration Details
3.2. Configuration Parameters for Driver Warmup
Warmup using the first 160,000 operations
3.3. Configuration Parameters for Driver Execution
See user_parameters.properties, startup with 16 worker threads and TCR = 0.61
4. Performance Metrics
Duration Operations Throughput % above threshold
72.5min 377,000 86.5 3.89%
Query Count Mean % Execution
Complex 1 2,955.0 331.2 2.61%
Complex 2 2,076.0 354.7 1.96%
Complex 3 725.0 725.4 1.40%
Complex 4 2,134.0 326.8 1.86%
Complex 5 1,068.0 405.7 1.16%
Complex 6 243.0 984.0 0.64%
Complex 7 1,601.0 333.5 1.42%
Complex 8 8,537.0 351.8 8.01%
Complex 9 200.0 3,451.4 1.84%
Complex 10 2,076.0 449.7 2.49%
Complex 11 3,841.0 362.1 3.71%
Complex 12 1,746.0 383.0 1.78%
Complex 13 4,043.0 1,137.6 12.27%
Complex 14 1,566.0 2,010.3 8.40%
Short 1 41,220.0 40.9 4.49%
Short 2 41,221.0 27.8 3.06%
Short 3 41,222.0 31.2 3.43%
Short 4 41,027.0 45.0 4.93%
Short 5 41,029.0 19.7 2.16%
Short 6 41,030.0 19.0 2.08%
Short 7 41,033.0 18.0 1.97%
Update 1 17.0 964.6 0.04%
Update 2 8,776.0 187.8 4.40%
Update 3 15,423.0 189.5 7.79%
Update 4 242.0 179.9 0.12%
Update 5 21,901.0 188.9 11.04%
Update 6 3,031.0 176.5 1.43%
Update 7 6,166.0 189.2 3.11%
Update 8 851.0 176.0 0.40%
Table 10: Execution Summary
Query Min Max Mean 50th 90th 95th 99th
Complex 1 2.0 3,055.0 331.2 98.0 896.0 1,007.0 2,122.6 Complex 2 2.0 3,431.0 354.7 112.5 927.0 1,027.0 2,146.5 Complex 3 2.0 3,496.0 725.4 606.0 1,329.4 1,501.4 2,207.6 Complex 4 1.0 2,998.0 326.8 103.0 884.4 1,003.4 1,923.0 Complex 5 2.0 3,452.0 405.7 242.5 993.6 1,329.0 2,060.3 Complex 6 2.0 2,814.0 984.0 820.0 1,622.8 1,757.8 2,359.8 Complex 7 1.0 2,887.0 333.5 91.0 898.0 1,022.0 1,851.0 Complex 8 11.0 3,572.0 351.8 109.0 922.0 1,032.0 2,115.1 Complex 9 1,554.0 5,808.0 3,451.4 3,392.5 4,427.2 4,711.2 5,032.0 Complex 10 1.0 3,575.0 449.7 215.5 1,041.0 1,144.5 2,238.8 Complex 11 2.0 3,264.0 362.1 125.0 941.0 1,049.0 2,220.6 Complex 12 2.0 3,290.0 383.0 155.5 954.0 1,063.3 1,915.5 Complex 13 6.0 4,657.0 1,137.6 1,139.0 1,911.8 2,005.0 2,946.4 Complex 14 15.0 6,324.0 2,010.3 1,878.0 3,511.0 3,935.5 4,623.8
Table 11: Complex reads detail
Query Min Max Mean 50th 90th 95th 99th
Short 1 1.0 3,767.0 40.9 12.0 56.0 98.0 995.0 Short 2 1.0 3,593.0 27.8 18.0 43.0 57.0 112.0 Short 3 1.0 3,057.0 31.2 19.0 42.0 52.0 119.0 Short 4 1.0 3,775.0 45.0 12.0 58.0 102.0 1,003.0 Short 5 1.0 3,509.0 19.7 11.0 30.0 44.0 98.0 Short 6 1.0 3,586.0 19.0 11.0 30.0 40.0 81.0 Short 7 1.0 3,777.0 18.0 10.0 27.0 34.0 73.0
Table 12: Short Reads detail
Query Min Max Mean 50th 90th 95th 99th
Update 1 14.0 3,827.0 964.6 702.0 2,948.6 3,781.4 3,817.9 Update 2 6.0 5,669.0 187.8 24.0 796.0 1,073.3 2,510.0 Update 3 6.0 5,996.0 189.5 24.0 821.0 1,105.0 2,457.7 Update 4 7.0 4,145.0 179.9 25.0 561.1 1,031.8 2,626.2 Update 5 6.0 5,831.0 188.9 24.0 817.0 1,069.0 2,424.0 Update 6 9.0 3,897.0 176.5 28.0 757.0 1,014.5 2,229.1 Update 7 7.0 4,065.0 189.2 29.0 823.0 1,046.0 2,333.6 Update 8 6.0 3,682.0 176.0 24.0 764.0 1,004.0 2,243.0
Table 13: Updates detail
5. Recovery
Table 14: Recovery
Time to Recover 1.281s
6. Pricing Summary
Item Price
SPARKSEE 5.1.1 SME LARGE 3Y 21,600.00 €
DELL R730 8,827.94 €
TOTAL 30,427.94 €
Table 15: Pricing Information
7. Attachment's CheckList
DATAGEN PARAMS.INI Attached
DRIVER’S LDBC-CONFIGURATION.PROPERTIES Attached
DRIVER’S LDBC-RESULTS.JSON Attached
VENDOR SPECIFIC CONFIGURATION FILES sparksee.cfg
Table 9: Checklist