clusterperf.py is a program that configures a RAMCloud cluster (using cluster.py) and then runs various benchmarks on it, using the program ClusterPerf as a client running on some of the cluster machines. This page contains the output of that program at various points in time, so it provides a history of RAMCloud cluster performance. Unless otherwise indicated, infrc is used as transport.
Note: for consistency, be sure to compile with DEBUG=no.
April 12, 2012
Master client reading from all masters
Slave id 1 reading from all masters
Slave id 2 reading from all masters
Slave id 3 reading from all masters
Slave id 4 reading from all masters
Slave id 5 reading from all masters
Slave id 6 reading from all masters
Slave id 7 reading from all masters
Slave id 8 reading from all masters
Slave id 9 reading from all masters
Slave id 10 reading from all masters
Slave id 11 reading from all masters
Slave id 12 reading from all masters
Slave id 13 reading from all masters
Slave id 14 reading from all masters
Slave id 15 reading from all masters
Slave id 16 reading from all masters
Slave id 17 reading from all masters
Slave id 18 reading from all masters
Slave id 19 reading from all masters
Slave id 20 reading from all masters
Slave id 21 reading from all masters
Slave id 22 reading from all masters
Slave id 23 reading from all masters
Slave id 24 reading from all masters
Slave id 25 reading from all masters
Slave id 26 reading from all masters
Slave id 27 reading from all masters
Slave id 28 reading from all masters
Slave id 29 reading from all masters
Slave id 30 reading from all masters
Slave id 31 reading from all masters
Slave id 32 reading from all masters
Slave id 33 reading from all masters
Slave id 34 reading from all masters
Slave id 35 reading from all masters
Slave id 36 reading from all masters
Slave id 37 reading from all masters
Slave id 38 reading from all masters
Slave id 39 reading from all masters
Slave id 40 reading from all masters
Slave id 41 reading from all masters
Slave id 42 reading from all masters
Slave id 43 reading from all masters
Slave id 44 reading from all masters
Slave id 45 reading from all masters
Slave id 46 reading from all masters
Slave id 47 reading from all masters
Slave id 48 reading from all masters
Slave id 49 reading from all masters
Slave id 50 reading from all masters
basic.read100 5.3 us read single 100B object with 30B key
basic.readBw100 18.1 MB/s bandwidth reading 100B object with 30B key
basic.read1K 7.0 us read single 1KB object with 30B key
basic.readBw1K 135.9 MB/s bandwidth reading 1KB object with 30B key
basic.read10K 10.3 us read single 10KB object with 30B key
basic.readBw10K 928.8 MB/s bandwidth reading 10KB object with 30B key
basic.read100K 46.4 us read single 100KB object with 30B key
basic.readBw100K 2.0 GB/s bandwidth reading 100KB object with 30B key
basic.read1M 430.0 us read single 1MB object with 30B key
basic.readBw1M 2.2 GB/s bandwidth reading 1MB object with 30B key
basic.write100 16.1 us write single 100B object with 30B key
basic.writeBw100 5.9 MB/s bandwidth writing 100B object with 30B key
basic.write1K 19.9 us write single 1KB object with 30B key
basic.writeBw1K 47.8 MB/s bandwidth writing 1KB object with 30B key
basic.write10K 38.9 us write single 10KB object with 30B key
basic.writeBw10K 245.1 MB/s bandwidth writing 10KB object with 30B key
basic.write100K 246.9 us write single 100KB object with 30B key
basic.writeBw100K 386.2 MB/s bandwidth writing 100KB object with 30B key
basic.write1M 2.4 ms write single 1MB object with 30B key
basic.writeBw1M 404.0 MB/s bandwidth writing 1MB object with 30B key
broadcast 178.7 us broadcast message to 9 slaves
netBandwidth 109.4 GB/s many clients reading from different servers
netBandwidth.max 1.4 GB/s fastest client
netBandwidth.min 589.3 MB/s slowest client
readNotFound 13.9 us read object that doesn't exist
# RAMCloud write performance for 100 B object with 30 B key
# during interleaved asynchronous writes of various sizes
# Generated by 'clusterperf.py writeAsyncSync'
#
# firstWriteIsSync firstObjectSize firstWriteLatency(us) syncWriteLatency(us)
#----------------------------------------------------------------------------
0 100 6.8 18.3
0 1000 8.9 18.5
0 10000 15.7 29.9
0 100000 99.5 156.4
0 1000000 964.2 1402.6
1 100 15.9 16.7
1 1000 20.3 16.3
1 10000 36.9 16.4
1 100000 241.3 18.0
1 1000000 2368.9 22.2
# RAMCloud read performance for 100 B objects
# with keys of various lengths.
# Generated by 'clusterperf.py readVaryingKeyLength'
#
# Key Length Latency (us) Bandwidth (MB/s)
#----------------------------------------------------------------------------
1 5.3 0.2
5 5.2 0.9
10 5.2 1.8
15 5.3 2.7
20 5.3 3.6
25 5.3 4.5
30 5.3 5.4
35 5.4 6.2
40 5.4 7.0
45 5.4 7.9
50 5.4 8.8
55 5.5 9.6
60 5.5 10.5
65 5.5 11.4
70 5.5 12.2
75 5.5 13.0
80 5.5 13.8
85 5.5 14.7
90 5.5 15.6
95 5.5 16.4
100 5.5 17.2
200 6.4 30.0
300 6.6 43.6
400 7.1 54.1
500 7.3 65.6
600 7.4 77.0
700 7.4 90.1
800 7.5 101.4
900 7.7 111.5
1000 7.8 122.8
2000 8.6 221.7
3000 9.5 302.5
4000 10.2 372.9
5000 11.2 424.7
6000 12.0 475.5
7000 12.8 522.4
8000 13.6 559.7
9000 14.5 590.5
10000 15.4 619.2
20000 24.8 769.1
30000 34.0 841.3
40000 43.4 879.7
50000 52.3 912.4
60000 61.1 936.1
# RAMCloud write performance for 100 B objects
# with keys of various lengths.
# Generated by 'clusterperf.py writeVaryingKeyLength'
#
# Key Length Latency (us) Bandwidth (MB/s)
#----------------------------------------------------------------------------
1 15.5 0.1
5 15.7 0.3
10 15.7 0.6
15 15.5 0.9
20 16.2 1.2
25 15.8 1.5
30 16.0 1.8
35 15.7 2.1
40 15.7 2.4
45 16.0 2.7
50 15.8 3.0
55 15.8 3.3
60 16.2 3.5
65 16.2 3.8
70 16.6 4.0
75 16.7 4.3
80 16.8 4.5
85 16.8 4.8
90 17.0 5.1
95 17.0 5.3
100 17.1 5.6
200 17.7 10.8
300 18.8 15.2
400 19.4 19.7
500 19.8 24.0
600 20.2 28.3
700 20.6 32.4
800 21.9 34.9
900 21.9 39.1
1000 22.6 42.2
2000 26.7 71.4
3000 31.2 91.6
4000 35.1 108.7
5000 39.0 122.2
6000 43.7 131.0
7000 48.0 139.1
8000 52.8 144.5
9000 60.1 142.8
10000 65.5 145.6
20000 115.0 165.8
30000 165.8 172.5
40000 212.4 179.6
50000 261.7 182.2
60000 312.7 183.0
# RAMCloud read performance as a function of load (1 or more
# clients all reading a single 100-byte object with 30-byte key
# repeatedly).
# Generated by 'clusterperf.py readLoaded'
#
# numClients readLatency(us) throughput(total kreads/sec)
#----------------------------------------------------------
1 5.5 181
2 6.0 336
3 5.6 534
4 6.1 655
5 6.6 759
6 7.2 829
7 8.4 832
8 9.5 838
9 11.2 804
10 12.2 818
11 13.3 825
12 14.7 817
13 15.9 816
14 17.1 817
15 18.4 815
16 19.6 816
17 21.0 810
18 22.2 811
19 23.5 807
20 24.7 809
# RAMCloud read performance when 1 or more clients read
# 100-byte objects with 30-byte keys chosen at random from
# 10 servers.
# Generated by 'clusterperf.py readRandom'
#
# numClients throughput(total kreads/sec) slowest(ms) reads > 10us
#--------------------------------------------------------------------
1 162 2.11 0.4%
2 265 7.93 0.4%
3 427 2.08 0.4%
4 576 2.41 0.7%
5 633 15.90 0.5%
6 816 4.95 0.6%
7 939 2.97 0.6%
8 1132 1.97 0.5%
9 1088 9.95 0.8%
10 1286 5.95 1.2%
11 1472 2.22 1.3%
12 1573 4.01 1.2%
13 1754 3.02 1.3%
14 1815 2.95 1.3%
15 1727 9.77 1.3%
16 2176 1.94 0.9%
17 2229 2.94 1.2%
18 2423 3.66 1.1%
19 2358 6.56 1.3%
20 2355 9.83 1.8%
21 2044 9.95 2.0%
22 2807 3.74 2.0%
23 2575 7.86 2.1%
24 2804 9.85 2.3%
25 2900 9.93 2.5%
26 3236 1.96 2.8%
27 3362 4.32 2.9%
28 3274 9.95 3.1%
29 3397 7.84 3.6%
30 3764 3.50 3.7%
31 3875 1.82 3.9%
32 3953 4.08 4.3%
33 3872 5.63 4.6%
34 4209 3.96 4.8%
35 3809 10.26 5.3%
36 4228 4.24 5.6%
37 3874 14.17 6.3%
38 4284 7.87 6.8%
39 4844 2.24 7.5%
40 4503 6.35 7.8%
41 4726 5.90 8.6%
42 4851 3.95 9.2%
43 4300 8.72 10.6%
44 4810 3.85 11.9%
45 4457 6.55 12.9%
46 4987 7.86 13.6%
47 4889 8.19 14.0%
48 5432 4.02 15.9%
49 3586 35.50 16.6%
50 5262 10.87 18.4%
September 13, 2011
basic.read100 5.3 us read single 100B object
basic.readBw100 18.1 MB/s bandwidth reading 100B object
basic.read1K 7.1 us read single 1KB object
basic.readBw1K 134.5 MB/s bandwidth reading 1KB object
basic.read10K 10.2 us read single 10KB object
basic.readBw10K 936.1 MB/s bandwidth reading 10KB object
basic.read100K 44.9 us read single 100KB object
basic.readBw100K 2.1 GB/s bandwidth reading 100KB object
basic.read1M 427.8 us read single 1MB object
basic.readBw1M 2.2 GB/s bandwidth reading 1MB object
basic.write100 15.0 us write single 100B object
basic.writeBw100 6.3 MB/s bandwidth writing 100B object
basic.write1K 19.4 us write single 1KB object
basic.writeBw1K 49.3 MB/s bandwidth writing 1KB object
basic.write10K 38.3 us write single 10KB object
basic.writeBw10K 248.8 MB/s bandwidth writing 10KB object
basic.write100K 221.4 us write single 100KB object
basic.writeBw100K 430.8 MB/s bandwidth writing 100KB object
basic.write1M 2.2 ms write single 1MB object
basic.writeBw1M 436.9 MB/s bandwidth writing 1MB object
broadcast 181.1 us broadcast message to 9 slaves
netBandwidth 110.2 GB/s many clients reading from different servers
netBandwidth.max 1.6 GB/s fastest client
netBandwidth.min 470.4 MB/s slowest client
readNotFound 12.4 us read object that doesn't exist
# RAMCloud read performance as a function of load (1 or more
# clients all reading a single 100-byte object repeatedly).
# Generated by 'clusterperf.py readLoaded'
#
# numClients readLatency(us) throughput(total kreads/sec)
#----------------------------------------------------------
1 5.2 193
2 6.0 331
3 5.5 541
4 6.1 650
5 6.6 758
6 7.1 841
7 8.4 834
8 9.4 847
9 10.8 833
10 12.0 834
11 13.2 835
12 14.4 834
13 15.6 831
14 16.9 828
15 18.5 811
16 19.4 823
17 20.7 822
18 21.8 825
19 22.8 832
20 24.2 825
# RAMCloud read performance when 1 or more clients read
# 100-byte objects chosen at random from 10 servers.
# Generated by 'clusterperf.py readRandom'
#
# numClients throughput(total kreads/sec) slowest(ms) reads > 10us
#--------------------------------------------------------------------
1 182 0.09 0.1%
2 342 0.33 0.1%
3 520 0.28 0.2%
4 674 2.05 0.2%
5 858 0.37 0.2%
6 1021 0.34 0.2%
7 1178 0.34 0.2%
8 1358 0.34 0.2%
9 1506 0.35 0.2%
10 1668 0.33 0.2%
11 1800 0.34 0.3%
12 1936 0.59 0.3%
13 2088 0.50 0.4%
14 2267 0.35 0.3%
15 2375 0.35 0.4%
16 2515 0.36 0.4%
17 2645 0.35 0.5%
18 2804 0.34 0.5%
19 2929 0.36 0.6%
20 3049 0.35 0.7%
21 3175 0.35 0.8%
22 3280 0.49 0.9%
23 3433 0.34 1.0%
24 3532 0.35 1.3%
25 3645 0.41 1.5%
26 3782 0.35 1.4%
27 3880 0.36 1.8%
28 4044 0.36 2.0%
29 4139 0.35 2.0%
30 4244 0.36 2.3%
31 4318 0.47 2.9%
32 4483 0.36 3.0%
33 4587 0.35 3.3%
34 4661 1.94 3.9%
35 4723 2.22 4.4%
36 4841 2.19 4.5%
37 4931 2.26 4.7%
38 5068 2.28 5.8%
39 5123 2.16 6.3%
40 5210 2.07 7.0%
41 5252 2.27 7.9%
42 5382 2.28 8.4%
43 5485 2.32 8.8%
44 5507 2.31 10.1%
45 5511 2.32 11.4%
46 5528 3.57 11.1%
47 5695 3.71 12.1%
48 5809 2.33 13.4%
49 5686 2.54 13.6%
50 5869 2.47 14.3%