comparison benchmark.txt @ 12:8cfb3d2a1f14

only gfs2 benchmark
author taiki
date Mon, 12 Jan 2015 21:37:28 +0900
parents 60e8fc84b413
children d0e15fec6e50
comparison
equal deleted inserted replaced
11:60e8fc84b413 12:8cfb3d2a1f14
1 use FileBench 1 use FileBench benchmark on Fedora 20 kernel-3.16
2 2
3 2014 1/1 GFS2 / fileserver / 60 seconds / VM to GFS2 only bldsv09 access / VM image on FC 3 * 2015 1/1 GFS2 / fileserver / 60 seconds / VM to GFS2 only bldsv09 access / VM image on FC
4 4
5 statfile1 16217ops 270ops/s 0.0mb/s 0.2ms/op 2155us/op-cpu [0ms - 428ms] 5 statfile1 16217ops 270ops/s 0.0mb/s 0.2ms/op 2155us/op-cpu [0ms - 428ms]
6 deletefile1 16221ops 270ops/s 0.0mb/s 8.4ms/op 6842us/op-cpu [0ms - 2911ms] 6 deletefile1 16221ops 270ops/s 0.0mb/s 8.4ms/op 6842us/op-cpu [0ms - 2911ms]
7 closefile3 16223ops 270ops/s 0.0mb/s 0.0ms/op 2132us/op-cpu [0ms - 19ms] 7 closefile3 16223ops 270ops/s 0.0mb/s 0.0ms/op 2132us/op-cpu [0ms - 19ms]
8 readfile1 16225ops 270ops/s 34.2mb/s 23.8ms/op 4463us/op-cpu [0ms - 5577ms] 8 readfile1 16225ops 270ops/s 34.2mb/s 23.8ms/op 4463us/op-cpu [0ms - 5577ms]
13 closefile1 16258ops 271ops/s 0.0mb/s 0.0ms/op 2133us/op-cpu [0ms - 9ms] 13 closefile1 16258ops 271ops/s 0.0mb/s 0.0ms/op 2133us/op-cpu [0ms - 9ms]
14 wrtfile1 16262ops 271ops/s 33.9mb/s 1.5ms/op 2783us/op-cpu [0ms - 1806ms] 14 wrtfile1 16262ops 271ops/s 33.9mb/s 1.5ms/op 2783us/op-cpu [0ms - 1806ms]
15 createfile1 16267ops 271ops/s 0.0mb/s 0.9ms/op 2445us/op-cpu [0ms - 428ms] 15 createfile1 16267ops 271ops/s 0.0mb/s 0.9ms/op 2445us/op-cpu [0ms - 428ms]
16 1093: 127.732: IO Summary: 178655 ops, 2976.451 ops/s, (270/542 r/w), 70.2mb/s, 457us cpu/op, 28.4ms latency 16 1093: 127.732: IO Summary: 178655 ops, 2976.451 ops/s, (270/542 r/w), 70.2mb/s, 457us cpu/op, 28.4ms latency
17 17
18 2014 1/1 GFS2 / fileserver / 60 seconds / only bldsv09 access / FC 18 * 2015 1/1 GFS2 / fileserver / 60 seconds / only bldsv09 access / FC
19 19
20 statfile1 19419ops 324ops/s 0.0mb/s 0.4ms/op 1967us/op-cpu [0ms - 230ms] 20 statfile1 19419ops 324ops/s 0.0mb/s 0.4ms/op 1967us/op-cpu [0ms - 230ms]
21 deletefile1 19419ops 324ops/s 0.0mb/s 8.5ms/op 6421us/op-cpu [0ms - 8915ms] 21 deletefile1 19419ops 324ops/s 0.0mb/s 8.5ms/op 6421us/op-cpu [0ms - 8915ms]
22 closefile3 19429ops 324ops/s 0.0mb/s 0.0ms/op 1396us/op-cpu [0ms - 0ms] 22 closefile3 19429ops 324ops/s 0.0mb/s 0.0ms/op 1396us/op-cpu [0ms - 0ms]
23 readfile1 19429ops 324ops/s 41.9mb/s 2.9ms/op 6144us/op-cpu [0ms - 8908ms] 23 readfile1 19429ops 324ops/s 41.9mb/s 2.9ms/op 6144us/op-cpu [0ms - 8908ms]
28 closefile1 19436ops 324ops/s 0.0mb/s 0.0ms/op 1338us/op-cpu [0ms - 0ms] 28 closefile1 19436ops 324ops/s 0.0mb/s 0.0ms/op 1338us/op-cpu [0ms - 0ms]
29 wrtfile1 19436ops 324ops/s 39.8mb/s 96.0ms/op 120915us/op-cpu [0ms - 9012ms] 29 wrtfile1 19436ops 324ops/s 39.8mb/s 96.0ms/op 120915us/op-cpu [0ms - 9012ms]
30 createfile1 19464ops 324ops/s 0.0mb/s 9.7ms/op 13736us/op-cpu [0ms - 7886ms] 30 createfile1 19464ops 324ops/s 0.0mb/s 9.7ms/op 13736us/op-cpu [0ms - 7886ms]
31 22867: 99.839: IO Summary: 213762 ops, 3562.315 ops/s, (324/648 r/w), 84.3mb/s, 1117us cpu/op, 43.5ms latency 31 22867: 99.839: IO Summary: 213762 ops, 3562.315 ops/s, (324/648 r/w), 84.3mb/s, 1117us cpu/op, 43.5ms latency
32 32
33 2014 1/1 ext4 / fileserver / 60 seconds / only bldsv09 access / SSD 33 * 2015 1/1 ext4 / fileserver / 60 seconds / only bldsv09 access / SSD
34 34
35 statfile1 41482ops 691ops/s 0.0mb/s 0.0ms/op 6404us/op-cpu [0ms - 0ms] 35 statfile1 41482ops 691ops/s 0.0mb/s 0.0ms/op 6404us/op-cpu [0ms - 0ms]
36 deletefile1 41487ops 691ops/s 0.0mb/s 1.2ms/op 7563us/op-cpu [0ms - 1571ms] 36 deletefile1 41487ops 691ops/s 0.0mb/s 1.2ms/op 7563us/op-cpu [0ms - 1571ms]
37 closefile3 41488ops 691ops/s 0.0mb/s 0.0ms/op 6276us/op-cpu [0ms - 2ms] 37 closefile3 41488ops 691ops/s 0.0mb/s 0.0ms/op 6276us/op-cpu [0ms - 2ms]
38 readfile1 41492ops 691ops/s 90.2mb/s 9.2ms/op 30000us/op-cpu [0ms - 1680ms] 38 readfile1 41492ops 691ops/s 90.2mb/s 9.2ms/op 30000us/op-cpu [0ms - 1680ms]
43 closefile1 41517ops 692ops/s 0.0mb/s 0.0ms/op 6335us/op-cpu [0ms - 2ms] 43 closefile1 41517ops 692ops/s 0.0mb/s 0.0ms/op 6335us/op-cpu [0ms - 2ms]
44 wrtfile1 41522ops 692ops/s 85.6mb/s 8.4ms/op 28669us/op-cpu [0ms - 675ms] 44 wrtfile1 41522ops 692ops/s 85.6mb/s 8.4ms/op 28669us/op-cpu [0ms - 675ms]
45 createfile1 41529ops 692ops/s 0.0mb/s 0.4ms/op 6989us/op-cpu [0ms - 1572ms] 45 createfile1 41529ops 692ops/s 0.0mb/s 0.4ms/op 6989us/op-cpu [0ms - 1572ms]
46 23036: 80.006: IO Summary: 456556 ops, 7608.630 ops/s, (691/1384 r/w), 181.3mb/s, 1016us cpu/op, 7.4ms latency 46 23036: 80.006: IO Summary: 456556 ops, 7608.630 ops/s, (691/1384 r/w), 181.3mb/s, 1016us cpu/op, 7.4ms latency
47 47
48 2014 1/1 ext4 / fileserver / 60 seconds / docker only bldsv09 / SSD 48 * 2015 1/1 ext4 / fileserver / 60 seconds / docker only bldsv09 / SSD
49 49
50 statfile1 45012ops 750ops/s 0.0mb/s 0.0ms/op 6428us/op-cpu [0ms - 1ms] 50 statfile1 45012ops 750ops/s 0.0mb/s 0.0ms/op 6428us/op-cpu [0ms - 1ms]
51 deletefile1 45015ops 750ops/s 0.0mb/s 0.4ms/op 7567us/op-cpu [0ms - 257ms] 51 deletefile1 45015ops 750ops/s 0.0mb/s 0.4ms/op 7567us/op-cpu [0ms - 257ms]
52 closefile3 45020ops 750ops/s 0.0mb/s 0.0ms/op 6320us/op-cpu [0ms - 3ms] 52 closefile3 45020ops 750ops/s 0.0mb/s 0.0ms/op 6320us/op-cpu [0ms - 3ms]
53 readfile1 45024ops 750ops/s 97.8mb/s 6.9ms/op 24806us/op-cpu [0ms - 302ms] 53 readfile1 45024ops 750ops/s 97.8mb/s 6.9ms/op 24806us/op-cpu [0ms - 302ms]
58 closefile1 45043ops 751ops/s 0.0mb/s 0.0ms/op 6377us/op-cpu [0ms - 2ms] 58 closefile1 45043ops 751ops/s 0.0mb/s 0.0ms/op 6377us/op-cpu [0ms - 2ms]
59 wrtfile1 45047ops 751ops/s 93.2mb/s 6.5ms/op 24195us/op-cpu [0ms - 289ms] 59 wrtfile1 45047ops 751ops/s 93.2mb/s 6.5ms/op 24195us/op-cpu [0ms - 289ms]
60 createfile1 45058ops 751ops/s 0.0mb/s 0.3ms/op 7260us/op-cpu [0ms - 258ms] 60 createfile1 45058ops 751ops/s 0.0mb/s 0.3ms/op 7260us/op-cpu [0ms - 258ms]
61 37: 79.282: IO Summary: 495354 ops, 8255.094 ops/s, (750/1501 r/w), 196.9mb/s, 1033us cpu/op, 5.5ms latency 61 37: 79.282: IO Summary: 495354 ops, 8255.094 ops/s, (750/1501 r/w), 196.9mb/s, 1033us cpu/op, 5.5ms latency
62 62
63 2014 1/1 GFS2 / fileserver / 60 seconds / docker to only bldsv09 access / FC 63 * 2015 1/1 GFS2 / fileserver / 60 seconds / docker to only bldsv09 access / FC
64 64
65 -v option で /media/fcs へ接続 65 -v option で /media/fcs へ接続
66 66
67 statfile1 27399ops 457ops/s 0.0mb/s 0.7ms/op 1869us/op-cpu [0ms - 13179ms] 67 statfile1 27399ops 457ops/s 0.0mb/s 0.7ms/op 1869us/op-cpu [0ms - 13179ms]
68 deletefile1 27381ops 456ops/s 0.0mb/s 3.6ms/op 6066us/op-cpu [0ms - 13194ms] 68 deletefile1 27381ops 456ops/s 0.0mb/s 3.6ms/op 6066us/op-cpu [0ms - 13194ms]
75 closefile1 27400ops 457ops/s 0.0mb/s 0.0ms/op 1341us/op-cpu [0ms - 1ms] 75 closefile1 27400ops 457ops/s 0.0mb/s 0.0ms/op 1341us/op-cpu [0ms - 1ms]
76 wrtfile1 27400ops 457ops/s 56.1mb/s 81.9ms/op 130988us/op-cpu [0ms - 13500ms] 76 wrtfile1 27400ops 457ops/s 56.1mb/s 81.9ms/op 130988us/op-cpu [0ms - 13500ms]
77 createfile1 27439ops 457ops/s 0.0mb/s 6.9ms/op 14198us/op-cpu [0ms - 13186ms] 77 createfile1 27439ops 457ops/s 0.0mb/s 6.9ms/op 14198us/op-cpu [0ms - 13186ms]
78 43: 92.660: IO Summary: 301419 ops, 5023.193 ops/s, (457/913 r/w), 118.9mb/s, 1187us cpu/op, 33.2ms latency 78 43: 92.660: IO Summary: 301419 ops, 5023.193 ops/s, (457/913 r/w), 118.9mb/s, 1187us cpu/op, 33.2ms latency
79 79
80 2014 1/1 GFS2 / fileserver / 60 seconds / bldsv09 access / FC 80 * 2015 1/1 GFS2 / fileserver / 60 seconds / bldsv09 access / FC
81 81
82 statfile1 26112ops 435ops/s 0.0mb/s 0.2ms/op 1669us/op-cpu [0ms - 291ms] 82 statfile1 26112ops 435ops/s 0.0mb/s 0.2ms/op 1669us/op-cpu [0ms - 291ms]
83 deletefile1 26111ops 435ops/s 0.0mb/s 4.4ms/op 5851us/op-cpu [0ms - 14536ms] 83 deletefile1 26111ops 435ops/s 0.0mb/s 4.4ms/op 5851us/op-cpu [0ms - 14536ms]
84 closefile3 26114ops 435ops/s 0.0mb/s 0.0ms/op 1187us/op-cpu [0ms - 0ms] 84 closefile3 26114ops 435ops/s 0.0mb/s 0.0ms/op 1187us/op-cpu [0ms - 0ms]
85 readfile1 26114ops 435ops/s 56.1mb/s 5.0ms/op 4831us/op-cpu [0ms - 14540ms] 85 readfile1 26114ops 435ops/s 56.1mb/s 5.0ms/op 4831us/op-cpu [0ms - 14540ms]
90 closefile1 26115ops 435ops/s 0.0mb/s 0.0ms/op 1206us/op-cpu [0ms - 0ms] 90 closefile1 26115ops 435ops/s 0.0mb/s 0.0ms/op 1206us/op-cpu [0ms - 0ms]
91 wrtfile1 26115ops 435ops/s 54.1mb/s 76.3ms/op 126556us/op-cpu [0ms - 14636ms] 91 wrtfile1 26115ops 435ops/s 54.1mb/s 76.3ms/op 126556us/op-cpu [0ms - 14636ms]
92 createfile1 26160ops 436ops/s 0.0mb/s 8.7ms/op 13211us/op-cpu [0ms - 14537ms] 92 createfile1 26160ops 436ops/s 0.0mb/s 8.7ms/op 13211us/op-cpu [0ms - 14537ms]
93 18999: 86.335: IO Summary: 287298 ops, 4787.839 ops/s, (435/870 r/w), 113.5mb/s, 1127us cpu/op, 35.0ms latency 93 18999: 86.335: IO Summary: 287298 ops, 4787.839 ops/s, (435/870 r/w), 113.5mb/s, 1127us cpu/op, 35.0ms latency
94 94
95 2014 1/6 GFS2 / fileserver / 60 seconds / bldsv10 access / FC 95 * 2015 1/6 GFS2 / fileserver / 60 seconds / bldsv10 access / FC
96 96
97 statfile1 23738ops 396ops/s 0.0mb/s 1.4ms/op 2917us/op-cpu [0ms - 13948ms] 97 statfile1 23738ops 396ops/s 0.0mb/s 1.4ms/op 2917us/op-cpu [0ms - 13948ms]
98 deletefile1 23718ops 395ops/s 0.0mb/s 8.4ms/op 6633us/op-cpu [0ms - 13969ms] 98 deletefile1 23718ops 395ops/s 0.0mb/s 8.4ms/op 6633us/op-cpu [0ms - 13969ms]
99 closefile3 23739ops 396ops/s 0.0mb/s 0.0ms/op 2433us/op-cpu [0ms - 0ms] 99 closefile3 23739ops 396ops/s 0.0mb/s 0.0ms/op 2433us/op-cpu [0ms - 0ms]
100 readfile1 23739ops 396ops/s 50.9mb/s 5.4ms/op 10531us/op-cpu [0ms - 14041ms] 100 readfile1 23739ops 396ops/s 50.9mb/s 5.4ms/op 10531us/op-cpu [0ms - 14041ms]
106 wrtfile1 23743ops 396ops/s 49.2mb/s 56.8ms/op 114702us/op-cpu [0ms - 14031ms] 106 wrtfile1 23743ops 396ops/s 49.2mb/s 56.8ms/op 114702us/op-cpu [0ms - 14031ms]
107 createfile1 23785ops 396ops/s 0.0mb/s 25.1ms/op 16142us/op-cpu [0ms - 13969ms] 107 createfile1 23785ops 396ops/s 0.0mb/s 25.1ms/op 16142us/op-cpu [0ms - 13969ms]
108 5359: 68.172: IO Summary: 261164 ops, 4352.327 ops/s, (396/791 r/w), 103.2mb/s, 1243us cpu/op, 36.3ms latency 108 5359: 68.172: IO Summary: 261164 ops, 4352.327 ops/s, (396/791 r/w), 103.2mb/s, 1243us cpu/op, 36.3ms latency
109 109
110 110
111 2014 1/6 GFS2 / fileserver / 60 seconds / bldsv10 and bldsv09 access / FC 111 * 2015 1/6 GFS2 / fileserver / 60 seconds / bldsv10 and bldsv09 access / FC
112 112
113 ansible を使った 2 node (bldsv09、bldsv10) から GFS2 上の別ディレクトリへの読み書き 113 ansible を使った 2 node (bldsv09、bldsv10) から GFS2 上の別ディレクトリへの読み書き
114 同じディレクトリへは filebench の性質上できなかった 114 同じディレクトリへは filebench の性質上できなかった
115 115
116 ansible -s -i hosts all -a 'filebench -f /home/taira/hg/benchmarks/fileserver.f' --sudo --ask-sudo-pass 116 ansible -s -i hosts all -a 'filebench -f /home/taira/hg/benchmarks/fileserver.f' --sudo --ask-sudo-pass
146 wrtfile1 4936ops 82ops/s 10.2mb/s 99.5ms/op 75415us/op-cpu [0ms - 10896ms] 146 wrtfile1 4936ops 82ops/s 10.2mb/s 99.5ms/op 75415us/op-cpu [0ms - 10896ms]
147 createfile1 4938ops 82ops/s 0.0mb/s 220.4ms/op 37436us/op-cpu [0ms - 16501ms] 147 createfile1 4938ops 82ops/s 0.0mb/s 220.4ms/op 37436us/op-cpu [0ms - 16501ms]
148 18603: 65.666: IO Summary: 54158 ops, 902.538 ops/s, (82/164 r/w), 21.1mb/s, 1473us cpu/op, 181.6ms latency 148 18603: 65.666: IO Summary: 54158 ops, 902.538 ops/s, (82/164 r/w), 21.1mb/s, 1473us cpu/op, 181.6ms latency
149 149
150 150
151 2014 1/12 ZFS / fileserver / 60 seconds / bldsv10 access / SSD 151 * 2014 1/12 ZFS / fileserver / 60 seconds / bldsv10 access / SSD
152 152
153 statfile1 38897ops 648ops/s 0.0mb/s 0.0ms/op 6531us/op-cpu [0ms - 2ms] 153 statfile1 38897ops 648ops/s 0.0mb/s 0.0ms/op 6531us/op-cpu [0ms - 2ms]
154 deletefile1 38902ops 648ops/s 0.0mb/s 2.7ms/op 7105us/op-cpu [0ms - 1203ms] 154 deletefile1 38902ops 648ops/s 0.0mb/s 2.7ms/op 7105us/op-cpu [0ms - 1203ms]
155 closefile3 38903ops 648ops/s 0.0mb/s 0.9ms/op 6688us/op-cpu [0ms - 1206ms] 155 closefile3 38903ops 648ops/s 0.0mb/s 0.9ms/op 6688us/op-cpu [0ms - 1206ms]
156 readfile1 38909ops 648ops/s 84.5mb/s 8.3ms/op 27683us/op-cpu [0ms - 218ms] 156 readfile1 38909ops 648ops/s 84.5mb/s 8.3ms/op 27683us/op-cpu [0ms - 218ms]
161 closefile1 38927ops 649ops/s 0.0mb/s 0.0ms/op 6489us/op-cpu [0ms - 0ms] 161 closefile1 38927ops 649ops/s 0.0mb/s 0.0ms/op 6489us/op-cpu [0ms - 0ms]
162 wrtfile1 38933ops 649ops/s 80.3mb/s 8.5ms/op 26005us/op-cpu [0ms - 1214ms] 162 wrtfile1 38933ops 649ops/s 80.3mb/s 8.5ms/op 26005us/op-cpu [0ms - 1214ms]
163 createfile1 38947ops 649ops/s 0.0mb/s 2.6ms/op 7003us/op-cpu [0ms - 1211ms] 163 createfile1 38947ops 649ops/s 0.0mb/s 2.6ms/op 7003us/op-cpu [0ms - 1211ms]
164 18334: 123.671: IO Summary: 428100 ops, 7134.431 ops/s, (648/1297 r/w), 169.9mb/s, 1221us cpu/op, 8.9ms latency 164 18334: 123.671: IO Summary: 428100 ops, 7134.431 ops/s, (648/1297 r/w), 169.9mb/s, 1221us cpu/op, 8.9ms latency
165 165
166
167 * 2014 1/12 GFS2 / fileserver / 60 seconds / bldsv10 access / FC
168 http://jpetazzo.github.io/2014/01/29/docker-device-mapper-resize/ を参考に、devicemapper が作る pool を FC 上に変更
169
170 1. Stop the Docker daemon.
171 2. Wipe out /var/lib/docker. (That should sound familiar, right?)
172 3. Create the storage directory: mkdir -p /var/lib/docker/devicemapper/devicemapper.
173 4. Create a data symbolic link in that directory, pointing to the device: ln -s /dev/sdb /var/lib/docker/devicemapper/devicemapper/data.
174 5. Restart Docker.
175 6. Check with docker info that the Data Space Total value is correct.
176
177 docker run --privileged -it fedora:20 /bin/bash で docker を実行し filebench を install
178
179 statfile1 41866ops 698ops/s 0.0mb/s 0.0ms/op 6235us/op-cpu [0ms - 1ms]
180 deletefile1 41869ops 698ops/s 0.0mb/s 0.2ms/op 6971us/op-cpu [0ms - 218ms]
181 closefile3 41874ops 698ops/s 0.0mb/s 0.0ms/op 6054us/op-cpu [0ms - 2ms]
182 readfile1 41881ops 698ops/s 91.0mb/s 8.8ms/op 29662us/op-cpu [0ms - 266ms]
183 openfile2 41886ops 698ops/s 0.0mb/s 0.1ms/op 6587us/op-cpu [0ms - 13ms]
184 closefile2 41890ops 698ops/s 0.0mb/s 0.0ms/op 6085us/op-cpu [0ms - 2ms]
185 appendfilerand1 41895ops 698ops/s 5.4mb/s 2.5ms/op 12903us/op-cpu [0ms - 14ms]
186 openfile1 41900ops 698ops/s 0.0mb/s 0.1ms/op 6640us/op-cpu [0ms - 9ms]
187 closefile1 41904ops 698ops/s 0.0mb/s 0.0ms/op 6122us/op-cpu [0ms - 2ms]
188 wrtfile1 41910ops 698ops/s 86.5mb/s 8.5ms/op 28960us/op-cpu [0ms - 272ms]
189 createfile1 41914ops 699ops/s 0.0mb/s 0.2ms/op 7029us/op-cpu [0ms - 15ms]
190 35: 76.024: IO Summary: 460789 ops, 7679.141 ops/s, (698/1397 r/w), 182.9mb/s, 1022us cpu/op, 6.8ms latency