Google Compute Engine 32coreを試してみる!

Google Compute Engine 32coreを試してみる!

あたらしいおもちゃゲット!(違

Fuel your hungry applications with our new, larger virtual machines

一番気になるのはNetworkBandwidth!

Instance 作成

bench3201を作成

Plain text
gcloud compute instances create bench3201 \
 --machine-type n1-highmem-32 \
 --zone us-central1-f \
 --local-ssd interface=nvme \
 --local-ssd interface=nvme \
 --local-ssd interface=nvme \
 --local-ssd interface=nvme \
 --image nvme-backports-debian-7-wheezy-v20141108 \
 --image-project gce-nvme

必要なPackage Install

Plain text
sudo apt-get update
sudo apt-get install -y build-essential git libtool gettext autoconf \
libgconf2-dev libncurses5-dev python-dev fio
sudo apt-get install mdadm iperf sysbench

benchmark

iperf

もう1インスタンス作る

bench3202

Plain text
gcloud compute instances create bench3202 \
 --machine-type n1-highmem-32 \
 --zone us-central1-f \
 --image nvme-backports-debian-7-wheezy-v20141108 \
 --image-project gce-nvme

Package Install

Plain text
sudo apt-get update
sudo apt-get install iperf

bench3201

Plain text
iperf -s

bench3202

Plain text
iperf -c bench3201 -P 32 -t 10

bench3201 結果

Plain text
 — — — — — — — — — — — — — — — — — — — — — — — — — — — — — —
Server listening on TCP port 5001
TCP window size: 85.3 KByte (default)
 — — — — — — — — — — — — — — — — — — — — — — — — — — — — — —
[ 4] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36446
[ 5] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36441
[ 6] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36445
[ 7] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36442
[ 8] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36451
[ 9] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36448
[ 11] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36461
[ 10] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36440
[ 12] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36456
[ 13] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36447
[ 14] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36454
[ 15] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36452
[ 16] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36449
[ 17] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36457
[ 18] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36459
[ 19] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36466
[ 20] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36462
[ 21] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36465
[ 22] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36464
[ 23] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36463
[ 24] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36453
[ 25] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36469
[ 26] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36470
[ 27] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36458
[ 28] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36472
[ 29] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36471
[ 30] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36473
[ 31] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36450
[ 32] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36460
[ 33] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36455
[ 34] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36468
[ 35] local 10.240.212.156 port 5001 connected with 10.240.98.26 port 36467
[ ID] Interval Transfer Bandwidth
[ 7] 0.0–10.0 sec 351 MBytes 294 Mbits/sec
[ 5] 0.0–10.0 sec 371 MBytes 310 Mbits/sec
[ 8] 0.0–10.0 sec 441 MBytes 368 Mbits/sec
[ 15] 0.0–10.0 sec 304 MBytes 254 Mbits/sec
[ 4] 0.0–10.1 sec 300 MBytes 250 Mbits/sec
[ 6] 0.0–10.1 sec 340 MBytes 283 Mbits/sec
[ 9] 0.0–10.1 sec 339 MBytes 283 Mbits/sec
[ 10] 0.0–10.1 sec 268 MBytes 224 Mbits/sec
[ 12] 0.0–10.0 sec 326 MBytes 272 Mbits/sec
[ 14] 0.0–10.0 sec 338 MBytes 282 Mbits/sec
[ 16] 0.0–10.0 sec 279 MBytes 233 Mbits/sec
[ 17] 0.0–10.1 sec 355 MBytes 296 Mbits/sec
[ 20] 0.0–10.1 sec 205 MBytes 171 Mbits/sec
[ 21] 0.0–10.1 sec 395 MBytes 330 Mbits/sec
[ 23] 0.0–10.1 sec 387 MBytes 323 Mbits/sec
[ 26] 0.0–10.1 sec 461 MBytes 385 Mbits/sec
[ 27] 0.0–10.1 sec 344 MBytes 287 Mbits/sec
[ 31] 0.0–10.0 sec 329 MBytes 275 Mbits/sec
[ 32] 0.0–10.1 sec 361 MBytes 301 Mbits/sec
[ 33] 0.0–10.1 sec 343 MBytes 286 Mbits/sec
[ 35] 0.0–10.1 sec 290 MBytes 242 Mbits/sec
[ 11] 0.0–10.1 sec 334 MBytes 279 Mbits/sec
[ 13] 0.0–10.1 sec 354 MBytes 296 Mbits/sec
[ 18] 0.0–10.1 sec 188 MBytes 157 Mbits/sec
[ 19] 0.0–10.1 sec 204 MBytes 170 Mbits/sec
[ 22] 0.0–10.1 sec 405 MBytes 338 Mbits/sec
[ 24] 0.0–10.1 sec 330 MBytes 275 Mbits/sec
[ 25] 0.0–10.1 sec 289 MBytes 241 Mbits/sec
[ 28] 0.0–10.1 sec 373 MBytes 311 Mbits/sec
[ 29] 0.0–10.1 sec 366 MBytes 305 Mbits/sec
[ 30] 0.0–10.1 sec 309 MBytes 258 Mbits/sec
[ 34] 0.0–10.1 sec 388 MBytes 323 Mbits/sec
[SUM] 0.0–10.1 sec 10.4 GBytes 8.89 Gbits/sec

bench3202 結果

Plain text
 — — — — — — — — — — — — — — — — — — — — — — — — — — — — — —
Client connecting to bench3201, TCP port 5001
TCP window size: 45.0 KByte (default)
 — — — — — — — — — — — — — — — — — — — — — — — — — — — — — —
[ 32] local 10.240.98.26 port 36473 connected with 10.240.212.156 port 5001
[ 3] local 10.240.98.26 port 36441 connected with 10.240.212.156 port 5001
[ 5] local 10.240.98.26 port 36446 connected with 10.240.212.156 port 5001
[ 7] local 10.240.98.26 port 36445 connected with 10.240.212.156 port 5001
[ 6] local 10.240.98.26 port 36442 connected with 10.240.212.156 port 5001
[ 15] local 10.240.98.26 port 36451 connected with 10.240.212.156 port 5001
[ 33] local 10.240.98.26 port 36448 connected with 10.240.212.156 port 5001
[ 9] local 10.240.98.26 port 36447 connected with 10.240.212.156 port 5001
[ 11] local 10.240.98.26 port 36454 connected with 10.240.212.156 port 5001
[ 12] local 10.240.98.26 port 36452 connected with 10.240.212.156 port 5001
[ 14] local 10.240.98.26 port 36456 connected with 10.240.212.156 port 5001
[ 31] local 10.240.98.26 port 36450 connected with 10.240.212.156 port 5001
[ 24] local 10.240.98.26 port 36461 connected with 10.240.212.156 port 5001
[ 4] local 10.240.98.26 port 36440 connected with 10.240.212.156 port 5001
[ 13] local 10.240.98.26 port 36449 connected with 10.240.212.156 port 5001
[ 17] local 10.240.98.26 port 36460 connected with 10.240.212.156 port 5001
[ 20] local 10.240.98.26 port 36459 connected with 10.240.212.156 port 5001
[ 26] local 10.240.98.26 port 36453 connected with 10.240.212.156 port 5001
[ 25] local 10.240.98.26 port 36462 connected with 10.240.212.156 port 5001
[ 27] local 10.240.98.26 port 36466 connected with 10.240.212.156 port 5001
[ 21] local 10.240.98.26 port 36463 connected with 10.240.212.156 port 5001
[ 16] local 10.240.98.26 port 36457 connected with 10.240.212.156 port 5001
[ 19] local 10.240.98.26 port 36458 connected with 10.240.212.156 port 5001
[ 8] local 10.240.98.26 port 36469 connected with 10.240.212.156 port 5001
[ 28] local 10.240.98.26 port 36464 connected with 10.240.212.156 port 5001
[ 10] local 10.240.98.26 port 36455 connected with 10.240.212.156 port 5001
[ 18] local 10.240.98.26 port 36470 connected with 10.240.212.156 port 5001
[ 34] local 10.240.98.26 port 36465 connected with 10.240.212.156 port 5001
[ 29] local 10.240.98.26 port 36468 connected with 10.240.212.156 port 5001
[ 30] local 10.240.98.26 port 36467 connected with 10.240.212.156 port 5001
[ 22] local 10.240.98.26 port 36471 connected with 10.240.212.156 port 5001
[ 23] local 10.240.98.26 port 36472 connected with 10.240.212.156 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0–10.0 sec 371 MBytes 312 Mbits/sec
[ 5] 0.0–10.0 sec 300 MBytes 253 Mbits/sec
[ 7] 0.0–10.0 sec 340 MBytes 286 Mbits/sec
[ 6] 0.0–10.0 sec 351 MBytes 296 Mbits/sec
[ 15] 0.0–10.0 sec 441 MBytes 371 Mbits/sec
[ 33] 0.0–10.0 sec 339 MBytes 285 Mbits/sec
[ 11] 0.0–10.0 sec 338 MBytes 284 Mbits/sec
[ 12] 0.0–10.0 sec 304 MBytes 255 Mbits/sec
[ 14] 0.0–10.0 sec 326 MBytes 274 Mbits/sec
[ 31] 0.0–10.0 sec 329 MBytes 277 Mbits/sec
[ 13] 0.0–10.0 sec 279 MBytes 234 Mbits/sec
[ 9] 0.0–10.0 sec 354 MBytes 298 Mbits/sec
[ 24] 0.0–10.0 sec 334 MBytes 281 Mbits/sec
[ 4] 0.0–10.0 sec 268 MBytes 225 Mbits/sec
[ 17] 0.0–10.0 sec 361 MBytes 303 Mbits/sec
[ 26] 0.0–10.0 sec 330 MBytes 277 Mbits/sec
[ 25] 0.0–10.0 sec 205 MBytes 172 Mbits/sec
[ 21] 0.0–10.0 sec 387 MBytes 325 Mbits/sec
[ 16] 0.0–10.0 sec 355 MBytes 298 Mbits/sec
[ 19] 0.0–10.0 sec 344 MBytes 289 Mbits/sec
[ 28] 0.0–10.0 sec 405 MBytes 340 Mbits/sec
[ 10] 0.0–10.0 sec 343 MBytes 288 Mbits/sec
[ 18] 0.0–10.0 sec 461 MBytes 387 Mbits/sec
[ 34] 0.0–10.0 sec 395 MBytes 332 Mbits/sec
[ 30] 0.0–10.0 sec 290 MBytes 244 Mbits/sec
[ 32] 0.0–10.0 sec 309 MBytes 260 Mbits/sec
[ 20] 0.0–10.0 sec 188 MBytes 158 Mbits/sec
[ 27] 0.0–10.0 sec 204 MBytes 171 Mbits/sec
[ 8] 0.0–10.0 sec 289 MBytes 242 Mbits/sec
[ 29] 0.0–10.0 sec 388 MBytes 325 Mbits/sec
[ 22] 0.0–10.0 sec 366 MBytes 307 Mbits/sec
[ 23] 0.0–10.0 sec 373 MBytes 313 Mbits/sec
[SUM] 0.0–10.0 sec 10.4 GBytes 8.95 Gbits/sec

おまけ

fio

以下の手順参考に
Google Compute Engine — LocalSSDGoogle Compute Engineの鬼速Local SSDを試す

以下のパラメータで統一
block: 4k
ioengine: libaio
iodepth: 128
runtime: 60

fio randread job 16

Plain text
benchmark: (groupid=0, jobs=16): err= 0: pid=1958
 read : io=135926MB, bw=2265.3MB/s, iops=579892 , runt= 60006msec

fio randwrite job 16

Plain text
benchmark: (groupid=0, jobs=16): err= 0: pid=2008
 write: io=137410MB, bw=2289.1MB/s, iops=586225 , runt= 60006msec

fio randread job 32

Plain text
benchmark: (groupid=0, jobs=32): err= 0: pid=1888
 read : io=46253MB, bw=789245KB/s, iops=197311 , runt= 60010msec

fio randwrite job 32

Plain text
benchmark: (groupid=0, jobs=32): err= 0: pid=2095
 write: io=38229MB, bw=652327KB/s, iops=163081 , runt= 60010msec

感想

buildが早かった!
あたりまえだけど・・・

DBとして使ったらこれってもしかすると・・・

転載:Google Compute Engine 32coreを試してみる!

この記事は Medium(@yusuke_h) からの転載です。