ZFS send/receive & rsync

用 rsync 在兩組六顆硬碟的 raidz2 複製資料時發現速度很慢，根據之前的經驗 cpu 夠力的話不該這麼慢。觀察 cpu 與 disk 狀態：

  PID USERNAME  THR PRI NICE   SIZE    RES STATE   C   TIME   WCPU COMMAND
   11 root        4 155 ki31     0K    64K RUN     3  98:09 321.09% idle
 1430 root        1  43    0 70468K  5136K CPU3    3   0:15 31.40% rsync
 1428 root        1  42    0 66372K  5084K select  1   0:16 31.30% rsync
    0 root      308  -8    0     0K  4928K -       1   0:20 15.04% kernel

               capacity     operations    bandwidth
pool        alloc   free   read  write   read  write
----------  -----  -----  -----  -----  -----  -----
tank1       6.96G  10.9T      2      0  12.0K      0
tank2       10.7T   183G    695      0  85.7M      0
----------  -----  -----  -----  -----  -----  -----
tank1       6.96G  10.9T      0      0      0      0
tank2       10.7T   183G    769      0  95.6M      0
----------  -----  -----  -----  -----  -----  -----
tank1       6.96G  10.9T      0      0      0      0
tank2       10.7T   183G    776      0  96.2M      0
----------  -----  -----  -----  -----  -----  -----
tank1       6.96G  10.9T      0     70      0  8.61M
tank2       10.7T   183G    712      0  88.4M      0
----------  -----  -----  -----  -----  -----  -----
tank1       6.96G  10.9T      0  3.39K      0   424M
tank2       10.7T   183G    781      0  96.9M      0

不知道為什麼沒有邊讀邊寫，且讀的速度實在是有點慢... 改用 zfs send/receive 看看

  PID USERNAME  THR PRI NICE   SIZE    RES STATE   C   TIME   WCPU COMMAND
   11 root        4 155 ki31     0K    64K RUN     3  34.1H 270.70% idle
    0 root      307  -8    0     0K  4912K -       0 378:49 79.44% kernel
 2937 root        1  27    0 33548K  2820K CPU3    0   0:09 12.89% zfs
 2936 root        1  25    0 33548K  2740K pipelk  3   0:06  8.59% zfs

               capacity     operations    bandwidth
pool        alloc   free   read  write   read  write
----------  -----  -----  -----  -----  -----  -----
tank1       5.58G  10.9T     18  1.64K   127K   197M
tank2       10.3T   582G  1.56K      0   197M  3.27K
----------  -----  -----  -----  -----  -----  -----
tank1       6.19G  10.9T      0  3.15K      0   391M
tank2       10.3T   582G  2.34K      0   297M      0
----------  -----  -----  -----  -----  -----  -----
tank1       6.19G  10.9T      0  2.44K      0   304M
tank2       10.3T   582G  2.17K      0   276M      0
----------  -----  -----  -----  -----  -----  -----
tank1       6.81G  10.9T      0  1.05K      0   116M
tank2       10.3T   582G  1.95K      0   247M      0
----------  -----  -----  -----  -----  -----  -----
tank1       6.81G  10.9T      0  3.47K      0   427M
tank2       10.3T   582G  2.63K      0   334M      0

速度快了不少，最後 7TB 的資料花了九小時才複製完 @@

receiving full stream of tank2/data@2012-11-22 into tank1/data@2012-11-22
                received 6.88TB stream in 32266 seconds (224MB/sec)