zero だと意味がないので。
測定対象は例のマシーン model name : AMD Turion(tm) II Neo N54L Dual-Core Processor
hddはWD20 Red
# ls -la /sdb1/ご注文はうさぎですか？？\#2.m2ts -rw-r--r-- 1 test test 2935983028 10月 18 13:17 /sdb1/ご注文はうさぎですか？？#2.m2ts
[root@chinachu] # zfs get compress,dedup NAME PROPERTY VALUE SOURCE dedup compression off default dedup dedup verify local dedup/gzip-1 compression gzip-1 local dedup/gzip-1 dedup verify inherited from dedup dedup/gzip-4 compression gzip-4 local dedup/gzip-4 dedup verify inherited from dedup dedup/gzip-9 compression gzip-9 local dedup/gzip-9 dedup verify inherited from dedup dedup/lzjb compression lzjb local dedup/lzjb dedup verify inherited from dedup dedup/off compression off local dedup/off dedup verify inherited from dedup dedup/zle compression zle local dedup/zle dedup verify inherited from dedup zfs compression off default zfs dedup off default zfs/gzip-1 compression gzip-1 local zfs/gzip-1 dedup off default zfs/gzip-4 compression gzip-4 local zfs/gzip-4 dedup off default zfs/gzip-9 compression gzip-9 local zfs/gzip-9 dedup off default zfs/lzjb compression lzjb local zfs/lzjb dedup off default zfs/off compression off local zfs/off dedup off default zfs/zle compression zle local zfs/zle dedup off default
xfs
cp /sdb1/ご注文はうさぎですか？？\#2.m2ts /tv/ 0.02s user 3.23s system 33% cpu 9.783 total
zfs set compression=off
cp /sdb1/ご注文はうさぎですか？？\#2.m2ts /tv/ 0.08s user 4.26s system 9% cpu 46.269 total
zfs set compression=off,dedup=verify
一回目
cp /sdb1/ご注文はうさぎですか？？\#2.m2ts /dedup/off 0.10s user 3.89s system 3% cpu 1:23.71 total
２発目
cp /sdb1/ご注文はうさぎですか？？\#2.m2ts /dedup/off 0.10s user 3.89s system 3% cpu 1:40.57 total
zfs set compression=zle
cp /sdb1/ご注文はうさぎですか？？\#2.m2ts /tv/ 0.06s user 4.24s system 9% cpu 46.867 total
zfs set compression=zle,dedup=verify
cp /sdb1/ご注文はうさぎですか？？\#2.m2ts /dedup/zle/ 0.09s user 3.91s system 4% cpu 1:39.68 total
zfs set compression=lzjb
cp /sdb1/ご注文はうさぎですか？？\#2.m2ts /tv/ 0.05s user 3.97s system 7% cpu 53.559 total
zfs set compression=lzjb,dedup=verify
cp /sdb1/ご注文はうさぎですか？？\#2.m2ts /dedup/lzjb/ 0.08s user 3.86s system 3% cpu 2:05.88 total
zfs set compression=gzip-1
cp /sdb1/ご注文はうさぎですか？？\#2.m2ts /tv/ 0.10s user 4.24s system 2% cpu 2:50.90 total
zfs set compression=gzip-1,dedup=verify
cp /sdb1/ご注文はうさぎですか？？\#2.m2ts /dedup/gzip-1 0.06s user 3.84s system 1% cpu 4:03.19 total
zfs set compression=gzip-4 tv
cp /sdb1/ご注文はうさぎですか？？\#2.m2ts /tv/ 0.08s user 3.82s system 2% cpu 3:03.95 total
zfs set compression=gzip-4,dedup=verify
cp /sdb1/ご注文はうさぎですか？？\#2.m2ts /dedup/gzip-4 0.09s user 3.83s system 1% cpu 4:15.79 total
zfs set compression=gzip-9
cp /sdb1/ご注文はうさぎですか？？\#2.m2ts /tv/ 0.06s user 4.00s system 2% cpu 3:20.35 total
zfs set compression=gzip-9,dedup=verify
cp /sdb1/ご注文はうさぎですか？？\#2.m2ts /dedup/gzip-9 0.05s user 3.87s system 1% cpu 4:33.64 total
df -k
[root@chinachu] # df -k ファイルシス 1K-ブロック 使用 使用可 使用% マウント位置 rootfs 330215 217031 96135 70% / /dev/sdb1 1952559608 2900996 1949658612 1% /sdb1 /dev/sda1 1952559608 2900996 1949658612 1% /tv zfs 1898597109 2869223 1895727886 1% /zfs zfs/gzip-9 1898575986 2848100 1895727886 1% /zfs/gzip-9 zfs/gzip-4 1898577146 2849260 1895727886 1% /zfs/gzip-4 zfs/gzip-1 1898579393 2851507 1895727886 1% /zfs/gzip-1 zfs/zle 1898597049 2869163 1895727886 1% /zfs/zle zfs/lzjb 1898591748 2863862 1895727886 1% /zfs/lzjb zfs/off 1898597102 2869216 1895727886 1% /zfs/off dedup 1915255848 2869352 1912386496 1% /dedup dedup/gzip-1 1915238093 2851597 1912386496 1% /dedup/gzip-1 dedup/gzip-4 1915235860 2849364 1912386496 1% /dedup/gzip-4 dedup/gzip-9 1915234712 2848216 1912386496 1% /dedup/gzip-9 dedup/off 1915255841 2869345 1912386496 1% /dedup/off dedup/lzjb 1915250494 2863998 1912386496 1% /dedup/lzjb dedup/zle 1915255813 2869317 1912386496 1% /dedup/zle
| 種類 | 元ファイルのブロック | 先ファイルのブロック | 占有率 | かかった時間 |
|---|---|---|---|---|
| xfs | 2900996 | 2900996 | 100.00% | 00:09.8 |
| zfs/off | 2900996 | 2869216 | 98.90% | 00:46.3 |
| zfs/zle | 2900996 | 2869163 | 98.90% | 00:46.9 |
| zfs/lzjb | 2900996 | 2863862 | 98.72% | 00:53.6 |
| dedup/zle | 2900996 | 2869317 | 98.91% | 01:39.7 |
| dedup/off | 2900996 | 2869345 | 98.91% | 01:40.6 |
| dedup/lzjb | 2900996 | 2863998 | 98.72% | 02:05.9 |
| zfs/gzip-1 | 2900996 | 2851507 | 98.29% | 02:50.9 |
| zfs/gzip-4 | 2900996 | 2849260 | 98.22% | 03:04.0 |
| zfs/gzip-9 | 2900996 | 2848100 | 98.18% | 03:20.3 |
| dedup/gzip-1 | 2900996 | 2851597 | 98.30% | 04:03.2 |
| dedup/gzip-4 | 2900996 | 2849364 | 98.22% | 04:15.8 |
| dedup/gzip-9 | 2900996 | 2848216 | 98.18% | 04:33.6 |
dedup dedupratio 6.11x -
dedup/zle はありだな。
その後各データセットにごちうさ？？#1 (BS-11) .m2ts をコピった後
| PROPERTY | zfs | dedup |
|---|---|---|
| size | 1.81T | 1.81T |
| capacity | 2% | 0% |
| altroot | - | - |
| health | ONLINE | ONLINE |
| version | 23 | 23 |
| bootfs | - | - |
| delegation | on | on |
| autoreplace | off | off |
| cachefile | - | - |
| failmode | wait | wait |
| listsnapshots | off | off |
| autoexpand | off | off |
| dedupditto | 0 | 0 |
| dedupratio | 1.00x | 6.11x |
| free | 1.77T | 1.81T |
| allocated | 43.2G | 7.11G |
Simulated DDT histogram:
bucket allocated referenced
______ ______________________________ ______________________________
refcnt blocks LSIZE PSIZE DSIZE blocks LSIZE PSIZE DSIZE
------ ------ ----- ----- ----- ------ ----- ----- -----
1 3.20K 409M 317M 317M 3.20K 409M 317M 317M
2 469 58.6M 58.6M 58.6M 1.33K 170M 170M 170M
4 53.5K 6.69G 6.69G 6.69G 341K 42.7G 42.7G 42.7G
Total 57.2K 7.15G 7.06G 7.06G 346K 43.2G 43.1G 43.1G
dedup = 6.11, compress = 1.00, copies = 1.00, dedup * compress / copies = 6.12
