{"id":16145,"date":"2020-07-21T01:57:08","date_gmt":"2020-07-20T17:57:08","guid":{"rendered":"http:\/\/www.rao-bing.cn\/?p=16145"},"modified":"2020-09-04T14:23:35","modified_gmt":"2020-09-04T06:23:35","slug":"nvme-over-tcp-and-ana","status":"publish","type":"post","link":"http:\/\/www.rao-bing.cn\/index.php\/2020\/07\/21\/16145\/","title":{"rendered":"NVMe over TCP and ANA"},"content":{"rendered":"

nvme over fabrics \u662f\u6bd4SRP\uff0c iSER \u6548\u7387\u66f4\u9ad8\u7684\u5b58\u50a8\u534f\u8bae\uff0c\u4e3b\u8981\u8868\u73b0\u5728\u5ef6\u65f6\u964d\u4f4e\uff0ciops\u548c\u672c\u5730\u4f7f\u7528\u76f8\u5dee\u65e0\u51e0\u3002\u4eceNVMe \u2013oF 1.4\u5f00\u59cb\uff0c\u6709\u4e86ANA\uff08Asymmetric Namespace Access\uff09\uff0c\u7b80\u5355\u8bf4\uff0c\u5b83\u5c31\u76f8\u5f53\u4e8eSCSI\u5bb6\u65cf\u534f\u8bae\uff08iSCSI\uff0cSRP\uff0ciSER\uff09\u7684ALUA\uff0c\u53ef\u4ee5\u5b9e\u73b0\u6240\u8c13\u7684\u201c\u53cc\u6d3b\u201d\u3002ALUA\u548cANA\u7684\u8be6\u7ec6\u5b9a\u4e49\u6211\u5c31\u4e0d\u5e9f\u8bdd\u4e86\uff0c\u5927\u5bb6\u90fd\u53ef\u4ee5\u53bb\u7f51\u4e0a\u641c\uff0c\u8fd9\u7bc7\u6587\u7ae0\u4e5f\u53ea\u662f\u8bb0\u5f55\u4e0b\u5982\u4f55\u914d\u7f6e\u5b9e\u73b0ANA\uff0c\u4ee5\u53ca\u5982\u4f55\u548clinux multipath-tool\u914d\u5408\u3002\u81f3\u4e8e\u539f\u751f\u7684nvme multipath\uff0c\u4e0d\u662f\u6211\u4eec\u7684\u91cd\u70b9\uff0c\u6709\u65f6\u95f4\u539f\u751f\u7684nvme multipath\u5355\u5199\u4e00\u7bc7\u3002<\/p>\n

\u672c\u6b21\u6d4b\u8bd5\u672c\u60f3\u7528nvme over fabrics\uff08infiniband)\uff0c\u4f46\u662f\u5b9e\u9a8c\u670d\u52a1\u5668\u88ab\u540c\u4e8b\u5360\u7528\uff0c\u5728ANA\u8fd9\u5757\uff0cnvme over fabrics\u548cnvme over tcp\u6ca1\u4ec0\u4e48\u533a\u522b\uff0c\u6240\u4ee5\u7528\u865a\u62df\u673a\u548cnvme over tcp\u6765\u6f14\u793aANA\u7684\u914d\u7f6e\u3002<\/p>\n

\u9996\u5148\uff0cnvme over tcp\u5e94\u8be5\u8981\u5347\u7ea7\u5185\u6838\u5230\u6bd4\u8f83\u9ad8\u7684\u7248\u672c\uff0c\u5177\u4f53\u4ece\u54ea\u4e2a\u7248\u672c\u5f00\u59cb\u652f\u6301\u7684\u6211\u4e0d\u8bb0\u5f97\u4e86\uff0c\u53ea\u786e\u5b9a\u662f5.x\uff0c\u672c\u6b21\u6d4b\u8bd5\u7528\u7684\u6700\u8fd1\u7684\u7a33\u5b9a\u7248\u672c5.7.8\u3002\u5f53\u7136\uff0c\u5982\u679c\u4f7f\u7528nvme over fabrcis (IB or RoCE)+ ANA\uff0c\u53ef\u4ee5\u75284.19.x\u5185\u6838\u3002<\/p>\n

\u5176\u6b21\uff0c\u652f\u6301ANA\u7684multipath-tool\u7248\u672c\u81f3\u5c11\u662fredhat(centos) 7.7 \u81ea\u5e26\u7684device-mapper-mulitpath 0.49-127, \u56e0\u4e3a\u624b\u5934\u6ca1\u6709x86\u7248\u76847.7\uff0c\u5c31\u7528\u4e867.8\uff0c\u4f46\u662f\u6211\u4e5f\u4e0d\u662f\u6574\u4e2aOS\u90fd\u662f7.8\uff0c\u800c\u662f\u5728\u5b89\u88c5\u4e86centos7.5\u4e4b\u540e\uff0c\u5355\u72ec\u5347\u7ea7device-mapper-multipath\u76f8\u5173\u8f6f\u4ef6\u5305\u52300.49-131\u3002<\/p>\n

\u6240\u4ee5\u6211\u7684\u914d\u7f6e\u6700\u540e\u5c31\u662f2\u53f0centos75\u7684VM\uff0c\u5347\u7ea7\u5185\u6838\u52305.7.8\uff0c\u5347\u7ea7device-mapper-multipath\u52300.49-131\u3002<\/p>\n

\u7f16\u8bd1\u5185\u6838\u7684\u6b65\u9aa4\u5c31\u4e0d\u5e9f\u8bdd\u4e86\uff0c\u4e3b\u8981\u7684\u5f53\u7136\u662f\u8981\u628anvme over tcp\u6a21\u5757\u9009\u4e0a\uff0c\u5177\u4f53\u65b9\u6cd5\u53ef\u4ee5\u53c2\u8003mellanox\u7684 https:\/\/community.mellanox.com\/s\/article\/howto-compile-linux-kernel-for-nvme-over-fabrics<\/a>\uff0c\u6587\u7ae0\u8bb2\u7684\u662f\u600e\u4e48\u7f16\u8bd14.8\uff0c\u4f46\u662f5.7.8\u7684\u8fc7\u7a0b\u4e5f\u5dee\u4e0d\u591a\u3002<\/p>\n

\u7f16\u8bd1\u540e\uff0c\u5185\u6838\u4f1a\u81ea\u5e26nvme over tcp target \u548c nvme over tcp host driver\uff1a<\/p>\n

[root@centos75vm6 ~]# modprobe nvmet\n[root@centos75vm6 ~]# modprobe nvmet_tcp\n[root@centos75vm6 ~]# lsmod |grep nvme\nnvmet_tcp\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 28672\u00a0 0 \nnvmet\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 102400\u00a0 1 nvmet_tcp\nnvme_tcp\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 36864\u00a0 0 \nnvme_fabrics\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 28672\u00a0 1 nvme_tcp\nnvme\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 49152\u00a0 0 \nnvme_core\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 98304\u00a0 3 nvme_tcp,nvme,nvme_fabrics\nt10_pi\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 16384\u00a0 2 sd_mod,nvme_core<\/pre>\n
\u4e3a\u4e86\u65b9\u4fbf\u914d\u7f6e\u548c\u6d4b\u8bd5\uff0c\u6211\u4eec\u8fd8\u8981\u5b89\u88c5\u6700\u65b0\u7684nvme-cli\u548cnvmetcli\uff0c\u4e00\u4e2a\u662fhost\u7aef\u7528\uff0c\u4e00\u4e2a\u662ftarget\u7aef\u7528\u3002<\/p>\n
centos 7.5 \u81ea\u5e26\u7684\u4e24\u4e2a\u5de5\u5177\u7684\u7248\u672c\u6bd4\u8f83\u65e7\uff0c\u5efa\u8bae\u4e0b\u8f7d\u6700\u65b0\u7248\u672c\uff1a<\/p>\n
nvme-cli\uff1ahttps:\/\/github.com\/linux-nvme\/nvme-cli\/releases<\/a>\uff0c\u6211\u7528\u76841.12\u7248<\/p>\n
nvmetcli\uff1ahttp:\/\/git.infradead.org\/users\/hch\/nvmetcli.git<\/a>\uff0c\u6211\u7528\u7684\u662f0.7\u7248<\/p>\n
\u4e0b\u9762\u7684setup\u8fc7\u7a0b\uff1a<\/p>\n
1. \u5b89\u88c5\u4e24\u4e2acentos7.5 \u865a\u62df\u673a\uff0c\u5404\u67093\u4e2a\u7f51\u5361\uff0c\u4fdd\u8bc13\u4e2a\u7f51\u5361\u5728\u4e09\u4e2a\u4e0d\u540c\u7f51\u6bb5\uff0c\u5f7c\u6b64\u80fdping\u901a\u3002<\/p>\n\n\n\n\n\n\n
<\/td>\ncentos75vm6<\/td>\ncentos75vm7<\/td>\n<\/tr>\n
\u7f51\u53611\uff1aens33<\/td>\n192.168.204.126<\/td>\n192.168.204.127<\/td>\n<\/tr>\n
\u7f51\u53612\uff1aens34<\/td>\n192.168.42.126<\/td>\n192.168.42.127<\/td>\n<\/tr>\n
\u7f51\u53613\uff1aens35<\/td>\n192.168.10.126<\/td>\n192.168.10.127<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n
2.\u00a0\u00a0 \u5728\u5176\u4e2d\u4e00\u53f0vm\u6dfb\u52a0\u4e00\u4e2a\u865a\u62dfnvme\u8bbe\u5907\uff0c\u5bf9\u5e94\u8bbe\u5907\u540d\u4e3a\/dev\/nvme0n1<\/p>\n
3.\u00a0 \u4f7f\u7528nvmetcli\u914d\u7f6etarget\u7aef\uff0c\u4e09\u4e2aport\uff0c\u4e24\u4e2a\u662foptimized\uff0c\u4e00\u4e2a\u662fnon-optimized\uff1a<\/p>\n
[root@centos75vm7 dist]# nvmetcli\n\/> ls\no- \/ ......................................................................................................................... [...]\n\u00a0\u00a0 o- hosts ................................................................................................................... [...]\n\u00a0\u00a0 o- ports ................................................................................................................... [...]\n\u00a0\u00a0 | o- 1 ................................................. [trtype=tcp, traddr=192.168.10.127, trsvcid=4420, inline_data_size=16384]\n\u00a0\u00a0 | | o- ana_groups .......................................................................................................... [...]\n\u00a0\u00a0 | | | o- 1 ..................................................................................................... [state=optimized]\n\u00a0\u00a0 | | o- referrals ........................................................................................................... [...]\n\u00a0\u00a0 | | o- subsystems .......................................................................................................... [...]\n\u00a0\u00a0 | |\u00a0\u00a0 o- testnqn ........................................................................................................... [...]\n\u00a0\u00a0 | o- 2 ................................................. [trtype=tcp, traddr=192.168.42.127, trsvcid=4420, inline_data_size=16384]\n\u00a0\u00a0 | | o- ana_groups .......................................................................................................... [...]\n\u00a0\u00a0 | | | o- 1 ..................................................................................................... [state=optimized]\n\u00a0\u00a0 | | o- referrals ........................................................................................................... [...]\n\u00a0\u00a0 | | o- subsystems .......................................................................................................... [...]\n\u00a0\u00a0 | |\u00a0\u00a0 o- testnqn ........................................................................................................... [...]\n\u00a0\u00a0 | o- 3 ................................................ [trtype=tcp, traddr=192.168.204.127, trsvcid=4420, inline_data_size=16384]\n\u00a0\u00a0 |\u00a0\u00a0 o- ana_groups .......................................................................................................... [...]\n\u00a0\u00a0 |\u00a0\u00a0 | o- 1 ................................................................................................. [state=non-optimized]\n\u00a0\u00a0 |\u00a0\u00a0 o- referrals ........................................................................................................... [...]\n\u00a0\u00a0 |\u00a0\u00a0 o- subsystems .......................................................................................................... [...]\n\u00a0\u00a0 |\u00a0\u00a0\u00a0\u00a0 o- testnqn ........................................................................................................... [...]\n\u00a0\u00a0 o- subsystems .............................................................................................................. [...]\n\u00a0\u00a0\u00a0\u00a0 o- testnqn ................................................................. [version=1.3, allow_any=1, serial=6945bae9473e0b0e]\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 o- allowed_hosts ....................................................................................................... [...]\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 o- namespaces .......................................................................................................... [...]\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 o- 1 ...................................... [path=\/dev\/nvme0n1, uuid=fb5bc33c-26b5-41f5-85f7-7fcaa70f8574, grpid=1, enabled]\n\/><\/pre>\n
\u6ce8\u610f<\/p>\n
set addr trtype=tcp
\nset addr adrfam=ipv4<\/p>\n
\u8fd9\u4e2a\u7248\u672c\u6bd4\u4ee5\u524d\u7248\u672c\uff0c\u5728\u6bcf\u4e2aport\u91cc\u9762\u591a\u8bbe\u7f6e\u4e00\u4e2a\u540d\u4e3a1\u7684ana_groups\u4e2d\u7684state\uff0c\u4e00\u4e2a\u662fnon-optimized\uff0c\u4e24\u4e2a\u662foptimized\uff0c\u5176\u4ed6\u7684\u548c\u666e\u901a\u7684nvme over fabrics\u6ca1\u5565\u533a\u522b\uff0c\u8bbe\u7f6e\u5b8c\u6210\u540e\u7684json\u6587\u4ef6:<\/p>\n
{\n\u00a0\u00a0 \"hosts\": [],\n\u00a0\u00a0 \"ports\": [\n\u00a0\u00a0\u00a0\u00a0 {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"addr\": {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"adrfam\": \"ipv4\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"traddr\": \"192.168.204.127\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"treq\": \"not specified\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"trsvcid\": \"4420\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"trtype\": \"tcp\"\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 },\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"ana_groups\": [\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"ana\": {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"state\": \"non-optimized\"\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 },\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"grpid\": 1\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 }\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 ],\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"param\": {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"inline_data_size\": \"16384\"\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 },\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"portid\": 3,\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"referrals\": [],\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"subsystems\": [\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"testnqn\"\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 ]\n\u00a0\u00a0\u00a0\u00a0 },\n\u00a0\u00a0\u00a0\u00a0 {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"addr\": {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"adrfam\": \"ipv4\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"traddr\": \"192.168.42.127\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"treq\": \"not specified\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"trsvcid\": \"4420\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"trtype\": \"tcp\"\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 },\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"ana_groups\": [\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"ana\": {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"state\": \"optimized\"\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 },\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"grpid\": 1\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 }\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 ],\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"param\": {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"inline_data_size\": \"16384\"\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 },\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"portid\": 2,\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"referrals\": [],\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"subsystems\": [\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"testnqn\"\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 ]\n\u00a0\u00a0\u00a0\u00a0 },\n\u00a0\u00a0\u00a0\u00a0 {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"addr\": {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"adrfam\": \"ipv4\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"traddr\": \"192.168.10.127\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"treq\": \"not specified\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"trsvcid\": \"4420\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"trtype\": \"tcp\"\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 },\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"ana_groups\": [\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"ana\": {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"state\": \"optimized\"\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 },\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"grpid\": 1\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 }\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 ],\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"param\": {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"inline_data_size\": \"16384\"\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 },\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"portid\": 1,\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"referrals\": [],\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"subsystems\": [\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"testnqn\"\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 ]\n\u00a0\u00a0\u00a0\u00a0 }\n\u00a0\u00a0 ],\n\u00a0\u00a0 \"subsystems\": [\n\u00a0\u00a0\u00a0\u00a0 {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"allowed_hosts\": [],\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"attr\": {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"allow_any_host\": \"1\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"cntlid_max\": \"65519\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"cntlid_min\": \"1\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"model\": \"hthorizon\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"serial\": \"6945bae9473e0b0e\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"version\": \"1.3\"\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 },\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"namespaces\": [\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"ana_grpid\": 1,\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"device\": {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"nguid\": \"00000000-0000-0000-0000-000000000000\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"path\": \"\/dev\/nvme0n1\",\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"uuid\": \"fb5bc33c-26b5-41f5-85f7-7fcaa70f8574\"\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 },\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"enable\": 1,\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"nsid\": 1\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 }\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 ],\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"nqn\": \"testnqn\"\n\u00a0\u00a0\u00a0\u00a0 }\n\u00a0\u00a0 ]\n}<\/pre>\n
4\u00a0 \u5728host\u7aef\u8fde\u63a5\u548cnvme over fabris\u533a\u522b\u4e0d\u5927\uff0c-t \u540e\u9762\u628ardma\u6362\u6210tcp\u5c31\u53ef\u4ee5\uff1a<\/p>\n
[root@centos75vm6 ~]# nvme discover -t tcp -a 192.168.204.127 -s 4420\n\nDiscovery Log Number of Records 1, Generation counter 4\n=====Discovery Log Entry 0======\ntrtype:\u00a0 tcp\nadrfam:\u00a0 ipv4\nsubtype: nvme subsystem\ntreq:\u00a0\u00a0\u00a0 not specified, sq flow control disable supported\nportid:\u00a0 3\ntrsvcid: 4420\nsubnqn:\u00a0 testnqn\ntraddr:\u00a0 192.168.204.127\nsectype: none\n\n[root@centos75vm6 ~]# nvme connect -t tcp -a 192.168.204.127 -s 4420 -n testnqn\n[root@centos75vm6 ~]# \n[root@centos75vm6 ~]# nvme list\nNode\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 SN\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Model\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Namespace Usage\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Format\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 FW Rev\u00a0 \n---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- --------\n\/dev\/nvme0n1\u00a0\u00a0\u00a0\u00a0 0e0b3e47e9ba4569\u00a0\u00a0\u00a0\u00a0 hthorizon\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 1\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 4.29\u00a0 GB \/\u00a0\u00a0 4.29\u00a0 GB\u00a0\u00a0\u00a0 512\u00a0\u00a0 B +\u00a0 0 B\u00a0\u00a0 5.7.8<\/pre>\n
\u4f9d\u6b21\u8fde\u63a5\u53e6\u4e24\u4e2aport\uff1a<\/p>\n
[root@centos75vm6 ~]# nvme connect -t tcp -a 192.168.42.127 -s 4420 -n testnqn\u00a0\u00a0 \n[root@centos75vm6 ~]# nvme connect -t tcp -a 192.168.10.127 -s 4420 -n testnqn\u00a0 \n[root@centos75vm6 ~]# \n[root@centos75vm6 ~]# \n[root@centos75vm6 ~]# nvme list\nNode\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 SN\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Model\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Namespace Usage\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Format\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 FW Rev\u00a0 \n---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- --------\n\/dev\/nvme0n1\u00a0\u00a0\u00a0\u00a0 0e0b3e47e9ba4569\u00a0\u00a0\u00a0\u00a0 hthorizon\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 1\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 4.29\u00a0 GB \/\u00a0\u00a0 4.29\u00a0 GB\u00a0\u00a0\u00a0 512\u00a0\u00a0 B +\u00a0 0 B\u00a0\u00a0 5.7.8\u00a0\u00a0 \n\/dev\/nvme1n1\u00a0\u00a0\u00a0\u00a0 0e0b3e47e9ba4569\u00a0\u00a0\u00a0\u00a0 hthorizon\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 1\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 4.29\u00a0 GB \/\u00a0\u00a0 4.29\u00a0 GB\u00a0\u00a0\u00a0 512\u00a0\u00a0 B +\u00a0 0 B\u00a0\u00a0 5.7.8\u00a0\u00a0 \n\/dev\/nvme2n1\u00a0\u00a0\u00a0\u00a0 0e0b3e47e9ba4569\u00a0\u00a0\u00a0\u00a0 hthorizon\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 1\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 4.29\u00a0 GB \/\u00a0\u00a0 4.29\u00a0 GB\u00a0\u00a0\u00a0 512\u00a0\u00a0 B +\u00a0 0 B\u00a0\u00a0 5.7.8<\/pre>\n
5. \u914d\u7f6emultipath.conf<\/p>\n
defaults {\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 polling_interval\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 10\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 path_selector\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"round-robin 0\"\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 path_grouping_policy\u00a0\u00a0\u00a0\u00a0 group_by_prio\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 prio\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 ana\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 path_checker\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 readsector0\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 failback\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 immediate\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 no_path_retry\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 fail\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 user_friendly_names\u00a0\u00a0\u00a0\u00a0 yes\n}<\/pre>\n
\u4e24\u4e2a\u4e3b\u8981\u53c2\u6570\uff1apath_selector \u4e00\u5b9a\u8981\u662f group_by_prio\uff0cprio \u503c\u4e00\u5b9a\u8981\u662fana<\/p>\n
[root@centos75vm6 etc]# multipath \u2013ll\n\n\u2026\u2026\nmpathf (uuid.fb5bc33c-26b5-41f5-85f7-7fcaa70f8574) dm-8 NVME,hthorizon\nsize=4.0G features='0' hwhandler='0' wp=rw\n|-+- policy='round-robin 0' prio=50 status=active\n| |- 1:2:1:1 nvme1n1 259:1 active ready running\n| `- 2:3:1:1 nvme2n1 259:2 active ready running\n`-+- policy='round-robin 0' prio=10 status=enabled\n`- 0:1:1:1 nvme0n1 259:0 active ready running<\/pre>\n
\u6709\u65f6\uff0c\u5728\u771f\u6b63\u6709io\u64cd\u4f5c\u4e4b\u524d\uff0c\u4e24\u4e2a\u7ec4\u7684status\u90fd\u662fenabled\uff0c\u6b63\u5e38\u3002<\/p>\n
6\u00a0 \u6d4b\u8bd5\uff1a<\/p>\n
\u5728centos75vm6 \u5bf9 dm-8 \u8fdb\u884cfio\u6d4b\u8bd5\uff1a<\/p>\n
fio --rw=randread --bs=8k --numjobs=4 --iodepth=32 --runtime=120 --ioengine=libaio\u00a0 --direct=1 --time_based --name task1 --filename=\/dev\/dm-8<\/pre>\n
\u53e6\u5f00\u4e00\u4e2a\u7a97\u53e3\u67e5\u770biostat\uff1a<\/p>\n
avg-cpu:\u00a0 %user\u00a0\u00a0 %nice %system %iowait\u00a0 %steal\u00a0\u00a0 %idle\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 1.40\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 68.91\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 29.69\n\nDevice:\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 rrqm\/s\u00a0\u00a0 wrqm\/s\u00a0\u00a0\u00a0\u00a0 r\/s\u00a0\u00a0\u00a0\u00a0 w\/s\u00a0\u00a0\u00a0 rkB\/s\u00a0\u00a0\u00a0 wkB\/s avgrq-sz avgqu-sz\u00a0\u00a0 await r_await w_await\u00a0 svctm\u00a0 %util\nscd0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nsda\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 1.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 4.50\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 48.75\u00a0\u00a0\u00a0 21.67\u00a0\u00a0\u00a0\u00a0 0.01\u00a0\u00a0\u00a0 2.11\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 2.11\u00a0\u00a0 0.33\u00a0\u00a0 0.15\ndm-0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 5.50\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 48.75\u00a0\u00a0\u00a0 17.73\u00a0\u00a0\u00a0\u00a0 0.01\u00a0\u00a0\u00a0 2.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 2.00\u00a0\u00a0 0.27\u00a0\u00a0 0.15\ndm-1\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nsdb\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nsdc\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nsdd\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nsde\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nsdf\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\ndm-2\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\ndm-3\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\ndm-4\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\ndm-5\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\ndm-6\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nsdg\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\ndm-7\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nnvme0n1\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\ndm-8\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00 19106.50\u00a0\u00a0\u00a0 0.00 152908.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 16.01\u00a0\u00a0 128.28\u00a0\u00a0\u00a0 6.71\u00a0\u00a0\u00a0 6.71\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.05\u00a0 99.15\nnvme1n1\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00 9540.50\u00a0\u00a0\u00a0 0.00 76324.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 16.00\u00a0\u00a0\u00a0 63.33\u00a0\u00a0\u00a0 6.64\u00a0\u00a0\u00a0 6.64\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.10\u00a0 99.35\nnvme2n1\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00 9573.00\u00a0\u00a0\u00a0 0.00 76584.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 16.00\u00a0\u00a0\u00a0 59.34\u00a0\u00a0\u00a0 6.20\u00a0\u00a0\u00a0 6.20\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.10\u00a0 99.45<\/pre>\n
\u53ef\u4ee5\u53d1\u73b0io\u4e3b\u8981\u96c6\u4e2d\u5728nvme1n1\u548cnvme2n1\u8fde\u4e2a\u8bbe\u5907\u4e0a\uff0c\u56e0\u4e3a\u8fd9\u4e24\u4e2a\u8bbe\u5907\u662foptimized\u7ec4\u7684\uff0c\u4f18\u5148\u7ea7\u4e3a50\uff0c\u800c\u4f18\u5148\u7ea7\u4e3a10\u7684non-optimized\u7684nvme0n1\uff0c\u5219\u4e0d\u4f1a\u6709io\u3002<\/p>\n
\u5728target\u7aef\uff0cdown\u6389nvme1n1\u548cnvme2n1\u5bf9\u5e94\u7684\u7f51\u5361\uff0c\u5728host\u7aef\uff1a<\/p>\n
[root@centos75vm6 etc]# multipath \u2013ll\n\n\u2026\u2026\nmpathf (uuid.fb5bc33c-26b5-41f5-85f7-7fcaa70f8574) dm-8 NVME,hthorizon\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \nsize=4.0G features='0' hwhandler='0' wp=rw\n|-+- policy='round-robin 0' prio=0 status=enabled\n| |- 1:2:1:1 nvme1n1 259:1 failed faulty running\n| `- 2:3:1:1 nvme2n1 259:2 failed faulty running\n`-+- policy='round-robin 0' prio=10 status=active\n\u00a0\u00a0 `- 0:1:1:1 nvme0n1 259:0 active ready running<\/pre>\n
\u8fd9\u65f6\u5019\u518d\u5bf9dm-8\u505afio\u6d4b\u8bd5\uff0cio\u5c31\u96c6\u4e2d\u5230prio\u4e3a10\u7684\u90a3\u4e00\u4e2a\u94fe\u8def\u4e86\uff1a<\/p>\n
avg-cpu:\u00a0 %user\u00a0\u00a0 %nice %system %iowait\u00a0 %steal\u00a0\u00a0 %idle\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 1.15\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 61.49\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 37.36\n\nDevice:\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 rrqm\/s\u00a0\u00a0 wrqm\/s\u00a0\u00a0\u00a0\u00a0 r\/s\u00a0\u00a0\u00a0\u00a0 w\/s\u00a0\u00a0\u00a0 rkB\/s\u00a0\u00a0\u00a0 wkB\/s avgrq-sz avgqu-sz\u00a0\u00a0 await r_await w_await\u00a0 svctm\u00a0 %util\nscd0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nsda\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.50\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 2.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 16.00\u00a0\u00a0\u00a0 16.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.25\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.25\u00a0\u00a0 0.25\u00a0\u00a0 0.05\ndm-0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 2.50\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 16.00\u00a0\u00a0\u00a0 12.80\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.20\u00a0\u00a0 0.05\ndm-1\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nsdb\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nsdc\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nsdd\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nsde\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nsdf\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\ndm-2\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\ndm-3\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\ndm-4\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\ndm-5\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\ndm-6\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nsdg\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\ndm-7\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nnvme0n1\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00 20557.00\u00a0\u00a0\u00a0 0.00 164456.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 16.00\u00a0\u00a0 119.41\u00a0\u00a0\u00a0 5.81\u00a0\u00a0\u00a0 5.81\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.05 100.00\ndm-8\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00 20556.50\u00a0\u00a0\u00a0 0.00 164456.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 16.00\u00a0\u00a0 122.21\u00a0\u00a0\u00a0 5.94\u00a0\u00a0\u00a0 5.94\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.05\u00a0 96.55\nnvme1n1\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00\nnvme2n1\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0\u00a0 0.00\u00a0\u00a0 0.00\u00a0\u00a0 0.00<\/pre>\n","protected":false},"excerpt":{"rendered":"
nvme over fabrics \u662f\u6bd4SRP\uff0c iSER \u6548\u7387\u66f4\u9ad8\u7684\u5b58\u50a8\u534f\u8bae\uff0c\u4e3b\u8981\u8868\u73b0\u5728\u5ef6\u65f6\u964d\u4f4e\uff0ciops\u548c\u672c\u5730\u4f7f\u7528\u76f8\u5dee\u65e0\u51e0\u3002\u4eceNVMe \u2013oF 1.4\u5f00\u59cb\uff0c…<\/p>\n
 Read More  Read More<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"aside","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[1],"tags":[42],"class_list":["post-16145","post","type-post","status-publish","format-aside","hentry","category-uncategorized","tag-nvmeananvme-over-tcp","post_format-post-format-aside"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p8gSFq-4cp","jetpack_likes_enabled":true,"jetpack-related-posts":[{"id":699,"url":"http:\/\/www.rao-bing.cn\/index.php\/2017\/05\/18\/699\/","url_meta":{"origin":16145,"position":0},"title":"\u91ca\u653eNVMe\u95ea\u5b58\u7684\u6027\u80fd –NVMe over Fabrics\u5728Oracle RAC\u4e2d\u7684\u5e94\u7528\u5b9e\u6d4b","author":"raobing","date":"2017-05-18","format":"aside","excerpt":"\u6982\u8ff0 \u4f17\u6240\u5468\u77e5\uff0cOracle RAC\u7684\u67b6\u6784\u662fShare Disk\uff0c\u5171\u4eab\u5b58\u50a8\u7684\u6027\u80fd\u5bf9\u7cfb\u7edf\u6574\u4f53\u8868\u73b0\u6765\u8bf4\u81f3\u2026","rel":"","context":"\u5728\u201cOracle\u201d\u4e2d","block_context":{"text":"Oracle","link":"http:\/\/www.rao-bing.cn\/index.php\/category\/oracle\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.rao-bing.cn\/wp-content\/uploads\/2017\/05\/clip_image002.jpg?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rao-bing.cn\/wp-content\/uploads\/2017\/05\/clip_image002.jpg?resize=350%2C200 1x, https:\/\/i0.wp.com\/www.rao-bing.cn\/wp-content\/uploads\/2017\/05\/clip_image002.jpg?resize=525%2C300 1.5x"},"classes":[]},{"id":16225,"url":"http:\/\/www.rao-bing.cn\/index.php\/2024\/04\/07\/16225\/","url_meta":{"origin":16145,"position":1},"title":"test S5000C","author":"raobing","date":"2024-04-07","format":"aside","excerpt":"\u98de\u817eS5000C\u7684\u521d\u6b65\u6d4b\u8bd5","rel":"","context":"\u7c7b\u4f3c\u6587\u7ae0","block_context":{"text":"\u7c7b\u4f3c\u6587\u7ae0","link":""},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.rao-bing.cn\/wp-content\/uploads\/2024\/04\/s5k_dual_socket_cpubenchmark_thumb.jpg?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rao-bing.cn\/wp-content\/uploads\/2024\/04\/s5k_dual_socket_cpubenchmark_thumb.jpg?resize=350%2C200 1x, https:\/\/i0.wp.com\/www.rao-bing.cn\/wp-content\/uploads\/2024\/04\/s5k_dual_socket_cpubenchmark_thumb.jpg?resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.rao-bing.cn\/wp-content\/uploads\/2024\/04\/s5k_dual_socket_cpubenchmark_thumb.jpg?resize=700%2C400 2x"},"classes":[]},{"id":16246,"url":"http:\/\/www.rao-bing.cn\/index.php\/2026\/03\/29\/16246\/","url_meta":{"origin":16145,"position":2},"title":"Apache Doris \u7248\u672c\u5347\u7ea7\u6307\u5357 | \u4ece 2.0.1.1 \u5230 2.1.11","author":"\u9976, \u51b0","date":"2026-03-29","format":"aside","excerpt":"\u672c\u6587\u6863\u8be6\u7ec6\u4ecb\u7ecd Apache Doris \u4ece 2.0.1.1 \u5347\u7ea7\u5230 2.1.11 \u7684\u5b8c\u6574\u64cd\u4f5c\u6d41\u7a0b\uff0c\u2026","rel":"","context":"\u7c7b\u4f3c\u6587\u7ae0","block_context":{"text":"\u7c7b\u4f3c\u6587\u7ae0","link":""},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":480,"url":"http:\/\/www.rao-bing.cn\/index.php\/2017\/01\/22\/480\/","url_meta":{"origin":16145,"position":3},"title":"\u901a\u8fc7RDS\u5907\u4efd\uff1aOracle Secure Backup\u7b80\u4ecb","author":"raobing","date":"2017-01-22","format":"aside","excerpt":"\u00a0 \u80cc\u666f \u6700\u65e9\u542c\u8bf4\u8fd9\u4e2a\u540d\u5b57\u662f\u5728\u51e0\u5e74\u524d\u5b9e\u65bd\u7b2c\u4e00\u53f0EXADATA\u7684\u65f6\u5019\uff0c\u5f53\u65f6\u53ea\u662f\u5728\u6295\u6807\u6587\u4ef6\u91cc\u8ba4\u2026","rel":"","context":"\u5728\u201cOracle\u201d\u4e2d","block_context":{"text":"Oracle","link":"http:\/\/www.rao-bing.cn\/index.php\/category\/oracle\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.rao-bing.cn\/wp-content\/uploads\/2017\/01\/Oracle-Security-Backup.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":883,"url":"http:\/\/www.rao-bing.cn\/index.php\/2018\/09\/11\/883\/","url_meta":{"origin":16145,"position":4},"title":"GlusterFS  install and config","author":"raobing","date":"2018-09-11","format":"aside","excerpt":"GlusterFS\u662f\u4e00\u4e2a\u5206\u5e03\u5f0f\u6587\u4ef6\u7cfb\u7edf\uff0c\u901a\u8fc7 RDMA \u548c TCP\/IP \u65b9\u5f0f\u5c06\u5206\u5e03\u5230\u4e0d\u540c\u670d\u52a1\u5668\u4e0a\u7684\u2026","rel":"","context":"\u7c7b\u4f3c\u6587\u7ae0","block_context":{"text":"\u7c7b\u4f3c\u6587\u7ae0","link":""},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.rao-bing.cn\/wp-content\/uploads\/2018\/09\/clip_image006_thumb.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rao-bing.cn\/wp-content\/uploads\/2018\/09\/clip_image006_thumb.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/www.rao-bing.cn\/wp-content\/uploads\/2018\/09\/clip_image006_thumb.png?resize=525%2C300 1.5x"},"classes":[]},{"id":895,"url":"http:\/\/www.rao-bing.cn\/index.php\/2018\/10\/11\/895\/","url_meta":{"origin":16145,"position":5},"title":"install ceph 13.2.1 without internet","author":"raobing","date":"2018-10-11","format":"aside","excerpt":"Ceph\u7684rpm\u5305\u5b89\u88c5\u65b9\u5f0f\uff0c\u9700\u8981\u4f7f\u7528yum\uff0c\u5728\u5185\u7f51\u73af\u5883\u4e2d\uff0c\u5f80\u5f80\u6ca1\u6709internet\u8fde\u63a5\u3002\u672c\u6587\u4ecb\u7ecd\u4e00\u79cd\u2026","rel":"","context":"\u7c7b\u4f3c\u6587\u7ae0","block_context":{"text":"\u7c7b\u4f3c\u6587\u7ae0","link":""},"img":{"alt_text":"clip_image002","src":"https:\/\/i0.wp.com\/www.rao-bing.cn\/wp-content\/uploads\/2018\/10\/clip_image002_thumb.jpg?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rao-bing.cn\/wp-content\/uploads\/2018\/10\/clip_image002_thumb.jpg?resize=350%2C200 1x, https:\/\/i0.wp.com\/www.rao-bing.cn\/wp-content\/uploads\/2018\/10\/clip_image002_thumb.jpg?resize=525%2C300 1.5x"},"classes":[]}],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"http:\/\/www.rao-bing.cn\/index.php\/wp-json\/wp\/v2\/posts\/16145","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.rao-bing.cn\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.rao-bing.cn\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.rao-bing.cn\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.rao-bing.cn\/index.php\/wp-json\/wp\/v2\/comments?post=16145"}],"version-history":[{"count":4,"href":"http:\/\/www.rao-bing.cn\/index.php\/wp-json\/wp\/v2\/posts\/16145\/revisions"}],"predecessor-version":[{"id":16154,"href":"http:\/\/www.rao-bing.cn\/index.php\/wp-json\/wp\/v2\/posts\/16145\/revisions\/16154"}],"wp:attachment":[{"href":"http:\/\/www.rao-bing.cn\/index.php\/wp-json\/wp\/v2\/media?parent=16145"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.rao-bing.cn\/index.php\/wp-json\/wp\/v2\/categories?post=16145"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.rao-bing.cn\/index.php\/wp-json\/wp\/v2\/tags?post=16145"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}