Using command line iSER DEMO to test iSER target performance

From the package of us, there are few demo utils to create a single pooled storage to demonstrate storage features and performance. Through the way, you can quick preview the favourited features in minutes.

For iSER target, you may run the following command to start:

./nvmf_test -p iser spool 1 2 /dev/sdc pci://0000:04:00.0 pci://0000:05:00.0
outputs are:
found 1 ib devices
device0: mlx4_0, uverbs0, /sys/class/infiniband_verbs/uverbs0, /sys/class/infiniband/mlx4_0
copies: 1/2
create name space:…done.
iSCSI over RDMA service is started.

Using built-in iSCSI / iSER initiator in Linux


Install the nvmf-cli package:

Cent OS: yum install -y iscsi-initiator-utils
Ubuntu: apt-get install iscsi-initiator-utils

Discover and connect:

#iscsiadm -m discovery -t sendtargets -p -I iser
#iscsiadm -m node -T -l -I iser
After connected to the iSER target, you will see an additional drive in your system some like /dev/sdc
Then you can use vdbench, fio or similar software to test for performance.
Note: The virtual device is created by the Linux built-in kernel mode iSCSI initiator driver, the performance will be limited on this, will not represent to the server’s throughput.

Testing environment and results

CPU: E52680

Memory: 64G

NVMe: Intel NVMe 3700 * 2, other NVMe * 1 for metadata.

NIC:  Mellanox ConnectX-3 40GB

PERFORMANCE: around 245,000 IOPS in Read, 245,000 IOPS in Write.

Note: The above result can be tested in three client machine with same result.