Hello, have you written the detailed configuration information for some experienceAfter messing about with the undocumented ROCE protocols on the old Connectx-3 EN card, using ROCE V 1.25 on windows (?!? only mentioned occasionally in some Mellanox docs) I was able to get nd_rping / rping running between linux and windows.
I was then able to use Starwind rperf to run RDMA tests which passed.
I was then able to configure and setup a NVMe-oF share of a ZFS zvol on linux -> windows. Performance is out of this world vs. iSCSI. Max read and writes on iSCSI were about 1.9GB/s read and 900MB/s write using ATTO. They are now 2.5GB/s R and W. Not only that but the 4k r/w performance increased by 10x!
Incredible performance. I am going to write a short blog post on it with some benchmarks as soon as I stablize the setup properly between reboots.
Statistics: Posted by vmware — Wed Mar 12, 2025 1:56 am