Source: Intel
What happens when you take two identical Xeon servers with PCIe 3.0 x 4
- Supermicro SuperServer SYS-5028D-TN4T (Bundle 2)
- 64GB of Samsung 2133MHz DDR4 RDIMM RAM
...and bless each of them with magical NVMe powers
This motherboard and chipsets supports the full speeds NVMe is capable of, given the PCIe 3.0 x 4 lanes. Note that even the latest Skylake Intel NUC Kit NUC6i3SYH does not, capping out at 1600 MB/sec.
1) install an Intel SSD 750 Series 400 GB NVMe PCIe card in the one on the left
(related articles here)
2) install a Samsung 950 PRO M.2 NVMe M.2 SSD into the one on the right
(related articles here)
...then top it all off with a fresh copy of VMware ESXi 6.0 Update 1?
3) format those two brands of delicious NVMe as VMFS5 as they become an ESXi datastore, then build a nice default Windows 10 VM one one, then clone it to the other
Here's what happens, a fun video...
The video appears below, showing the two systems booting each booting a Windows 10 VM simultaneously.
Interesting to note, with the Intel 750, you need to install a VIB (driver) for decent speeds, but the Samung 950 "just works" and exhibits good speeds using just ESXi 6.x's built in NVMe driver.
that also features some ATTO Disk Benchmark action...
For these tests (which were consistent across off camera runs), I went with the highest system fan speed to avoid any thermal throttling during even the most extended abuse, with the BIOS configured the same way I did my Windows 10 ATTO benchmarks.
...and finishes with a typical use case demonstration.
This strong ending gives you a real sense of how glorious it is to be able to deploy a new Windows 10 VM from Template (a full clone) in a mere 18 seconds. Now that's what I'm talking about!
Samsung Specifications state:
2,500 MB/sec reads and 1,500 MB/sec writes.
According to ATTO, my highest numbers from 3 runs, under Windows 10 natively:
2,598 MB/sec reads and 1,576 MB/sec writes.
Now let's look at the numbers for ATTO run inside a VM:
2,578 MB/sec reads and 1,568 MB/sec writes.
Closing thoughts and observations.
Despite the diminished speeds at the very important 4.0K size seen on the 4th row of the graphs, these results are pretty darn good. It would appear that both the Samsung Windows 10 drivers and the VMware ESXi 6.0 NVMe drivers are pretty darn mature, even in this brave and wonderful new world of NVMe speeds that blow away any SATA3 device out there. It's about time (see how far back some of my NVMe articles were published!)
See also at TinkerTry
-
Intel 750 Series NVMe PCIe SSD supported by ESXi 6.x out-of-the-box, install Intel's VIB for full speed
Sep 29 2015 -
World's fastest consumer SSD - Samsung 950 PRO M.2 NVMe benchmark results
Nov 07 2015 - Order a TinkerTry'd Supermicro SuperServer Bundle - powerful and efficient home virtualization lab solutions
See also
- Podcast #381 - Picks of the Year, the EK Predator 240, ASUS MG278Q FreeSync and more!
Listen to the discussion about Intel 750 versus Samsung 950, at 1 hour and 7 minutes: