ESXi -> XCP-ng Homelab

mohammadm

Recently we made the switch at the office from ESXi to XCP-ng. Ofcourse I had to do the same thing at my homelab.

Homelab

XCP01 Main
Supermicro SC216BE1C-R920LPB
Supermicro X11DPi-N(T)
2x Intel(R) Xeon(R) Silver 4108 CPU @ 1.80GHz
16x 32GB Samsung DDR4 ECC RAM
1x Nvidia NVS 510 Passthrough
1x 256GB Samsng NVMe OS boot
2x 4TB Samsung SSD PM883 local ZFS
48x 2TB Samsung SSD PM883 Raidz2 (24, 24JBOD)
Avago Fusion-MPT 12GSAS SAS3008 Passthrough
2x 920Watt Platinum+ SQ PSU (PWS-920P-SQ)

JOB01
Supermicro SC216BE1C-R920LPB JBOD
24x 2TB Samsung SSD PM883 Raidz2
2x 920Watt Platinum+ SQ PSU (PWS-920P-SQ)

XCP02 Test
Supermicro SC216BE1C-R920LPB
Supermicro X11DPi-N(T)
2x Intel(R) Xeon(R) Silver 4108 CPU @ 1.80GHz
16x 32GB Samsung DDR4 ECC RAM
1x Nvidia NVS 510 Passthrough
1x 256GB Samsng NVMe OS boot
2x 1TB Samsung SSD PM883 local ZFS
24x 1TB Samsung SSD PM883 Raidz2
Avago Fusion-MPT 12GSAS SAS3008 Passthrough
2x 920Watt Platinum+ SQ PSU (PWS-920P-SQ)

XCP03 XOA & Docker
Dell Precision Tower 3420
Intel(R) Xeon(R) CPU E3-1245 v5 @ 3.50GHz
2x 16GB Samsung DDR4 ECC RAM
1x 256GB Samsng NVMe OS boot
2x 1TB Samsung SSD PM883 local RAID1
4x 1Gb NIC

SYN01 Xpenology
Supermicro SC216BE1C-R920LPB
Supermicro X11DPi-N(T)
2x Intel(R) Xeon(R) Silver 4108 CPU @ 1.80GHz
16x 16GB Kingston DDR4 ECC RAM
1x 16GB USB3 OS boot
8x 10TB HGST 7200RPM 4K HHD
Avago Fusion-MPT 12GSAS SAS3008 PCI-Express
2x 920Watt Platinum+ SQ PSU (PWS-920P-SQ)

Networking
UDM-SE (6TB HGST)
USW-24-PoE
3x UAP-nanoHD
3x USW Flex
G4 Doorbell
2x G4 Bullet
G3 Instant

What am I running?
Windows Servers
Ubuntu Servers
TrueNAS Scale
Docker Swarm

Next Steps
Adding SSD's for cache to my Xpenology
Virtualizing the Xpenology machine to XCP02 but somehow Xpenology and XCP-ng are not good friends yet.

olivierlambert

Nice setup! Thanks for sharing

austinw

So I bet you don't have to use a heater in the winter lol.

mohammadm

@austinw Since 80% is SSD, it does not generate that much heat to be honest. All the machines have their original supermicro fans. Tweaked some stuff in the ipmi. Average temperature of the cpu and ram is around 45/48c without the fans making lots of noises.