Ok, I am about to upgrade my last set of 2TB hard drives to 4TB and am wondering how bad of an idea is it to make just one large pool instead of 3 smaller vdevs
Right now I have 3 vdev at 11 raidz3 disk each (11x4TB, 11x4TB, 11x2TB), I want to go to one 35x4TB raidz3 + hot spare (36 disk total), however I am seeing warnings not to go over 10 drives or 16 drives (different sites say different things) I will get close to 18TB more storage with 35 disk vdev vs going with 11 disk vdevs. This is mostly for storage so high speed is not an issue (I currently get 290 MBps, as long as I get around 150 MBps, I should have no issues at all)
according to the ZFS calculator
https://www.servethehome.com/raid-calculator/raid-reliability-calculator-simple-mttdl-model/
my 3 year outlook is for failure 11 disc vdev 0.00016 %vs 35 disk vdev 0.09998 % not covering the hot spare I want to add. it is less than 1 percent.
So has anyone here done large disk vdevs. Good, Bad, very bad?
update:
I plan on upgrade again in three years. A full system upgrade (new MB, CPU, more Ram, new harddrives PSU, ect) So upgrading my drives will not be and issue then since I will be making a new Zpool instead of increments upgrades like I have for the last 5 years (upgrading only one vdev when needed)
Current
Zpool Media01 (raidz3)
vdev 11x4TB
vdev 11x4TB
vdev 11x2TB
Zpool Media02 (raidz3)
vdev 11x3TB
Future ???? #1
Zpool Media01 (raidz3)
vdev 35x4TB + hot spare
Zpool Media02 (raidz3)
vdev 11x3TB
Right now I have 3 vdev at 11 raidz3 disk each (11x4TB, 11x4TB, 11x2TB), I want to go to one 35x4TB raidz3 + hot spare (36 disk total), however I am seeing warnings not to go over 10 drives or 16 drives (different sites say different things) I will get close to 18TB more storage with 35 disk vdev vs going with 11 disk vdevs. This is mostly for storage so high speed is not an issue (I currently get 290 MBps, as long as I get around 150 MBps, I should have no issues at all)
according to the ZFS calculator
https://www.servethehome.com/raid-calculator/raid-reliability-calculator-simple-mttdl-model/
my 3 year outlook is for failure 11 disc vdev 0.00016 %vs 35 disk vdev 0.09998 % not covering the hot spare I want to add. it is less than 1 percent.
So has anyone here done large disk vdevs. Good, Bad, very bad?
update:
I plan on upgrade again in three years. A full system upgrade (new MB, CPU, more Ram, new harddrives PSU, ect) So upgrading my drives will not be and issue then since I will be making a new Zpool instead of increments upgrades like I have for the last 5 years (upgrading only one vdev when needed)
Current
Zpool Media01 (raidz3)
vdev 11x4TB
vdev 11x4TB
vdev 11x2TB
Zpool Media02 (raidz3)
vdev 11x3TB
Future ???? #1
Zpool Media01 (raidz3)
vdev 35x4TB + hot spare
Zpool Media02 (raidz3)
vdev 11x3TB
Last edited: