TeleFragger
Gawd
- Joined
- Nov 10, 2005
- Messages
- 992
but they only billed me $53 shipped plus tax for all 4... so it was weird to see those numbers as they didn't add up...
but now my box is dead.. UGHHHHH!!!!!!
gonna post in mobo section
![[H]ard|Forum](/styles/hardforum/xenforo/logo_dark.png){kind=logo}
[H]ard Forum Storage Showoff Thread
- Thread starter EnderW
- Start date
but they only billed me $53 shipped plus tax for all 4... so it was weird to see those numbers as they didn't add up...
but now my box is dead.. UGHHHHH!!!!!!
gonna post in mobo section
TeleFragger
Gawd
- Joined
- Nov 10, 2005
- Messages
- 992
aight....
update to my setup...
Case: Corsair 750D with 6x3 bay cages
OS: Server 2019 Standard (Essentials role is gone.. im sad)
CPU: Intel i5-6600k
MoBo: Gigabyte GA-Z170XP-SLI
RAM: 4x8gb ddr4
GFX: Onboard Intel HD 530
PSU: Corsair HX 620W
OS Drive: 128GB SSD, Samsung
Storage Controllers: HP H220 8i feeding - HP AEC-83605/HP2 36 Ports 12GB SAS Expansion Board 761879-001
Hot Swap Cages: ICY DOCK 6 x 2.5" SATA /SAS HDD/SSD Hot Swap x 3
Storage Pool1: SSD
Storage Pool2: Sata with 500GB SSD 256gb NVME Cache
So...
15x 2tb SATA
3x 4tb SATA
256gb NVME Cache
1x 120gb Samsung SSD - OS
21x 500gb ssd
all quiet, compact, 10gb network.....
Corsair 750d with 6x3 bay cages by Jeffrey Riggs, on Flickr
Icy Dock 3x - 6x2.5" hot swap by Jeffrey Riggs, on Flickr
SSD Pool by Jeffrey Riggs, on Flickr
SATA Pool - NVME Cache by Jeffrey Riggs, on Flickr
update to my setup...
Case: Corsair 750D with 6x3 bay cages
OS: Server 2019 Standard (Essentials role is gone.. im sad)
CPU: Intel i5-6600k
MoBo: Gigabyte GA-Z170XP-SLI
RAM: 4x8gb ddr4
GFX: Onboard Intel HD 530
PSU: Corsair HX 620W
OS Drive: 128GB SSD, Samsung
Storage Controllers: HP H220 8i feeding - HP AEC-83605/HP2 36 Ports 12GB SAS Expansion Board 761879-001
Hot Swap Cages: ICY DOCK 6 x 2.5" SATA /SAS HDD/SSD Hot Swap x 3
Storage Pool1: SSD
Storage Pool2: Sata with 500GB SSD 256gb NVME Cache
So...
15x 2tb SATA
3x 4tb SATA
256gb NVME Cache
1x 120gb Samsung SSD - OS
21x 500gb ssd
all quiet, compact, 10gb network.....
Last edited:
Holy crap that is sexy
- Joined
- Jun 27, 2001
- Messages
- 15,740
added another expander
Deadjasper
2[H]4U
- Joined
- Oct 28, 2001
- Messages
- 2,344
WOW, I bet that heats your whole house.
Spartacus09
[H]ard|Gawd
- Joined
- Apr 21, 2018
- Messages
- 1,903
pendragon1
Extremely [H]
- Joined
- Oct 7, 2000
- Messages
- 44,889
4k/60 porn takes a surprising amount of space.
Yeah after dealing with keeping a single 24-drive enclosure cool and quite, where do you keep that and how do you cool it?
- Joined
- Jun 27, 2001
- Messages
- 15,740
in a datacenter... that entire rack uses ~3.5kw
Interesting. So is that the datacenter rack and you just put your equipment in, or your whole rack? And how does physical access to it work? I've always wondered if it was possible to take our servers and just put them in a datacenter.
- Joined
- Jun 27, 2001
- Messages
- 15,740
usually the datacenter owns the racks and you put your equipment in, in this case I have a deal with them to rent a small space in the corner, and that's my rack
Deadjasper
2[H]4U
- Joined
- Oct 28, 2001
- Messages
- 2,344
What do you do with it?
Memes
- Joined
- Jun 27, 2001
- Messages
- 15,740
only the dankest...
no but it's mostly off-site customer backups and other boring data on the arrays... the 1U boxes are a hyper-v cluster that runs a bunch of asterisk vms, couple mail/web vms etc
Nice! That's pretty reasonable.
TeleFragger
Gawd
- Joined
- Nov 10, 2005
- Messages
- 992
thx... I like it.. small package and very quiet!!!
pendragon1
Extremely [H]
- Joined
- Oct 7, 2000
- Messages
- 44,889
you ever straighten the heat sink? it being cockeyed in the window would drive me nuts!
Machupo
Gravity Tester
- Joined
- Nov 14, 2004
- Messages
- 5,590
Ran out of space on my old SFF/SSD NAS and my Avoton mobo finally bit the dust (the dreaded BMC/novideo issue). Instead of just getting a new mobo, decided it was time for an upgrade (that had lasted 5 years through a couple storage pool iterations).
New SFF NAS:
Sharing a twin-ITX 2U chassis with my edge device
Supermicro X10SDV-6C+-TLN4F
64GB DDR4-2133 ECC
Pico PSU 150
970 evo plus 250gb boot drive / cache (yeah, way overkill)
9305-24i
3x vdevs of Z2 goodness (each 8x 2TB WD Blue m.2 SATA drives) + 2 hot spares
31 TiB available
New SFF NAS:
Sharing a twin-ITX 2U chassis with my edge device
Supermicro X10SDV-6C+-TLN4F
64GB DDR4-2133 ECC
Pico PSU 150
970 evo plus 250gb boot drive / cache (yeah, way overkill)
9305-24i
3x vdevs of Z2 goodness (each 8x 2TB WD Blue m.2 SATA drives) + 2 hot spares
31 TiB available
Last edited:
![Zarathustra[H]](https://cdn.hardforum.com/data/avatars/m/9/9298.jpg?1677728934){kind=avatar}
Zarathustra[H]
Extremely [H]
- Joined
- Oct 29, 2000
- Messages
- 36,095
I looked into co-location once but found it to be prohibitively expensive. (Like, way more expensive than just renting something that includes the server as well, which made no sense to me at all...)
Instead I stash my remote backup server in a friends basement and he stashes his in mine.
Last edited:
TeleFragger
Gawd
- Joined
- Nov 10, 2005
- Messages
- 992
hah..no.. I got to look back to see as I don't recall LOL...
It's definitely cheaper than renting servers. My 48U rack, with 30A 120V service, and 100mbit unmetered (with /26) is ~$700 a month last I checked. My 4U 24 bay Supermicros only use about 3A each and would probably cost $500+ a month per server if not colocated. Paying someone else for 150TB of storage gets to be very expensive. You also don't have to get a full rack. A single server (depending on power), can often be colocated for ~$100 and 10U runs about $300 (with 10A). Not that bad when you consider electricity to run and cool that takes up half of the price.
I should update my post seeing as I'm at ~500TB currently...
pendragon1
Extremely [H]
- Joined
- Oct 7, 2000
- Messages
- 44,889
thats a lot of pron...
TeeJayHoward
Limpness Supreme
- Joined
- Feb 8, 2005
- Messages
- 11,991
Damn, electricity where you live is expensive. This pulls about 10-11A (120V) under full load and our electric bill for the whole house is only like $150/month:
It idles at around 9A, so your 3A per server estimate is actually pretty much spot on.
edit: Ignore me. I see what you were getting at now. Doh.
TeleFragger
Gawd
- Joined
- Nov 10, 2005
- Messages
- 992
damn my electric bill is $300-$400/m and I have LED bulbs everywhere, home automation to control shutting on/off lights...
ae00711
n00b
- Joined
- Feb 28, 2015
- Messages
- 11
stupid question: iirc, generally speaking, ppl stay away from WD Blue HDDs for RAID arrays etc.. but given these are SSDs.. any issues? Any drop-outs?
It's a wildly different way of doing a file server, and I love it!
Machupo
Gravity Tester
- Joined
- Nov 14, 2004
- Messages
- 5,590
No issues with the drives themselves, they have been rock solid. Only funny issue was with FreeNAS 11.3 having what appears to be SMART temperature reporting bug when using SAS3008; there is a workaround and SMART temperature is disabled for SSDs in 11.3U2.
ae00711
n00b
- Joined
- Feb 28, 2015
- Messages
- 11
I assume you were 'forced' to go with that LSI card, in need of the number of ports? I checked the card after I posted - quite an expensive HBA!
Deadjasper
2[H]4U
- Joined
- Oct 28, 2001
- Messages
- 2,344
It depends. I just picked up a Quanta 24 bay 2.5 HD server that uses a Mezzanine card. I picked up a Quanta SAS 3008 HBA for $29.09 with free shipping.
https://www.ebay.com/itm/8-Port-12G...614978&hash=item41f2fde91e:g:x~sAAOSwSK9eTYXy
This is the server. Came with a dual 10G NIC too. Seller accepted $225
https://www.ebay.com/itm/QUANTA-D51...540209?hash=item23d3479931:g:JqoAAOSw1dVehMSQ
It's a Xeon E5 26xx v3 /4 server.
IdiotInCharge
NVIDIA SHILL
- Joined
- Jun 13, 2003
- Messages
- 14,675
Blue spinners are bottom-barrel; they will work, but they lack the features that Red spinners have for playing nice in a RAID.
Blue SSDs are also bottom-barrel, but for SSDs, that means something different. No RAM cache, no capacitor for ensuring writes if power is lost, lower endurance, lower SLC cache, etc. Stuff that might be important for a SAN or database server running in a cluster that demands high performance but generally meaningless on a read-focused storage server.
Machupo
Gravity Tester
- Joined
- Nov 14, 2004
- Messages
- 5,590
Yep -- really not much is needed for storage, most mainboards have a m.2 if you really want to be ridiculous and add a cache. One could say that SSDs are 100% unnecessary for storage (and probably be right), but I was aiming for interesting/different SFF implementations.
Factum
2[H]4U
- Joined
- Dec 24, 2014
- Messages
- 2,455
Yep -- really not much is needed for storage, most mainboards have a m.2 if you really want to be ridiculous and add a cache. One could say that SSDs are 100% unnecessary for storage (and probably be right), but I was aiming for interesting/different SFF implementations.
We have gone all flash storage (Tier 3 data-centers, so power loss is not really a worry) simply because of the speed.
Spindle storage is dying, we only have backup on spindles now.
IdiotInCharge
NVIDIA SHILL
- Joined
- Jun 13, 2003
- Messages
- 14,675
If the only goal is to store data that can then be re-read on demand, then yeah. Otherwise spinners are unnecessary and we'd use tape!
Also for write-intensive workloads, spinners can be desirable, as they're even more of a value versus SSDs designed for constant writes. Especially when you start moving up to cloud interconnect speeds of 40Gbps+. For many / most uses, the only reason to pay for better flash anywhere is for the associated warrant or service agreement. Write intensive scenarios where low-latency, high-speed read is also desirable are the main exception.
Deadjasper
2[H]4U
- Joined
- Oct 28, 2001
- Messages
- 2,344
No way I would trust my data to tape again. Been there done that and lost big time more than once. Never again.
Factum
2[H]4U
- Joined
- Dec 24, 2014
- Messages
- 2,455
Oh, there is a lot of other benefits besides raw speed.
Power usage, lifespan is better, failure rates are better, you don't have drives failed after inergen relase etc.
Spindles are dying, I guess I 5 years not only our storage is all flash...but so will our backup be.
Deadjasper
2[H]4U
- Joined
- Oct 28, 2001
- Messages
- 2,344
As I understand it, flash is not good for long term storage. Bit rot or something like that. For me, the best long term storage has been those little 2.5" SAS enterprise HD's. I can set them on the shelf and forget about them. Have never had one fail to read when needed.