this post was submitted on 22 Nov 2023
1 points (100.0% liked)

Data Hoarder

116 readers
1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago
MODERATORS
[email protected]
1
Trying to figure out best build for 100-150 TB of data. (alien.top)
submitted 11 months ago by [email protected] to c/[email protected]
1 comments fedilink hide all child comments
 

I currently have a Dell PowerEdge T430 with a 20c CPU and 128 GB of RAM running Proxmox. Right now I just have an old 240 GB SSD and 4 4 TB hard drives in RAIDZ-2. I have a Plex server in the cloud that I would like to localize including bringing the data in house. Right now my data footprint is around 170 TB but I am trying to whittle that down to around 100 TB.

I am trying to figure out the best way to store the data for Plex. I use Proxmox for things like hosting game servers and hosting software that I use for work. There are only 8 HDD trays so it is not enough for a 100 TB+ storage array. What would be the best way to utilize the hardware I currently have while adding a large array of storage to use?

Ultimately I would like to utilize RAIZ-2 or similar so I have some redundancy and I would love to be able to expand the array as I add more drives to it since I figure my data footprint will continue to grow. Thanks!

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 11 months ago

Easiest way to add a ton more storage is an HBA card with external SAS ports, and a JBOD disk shelf. A disk shelf is basically just a power supply and a SAS expander card hooked up to a bunch of disk backplanes.

You can find them used for reasonably cheap, or build your own from old parts if you're on a shoe string budget and don't care about hotswap bays or anything.

They will act just like any internally connected hard drive, so you can make them part of whatever RAID or ZFS arrays you want.