I have a Dell T110ii file server running FreeBSD with a ZFS RAID 10 array with all my documents, media, photos, etc. I work directly off the server instead of local storage.
A lot of the transfers I'm doing are from SD cards, which are fast-ish cards but often only seeing 50-60MB/s transfers. When I've done file transfers from my desktop in Windows to the server, I think it will reach 80-90MB speeds. If I scp a file from my Proxmox server to the SSD on the file server, I max out network speeds at about 114MB/s.
I now use Geeqie to do my initial cull and preview of photo sessions, but sometimes it can get hit with the slow downs that is kind of frustrating. When I'm doing more "art" I don't take a lot of photos, but when doing any action or wildlife some days I'll have 1500 photos to go through (and delete half of them). I would like to consider what I can do to improve the network performance of the server, or if I need to consider another storage strategy. I've even kind of looked at picking up something like a Dell T140 because I've had issues with the USB 3.0 add-on cards I use for backup drives on the server, but that's a lot of money to spend to replace a server that has (aside from the USB issues) been very reliable.
Some options I've considered:
-Moving all the files back to the desktop to WD Black or something, but then I lose the ECC/ZFS protection my server provides. My desktop runs OpenSUSE right now, so I could use btrfs and arguably have similar protections and then just use the server for backups.
-Adding a 10 gigabit network direct-connect between the desktop and server. I'm assuming I'd have to consider upgrading the server with cache drives or something to improve performance.
-Using local storage or adding a local storage drive specifically to import and do the initial cull, then move the files off to the server. It's the most cost-effective method, but adds extra steps in the workflow that I'm not overly excited about.
I am open to ideas, does anyone have suggestions?
A lot of the transfers I'm doing are from SD cards, which are fast-ish cards but often only seeing 50-60MB/s transfers. When I've done file transfers from my desktop in Windows to the server, I think it will reach 80-90MB speeds. If I scp a file from my Proxmox server to the SSD on the file server, I max out network speeds at about 114MB/s.
I now use Geeqie to do my initial cull and preview of photo sessions, but sometimes it can get hit with the slow downs that is kind of frustrating. When I'm doing more "art" I don't take a lot of photos, but when doing any action or wildlife some days I'll have 1500 photos to go through (and delete half of them). I would like to consider what I can do to improve the network performance of the server, or if I need to consider another storage strategy. I've even kind of looked at picking up something like a Dell T140 because I've had issues with the USB 3.0 add-on cards I use for backup drives on the server, but that's a lot of money to spend to replace a server that has (aside from the USB issues) been very reliable.
Some options I've considered:
-Moving all the files back to the desktop to WD Black or something, but then I lose the ECC/ZFS protection my server provides. My desktop runs OpenSUSE right now, so I could use btrfs and arguably have similar protections and then just use the server for backups.
-Adding a 10 gigabit network direct-connect between the desktop and server. I'm assuming I'd have to consider upgrading the server with cache drives or something to improve performance.
-Using local storage or adding a local storage drive specifically to import and do the initial cull, then move the files off to the server. It's the most cost-effective method, but adds extra steps in the workflow that I'm not overly excited about.
I am open to ideas, does anyone have suggestions?