Basically I'm trying to make a DIY 4DGS gaussian splatting rig out of 16-32 cameras, and streaming from all of them the data could be in the TBs. Instead of processing on that capture rig I'd look into processing on a different machine, so portability of the data is of interest. Basically treating NVMEs or something like that as a big memory card for the "camera." I've seen some things like "Icy Dock" that have these removable m.2. enclosures but wondering if there was a more robust idea I hadn't thought about yet.
![[H]ard|Forum](/styles/hardforum/xenforo/logo_dark.png){kind=logo}
Navigation
Install the app
How to install the app on iOS
Follow along with the video below to see how to install our site as a web app on your home screen.
Note: This feature may not be available in some browsers.
More options
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an alternative browser.
You should upgrade or use an alternative browser.
Hot swappable NVMEs or some other portable form of data storage in using a workstation as a camera-capture?
- Thread starter CyJackX
- Start date
There are a ton of options, Icy Dock makes some good ones. How much working data do you expect per project? How long do you expect to need to maintain the data, both live for working/processing and backups if you ever need to go back to it? Do you need just the data to be portable or the entire "processing machine?" Will each camera be saving to a local SD card and then you will move them up, or will each of the cameras download via IP? What cameras, what topology?Basically I'm trying to make a DIY 4DGS gaussian splatting rig out of 16-32 cameras, and streaming from all of them the data could be in the TBs. Instead of processing on that capture rig I'd look into processing on a different machine, so portability of the data is of interest. Basically treating NVMEs or something like that as a big memory card for the "camera." I've seen some things like "Icy Dock" that have these removable m.2. enclosures but wondering if there was a more robust idea I hadn't thought about yet.
Basler Machine vision cameras: https://www.baslerweb.com/en-us/shop/daa1280-54um-no-mount/There are a ton of options, Icy Dock makes some good ones. How much working data do you expect per project? How long do you expect to need to maintain the data, both live for working/processing and backups if you ever need to go back to it? Do you need just the data to be portable or the entire "processing machine?" Will each camera be saving to a local SD card and then you will move them up, or will each of the cameras download via IP? What cameras, what topology?
No on-board data, streaming directly to capture machine. I WAS going to go with networked cameras...but I have seen a crazy deal for these cameras (normally 260ish before accessories) at 80$ each on eBay...so now I'm thinking I'll just prototype a smaller scale using USB before I invest in a networked solution. Basler also sells 8-port USB3 PCIe cards for their industrial applications (https://www.baslerweb.com/en-us/shop/basler-usb-interface-card-4hc-5g-8port/)
1 of those is ~ 66 MBps. 24 of those would be 1.59GBps. 20 minutes ish would take up about 2TB, I think that's what I'd expect from one "shoot" of multiple takes of maybe a 3-5 minute performance.
I expect there might be cases where I just delete the raw data after processing, but I'll likely keep some datasets for tinkering / experimentation / open-sourcing.
Getting the data from the capture rig into a long-term NAS or processing machine is basically the thinking here. I realize it's really rather open-ended and depends entirely on how I want to setup that NAS & processing machine, yes.
I was planning to have the capture rig be Linux, then Windows for the Processing machine. But really agnostic for where it goes after capture.Which OS?
PCIe hotswap can be tricky.
Considering maybe the system writes directly to a USB4 drive, yeah.Portable storage sounds like it will need to be usb.