SomeGuy133
2[H]4U
- Joined
- Apr 12, 2015
- Messages
- 3,447
I use Teracopy and SnapRAID to do my best to reduce and prevent bit flips/rot and other types of errors.
I wanted to use a cache to speed up my HDDs in my server but I am concerned if a cache would add a new layer for errors that I can't prevent. And/or prevent SnapRAID from working correctly.
This isn't perfect but this is sorta how data works if I understand how teracopy works and ECC.
assume transferring on server HDD to HDD
HDD->OS->Server ECC RAM (if using system write cache)-HDD
teracopy than verifies CRC.
Server-Desktop (using desktop to access server)
HDD->Network->OS->Desktop non-ECC RAM (if using system write cache)-HDD
teracopy than verifies CRC.
Using Primocache (assume transferring on server HDD to HDD)
HDD->cache->OS->RAM(if using system write cache)-HDD
Teracopy verifies cache? and not original source?
Does Optane or Primocache verify data?
Am I opening myself up to more possible errors i can not see or prevent?
FYI I have seen Teracopy prevent 100s-10,000 of errors since i started using it.
It really depends the situation where errors come:
1.) USB drives/network transfers are more likely to create an error.
2.) Failing HDDs can spit out single digit error rates. I had a dying drive spit out like 1 or 10% of all files have errors. Forget the exact number. I posted it somewhere. I would have never know it was spitting out so many bad copies if it wasn't for teracopy. It was when I first started to use it and tested it out on an old HDD. (Seagate of course)
3.) type of media and connection makes big difference. Same with age.
I wanted to use a cache to speed up my HDDs in my server but I am concerned if a cache would add a new layer for errors that I can't prevent. And/or prevent SnapRAID from working correctly.
This isn't perfect but this is sorta how data works if I understand how teracopy works and ECC.
assume transferring on server HDD to HDD
HDD->OS->Server ECC RAM (if using system write cache)-HDD
teracopy than verifies CRC.
Server-Desktop (using desktop to access server)
HDD->Network->OS->Desktop non-ECC RAM (if using system write cache)-HDD
teracopy than verifies CRC.
Using Primocache (assume transferring on server HDD to HDD)
HDD->cache->OS->RAM(if using system write cache)-HDD
Teracopy verifies cache? and not original source?
Does Optane or Primocache verify data?
Am I opening myself up to more possible errors i can not see or prevent?
FYI I have seen Teracopy prevent 100s-10,000 of errors since i started using it.
It really depends the situation where errors come:
1.) USB drives/network transfers are more likely to create an error.
2.) Failing HDDs can spit out single digit error rates. I had a dying drive spit out like 1 or 10% of all files have errors. Forget the exact number. I posted it somewhere. I would have never know it was spitting out so many bad copies if it wasn't for teracopy. It was when I first started to use it and tested it out on an old HDD. (Seagate of course)
3.) type of media and connection makes big difference. Same with age.