Well, the plot thickens. It's NOT the NAS, it's NOT the SOC in it. I think the culprit here is . . .
* drum roll please *
The software RAID configuration. Either the drives or the software layer trying to handle RAID is failing miserably.
Take a look at this image of a transfer I am...
To be clear, the storage pool is on the Windows Server, the NAS is using a simple RAID 5 array with EXT4 as the file system -- I believe that is the standard configuration on those things.
I concur. I really don't think it's the WD either. Unfortunately, this means comparisons, which take time, and time costs money. I think I'm going to just let it ride for now until the job finishes so I can invoice. Afterwords, when the dust settles, I can compare all day long and figure out...
Even using "Storage Pools" on Windows Server 2012? That is what I'm currently using. It also seems as if there is some sort of difference between storage pools and straight-up "software RAID" available within Disk Management. I could be wrong, but it just seems that way. I'm wondering if there...
Seems like I run into the same issues over and over again, large data buses that promise the world, but when it comes down to it, just fail.
Would increasing the NAS's RAM help us in this situation possibly?
Just curious, is it possible the cache on the WD Red drives on the TARGET server is filling up over and over. When I back off for a period of time and resume transfer, suddenly I'm back to 100+MB/s.
I'm willing to fork over some green if someone can figure this out. This will dog me on the next...
I would love to do that, but I am afraid I will interrupt the copying process while I'm shutting down the service and create a whole new problem for myself.
I was actually able to pause the process on the server-side, update the network drivers, then continue the process -- upon which I...
And herein lies the rub.
That is exactly what is happening. It starts out fast for a couple of minutes, then chokes down to around 35 MB/s average.
Therefore, we can rule out the capability of the link, the link is definitely able to sustain 115 MB/s without issue.
BOTH the drives in the NAS...
I have seen the flow of these conversations before on other threads. I suppose we shall have to start checking off things.
ALL files I am transferring (98% of them) are very large (3-10 GB) in size. You are (of course) correct about the smaller files choking down the flow of data. But, to make...
I am supremely frustrated this morning. I have a very large file transfer to complete for a client and (initially) everything was working smoothly at first.
Setup
1. Server with Gigabit Network Adapter
2. Western Digital MyCloud PR4100
BOTH ends of the connection have a gigabit capable...
You do not sound stupid my friend. Yes, I have looked into and downloaded several of these programs. Some of them are good and others are not. I do have scripts setup that take care of some of this, but honestly, I haven't seen any that will handle ALL situations. I am charging the customer for...
That is an EXCELLENT reply! I truly appreciate this level of response. I don't normally take on this line of work, even though I have the necessary equipment, setup and software configured and ready to use. Many of my clients just say "whatever it costs", but I really would like to have some...
Good suggestion as far as the technical aspect, but it doesn't answer the question how much to charge. Also, unfortunately, the individual I am working with is definitely not a technically-minded person. They would be thoroughly confused browsing around a plethora of folder trees to get at their...
I have a client who brought me 12 external hard drives. They wanted me to go through them and merge and combine everything into one drive. Sounds simple, no? It hasn't been that.
There is a lot of manual work because much of the drives have different data types on them.
My question: In your...
I paid like $200 for a EE subscription and I couldn't get a reply to a question like this in a few hours. I come here and I get a high-quality reply in no time at all. Go figure.
Now to the topic at hand. the UrBackup feature set is really quite impressive and I would not mind paying for...
I am looking to build out a "basic" backup server on which I want to run UrBackup.
I have a copy of Windows Server 2012 as well as Windows Server 2016.
I will NOT be running any other application or other services on this server.
I would like some opinions on whether I should use Windows or...
Solved! On the right side of the CMOS battery (from the original picture orientation), you can pull the plastic container that holds the battery in the downward direction. That side of the container is separate from the rest of it, so it bends just enough to pull the battery out. Once out, CMOS...
I knew I could count on you guys. Thank you. Now, how to disconnect the battery without removing it. I might slip something thin in between the contacts so I don't have to remove the whole heat sink. Any ideas?
I am working on an appliance device that is using an old motherboard (2009 time frame).
I would like to have some help identifying what motherboard this is so I can learn how to reset its BIOS settings. There is no CMOS battery (or I just haven't located it.
Can anyone give me a hand here?
I will take a serious look at that program. What type of transfers have you done with it? Large files, small files, etc.
Thank you very much for your recommendation. I will add it to my list of potentials.
I have a couple of thoughts. First off, thank you for suggesting the PowerShell script. It looks very interesting.
As I'm contemplating this more and more, I'm getting concerned that I have no control over this procedure. I don't have ...
1). Some sort of progress indicator (this isn't a...
I guess I went a little overkill. I keep seeing "10 Gigabit" Ethernet cards, but I have had bad experiences with "1 Gigabit" cards that never performed anywhere near that. So --- I bought two SFP+ 10 Gigabit cards. Going to run a whip (short) DAC cable from one sever to the other. I have seen...
That's REALLY good information and the guidance I was looking for. Unfortunately, I am forced to work in a Windows environment.
Can you disable indexing while running Robocopy?
Should I not consider using cgwin (forgive me if I typo the name) to run rsync?
I will be using Windows Server 2012...
Morning Gentleman, Good to see my fellow problem solvers have had their cup of java already! I have always come back to this forum. It seems to be the old reliable in a sea of forums.
Back on topic -- I'd like to get an affirmative "I've broken the glass" from someone dealing with very large...
I have, what I stupidly thought, was a simple problem. I will (soon) have two 6-bay Windows servers.
I want to duplicate Server A to Server B efficiently and without implementing DFS. Why? Neither of the servers are on a domain and I don't want to upgrade them to a domain controller. I want to...
I'm a bit confused by this approach to connecting a SAS controller. Why is this person using two different brands of cables? It shouldn't matter. I guess my question is, why did he even mention the brands? Any ideas?
In the link below, do a text search for the phrase "Hi All, got everything...
Trying to find a home for these two units. They are in excellent working condition. Prices negotiable.
Dell PowerEdge R610 Server / 2 x Xeon Quad-Core 2.13 GHz CPUs - $500
Dell PowerEdge 2950 Server / 2 x Xeon Quad-Core 2.0 GHz CPUs + UPS - $300
I want to take the time to thank all of you for putting in the effort to answer my question. I am considering all of your comments. I knew this was a community I could count on!
Let me give some more background on the situation.
Firstly, thank you for the suggestions to use ZFS. In fact...
It's been a while since I have posted. I think becoming a father soon has something to do with it ;). Anyhow, I am having a very tough time solving a simple problem and I thought I would ask in this forum.
My goal is to have an automated backup for all of my clients who I work for that...
Likewise. I am also looking forward to see how this turn out. Things are slowing down for me at the moment because I am also in the process of finishing the room all of this equipment will go in.
Take a look at the new drive photos I just posted. These drives were delivered some time ago and...
I hear everything you're saying, but I am not sending these back. They were at the right price. If they don't fail miserably, I will keep using them until I have a good reason to upgrade the model. Your is assessment is correct though.
I looked at that same page when I was in the process of purchasing the drives. The drives I have are in teh same "line", but I believe the particular model I have are enterprise rated - designed for high availablility (whatever that means as far as manufacturing goes). It might not be everyone's...
I can't speak to the warranty. To be completely honest, I didn't look. I generally don't rely or am concerned with warranties - ESPECIALLY when dealing with non-U.S. companies purely because of the pain in getting service. THAT time is better spent getting back up and running. goHardDrive DID...
Hmm. Well, it all depends on what you define as "work" :D. I am running a business from "mi la casa". Live production data WILL be stored on this machine. So, risk wise, it's definitely for work. I will be posting detailed captions for each photo soon. Click on each thumbnail to view the full...
I love the phrase "self-healing". It sounds like a monster out of LOTR or something. Not downplaying that by any means. But, every time I come across that phrase in IT, it just gives me a feeling of "mwahahah, you cut my hand off, I'll grow it back!" :D.
"It's a ZFS monster! RUN!"