OpenSolaris derived ZFS NAS/ SAN (OmniOS, OpenIndiana, Solaris and napp-it)

_Gea said:
Everything seems like it should be.
-You have tried to replace a missing disk with a missing disk, resulting in an error
-You have a Spare that replaced this faulted disk (Spare is now in use)

Needed Actions:
Insert a working disk and do a
zpool replace c2t5000CCA369CD615Fd0 'new and working disk'
A resilver will start and after that your spare is available again

-Clear remaining errors
Click to expand...

Gea,
Thanks for your response and helping a ZFS noob.
Here are a few things that I want to accomplish (not necessarily in the correct order).
1. I want to remove "c2t5000CCA369CD615Fd0/old" & "c2t5000CCA369CD615Fd0" from the zfs_p1 pool (so no longer visible via zpool status.
2. The INUSE spare "c2t5000CCA36AC2ADB6d0" should be set to ONLINE
3. zfs_p1 should change from DEGRADED to ONLINE

NOTE: Previous tests of the c2t5000CCA369CD615Fd0 disk using DFT showed no errors. So I am not sure what is wrong with this disk, why it originally faulted. I need to figure out what other tests I can run on this Hitachi 5k3000 HD.
 
Hello guys,

Is there any way to locate a failed hard drive by flashing an LED light?

I'm able to do this with Nexentastor, but not with OI+Napp it.

Thanks!
 
crept said:
Hello guys,

Is there any way to locate a failed hard drive by flashing an LED light?

I'm able to do this with Nexentastor, but not with OI+Napp it.

Thanks!
Click to expand...

Napp-it does have a locate drive feature by using DD. I forget exaclty where you go in the web interface to access it. Also curious if this would work if the drive is marked failed.
 
shanester said:
Gea,
Thanks for your response and helping a ZFS noob.
Here are a few things that I want to accomplish (not necessarily in the correct order).
1. I want to remove "c2t5000CCA369CD615Fd0/old" & "c2t5000CCA369CD615Fd0" from the zfs_p1 pool (so no longer visible via zpool status.
2. The INUSE spare "c2t5000CCA36AC2ADB6d0" should be set to ONLINE
3. zfs_p1 should change from DEGRADED to ONLINE

NOTE: Previous tests of the c2t5000CCA369CD615Fd0 disk using DFT showed no errors. So I am not sure what is wrong with this disk, why it originally faulted. I need to figure out what other tests I can run on this Hitachi 5k3000 HD.
Click to expand...

Unless you have a failed disk, your pool is degraded
- the fact that you have full redundancy due to the hot spare does not matter

- a spare is a spare-
does not matter if available or in use

- you can detach a failed disk and use a hot spare
http://docs.oracle.com/cd/E19253-01/819-5461/6n7ht6qvv/index.html#gjfbz

!! it would be better to replace the faulted disk and keep the hot spare available !!

- if all faulted disks are replaced or the active spare become part of the pool, you can clear the remaining errors and the pool is online again.
 
crept said:
Hello guys,

Is there any way to locate a failed hard drive by flashing an LED light?

I'm able to do this with Nexentastor, but not with OI+Napp it.

Thanks!
Click to expand...

You can locate (active disks) with dd in menu disks if you have activity led's.

If you have a LSI SAS2 controller, you can locate disks with the SAS2 extension
on supported backplanes (menu disks-sas2 extension)

Otherwise:
with SAS1: your disk id's like c0t0d0 are port numbers of your controller (first disk on first controller)
with SAS2: you must write down the WWN like c0t5000C50033438DBBd0 of your disks to identify
 
Thanks for the quick response.

Under DISKS->DETAILS I can see "identify" via dd, but if I click on one of the listed hdd's, all hdd activity lights blink.
I'm using a m1015, flashed to LSI 2008 in IT mode.
This is a chenbro 2u 12 slot enclosure.

Any ideas?

HDDS are listed as:

Code: 
zpool status:
Pool
  pool: mws
 state: ONLINE
  scan: none requested
config:

	NAME                       STATE     READ WRITE CKSUM     SLOT           CAP            MODELL
	mws                        ONLINE       0     0     0
	  mirror-0                 ONLINE       0     0     0
	    c3t5000C50051E38BFBd0  ONLINE       0     0     0                    3.00 TB        ST3000DM001-1CH1
	    c3t5000C50051E5C31Bd0  ONLINE       0     0     0                    3.00 TB        ST3000DM001-1CH1
	  mirror-1                 ONLINE       0     0     0
	    c3t5000C50051E6424Dd0  ONLINE       0     0     0                    3.00 TB        ST3000DM001-1CH1
	    c3t5000C50051E6E39Dd0  ONLINE       0     0     0                    3.00 TB        ST3000DM001-1CH1
	cache
	  c3t0000120000000000d0    ONLINE       0     0     0                    240.06 GB      MKNSSDCR240GB-DX

errors: No known data errors

  pool: rpool
 state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
	still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
	the pool may no longer be accessible by software that does not support
	the features. See zpool-features(5) for details.
  scan: none requested
config:

	NAME        STATE     READ WRITE CKSUM     SLOT           CAP            MODELL
	rpool       ONLINE       0     0     0
	  c5t0d0s0  ONLINE       0     0     0                    34.36 GB       Virtual disk

errors: No known data errors

Thanks!
 
@_Gea

Thank you! I detached the two unavailable drives. The spare is now part of the pool and the pool is in an ONLINE state. Now I need to figure out what is wrong with this drive.

Code: 
pool: zfs_p1
 state: ONLINE
status: The pool is formatted using an older on-disk format.  The pool can
	still be used, but some features are unavailable.
action: Upgrade the pool using 'zpool upgrade'.  Once this is done, the
	pool will no longer be accessible on older software versions.
  scan: scrub repaired 0 in 11h55m with 0 errors on Mon Nov 26 10:57:36 2012
config:

	NAME                       STATE     READ WRITE CKSUM     CAP            Product
	zfs_p1                     ONLINE       0     0     0
	  raidz2-0                 ONLINE       0     0     0
	    c2t5000CCA369CAB2A4d0  ONLINE       0     0     0     2.00 TB        Hitachi HDS5C302
	    c2t5000CCA369CD3F3Ad0  ONLINE       0     0     0     2.00 TB        Hitachi HDS5C302
	    c2t5000CCA36AC2ADB6d0  ONLINE       0     0     0     2.00 TB        Hitachi HDS72302
	    c2t5000CCA369CD6427d0  ONLINE       0     0     0     2.00 TB        Hitachi HDS5C302
	    c2t5000CCA369CF89D1d0  ONLINE       0     0     0     2.00 TB        Hitachi HDS5C302
	    c2t5000CCA369CF9DD7d0  ONLINE       0     0     0     2.00 TB        Hitachi HDS5C302
	  raidz2-1                 ONLINE       0     0     0
	    c2t5000CCA36AC2A785d0  ONLINE       0     0     0     2.00 TB        Hitachi HDS72302
	    c2t5000CCA36AC2ADB2d0  ONLINE       0     0     0     2.00 TB        Hitachi HDS72302
	    c2t5000CCA36AC2BCCAd0  ONLINE       0     0     0     2.00 TB        Hitachi HDS72302
	    c2t5000CCA36AC2BCCDd0  ONLINE       0     0     0     2.00 TB        Hitachi HDS72302
	    c2t5000CCA36AC2BCDAd0  ONLINE       0     0     0     2.00 TB        Hitachi HDS72302
	    c2t5000CCA36AC2D771d0  ONLINE       0     0     0     2.00 TB        Hitachi HDS72302

errors: No known data errors
 
crept said:
Thanks for the quick response.

Under DISKS->DETAILS I can see "identify" via dd, but if I click on one of the listed hdd's, all hdd activity lights blink.
I'm using a m1015, flashed to LSI 2008 in IT mode.
This is a chenbro 2u 12 slot enclosure.

Any ideas?

!
Click to expand...

Try the sas2 extenson (optionally request an eval key at http://www.napp-it.org/extensions/evaluate_en.html) or insert one disk by another and write down the WWN and the slot where the disk is plugged in.
 
setting ACL's from win 7 home does not work.. pfff....pulling my hair out

why are such basic things as setting file permissions only available as extension?
i'm a home user
 
nl-darklord said:
setting ACL's from win 7 home does not work.. pfff....pulling my hair out

why are such basic things as setting file permissions only available as extension?
i'm a home user
Click to expand...

beside the option to pay for Win7 Pro you can
- use CLI on OI to set all ACL options
- use the napp-it ACL extension to set user or trivial ACL (like owner or everyone), this is free and available without registration
 
NTFS privs are really a lot more complex than most people think, and often more than people really need. The UI in winPro hides QUITE a lot of the dirty work going on.
 
wkearney99 said:
NTFS privs are really a lot more complex than most people think, and often more than people really need. The UI in winPro hides QUITE a lot of the dirty work going on.
Click to expand...

Beside home-use with a few users, you need NTFS like Windows ACL/ Unix NFS4 ACL or you are lost.

OR
you open your filer with Unix permissions completely because you cannot set the needed multi-user or multi group based fine granular permissionns
 
Hey,

I have been using OI + napp-it for awhile now. Previously I had a single vdev of 10 HD204UI's in a raidz2. I purchased 10 ST3000DM001 drives and plan to put them in a second 10 drive raidz2 vdev, in the same pool.

Currently the pool has an ashift value of 9. When I went to create the new vdev I saw this option:

experimental!, opt. unstable, only for evaluation
force 4k optimized vdev with modified zpool force ashift=12 - requires Pool ZFS V.28

Should this be enabled when adding this new vdev to the existing pool? Does this affect the existing HD204UI vdev, or only the new vdev?

Thanks for any assistance with this.
 
CJ145 said:
Hey,

I have been using OI + napp-it for awhile now. Previously I had a single vdev of 10 HD204UI's in a raidz2. I purchased 10 ST3000DM001 drives and plan to put them in a second 10 drive raidz2 vdev, in the same pool.

Currently the pool has an ashift value of 9. When I went to create the new vdev I saw this option:

experimental!, opt. unstable, only for evaluation
force 4k optimized vdev with modified zpool force ashift=12 - requires Pool ZFS V.28

Should this be enabled when adding this new vdev to the existing pool? Does this affect the existing HD204UI vdev, or only the new vdev?

Thanks for any assistance with this.
Click to expand...


I would only use the modified zpool binary for speed tests with older 4k disks that do not create ashift=12 vdevs automatically or with a modified sd.conf.

In your case, I would create a new test pool and check the ashift value. If it is 12, you can just add a new vdev with the correct ashift value (this is a vdev parameter). If not, you can try to force ashift=12 via sd.conf.
 
Thanks,

I made another test pool (had been stressing them in before), and saw that it was ashift=12. Then I added the drives as a new vdev to the existing pool and they showed up as ashift=12 as well. Nice that this is handled automatically and properly. Now just to clone all the data to help spread it out some. >.>

BTW, thanks for napp-it, it is an amazing piece of software.
 
Hey guys I have been looking around and cant find anything similar to my issue. I have 6 hard drives in a raidz2 and noticed in napp it that the H error has been going up on all 6 drives

OI version oi_151a5

" Error: S:0 H:42 T:0"

It was at 3000+ before but i scrubbed, cleared errors, restarted than it was back at 0, now its going up again.

Anyone have any idea what could be happening? Write speeds are slower than normal and gui has been slow as well.

The ssd that open indiana is installed on is also reporting errors "Error: S:2 H:12 T:0"

Let me know if there is anything else i can provide to help diagnose the issue.
Thanks
 
Last edited:
I'd guess you have a bad drive in there. I'd try replacing it and see if the count continues.
 
monkizzle said:
I meant to include that the H errors are showing up on ALL 6 drives.
Click to expand...

if all of your drives are affected there are two main possibilities, well, maybe 3.

1) your drives suck.

2) the HBA they're connected too is having problems.

3) you have a vibration problem.


I would look at 3 first. Make sure your drives are securely mounted. If there is no data on these drives yet then blow away the pool, turn off all but two of the drives, and setup a mirror.

if that clears up the problem, add another mirror and test. repeat until all drives are provisioned. if you have a vibration problem at some point while adding drives it will appear again.

As for the drives themselves, if these are say WD greens or something I could see a situation where the green parking features cause problems.

do an 'fmdump -e -t1day | less' if there are any errors paste them here.
 
madrebel said:
if all of your drives are affected there are two main possibilities, well, maybe 3.

1) your drives suck.

2) the HBA they're connected too is having problems.

3) you have a vibration problem.


I would look at 3 first. Make sure your drives are securely mounted. If there is no data on these drives yet then blow away the pool, turn off all but two of the drives, and setup a mirror.

if that clears up the problem, add another mirror and test. repeat until all drives are provisioned. if you have a vibration problem at some point while adding drives it will appear again.

As for the drives themselves, if these are say WD greens or something I could see a situation where the green parking features cause problems.

do an 'fmdump -e -t1day | less' if there are any errors paste them here.
Click to expand...

1. They are seagate ST2000DM001-9YN1
2. they are plugged directly to the motherboard
3. i will double check.
 
monkizzle said:
1. They are seagate ST2000DM001-9YN1
Click to expand...
those are geenerally good quality drives. one having trouble, ok that isn't abnormal.
2. they are plugged directly to the motherboard
Click to expand...
AHCI mode?

it would be extremely strange to have all of the sata cables going bad. only to check there would possibly be something causing interference to the cables themselves. would be a really strange thing to have though and not very likely.
3. i will double check.
Click to expand...
i am leaning more towards vibration now. like i said above, one drive having problems is not strange. all the drives having problems all at the same time and you're looking for something that effects all the drives. this would be cabling (rare but possible), backplane/JBOD (N/A for you?), HBA, or vibration.

my guess is vibration at this point but i could be wrong.
 
Here goes everything.

We needed to buy a new ESX server before year end and as luck would have it our MD3000i had a RAID controller die on us. This backed us into a bit of a corner because now we needed an ESX server as well as a new NFS SAN or a replacement part on an EOL SAN.

We're going with a SuperMicro based build using an all-in-one configuration. I was able to spec out all VMWare HCL parts of just a little more than what the R710 we planned to build would cost.

This will still give us a 48GB OI/Napp-It VM with the 144GB ESX server. The upshot is that we will do the following with this approach:

  • We drop vendor lock-in with Dell specific SAS drives
  • We can host our DB servers on this new box and get the best performance we can without upgrading everything to 10G
  • We have a MOBO that can take us to 784GB of RAM and we can add another 192GB without throwing out a single stick of RAM
  • We can utilize 6Gb/s drives where the MD3000i was a 3Gb/s backplane
  • We can use SAS and SATA drives depending on what tier level of storage we need
  • We can now expand to the 45 bay SuperMicro JBOD chassis for < $2000

Granted, my job is kinda on the line if this all goes tango uniform on us, but we're not using any cheap components. We're all SuperMicro, Intel, and Samsung which is probably what we would get with a branded server. Our hardware should all be Nexenta HCL compliant (MoBo is off the list due to being a 2011 chipset) in case we ever needed to look into HA and that is not even on the radar right now.

Napp-It has really helped me to get into the ZFS world and now I can usually do things faster in the CLI than the UI, but this is a great springboard.

When everything comes in I will look to put a build thread together. I've spent the last couple of weeks coming up with options that will not break the end of year budget and I can say that OI/Napp-It with ESX just saved us enough off the top to buy enough spare hardware to render 4 hour replacement irrelevant. We can have spare parts sitting in our cage about 100' from our NOC if something fails.

Both this thread and http://www.zfsbuild.com helped to get us going in the right direction.

Thanks Gea for the work you've put into Napp-It. There are things I would like to see changed or added to the UI but considering what a vendor would charge or what a Dell/HP solution would cost I can live with the need to drop to the command line from time to time. To the skeptics, we were on Dell hardware and even that fails. We've lost a RAID controller and a SAS controller to an MD1000, so nothing is rock solid. For what we are spending to put together this all-in-one we could do two for the price of our initial hardware.

I'm keeping my fingers crossed that I have researched every angle of my suggestion to management but at the end of the day I think this was the right decision. We basically added a second CPU, upgraded the mobo (less than $100), and added RAM and ended up where we planned to be anyway.

I know some will say that EMC, Nexenta, HP, or Netapp would be the way to go an I would probably agree. On the other hand, this was very much an unplanned event that we had no option than to work around and for what we get I am sure we could build a second server with spare parts for half of what I have seen for any of the above vendors. There's a very rough point in the growth of a business where you are big enough to need a big vendor to come in while being small enough to not have the $30k+ budget to throw at hardware. I think we are one of the 'tweener companies that need an enterprise configuration for growth but don't have the growth to support the necessary budget.

I guess what I am trying to say is: thanks for all of the info and to those who have been blazing this trail. It would be nice to win the lottery and just have EMC come in an write them a check unfortunately this isn't the world I get to live in.
 
madrebel said:
those are geenerally good quality drives. one having trouble, ok that isn't abnormal.
AHCI mode?

it would be extremely strange to have all of the sata cables going bad. only to check there would possibly be something causing interference to the cables themselves. would be a really strange thing to have though and not very likely.

i am leaning more towards vibration now. like i said above, one drive having problems is not strange. all the drives having problems all at the same time and you're looking for something that effects all the drives. this would be cabling (rare but possible), backplane/JBOD (N/A for you?), HBA, or vibration.

my guess is vibration at this point but i could be wrong.
Click to expand...


Alright so i rebuilt the NAS and this time used vibration dampeners on the hard drives. destroyed the pool and i ran the format analyze test on of the hard drives and I still have H errors.

The H errors show up on my 64GB SSD Crucial M4 now along with my six 2TB Seagates. Any other ideas?

On one of the seagates i used seatools and did extended test as well as low level format, put it back in and H errors still go up. Ive restarted the NAS as well (H errors reset to 0)

Any ideas what I could try next? Ports are set to AHCI.
 
c4t0d0, c4t1d0,c4t2d0 are all currently running "analyze test" so the H errors are down but other 3 havent been toughed

c3t1d0 is my 64gb ssd which is also showing errors

iostat -en
---- errors ---
s/w h/w trn tot device
0 0 0 0 c4t0d0
0 6 0 6 c4t1d0
0 288 0 288 c4t2d0
0 10032 0 10032 c4t3d0
0 10032 0 10032 c4t4d0
0 10032 0 10032 c4t5d0
0 0 0 0 c3t0d0
0 3744 0 3744 c3t1d0
0 0 0 0 c5t0d0
0 0 0 0 c6t1d0
0 0 0 0 c6t5d0
0 0 0 0 c6t4d0
0 0 0 0 c6t0d0
0 0 0 0 c6t6d0
0 0 0 0 c6t7d0
 
madrebel said:
if all of your drives are affected there are two main possibilities, well, maybe 3.

1) your drives suck.

2) the HBA they're connected too is having problems.

3) you have a vibration problem.


I would look at 3 first. Make sure your drives are securely mounted. If there is no data on these drives yet then blow away the pool, turn off all but two of the drives, and setup a mirror.

if that clears up the problem, add another mirror and test. repeat until all drives are provisioned. if you have a vibration problem at some point while adding drives it will appear again.

As for the drives themselves, if these are say WD greens or something I could see a situation where the green parking features cause problems.

do an 'fmdump -e -t1day | less' if there are any errors paste them here.
Click to expand...

Results from fmdump =e =t1day | less

there is an endless amount of
Dec 06 12:11:37.6100 ereport.io.scsi.cmd.disk.dev.rqs.derr

Update: Could it be the OI installation? all 12 drives have errors now. I have no idea whats going on. 12 hard drives and my ssd.
iostat -e
---- errors ---
device s/w h/w trn tot
sd0 0 78 0 78
sd1 0 78 0 78
sd2 0 78 0 78
sd3 0 138 0 138
sd4 0 138 0 138
sd5 0 138 0 138
sd6 0 0 0 0
sd7 0 1296 0 1296
sd8 0 0 0 0
sd9 0 5 54 59
sd11 0 2 9 11
sd13 0 1 11 12
sd14 0 3 30 33
sd15 0 0 11 11
sd16 0 4 36 40
 
Last edited:
monkizzle said:
Results from fmdump =e =t1day | less

there is an endless amount of
Dec 06 12:11:37.6100 ereport.io.scsi.cmd.disk.dev.rqs.derr

Update: Could it be the OI installation? all 12 drives have errors now. I have no idea whats going on. 12 hard drives and my ssd.
iostat -e
---- errors ---
device s/w h/w trn tot
sd0 0 78 0 78
sd1 0 78 0 78
sd2 0 78 0 78
sd3 0 138 0 138
sd4 0 138 0 138
sd5 0 138 0 138
sd6 0 0 0 0
sd7 0 1296 0 1296
sd8 0 0 0 0
sd9 0 5 54 59
sd11 0 2 9 11
sd13 0 1 11 12
sd14 0 3 30 33
sd15 0 0 11 11
sd16 0 4 36 40
Click to expand...


First of all, unless you have a degraded pool, there is no serious error.

BUT
these errors may indicate future problems.

BUT
it is very hard to find semi dead hardware

usual way:
use a second identical system where you can put in part by part waiting for the error to appear (hoping its not a dual reason error)

OR
replacing part by part in your system, waiting for disappearing of the error to find the part that is not working correctly.

Because you have errors on all disks, most likely reaon is
- disk-controller (try another controller)
- power supply (try another power supply)
- RAM (remove half of the RAM, check the other half)
- Mainboard + CPU (need another mainboard)

check/ replace them in this order
 
_Gea said:
First of all, unless you have a degraded pool, there is no serious error.

BUT
these errors may indicate future problems.

BUT
it is very hard to find semi dead hardware

usual way:
use a second identical system where you can put in part by part waiting for the error to appear (hoping its not a dual reason error)

OR
replacing part by part in your system, waiting for disappearing of the error to find the part that is not working correctly.

Because you have errors on all disks, most likely reaon is
- disk-controller (try another controller)
- power supply (try another power supply)
- RAM (remove half of the RAM, check the other half)
- Mainboard + CPU (need another mainboard)

check/ replace them in this order
Click to expand...

I might just being paranoid, but seeing that number go up scares me. I rebuilt pools and everything and H errors still come up. motherboard is really only thing in common. 6 of the drives on dell perc 6ir stopped giving errors since last restart.

I guess the ultimate question is do i have to worry right now if everything else is working fine?
 
there is something wrong with the hardware. you've dampened vibration. highly unlikely all of your same manufacturer drives are all going bad but the ssd is throwing errors too?

at this point i would suggest flashing firmware or trying a different HBA. a few errors aren't bad but youre having too many in way to short of a time.

http://dsc.sun.com/solaris/articles/scsi_disk_fma2.html
 
Looks like power problem...try switching PSU and see if you still get hardware problems,could also be a grounding problem after dampening the drives! Happenend to me once!
Is your PSU powerful enough?

Gr33tz
 
Ill try a new PSU tonight. Its hard to figure out whats wrong cause if one thing is working something else isnt, etc.

6 seagates are plugged into mobo, 2 ssd's are plugged into mobo. ALL of these except 1 have H errors.

6 other seagates are plugged into dell perc 6ir and arent getting errors anymore.

all drives off same PSU, Its a 500 watt seasonic. i would expect that to be enough.
 
madrebel said:
flash the mobo firmware to a newer version if you can.
Click to expand...

Mobo is already newest one.

Powered hard drives from another PSU with no luck.

Guess memory test is next, not sure what else. Does anyone know exactly what an H error means?
 
I am trying to sort through the log and I have alot of these... any ideas?

scsi: [ID 107833 kern.warning] WARNING: /pci@0,0/pci1458,b002@11/disk@2,0 (sd2):
Log Sense Failed
 
For anyone that is following my problem, here is an update...

Last night i built another computer with all newish parts and moved 6 of my 2TB drives over. Installed OI and napp it on a 16gb flash drive. Imported my pool successfully.

Transferred hundreds of gigs over and no H errors at all yet.

Now that i have ruled out the hard drives as being the problem, its time to start ruling out the other things.

Thanks for all the ideas!
 
Question on L2ARC:

I just picked up 2 Intel 330 120GB SSD drives for my new production AIO server but after thinking about it a bit more I think those might be best served as L2ARC drives for the remaining datastores. Due to migrating the drives out of my MD3000i array I will have 3 different drive types and sizes so I will need to have 3 L2ARC drives (ideally). I know the Intel 520 drives are great for L2ARC and I have one for our fastest drives, but the remaining pools will be 6x1TB 7200RPM SAS Seagate Constellation drives (mirrored) and 10 2TB 7200RPM SATA drives (mirrored).

Looking at scsi4me I can get 2 brand new 10k RPM 73GB SAS drives for $30 each so it seems like a better use of resources to get 2 of those in a mirror for VMWare/OI and move the 330's to cache.

I haven't seen too many mentions of the 330's as cache drives, but the specs seem like they should do fine on the 7200RPM drives.

Would you go with the 330's now or hold off and add a 520 to each pool later?
 
hello,
first of all i want to thank _Gea for all this.
i am in the process off building a file server (has to be very stable)
i have an lsi 9750 8i controller at hand, but i know about the problems with raid cards.
i asked lsi if there is a IT firmware for it, but they said there is not.
so my question is, what exactly is the problem using a raid card for zfs ( i can create single disks with the controler, but they are somehow different) ?
and
Would you recommend using it in a stable environment ?
and
What elso should i do with it ? ( it was used for a 4 ssd raid0 but today a single ssd is faster than that). Are the chances good for selling it on ebay ?
thanks for your answers.

and another question regarding my current nas.
is it possible to reset all permissions on all files ? (i messed up)
 
Hey all,

I finally was able to procure a managed switch, and working with my dual NICS on my mobo. I got 4 2TB reds setup in a ESXI all-in-one OI vm. I added the NFS to my esx servers, and loaded up some VMs. I am getting TERRIBLE write speeds. Is there anything that jumps out to you? I mean something has to be really wrong to get speeds that low.

The specs on my main server is Supermicro X8DAH, Intel X5650, 72gb ddr3 ECC Reg then I have 4 2tb WD Reds in a raidz1 setup and a 40gb SSD, dual intel nic. I have OI setup with 16gb ram and 4 virtual sockets with 2 cores per socket.

My other two servers are ASRock H77 Pro4-M, Intel Xeon E3-1230 V2, 32GB DDR3 desktop RAM.

And a Dell 5324



35n358p.jpg
 
Are the NFS share using sync write? if so try going off (async) and try again..

This is a setting on the shares in napp-it.
 
x-cimo said:
Are the NFS share using sync write? if so try going off (async) and try again..

This is a setting on the shares in napp-it.
Click to expand...

RedPool/RedFolder_sync = standard ?

disabled that and got this

25f0dpc.jpg
 
Last edited:
You must log in or register to reply here.
Back
Top