Nexenta NAS Error

N

nbat58

Limp Gawd
Joined
Oct 12, 2009
Messages
170
I have recently experienced multiple freezes while watching a movie on my NAS while accessing it via my popcorn hour via SMB, I have tried accessing the NAS (24 HDD's) via MY WINDOWS 7 PC and Nappit and found that my NAS was loosing the network connection.

I have managed to open Nappit today (still running nexenta appliance v. 0.500r nightly Jun.27.2011) and found that my pool health was reported as degraded in Nappit, I have clicked on the clear errors and now this shows as online, has the problem been fixed by this or do I need to do something else.

I know I am running Nexenta which is no longer supported and an old version of Nappit, what path and steps do you recommend for an upgrade to current OS like illumian or OmniOS or suggest another OS?
 
Thanks, do I need to export the pool first, then import after installing Omnios, does the degraded message means that one of my drives is giving up?
 
Last edited:
Export the Pool, Install OmniOS/Napp-IT and Import the pool.

You most likely have a drive that's giving issues. You can sort that all out once you've moved over.
 
Should all the hardware drivers that are currently supported on Nexenta will work as well on OmniOs?
 
You can expect that your hardware is supported with OmniOS.

You currently use NexentaCore 3 which is more or less a quite old OpenSolaris build 134. OmniOS (and NexentaStor 4) is based on Illumos - more or less a fork of last free OpenSolaris 148 with many improvements since then and support for newer hardware.
 
Thank you all for all your help, I will get to it as soon as I come back of my summer holidays ;).
 
Here I am again, after the great 2 weeks holidays in the Red Sea Egypt, back to work now and after adjusting to work and the daily grind of life I have decided to look at my NAS again and what to do about the degraded pool problem.

Quite amazed to see that all is well, my drives and pool are all OK and online, I can only put the problem I had to a hot summer we had in the UK and my NAS is in a small attic downstairs.

Now back to it, I am going to upgrade to OmniOs and new napp it soon, but I have been reading about exporting pools with different versions and mountpoints.

My syspool is on a old version 26 and my storage pool is on version 28, is it safe to just export the pool then upgrade to OmniOs and Napp it?

Many thanks for all your help.
 
Hummm... that was a too early diagnoses I think...it has gone again (see below):

zpool list:
Pool VER SIZE ALLOC RES FRES FREE CAP DEDUP FAILMODE AUTOEXPAND AUTOREPLACE ALTROOT GUID HEALTH ENCRYPT ACTION
NAS 28 41.7T 33.3T - - 8.38T 79% 1.00x wait off off - 7798317525941449710 DEGRADED n.a. clear errors
syspool 26 55.5G 4.44G - - 51.1G 8% 1.00x wait off off - 13470680709172973177 ONLINE n.a. clear errors

All files are stored within a storage pool. A storage pool is composed of vdevs (Virtual Devices). A vdev can either be a single drive,
or 2 or more drives that are mirrored, or a group of drives that are organized using RAID-Z(1-3).
The 1,2, or 3 is the number of parity drives needed for that Raid-Z.

For example, a Raid-Z2 composed of 5 drives would have 2 parity drives and 3 drives for storage.

A note about Raid-Z:
If you choose to create a Raid-Z vdev be aware of: Once the vdev is created you cannot increase it's capacity by adding new drives.
If you must increase the capacity of a pool build from a Raid-Z vdev, you have 3 choices.

1. You can add any other vdev type to the existing pool to combine them. (recommended are identical vdev types)
2. You can replace each existing drive within the vdev with a larger drive, set 'autoexpand=on' and perform a resilver command.
3. You can back up all your data to a separate location, destroy the pool and recreate it.

The optimal number of disks in a vdev is a fraction of 128 plus the needed disks for redundancy
ex. if you want to optimize a vdev and use 4, 8 or 16 data-disks you need:
for Raid-Z1: 4+1, 8+1 or 16+1 disks
for Raid-Z2: 4+2, 8+2 or 16+2 disks
for Raid Z3: 4+3, 8+3 or 16+3 disks

These values are best for an optimal balanced pool. But don't forget: ZFS is designed to do its best
with any pool layout and with growing pools. Usually just add as many disks as you need, whether the
number is optimal or the disks are 4k or not. The only basic thing you should be aware:
If you need performance: use a pool build from mirrors
If you need capacity: use a pool build from Raid-Z(1-3)

Click on a pool for details about it's state and it's vdevs.
see also en.wikipedia.org/wiki/ZFS#Storage_pools


zpool status:
Pool

pool: NAS
state: DEGRADED
status: One or more devices are faulted in response to persistent errors.
Sufficient replicas exist for the pool to continue functioning in a
degraded state.
action: Replace the faulted device, or use 'zpool clear' to mark the device
repaired.
scan: resilvered 856K in 0h0m with 0 errors on Fri Jul 18 19:14:22 2014
config:

NAME STATE READ WRITE CKSUM
NAS DEGRADED 0 0 0
raidz1-0 DEGRADED 0 0 0
c2t3d0 ONLINE 0 0 0
c2t2d0 FAULTED 0 3 0 too many errors
c2t1d0 ONLINE 0 0 0
c2t0d0 ONLINE 0 0 0
raidz1-1 ONLINE 0 0 0
c2t6d0 ONLINE 0 0 0
c2t5d0 ONLINE 0 0 0
c2t4d0 ONLINE 0 0 0
c2t7d0 ONLINE 0 0 0
raidz1-2 ONLINE 0 0 0
c2t11d0 ONLINE 0 0 0
c2t10d0 ONLINE 0 0 0
c2t9d0 ONLINE 0 0 0
c2t8d0 ONLINE 0 0 0
raidz1-3 ONLINE 0 0 0
c2t13d0 ONLINE 0 0 0
c2t14d0 ONLINE 0 0 0
c2t15d0 ONLINE 0 0 0
c2t16d0 ONLINE 0 0 0
raidz1-4 ONLINE 0 0 0
c2t17d0 ONLINE 0 0 0
c2t18d0 ONLINE 0 0 0
c2t19d0 ONLINE 0 0 0
c2t20d0 ONLINE 0 0 0
raidz1-5 ONLINE 0 0 0
c2t21d0 ONLINE 0 0 0
c2t22d0 ONLINE 0 0 0
c2t23d0 ONLINE 0 0 0
c2t24d0 ONLINE 0 0 0

errors: No known data errors

pool: syspool
state: ONLINE
status: The pool is formatted using an older on-disk format. The pool can
still be used, but some features are unavailable.
action: Upgrade the pool using 'zpool upgrade'. Once this is done, the
pool will no longer be accessible on older software versions.
scan: none requested
config:

NAME STATE READ WRITE CKSUM
syspool ONLINE 0 0 0
c1t0d0s0 ONLINE 0 0 0

errors: No known data errors
 
Just re-placed the corrupted drive and currently re-silvering, I will upgrade to OmniOs and Napp it once the silvering has finished, hope it is OK doing it this way around.
 
The re-silvering estimated time was 21 hours, I left it for 24 hours and I couldn't access the NAS via Napp-it or via my windows 7 PC.

I have re-booted the server and still the same, anyone got any idea how to trouble shoot this issue?
 
You need to get console access somehow, if network does not work, connect a local keyboard and monitor.
A degraded/failing storage pool should not cause the network to drop. There seems something else wrong with this system.
 
nbat58 said:
The re-silvering estimated time was 21 hours, I left it for 24 hours and I couldn't access the NAS via Napp-it or via my windows 7 PC.

I have re-booted the server and still the same, anyone got any idea how to trouble shoot this issue?
Click to expand...


Try console access and enter ifconfig -a for current ip and try
http://ip:81

or restart napp-it (as root)
/etc/init.d/napp-it restart
 
Really weird, tonight I have managed to access the server via Napp-it and it is still showing degraded, see below:

pool: NAS
state: DEGRADED
status: One or more devices are faulted in response to persistent errors.
Sufficient replicas exist for the pool to continue functioning in a
degraded state.
action: Replace the faulted device, or use 'zpool clear' to mark the device
repaired.
scan: scrub in progress since Thu Sep 18 01:26:25 2014
77.5G scanned out of 33.3T at 142M/s, 68h21m to go
0 repaired, 0.23% done
config:

NAME STATE READ WRITE CKSUM
NAS DEGRADED 0 0 0
raidz1-0 DEGRADED 0 0 0
c2t3d0 ONLINE 0 0 0
c2t2d0 ONLINE 0 0 0
c2t1d0 DEGRADED 0 0 0 too many errors
c2t0d0 FAULTED 0 0 0 too many errors
raidz1-1 ONLINE 0 0 0
c2t6d0 ONLINE 0 0 0
c2t5d0 ONLINE 0 0 0
c2t4d0 ONLINE 0 0 0
c2t7d0 ONLINE 0 0 0
raidz1-2 ONLINE 0 0 0
c2t11d0 ONLINE 0 0 0
c2t10d0 ONLINE 0 0 0
c2t9d0 ONLINE 0 0 0
c2t8d0 ONLINE 0 0 0
raidz1-3 ONLINE 0 0 0
c2t13d0 ONLINE 0 0 0
c2t14d0 ONLINE 0 0 0
c2t15d0 ONLINE 0 0 0
c2t16d0 ONLINE 0 0 0
raidz1-4 ONLINE 0 0 0
c2t17d0 ONLINE 0 0 0
c2t18d0 ONLINE 0 0 0
c2t19d0 ONLINE 0 0 0
c2t20d0 ONLINE 0 0 0
raidz1-5 ONLINE 0 0 0
c2t21d0 ONLINE 0 0 0
c2t22d0 ONLINE 0 0 0
c2t23d0 ONLINE 0 0 0
c2t24d0 ONLINE 0 0 0

errors: No known data errors

pool: syspool
state: ONLINE
status: The pool is formatted using an older on-disk format. The pool can
still be used, but some features are unavailable.
action: Upgrade the pool using 'zpool upgrade'. Once this is done, the
pool will no longer be accessible on older software versions.
scan: none requested
config:

NAME STATE READ WRITE CKSUM
syspool ONLINE 0 0 0
c1t0d0s0 ONLINE 0 0 0

errors: No known data errors

The original drive failure was on c2t2d0 now it looks like maybe another drive has gone, just to mention that the pool had originally 4 x 1.5tb drives but couldn't get hold of 1.5tb hdd so I have replace it with a 3tb, hope this isn't the cause of all my troubles.
 
I would not use raid-z1 with that many disks (nor 4 disks in a z1 vdevs)
but z2 with 6 or 10 disks per vdev.

And yes, you have 2 disks in the same vdev (critical) that report problems.
You should replace the faulted disk c2t0d0 as soon as possible.

You can clear the error at c2t1d0 but should replace this disk as well if a problem remains.
Then check both disks with a test tool from the disk manufacturer.
 
Is this right, would you get 9 drives resilvering while I have only changed one?

zpool status:
Pool

pool: NAS
state: ONLINE
status: One or more devices is currently being resilvered. The pool will
continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
scan: resilver in progress since Sun Sep 21 23:54:57 2014
7.47T scanned out of 33.3T at 2.20G/s, 3h20m to go
26.7M resilvered, 22.42% done
config:

NAME STATE READ WRITE CKSUM
NAS ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
c2t3d0 ONLINE 0 0 0 (resilvering)
c2t2d0 ONLINE 0 0 0
c2t1d0 ONLINE 0 0 0 (resilvering)
c2t0d0 ONLINE 0 0 0 (resilvering)
raidz1-1 ONLINE 0 0 0
c2t6d0 ONLINE 0 0 0
c2t5d0 ONLINE 0 0 0
c2t4d0 ONLINE 0 0 0
c2t7d0 ONLINE 0 0 0
raidz1-2 ONLINE 0 0 0
c2t11d0 ONLINE 0 0 0
c2t10d0 ONLINE 0 0 0
c2t9d0 ONLINE 0 0 0 (resilvering)
c2t8d0 ONLINE 0 0 0
raidz1-3 ONLINE 0 0 0
c2t13d0 ONLINE 0 0 0
c2t14d0 ONLINE 0 0 0 (resilvering)
c2t15d0 ONLINE 0 0 0 (resilvering)
c2t16d0 ONLINE 0 0 0 (resilvering)
raidz1-4 ONLINE 0 0 0
c2t17d0 ONLINE 0 0 0
c2t18d0 ONLINE 0 0 0 (resilvering)
c2t19d0 ONLINE 0 0 0 (resilvering)
c2t20d0 ONLINE 0 0 0
raidz1-5 ONLINE 0 0 0
c2t21d0 ONLINE 0 0 0
c2t22d0 ONLINE 0 0 0
c2t23d0 ONLINE 0 0 0
c2t24d0 ONLINE 0 0 0

errors: No known data errors

pool: syspool
state: ONLINE
status: The pool is formatted using an older on-disk format. The pool can
still be used, but some features are unavailable.
action: Upgrade the pool using 'zpool upgrade'. Once this is done, the
pool will no longer be accessible on older software versions.
scan: none requested
config:

NAME STATE READ WRITE CKSUM
syspool ONLINE 0 0 0
c1t0d0s0 ONLINE 0 0 0

errors: No known data errors
 
No, that is not normal.
Like I said before, there is something else wrong with that system.
Make sure you have a good backup available.
 
Thank you omniscence, I am going to see if I can work out whether this related to a hardware failure.
 
Thanks for all your help guys, since the system re-silvered it has been running rock solid now for a few days, thanks to Napp-it and Nexenta, now hopefully updating to OmniOs and Napp-it will go smooth.

Any step by step for updating, I haven't done this for a while so... upgrading to OmniOs I suppose would be straight forward, for Napp-it if I recall last time I have used win nsp.

pool: NAS
state: ONLINE
scan: resilvered 1.16G in 1h38m with 0 errors on Mon Sep 22 01:33:47 2014
config:

NAME STATE READ WRITE CKSUM
NAS ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
c2t3d0 ONLINE 0 0 0
c2t2d0 ONLINE 0 0 0
c2t1d0 ONLINE 0 0 0
c2t0d0 ONLINE 0 0 0
raidz1-1 ONLINE 0 0 0
c2t6d0 ONLINE 0 0 0
c2t5d0 ONLINE 0 0 0
c2t4d0 ONLINE 0 0 0
c2t7d0 ONLINE 0 0 0
raidz1-2 ONLINE 0 0 0
c2t11d0 ONLINE 0 0 0
c2t10d0 ONLINE 0 0 0
c2t9d0 ONLINE 0 0 0
c2t8d0 ONLINE 0 0 0
raidz1-3 ONLINE 0 0 0
c2t13d0 ONLINE 0 0 0
c2t14d0 ONLINE 0 0 0
c2t15d0 ONLINE 0 0 0
c2t16d0 ONLINE 0 0 0
raidz1-4 ONLINE 0 0 0
c2t17d0 ONLINE 0 0 0
c2t18d0 ONLINE 0 0 0
c2t19d0 ONLINE 0 0 0
c2t20d0 ONLINE 0 0 0
raidz1-5 ONLINE 0 0 0
c2t21d0 ONLINE 0 0 0
c2t22d0 ONLINE 0 0 0
c2t23d0 ONLINE 0 0 0
c2t24d0 ONLINE 0 0 0

errors: No known data errors

pool: syspool
state: ONLINE
status: The pool is formatted using an older on-disk format. The pool can
still be used, but some features are unavailable.
action: Upgrade the pool using 'zpool upgrade'. Once this is done, the
pool will no longer be accessible on older software versions.
scan: none requested
config:

NAME STATE READ WRITE CKSUM
syspool ONLINE 0 0 0
c1t0d0s0 ONLINE 0 0 0

errors: No known data errors
 
You must log in or register to reply here.
Back
Top