OpenSolaris derived ZFS NAS/ SAN (OmniOS, OpenIndiana, Solaris and napp-it)

_Gea said:
You cannot use a disk that is part of a (nondestryed) pool.
You must reformat the disk prior use or enter zpool replace -f to override this warning
Click to expand...

Well i had a new 2TB drive come today so i could have a spare just in case. i ran the command

zpool replace Documents2 c9t4d0s0 c0t5000CCA36ACC7314d0

where the 4d0 drive is the new drive and i get this error

cannot replace c9t4d0s0 with c0t5000CCA36ACC7314d0: no such device in pool

I'm aware its not in the pool and i'm wanting to replace the failed rive in that pool XD what am i doing wrong. THe gui for replace didn't help at all either in this case as well.
 
wow ZFS really can use almost 16GB ram

I was just doing some testing, transfer over 12GB files, you can see the ram being used up. only 3 GB free. Try steaming 1080p as well can see ram go down bit more.

But cpu load isn't a lot. Going to get a i3 2120 to replace my 1260L so i can use the 1260l for my esxi lab. zfs just keep impressing me, so much performance :D
 
While Openindiana needs about 1GB for system use, nearly all additional ram is used to improve read performance.
OI caches datablocks automatically in otherwise unused ram to deliver most data from ram instead of slow disks.

With a lot of concurrent users or large files even ram sizes of several hundred gigabytes make sense with OI + ZFS.
 
I got it added. No more degraded on my main pool! However the fault errors are very annoying on reboot. Its especially got me worried because.it seems to be corrupting files but they seem fine to me.
 
madrebel said:
replace is for spares. add c0t5000CCA36ACC7314d0 to the pool then re-run the command.

*edit* let me rephrase that, replace is for drives in the pool, can be a spare. to replace a failed disk with a new disk in the same spot ...

http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html
Click to expand...

the above is true when the cXtYxxxx ID is position dependent. for one of the long IDs (based on a WWN), you need to use the 2 ID syntax. it would be nice if the OP described what he did that finally worked :(
 
Is there any trick to rebalance data over all the vdev. I am about to add a new one.

I have a fileserver in a zfolder and another one with esx vms

Thanks
 
moving the data is the only way to accomplish that.

not 100% positive if moving data within the pool but too a different data set/path will accomplish this. moving data in/out of the pool most certainly does.
 
i currently have a 128GB ssd acting as an l2arc, but i was wondering how can i tell if im really making use of it.
the system has 16GB and it is used by 1 or 2 users at a time.
i also have a 128GB zil.
would it be better for me to mirror to the zil or make it a zil for a second pool that im configuring?

thanks
 
bbzidane said:
i currently have a 128GB ssd acting as an l2arc, but i was wondering how can i tell if im really making use of it.
the system has 16GB and it is used by 1 or 2 users at a time.
i also have a 128GB zil.
would it be better for me to mirror to the zil or make it a zil for a second pool that im configuring?

thanks
Click to expand...
zpool iostat -v 'tank'
 
madrebel said:
zpool iostat -v 'tank'
Click to expand...

how should i interpret this output?


Code: 
admin@openindiana:~$ zpool iostat -v 'storage'
                              capacity     operations    bandwidth
pool                       alloc   free   read  write   read  write
-------------------------  -----  -----  -----  -----  -----  -----
storage                    13.8T  13.4T     70     69  8.72M  1.79M
  raidz2                   13.8T  13.4T     70     55  8.72M  1.22M
    c3t5000CCA228C06F43d0      -      -     22     14   896K   161K
    c3t5000CCA228C06F69d0      -      -     22     14   896K   161K
    c3t5000CCA228C07074d0      -      -     22     14   896K   161K
    c3t5000CCA228C07F9Bd0      -      -     22     14   896K   161K
    c3t5000CCA228C08301d0      -      -     22     14   896K   161K
    c3t5000CCA228C0D0D6d0      -      -     22     14   896K   161K
    c3t5000CCA228C0D2C3d0      -      -     22     14   896K   161K
    c3t5000CCA228C0D60Fd0      -      -     22     14   896K   161K
    c3t5000CCA228C0D66Ed0      -      -     22     14   896K   161K
    c3t5000CCA228C0D71Cd0      -      -     22     14   896K   161K
logs                           -      -      -      -      -      -
  c3t500A07510900A12Ed0    14.8M   119G      0     14      1   587K
cache                          -      -      -      -      -      -
  c3t500A0751090091E8d0     119G     8M      0     24  51.7K  3.04M
-------------------------  -----  -----  -----  -----  -----  -----
 
Last edited:
Why does the pool say:
status: The pool is formatted using an older on-disk format. The pool can
still be used, but some features are unavailable.
action: Upgrade the pool using 'zpool upgrade'. Once this is done, the
pool will no longer be accessible on older software versions.

But I go and do zpool upgrade -v it tell me that the current is V28 which is the version of my current ZPOOL
 
bbzidane said:
how should i interpret this output?
Click to expand...
if you would have used the code tags like

Code: 
                               [b]capacity[/b]     operations    bandwidth      latency
pool                        [b]alloc   free[/b]   read  write   read  write   read  write
--------------------------  -----  -----  -----  -----  -----  -----  -----  -----
tank                          711G  97.2T     32    112   116K   441K   5.91  18.31
  raidz2                     142G  10.7T      3     11  11.6K  44.1K   5.81  18.26
    c14t5000C50041CAC29Bd0      -      -      0      2  4.00K  24.2K   0.65   3.07
    c14t5000C50041CB4127d0      -      -      0      2     4K  24.1K   0.65   3.04
    c14t5000C50041D097B7d0      -      -      0      2  4.00K  24.2K   0.64   3.07
    c14t5000C50041E575AFd0      -      -      0      2  4.00K  24.2K   0.65   3.05
  raidz2                      142G  10.7T      3     11  11.6K  44.1K   5.80  17.84
    c14t5000C50041C0A8BFd0      -      -      1      2  4.00K  24.1K   0.68   3.05
    c14t5000C50041CABEF7d0      -      -      1      2  4.00K  24.1K   0.68   3.05
    c14t5000C50041D0AA37d0      -      -      1      2  4.00K  24.1K   0.67   3.04
    c14t5000C50041D14507d0      -      -      1      2  4.01K  24.1K   0.68   3.06
  raidz2                      142G  10.7T      3     11  11.6K  44.1K   5.95  18.53
    c14t5000C50041C94403d0      -      -      1      2  4.00K  24.1K   0.70   3.09
    c14t5000C50041CA1A47d0      -      -      1      2  3.99K  24.1K   0.67   3.07
    c14t5000C50041D7BE1Bd0      -      -      1      2  4.00K  24.1K   0.68   3.08
    c14t5000C50041E571F7d0      -      -      1      2  4.00K  24.1K   0.67   3.08
  raidz2                      142G  10.7T      3     11  11.6K  44.1K   6.18  18.72
    c14t5000C50041BEF583d0      -      -      0      2  4.00K  24.1K   0.69   3.10
    c14t5000C50041C81FA7d0      -      -      0      2  3.99K  24.1K   0.65   3.07
    c14t5000C50041D0E78Bd0      -      -      0      2  3.99K  24.1K   0.65   3.05
    c14t5000C50041D122B3d0      -      -      0      2  4.00K  24.1K   0.68   3.09
  raidz2                      142G  10.7T      3     11  11.6K  44.0K   5.84  18.19
    c14t5000C50041BF1277d0      -      -      0      2  4.00K  24.1K   0.65   3.06
    c14t5000C50041D19D4Bd0      -      -      1      2  4.00K  24.1K   0.66   3.06
    c14t5000C50041E57567d0      -      -      0      2     4K  24.1K   0.65   3.06
    c14t5000C50041E57797d0      -      -      0      2  4.00K  24.1K   0.65   3.06
  raidz2                      156K  10.9T      0      0     18    552   3.29   0.95
    c14t5000C50041CA7653d0      -      -      0      0      5    416   2.07   0.51
    c14t5000C50041D06643d0      -      -      0      0      5    415   2.31   0.45
    c14t5000C50041D1CD8Bd0      -      -      0      0     11    414   1.90   0.52
    c14t5000C50041E57C23d0      -      -      0      0     11    416   3.26   0.47
  raidz2                      147K  10.9T      0      0      6    542   3.11  12.10
    c14t5000C50041B7EF03d0      -      -      0      0      8    410   3.67   0.51
    c14t5000C50041BE62B3d0      -      -      0      0      8    410   2.73  17.18
    c14t5000C50041D40D5Fd0      -      -      0      0      8    409   1.84   0.72
    c14t5000C50041E37E53d0      -      -      0      0      8    410   1.98   0.60
  raidz2                      183K  10.9T      0      0      9    444   6.44   1.59
    c14t5000C50041C373CBd0      -      -      0      0      9    360   6.66   0.58
    c14t5000C50041D0D41Fd0      -      -      0      0      9    360   2.02   0.42
    c14t5000C50041D19D6Fd0      -      -      0      0      3    359   5.58   0.82
    c14t5000C50041E570EBd0      -      -      0      0      9    360   2.46   0.49
  raidz2                      150K  10.9T      0      0     14    370   2.66   2.78
    c14t5000C50041BF21D7d0      -      -      0      0     10    323   1.71   0.56
    c14t5000C50041CAB43Fd0      -      -      0      0      4    321   2.46   1.43
    c14t5000C50041D1E0D3d0      -      -      0      0     10    321   1.86   0.55
    c14t5000C50041E57547d0      -      -      0      0     10    321   2.06   0.69
  mirror                        0  7.44G      0      0      0      0   0.00   0.00
    c14t5000A72030068FB3d0      -      -      0      0    109    498   0.14   0.18
    c14t5000A72030068FB4d0      -      -      0      0    109    498   0.13   0.18
cache                           -      -      -      -      -      -
  c14t5000A7203006C544d0     [b]373G    80M[/b]      0      1  1.97K   160K   0.57   8.50
  c14t5000A7203006C548d0     [b]373G    80M[/b]      0      1  1.95K   166K   0.58   8.53
--------------------------  -----  -----  -----  -----  -----  -----  -----  -----

the bold is the answer to your question. the first number is the size of the device, the second number is how much has been allocated to that device.

your l2arc has 8GB allocated.
 
im a little confused then.
i can see how the first number, under alloc, is considered the size of the device.
but why is the second number, under free, described as the amount of space allocated?
and I take it you meant to say 8M not 8G?
 
Is it possible to add a user with napp-it that contains a period..?
like: test.user (I've tried creating one, but nappit creates a user called: testuser (without the period) )
Also any limitations on how many characters a username can have with OI..?

And lastly, is it possible to work with the user administrator within OI (create the administrator user in OI) ? (still testing this but giving administrator full access to a folder (when connected as root) doesn't seem to work when you connect as adminstrator to that share and try to access the folder)
 
Last edited:
nostradamus99 said:
Is it possible to add a user with napp-it that contains a period..?
like: test.user (I've tried creating one, but nappit creates a user called: testuser (without the period) )
Also any limitations on how many characters a username can have with OI..?

And lastly, is it possible to work with the user administrator within OI (create the administrator user in OI) ? (still testing this but giving administrator full access to a folder (when connected as root) doesn't seem to work when you connect as adminstrator to that share and try to access the folder)
Click to expand...

which napp-it version?
with current napp-it you should be able to create a user test.user

If you create a user "administrator" you must set ACL to allow administrator full access on the shared dataset.
and you can add administrator to SMB group administrators to allow share management as administraor.
(via Windows computer management)

about name-lenght
I have not tried but i suppose 20 char is max for Windows, OI maybee more.
 
_Gea said:
which napp-it version?
with current napp-it you should be able to create a user test.user

If you create a user "administrator" you must set ACL to allow administrator full access on the shared dataset.
and you can add administrator to SMB group administrators to allow share management as administraor.
(via Windows computer management)

about name-lenght
I have not tried but i suppose 20 char is max for Windows, OI maybee more.
Click to expand...

I've tried this with version :
v. 0.8k nightly Jul.29.2012

It creates a user but without the period .

TqSS0.jpg
 
Having issues still :( I got the HDD's resilvered however i'm still having a problem where after a while the ZFS stuff all seems to hang up including the napp-it gui. The only way i can seem to resolve this is a complete OS reboot which i can do because the computer itself isn't frozen, just ZFS stuff it seems. Anywhere i should look in logs etc to find whats causing this?
 
well doing that only turned up things from months ago when i was first trying to get hardware to cooperate, nothing recently though :( any other ideas?
 
moose517 said:
Having issues still :( I got the HDD's resilvered however i'm still having a problem where after a while the ZFS stuff all seems to hang up including the napp-it gui. The only way i can seem to resolve this is a complete OS reboot which i can do because the computer itself isn't frozen, just ZFS stuff it seems. Anywhere i should look in logs etc to find whats causing this?
Click to expand...

mostly a problem with a semi-dead cable or hardware, I would check
- disk activity led (always on)
- zpool status (errors)
- napp-it system - logs (failures)
- napp-it system - statistic - disk (lots of waits or other hints)
- smart status + smart test

if one of the disks is suspicious, check this disk with a manufacturers tool or replace cable


other options:
- problems of WD Sata disks with Expander
- cable length (max 1m)
- power problems
 
Last edited:
_Gea said:
What OS?
its working with my current S11 and OI


.. thanks for the help with the manual
Click to expand...

You are welcome..!
SOLVED
You can forget about my question: I've installed a new OI VM and installed 0.8k directly and that seems to work (the other vm I have the problem with had been updated to 0.8k so sure what happend there)

Other Napp-IT questions:
1) is it possible to change the workgroup from Napp-IT..? (if not, would be a nice feature :) )

2) when exporting a pool, you get this warning:
be careful!! pools with active shares or targets cannot be exported
question: what does "active shares" mean..? and is there a way to export pools properly..?
question: what is carried over when exporting a pool from 1 OI machine to another (shares, userrights, nothing..?)

3) I've create 2 pools OIVM1, which I exported to the new OI machine(OIVM2). I imported them (got one error about Napp-it being unable to create the smb shares)
Now I wanted to export them back to OIVM1, so I exported the 1st pool , this went perfect. Exporting the second pool gave this error:
Could not proceed due to an error. Please try again later or ask your sysadmin.
Maybee a reboot after power-off may help.
--------------------------------------------------------------------------------
cannot unmount '/singledisk/zfsfolder01': Device busy
I've already rebooted the machine and as far as I know I don't have any connection to "zfsfolder01" (even unshared the SMB share for this folder) so I don't know why this error is given..
 
Last edited:
_Gea said:
mostly a problem with a semi-dead cable or hardware, I would check
- disk activity led (always on)
- zpool status (errors)
- napp-it system - logs (failures)
- napp-it system - statistic - disk (lots of waits or other hints)
- smart status + smart test

if one of the disks is suspicious, check this disk with a manufacturers tool or replace cable


other options:
- problems of WD Sata disks with Expander
- cable length (max 1m)
- power problems
Click to expand...

I'm gonna have to check nappit logz as system shows fine and the HDDs aren't showing activity all the time. Its possible its cables as they are 1.5m I think
 
nostradamus99 said:
You are welcome..!
SOLVED
You can forget about my question: I've installed a new OI VM and installed 0.8k directly and that seems to work (the other vm I have the problem with had been updated to 0.8k so sure what happend there)

Other Napp-IT questions:
1) is it possible to change the workgroup from Napp-IT..? (if not, would be a nice feature :) )

2) when exporting a pool, you get this warning:
be careful!! pools with active shares or targets cannot be exported
question: what does "active shares" mean..? and is there a way to export pools properly..?
question: what is carried over when exporting a pool from 1 OI machine to another (shares, userrights, nothing..?)

3) I've create 2 pools OIVM1, which I exported to the new OI machine(OIVM2). I imported them (got one error about Napp-it being unable to create the smb shares)
Now I wanted to export them back to OIVM1, so I exported the 1st pool , this went perfect. Exporting the second pool gave this error:
Could not proceed due to an error. Please try again later or ask your sysadmin.
Maybee a reboot after power-off may help.
--------------------------------------------------------------------------------
cannot unmount '/singledisk/zfsfolder01': Device busy
I've already rebooted the machine and as far as I know I don't have any connection to "zfsfolder01" (even unshared the SMB share for this folder) so I don't know why this error is given..
Click to expand...

1. see menu services - SMB
2. If files are open, you cannot export so shutdown especially shares and iSCSI targets when you get errors on export (device busy)

On import all pool related settings are kept (ACL and permissisons, ZFS properties like SMB and NFS sharing etc)
You loose all system related settings like users or iSCSI LU and targets (You must import and setup)

3. The SMB error message on first time using a pool is an error is due to a permission problem - ignore,
will be fixed in future - otherwise see 2.

ps
Due to your corrections, I found the time to edit the manual and have uploaded a new version:
http://www.napp-it.org/doc/downloads/napp-it.pdf
 
_Gea said:
1. see menu services - SMB
2. If files are open, you cannot export so shutdown especially shares and iSCSI targets when you get errors on export (device busy)

On import all pool related settings are kept (ACL and permissisons, ZFS properties like SMB and NFS sharing etc)
You loose all system related settings like users or iSCSI LU and targets (You must import and setup)

3. The SMB error message on first time using a pool is an error is due to a permission problem - ignore,
will be fixed in future - otherwise see 2.

ps
Due to your corrections, I found the time to edit the manual and have uploaded a new version:
http://www.napp-it.org/doc/downloads/napp-it.pdf
Click to expand...

1) I've found it: its "hidden" in the Active Directory menu :)

On import all pool related settings are kept (ACL and permissisons, ZFS properties like SMB and NFS sharing etc)
Click to expand...
How does OI know what the ACL's and permissions are if the users are missing..?

3) I'm still getting an error when trying to export the pool. I'm going to try it with a -f option from the CLI to see if that works..
(as described here: http://mogulzfs.blogspot.nl/2011/10/moving-disk-from-existing-zfs-pool-to_20.html ) seems that more people have had this issue.

ps
Due to your corrections, I found the time to edit the manual and have uploaded a new version
Click to expand...
Good stuff! If I can find the time I'll also have a look at the Napp-IT All in one document.
 
nostradamus99 said:
1) I've found it: its "hidden" in the Active Directory menu :)
Click to expand...

with next version you will find an alias Service - SMB - Workgroup
to that menu

How does OI know what the ACL's and permissions are if the users are missing..?
Click to expand...

AD users:
similar to Windows:
OI has saved the Windows SID just like Windows on ntfs.
When there is no relationship to an AD user - only admin/ root has access

(When you check from Windows, you will see the SID instead the name,
I suppose the UID is nobody but CIFS is using the SID from automated/ ephemeral mapping).

with manual id-mapping, the according local user is used


3) I'm still getting an error when trying to export the pool. I'm going to try it with a -f option from the CLI to see if that works..
(as described here: http://mogulzfs.blogspot.nl/2011/10/moving-disk-from-existing-zfs-pool-to_20.html ) seems that more people have had this issue.
Click to expand...

I have added - force option to pool export
(export even when files are open - seems better behaviour than to search the reason)

Good stuff! If I can find the time I'll also have a look at the Napp-IT All in one document.
Click to expand...

Documentation is one of the things that must be done on the way to a 1.0 release
 
Last edited:
How many people have succesfully joined their OI to a win2k8r2 domain? So far it has only failed for me..

Are there setting that must be made to the domain? Such as compatibility mode etc

Also, assuming there is a OI root user with access to everything, if OI is joined to a domain and that domain is lost, all file should still be accessible through the local root right?

Thanks :)
 
Last edited:
You must log in or register to reply here.
Back
Top