OpenSolaris derived ZFS NAS/ SAN (OmniOS, OpenIndiana, Solaris and napp-it)

Hello!

I installed OmniOS today on my new SAN:
- AMD FM2+ motherboard
- AMD A4-xxxx CPU
- 8GB memory
- Intel PRO/1000 CT nic

I get a good write speed(around 92MB/s) over SMB, but read speeds are low(only around 52MB/s).

NFS goes full speed.

I also tried FreeNAS, and I get 100(read)/90(write) over SMB protocol.

Is that a know problem?
Is it solvable? How?

Matej
 
Hello!

I installed OmniOS today on my new SAN:
- AMD FM2+ motherboard
- AMD A4-xxxx CPU
- 8GB memory
- Intel PRO/1000 CT nic

I get a good write speed(around 92MB/s) over SMB, but read speeds are low(only around 52MB/s).

NFS goes full speed.

I also tried FreeNAS, and I get 100(read)/90(write) over SMB protocol.

Is that a know problem?
Is it solvable? How?

Matej

Mostly performance reports between BSD and Solaris are like (after some tweaking on BSD)
- regarding NFS , they are quite similar
- regarding SMB
quite similar with the SAMBA SMB server on both, the Solaris kernel based CIFS SMB server is mostly faster than SAMBA on either
- regarding iSCSI - Solaris is faster with Comstar

This means mostly. In a special case, results can differ.
The curious thing, mostly reads are faster than writes. Most reports about writes faster than reads that I am aware of are related with 4k disks and/or driver problems ex with Realtek nics on Windows or Windows copy tools like Teracopy.
 
Yes I know, I would expect writes to be slow, but they arent:)

- NFS works around 40% better on solaris,
- SMB read is super slow, but write is the same on both (80-90mb/s)
- iSCSI is about the same

Graph:
razlicni_benchmarki.png


I'm testing SMB speeds with CrystalDiskMark. Will try some other to see if results differ...

I'm looking at your benchmarks: http://napp-it.org/doc/manuals/benchmarks.pdf and I see the same trends. On all SMB tests, you read speed is stucked at 140MB/s, where writes goes up to 240MB/s...

Matej
 
Last edited:
Update:

I tried copying with windows explorer and I get nice speeds: 90MB/s writes and 100MB/s reads. According to Resource Monitor I get 850Mbps which is maxing out my link anyway(accroding to iperf test).

It might be a problem with a CrystalDiskMark?

Anyway, I tried copying 4G and 8G files from a fast SSD to my network share and I got the speeds above. I will now try a 16G file, since I have 8GB memory on both of my machines to eliminate caching...

Will report back.

BTW: found a thread where people had the same problems http://hardforum.com/showthread.php?t=1629765&page=3. Most people used SAMBA, but danswartz had the same problems on OpenIndiana. Problems for the poor reads were wrong version of samba, old drivers and wrong software(32bit Total commander, teracopy,...)

Matej
 
So I did some more testing...

When reading 12GB file from NAS to win7's SSD, transfer speed was around 70MB/s and raised to 100MB/s for the last 3GB of data:
prenos_NAS_etela_12GB_spike.png


Since I have 12GB of memory on my PC, I then created another 28GB file on NAS and did the transfer again. The speeds were around 70MB/s for the whole time.
prenos_NAS_etela_28GB_spike.png


In the evening, I will try all types of transfer again, all with 28GB file and report back...
 
So, here are the results of todays benchmarks:

NAS:
- Gigabyte GA-F2A88XM-HD3
- AMD A4-5300 BOX
- 8GB memory
- 4x Samsung F4 2TB in RAIDz2 configuration
- Intel NIC

SMB & iSCSI PC:
- Athlon X4 840
- 12GB memory
- Realtek NIC

NFS:
- Athlon X2 4800+
- 4GB memory
- Nvidia NIC

My test file was 24GB created with dd if=/dev/urandom bs=1M count=28000

SMB test: copy file with Windows Explorer
SMB CrystalDiskMark: 4x4GB seq test
iSCSI: copy file with Windows Explorer
NFS dd:
write test: dd bs=1M count=28000 if=/dev/zero of=/freenas/test conv=fdatasync,notrunc
read test:echo 3 > /proc/sys/vm/drop_caches; dd if=/freenas/test of=/dev/null
NFS bonnie: bonnie -s 28G

Results:
prenos_NAS_Omnios_freenas_28GB.png


I have no idea what FreeNAS NFS client is so slow...

I will do some testing with iozone tomorrow as well, but probably only over NFS.

Matej
 
Hi guys!

Is there any way to release control of a file that's in use?
I have a smb share (provisioned trough Napp-It and using OpenIndiana) with guest access set to ON.

Every now and then I can't get access to certain files because someone else is using them.
It gets annoying since all computers are OFF, and the only way to "free" these files is to preform a server restart.

In Linux I believe there is a smbstatus and smbcontrol command so you can kill the PID or close all clients connected to a share.

In Server2K8 you can kick a user through Task Manager or use Share and Storage Management to see who's using a particular file and close connections to it.

Can someone point me in the right direction? Restarting a server is.. well.. not optimal..
 
Hi guys!

Is there any way to release control of a file that's in use?
I have a smb share (provisioned trough Napp-It and using OpenIndiana) with guest access set to ON.

Every now and then I can't get access to certain files because someone else is using them.
It gets annoying since all computers are OFF, and the only way to "free" these files is to preform a server restart.

In Linux I believe there is a smbstatus and smbcontrol command so you can kill the PID or close all clients connected to a share.

In Server2K8 you can kick a user through Task Manager or use Share and Storage Management to see who's using a particular file and close connections to it.

Can someone point me in the right direction? Restarting a server is.. well.. not optimal..

- connect from Windows to a share with guest disabled as a user that is member of the SMB admin group on OmniOS
- start computermanagement on Windows
- connect computermanagement with your OmniOS server

You can now check open files and unconnect users like with a Windows server.
 
Hey,

just wanted to let you know I've just installed Napp-It on OI-hipster-gui-20131210 (wanted a Gui and current stable does not support i210), no issues.

Upon installing Ampo I had to set up the path to mysql though; you might want to include that in ampo2.sh;)


Edit:

Oh well, to soon :p

Upon importing an existing Pool:

cannot share <poolname>: smb add share failed
package file subroutine line
main admin.pl main::my_action 518
main /06_pools/03_import/action.pl main::my_do 17
main /06_pools/03_import/action.pl main::error 131


Creating a new pool works fine (incl sharing)
 
Last edited:
Hey,

just wanted to let you know I've just installed Napp-It on OI-hipster-gui-20131210 (wanted a Gui and current stable does not support i210), no issues.

Upon installing Ampo I had to set up the path to mysql though; you might want to include that in ampo2.sh;)


Edit:

Oh well, to soon :p

Upon importing an existing Pool:

cannot share <poolname>: smb add share failed
package file subroutine line
main admin.pl main::my_action 518
main /06_pools/03_import/action.pl main::my_do 17
main /06_pools/03_import/action.pl main::error 131


Creating a new pool works fine (incl sharing)

This is a common error message when you import a pool with shares enabled while SMB service is disabled. You can ignore as the pool works after import as expected.
 
Hello!!

I'm trying to setup NFS and SMB shares with ACL support and I got into troubles...

I have a share, that is mounted to linux client over NFSv3 and to windows client over SMB. My ACL's looks like the following:
ACL_for_share.png


What I want is to have a 755 unix permissions on folders and 644 permissions on files. User levak and root have full rights, when they access the folder from windows. That seems to be properly configured.

Now the problem.

I tried to copy my data from one drive to another. It starts to copy, but after some time, I start getting errors "cant create file, operation not permitted":
Code:
`joomla/plugins/editors/tinymce/jscripts/tiny_mce/plugins/safari/editor_plugin_src.js' -> `/omnios/joomla/plugins/editors/tinymce/jscripts/tiny_mce/plugins/safari/editor_plugin_src.js'
cp: cannot create regular file `/omnios/joomla/plugins/editors/tinymce/jscripts/tiny_mce/plugins/safari/editor_plugin_src.js': Operation not permitted
`joomla/plugins/editors/tinymce/jscripts/tiny_mce/plugins/safari/editor_plugin.js' -> `/omnios/joomla/plugins/editors/tinymce/jscripts/tiny_mce/plugins/safari/editor_plugin.js'
cp: cannot create regular file `/omnios/joomla/plugins/editors/tinymce/jscripts/tiny_mce/plugins/safari/editor_plugin.js': Operation not permitted

If I cancel the transfer and start again, it goes a little further and after some 10% more copied files, it starts throwing errors again, and so on and so on...

The same happens if I try to copy over data with rsync... I use -var parameters(verbose, archieve, recursive. It shows that it is coping files, but when I look in the folder, all files start with a . and a size of 0. After some time, it start throwing errors:
Code:
rsync: mkstemp "/omnios/joomla/administrator/components/com_templates/.index.html.gYKDOw" failed: Operation not permitted (1)
rsync: mkstemp "/omnios/joomla/administrator/components/com_templates/.templates.xml.exWYLJ" failed: Operation not permitted (1)
rsync: mkstemp "/omnios/joomla/administrator/components/com_templates/.toolbar.templates.html.php.0bG6WW" failed: Operation not permitted (1)
rsync: mkstemp "/omnios/joomla/administrator/components/com_templates/.toolbar.templates.php.5wyZ89" failed: Operation not permitted (1)
rsync: mkstemp "/omnios/joomla/administrator/components/com_templates/helpers/.index.html.qSFt8m" failed: Operation not permitted (1)

What is causing this? Are my ACL's wrong?

Matej
 
Why not go to OmniOS?

You should remind people if they go that route and create a new array, the new array will have features unsupported by most other NAS OS builds out there and therefore be impossible to import should they switch OS to something else.
 
You should remind people if they go that route and create a new array, the new array will have features unsupported by most other NAS OS builds out there and therefore be impossible to import should they switch OS to something else.

Indeed OmniOS is quite the closest OS to Illumos, the source of any free ZFS. But with OpenZFS the delay between Illumos based ones like OmniOS/OI/SmartOS and the others like BSD and ZOL is quite short.

A ZFS pool from current OmniOS should be importable in current FreeBSD or ZOL as well as they use the same set of features.
 
Indeed OmniOS is quite the closest OS to Illumos, the source of any free ZFS. But with OpenZFS the delay between Illumos based ones like OmniOS/OI/SmartOS and the others like BSD and ZOL is quite short.

A ZFS pool from current OmniOS should be importable in current FreeBSD or ZOL as well as they use the same set of features.

As of about two weeks ago I know my pool was not importable on OI or FreeNAS, two of the more known distributions of NAS software
 
Hello!!

I'm trying to setup NFS and SMB shares with ACL support and I got into troubles...

This is a very complex theme, some basics to consider
- SMB use ACL only with Windows SID, ACL inheritance and user authentication
- If you set Unix permissions on a folder, all ACL inheritance settings are lost
- Inheritance settings are not current settings but controls ACL when creating new files and folders

-NFS3 comes without user authentication but restricts on client ip (say on a goodwill base)
- NFS use Unix user id for acces but different on platforms
- NFS works best on a secure network with full access for everyone
- optionally set aclmode=discard to blocj chmod from Unix clients that destroy ACL settings

I would keep ACL as simple as possible, avoid multiprotokol use or go everyone=modify
 
As of about two weeks ago I know my pool was not importable on OI or FreeNAS, two of the more known distributions of NAS software

If you want to transfer pools, you must consider:

- A Pool V.28 ZFS V5 is universal between any OS - even Solaris (you can create v.28 manually)
- A pool V29-4999 is Oracle only
- If you update a Pool from V.28 on any OpenZFS platform you get Pool V.5000 with feature flags.
If you enable a feature, you can only import on another platform with support for the this feature.

But current FreeBSD 10, OI 151a8, OmniOS and ZOL should support the same feature set.
If not and you want to transfer the pools you should stay at V28 or do not enable a special feature ex LZ4 -
or wait with transfers until the feature is supported (currently all features are free)

Other option is a zfs send between platforms. This should work even when a feature is not supported
as the datastream is "encoded" for transfers.

Netherless, my favourite is OmniOS as well. It is the most up to date and stable ZFS.
 
Last edited:
Hello Gea!

My idea was that everything, that I would copy from a linux client to the NFS, it would inherit the ACLs but kept the original owner and group. Since my ACL would also had a user:levak with full_set, SMB user levak could also access all files and folders and "edit" them.

On the other hand, I could set up "user:user2" with read-only rights for the files and folders, so he couldn't erase anything...

Imagine the scenario:
I have my dataset mounted in my linux server in the folder /web_pages via NFS. In there, there are folders from different users with their web page. I would like to also access this share via SMB, over which I could edit all files and folders...

Another scenario:
On my linux box, I'm running Transmission torrent client which downloads to /download. Download folder is a NFS mount to my NAS. I also access this download folder from my windows box, from where I want to have full access, but I also want some users to have limited access...

What do you propose I do?
Do you have any ideas or solutions on how to solve that?

MAtej
 
I have another problem...

I have a share, on which I have the following ACLs:
Code:
root@biglittle:/pool0# /usr/bin/ls -Vd share/
drwxrwxrwx+ 17 1044     100           18 Jan 31 15:50 share/
              user:root:rwxpdDaARWcCos:fd-----:allow
             user:levak:rwxpdDaARWcCos:fd-----:allow
                 owner@:rwxp--aARWcCos:-------:allow
                 group@:rwxp--a-R-c--s:-------:allow
              everyone@:rwxp--a-R-c--s:-------:allow

In windows, I can open the Security tab and see the ACLs...

Inside this share is a folder, lets name it Folder1. I set the ACLs for that folder using the following commands:
Code:
/usr/bin/chmod A- Folder1
/usr/bin/chmod A0=user:root:rwxpdDaARWcCos:fd-----:allow Folder1
/usr/bin/chmod A1=user:levak:rwxpdDaARWcCos:fd-----:allow Folder1
/usr/bin/chmod A2=owner@:rwxp--aARWcCos:-------:allow Folder1
/usr/bin/chmod A3+group@:rwxp--a-R-c--s:-------:allow Folder1
/usr/bin/chmod A4+everyone@:rwxp--a-R-c--s:-------:allow Folder1
/usr/bin/ls -Vd Folder1

If I check ACLs of the folder, they look like:
Code:
root@biglittle:/pool0/share# /usr/bin/ls -Vd Folder1/
drwxrwxrwx+228 1044     1038         352 Jan 31 14:47 Folder1/
              user:root:rwxpdDaARWcCos:fd-----:allow
             user:levak:rwxpdDaARWcCos:fd-----:allow
                 owner@:rwxp--aARWcCos:-------:allow
                 group@:rwxp--a-R-c--s:-------:allow
              everyone@:rwxp--a-R-c--s:-------:allow

They are the same, that those of the share... If I select the folder in windows, go to Properties and Security tab, I get a message saying: The requested security informations is either unavailable or can't be displayed.

Why is that? Why does it work with the same ACLs on the share tab, but not on the folder??
 
I just wanted a GUI

I hope you don't get too attached to it as it may seem that the GUI in OI will be a thing of the past in coming versions.
I'm also on OI right now but I am reading up on the latest developments with NappIT and OmniOS.

@Levak
As Gea says, set userrights from Windows only decent way to make stuff work..

Anyone here already moved from OI to the VMWare NappIT appliance..? (tips on migrating gotchas are most welcome)

@Gea,
Congratz on the new appliances, excellent work again!
The current production version is:
Version 13b, Jan 11 2014:
OmniOS 1008 stable, napp-it 0.9d2/ 0.9e1 with vmware tools 5.5 and vmxnet3 + e1000)

What is your planning on releasing updates for the appliance..? are you going to create a new appliance once a new update/version of OmniOS comes out or will there be just the version 13b VM and keep Nappit + OmniOS upgrading from there on?
 
Last edited:
Personally I use the GUI quite a lot, along with wine applications. For example I copy a couple hundreds of GBs to the file server, then check the integrity (PAR2 or CRC32) directly on it using the GUI, instead of doing it at a tenth of the speed over the network. I've got nothing against command line but the way my brain works, a picture is worth a thousand words.
 
@Aesma
Too much work manually checking par files let tools to the work for you :)

I do not expect that OI will cancel the GUI.

But you can also add a GUI to OmniOS as well,
see http://pkgsrc-us-east.joyent.com/changes.html#major-changes-in-pkgsrc2013q4

And there may be other options with GUI like http://sonicle.com/index.jsp?pagename=xstreamos&parent=products
I only use the GUI for the updates of packages the rest I do with the Nappit GUI but I saw this mentioned on the OI IRC channel:


Code:
[10:32.48] <mickey_> found this discussion: JDS menus and launcher gone is there any solution right now?
[10:34.29] * alex1 ([email protected]) has joined channel #openindiana
[10:36.45] <tsoome_> from which version did you upgrade?
[10:37.27] <mickey_> i did a upgrade from 151a8 to a9
[10:38.21] <mickey_> found this here http://www.archivum.info/[email protected]/2013-09/00110/Re-%28OpenIndiana-discuss%29-oi-151a8-JDS-menus-and-launcher-gone.html
[10:38.34] <mickey_> but using admin role seems not to be in ideal solution
[10:39.39] <tsoome_> I have no a9 myself, but from people are talking about is sometimes it can happen that some files or packages are not getting updated properly
[10:40.12] <tsoome_> so, what you wanna check is to get installed package list and verify they all have updated version string
[10:40.43] <tsoome_> also, it may help to check .xsession-errors and /var/log/Xorg.log files
[10:41.44] <tsoome_> also, possibly, clean up the gnome related .files and directories and get them recreated
[10:42.04] <tsoome_> thats for your home
[10:43.22] <mickey_> thx! will try to find my way through your cues
[10:44.02] <tsoome_> I only have hipster myself and haven't been hit by this issue
[10:44.18] <mickey_> how stable is hipster anyway?
[10:44.51] <tsoome_> they are all fairly stable tbh.
[10:45.22] <tsoome_> sometimes you can see problems like the issue you got with gnome
[10:46.52] <tsoome_> what I am doing is, update often and keep a bit of history around for beadm, so you can switch back if needed
[10:47.28] <mickey_> i see. i just wanna setup a stable systeme once (for nas purpose)... i devided for openindiana for stability reasons and now gnome doesnt work and napp-it either, good start hugh?! :D
[10:47.51] <tsoome_> well, gnome is not important at all for nas;)
[10:48.08] <mickey_> true, but nice to have! :)
[10:48.59] <tsoome_> the main focus on all opensolaris - now illumos based distributions is the main system. desktop is nice to have but the manpower is somewhat limited
[10:49.39] <tsoome_> more contributions/help/input is always welcome to get things more smooth
[10:53.35] <mickey_> yeah, hope that this project continue
[10:54.37] <tsoome_> it was in an hibernation before hipster was started, now there is a lot more life in it.
[10:56.14] <tsoome_> but yes, the main focus is still about server side, smartos, omnios, nexenta etc are keeping the wheels running;)
[10:58.00] <mickey_> :)
[02:14.44] <Socra> Q: If I do an upgrade packages on my 151a7 will it upgrade to a8 or a9 by default..?
[02:15.13] <Woodstock> i would expect it to go straight to a9
[02:23.14] <Socra> yeah thought it might..
[02:24.32] <Socra> I using it with NappIT and every now and then I upgrade OI then NappIT but I'm not eager If I read the problems mentioned above 
[02:29.23] <tsoome_> you can set version where to update
[02:31.39] <Socra> tsoome_ where can I do that..?
[02:33.21] <tsoome_> pkg update entire@version. you can get version for example with browser while browsing the repository
[02:33.33] <tsoome_> or with pkg search
[02:41.22] <Socra> so only through cmdline or also possible through the gui of the pkg manager..?
[02:44.23] * Socra feels to noobish in OI world
[02:53.41] <tsoome_> no idea about gui
[02:53.57] <tsoome_> gui is almost dead anyhow
[02:54.20] <tsoome_> and probably will be gone unless someone will start to work with it.... :D
[02:56.39] <Socra> lol
[03:01.01] <tsoome_> its already gone from hipster btw.
 
Well that's what I'm doing, with a GUI I can drag and drop all the files in one swoop.
 
Yes, traditional Mac or Windows desktops loose marketshares against tablets with Android and IOS.
In such a situation even Linux desktops are a niche market. Nobody needs amother desktop solution.

But a GUI is more than a desktop solution, its a human interface for servers. In this sense, it would declare it a bad decision for OI to cancel the GUI as this is the only unique selling point against OmniOS. And then we have the problem that all Illumos distributions like OI, OmniOS and SmartOS compete against each others. No win-win situation unless one of them disappear or they concentrate on a special strength while using a common base/ userland or repository like the universal pkgin from SmartOS.
 
@Gea,
Congratz on the new appliances, excellent work again!
The current production version is:
Version 13b, Jan 11 2014:
OmniOS 1008 stable, napp-it 0.9d2/ 0.9e1 with vmware tools 5.5 and vmxnet3 + e1000)

What is your planning on releasing updates for the appliance..? are you going to create a new appliance once a new update/version of OmniOS comes out or will there be just the version 13b VM and keep Nappit + OmniOS upgrading from there on?

When I do no more than a pkg update or napp-it update, I will stay at the current release numbers like 13b but with newer dates. A new version like 14b (second in 2014) would mean, that this is a complete reinstall from scratch with newer or different applications.

But you can do this updates yourself. Even a complete reinstall with special settings is quite easy.
 
Maybe its easier to

- smb login as root and set all ACL from Windows
This is ok unless you do not need deny rules as they work different on Windows and Solaris.

And set zfs properties aclmode and aclinherit of the filesystem to pass-through

more infos
http://wiki.illumos.org/display/illumos/CIFS+Service+Troubleshooting

I still have problems, even if I login as 'root'. When I select a folder-Properties-Security, I get the message 'The requested security informations is either unavailable or can't be displayed'. I have even reset ACLs to 777 or 'modify' whithin napp-it on that folder, but I still get the sam error.

If I create a new folder, from windows or Omnios, Security tab works...

Matej
 
I would first reset the ACLs of that filesystem completely to a everyone=modify, root =full

- napp-it menu filesystems >> click on folder acl of the filesystem
- check if aclmode and aclinherit is set to pass-through (below file listing)
- click on reset acl (below file listing), select everyone@=modify recursively on files and folders
- optionally do a reset to 777 first then a reset acl (if ACL are completely disarranged)

As root you can do similar from Windows (reset permissions recursively. optionally get ownership recursively first)
Optionally check idmappings (delete all) and SMB groups in OmniOS (delete all beside the basic administrators, backup administrators and power users)
 
I tried that and it's not working. Same error... No error on the newly created folders and files though...

Also, if I try to change permissions on root folder or any other subfolder, I get error:
Code:
No mapping between account names and security IDs was done.

lp, Matej
 
I tried that and it's not working. Same error... No error on the newly created folders and files though...

Also, if I try to change permissions on root folder or any other subfolder, I get error:
Code:
No mapping between account names and security IDs was done.

lp, Matej

Haven's seen this yet, I would go back to older BE's or do a new setup and retry
 
I think I figured why I was getting the "No mapping between account names and security IDs was done." error...

I have my share mounted over NFS to linux client and over SMB to windows client.
I created a folder 'Folder1' on my linux client as 'user1' with ID 1010.
Code:
root@element:/share# ls -l
total 60
dr-xr-xr-x+ 2 user1 root 30 Jan  3 10:46 Folder1

User with UID 1010 doesn't exist on OmniOS server, so owner of the folder was 1010.
Code:
root@nas:/pool0/share# ls -l
total 60
drwxr-xr-x+ 2 1010 root 30 Jan  3 10:46 Folder1

Once I created a user with the same name and UID as the one on linux client, everything started to work and I could see and set all ACLs in windows...
I guess I will have to create all users in OmniOS and linux client and assign them the same UIDs. Is there a possibility to automaticly sync UIDs somehow?

Matej
 
Fine, you found the reason.
Syncing users must be done manually

(or set aclmode = discard to disable chmod from NFS3)
 
I'm not sure where I should post this to be honest but I've loaded up a fresh copy of OI with GUI and then installed Napp-it which is all ok and works as expected, if i open the task manager to view ram / cpu and network usage and then run the internal benchmarks through the napp-it interface, napp-it shoes that i'm using most of my ram (I can't remember the figure off the top of my head but It was around 6Gb out of 8Gb) but the task manager in OI shows that I'm only using 360-ish MB at the same time.

I'm a little confused as to why Napp-it shows high memory usage but the OS shows little to none at all?
 
I'm not sure where I should post this to be honest but I've loaded up a fresh copy of OI with GUI and then installed Napp-it which is all ok and works as expected, if i open the task manager to view ram / cpu and network usage and then run the internal benchmarks through the napp-it interface, napp-it shoes that i'm using most of my ram (I can't remember the figure off the top of my head but It was around 6Gb out of 8Gb) but the task manager in OI shows that I'm only using 360-ish MB at the same time.

I'm a little confused as to why Napp-it shows high memory usage but the OS shows little to none at all?

What command?
- OS command ?
- vmstat 1 2 (used in menu system - statistics -memory or via CLI)
- arcstat.pl (used in menu system- statistics - arc)

In doubt, I would trust the CLI commands like vmstat.

ps
During usage, nearly all otherwise not used RAM is assigned as read cache. Maybe this is excluded by your command. It is quite normal for Solaris based systems to have only minimal free RAM due to this behaviour as this gives you a value for your RAM: performance.
 
Back
Top