ZFS Build Questions

Are my speeds about right for my setup? Are there any tweaks i can do that would help transfers?
 
I'm not too familiar with Bonnie, but that looks pretty good if you ask me, but I guess that would depend on how your zpool is configured (post zpool status :)). Though CPU usage seems a little high? Are you doing any compression or dedup on the file system?
 
Thanks....Yeah i was confused on the cpu usage too. Im not doing any compression or dedup (that i know of).

Sorry, one last question. When I transfer folders/files from one pc to the nas, only that pc has read/write access to the folder/files. The permissions seem to be locked to the AD User that put the files on there.

# zpool status
pool: MC-NAS
state: ONLINE
scan: none requested
config:

NAME STATE READ WRITE CKSUM
MC-NAS ONLINE 0 0 0
raidz2-0 ONLINE 0 0 0
c0t5000CCA221E1DCA2d0 ONLINE 0 0 0
c0t5000CCA221E2A7B3d0 ONLINE 0 0 0
c0t5000CCA221E2A7B5d0 ONLINE 0 0 0
c0t5000CCA221E2A7D3d0 ONLINE 0 0 0
c0t5000CCA221E2A7DDd0 ONLINE 0 0 0
c0t5000CCA221E2A805d0 ONLINE 0 0 0
c0t5000CCA221E285EDd0 ONLINE 0 0 0
c0t5000CCA221E2491Ed0 ONLINE 0 0 0
spares
c1t3d0 AVAIL

errors: No known data errors

pool: syspool
state: ONLINE
scan: none requested
config:

NAME STATE READ WRITE CKSUM
syspool ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
c1t0d0s0 ONLINE 0 0 0
c1t1d0s0 ONLINE 0 0 0

errors: No known data errors
 
Last edited:
jaw4322 said:
Thanks....Yeah i was confused on the cpu usage too. Im not doing any compression or dedup (that i know of).

Sorry, one last question. When I transfer folders/files from one pc to the nas, only that pc has read/write access to the folder/files. The permissions seem to be locked to the AD User that put the files on there.
Click to expand...
I'm at work I don't want to look around too much. I imagine Nexenta uses the same ACL model as Solaris/OpenSolaris.

This was probably the most difficult part for me, coming from a Windows side. Mind you, you can manage this permissions from a Windows' box once the appropriate permissions are set (though manages share from Windows (MMC) never worked for me on B130, just kept getting errors)

This is a good walkthrough of the concepts of Identity mapping and setting the permissions:
http://vmsysadmin.wordpress.com/2009/01/18/using-zfs-acls-to-protect-cifs-shares-on-opensolaris/

Of course, Solaris' resource on ACLs: http://docs.sun.com/app/docs/doc/819-5461/ftyxi?l=en&a=view

You may also need to set the properties of the FS for aclinherit and aclmode to passthrough if you're seeing unexpected results.
 
Thanks jonny....got it worked out. Looks like when a new pool is created it the permissions are setup weird. Used these steps to fix it: http://nexenta.org/projects/site/wiki/ZFS_Permissions. Also, when you use napp-it to create a share it works perfectly.

I also have to say for anyone who is new to this, Napp-it is very helpful. It not only is able to do a lot of the functions for you, but gives information on whats being done and how. It gives a lot of info, stats, etc. Highly recommend.

Ok...so I pretty much have everything setup and done, but ran into what i think has to be the last problem in this build.

When I have simultaneous transfers going from multiple PC's, the transfers speeds are really slow. Meaning, i start at 80MB/s or so and drop to 25MB/s on one PC (windows 7), and the other PC (windows xp) maxes out at 14MB/s. If the xp pc stops the windows 7 pc takes off again. This cant be normal. I mean when both are going I'm only getting 40MB/s. And why is the windows xp pc so slow from the start? Its has a gig card and connected to the same gig switch.

If i can get this figured out i can be done. :) Please help. I dont want to think about this anymore...lol.
 
To use the same thread. I'm looking for a low energy consumption zfs storage server and at low cost.
This is the hardware that I'm planing to use:
Gigabyte GA-890GPA-UD3H
2x250GB Samsung 2.5" HD250HI M7 SATA (zfs mirror for os)
6x2TB Samsung Ecogreen F4EG (zfs raidz 2)
AMD Sempron 140 2,7GHz AMD Sempron 140
Corsair 4GB (2x2GB) Value Select DDR3 1333MHz

Will this be enough power to run zfs raidz2 ? will use the server for storage, hd-streaming and a very small wordpress blogg. A core i3 530 + Asus P7H57D-V EVO would cost like 150$ more in Sweden. What should i go fore?
 
gea said:
i have not tried that board, but performance should be good
enough for single user hd-streaming. otherwise i would add a ssd read cache
(40GB or 60 GB from Intel or Corsair). If you need high IOPs for Database you could
add a SSD Write Cache (ZIL) but then you should have at least ZFS Version 19.
to remove Cache-Drives in case of problems. Otherwise your Pool could be lost

i would suggest not to use Opensolaris but a small server distribution
like NexentaCore. Its based on Opensolaris Build 134 with many Backports
and has a very fast CIFS Server (build into Kernel) with newest ZFS Features
and ZFS Version 26.

Together with my napp-it, you have it running with Apache2, mySQL, mySQLAdmin,
PHP and a Web-Ui within Minutes.
Click to expand...
Ok, so its a good rigg then...;) I will hopefully unlock the second core on it to, but if i feel a lack in performance i will get a normal x2 but low energy am3 cpu and more ram.

The wordpress blogg has like 15-30 viewers a week, so its no monster blogg....
 
^ seeing that quoted post from gea reminds me i'm still annoyed that all of his posts got nuked for "spam", given all the other nonsense that gets overlooked around here. napp-it sounded just interesting enough for me to finally try getting into ZFS.

regardless, i took the opportunity to download and install Nexenta-Core, and then installed napp-it and literally 20 minutes later I had a zpool running with raidz2 and 24 x 2tb drives shared to windows clients. copied about 100gb of data to share, then pulled out a drive and put in a new one to test resilvering and it was done in 10-20 seconds, tested some snapshots and they showed up in Windows "Previous Versions" tab. pretty cool. consider i'm as dumb as nails when it comes to *nix cmdline. i know "ls" and "cd" and "ping" and thats about it!

EDIT: digging into google's cache for this forum I think I can see now why gea became an irritant to the admins - he was copy/pasting his same napp-it setup instructions into multiple forums and threads. perhaps if he'd just stuck to his one thread to talk about his work and left it at that, things might have gone down different.
 
Last edited:
odditory said:
^ seeing that quoted post from gea reminds me i'm still seriously annoyed that all of his posts got nuked for "spam", given all the other nonsense that gets overlooked around here. napp-it sounded just interesting enough for me to finally try getting into ZFS.
Click to expand...

Me too. When I PM'd "MajorDomo" about it, he told me to drop it, with what I thought was an implied threat of, or else. Admin power corrupts, I guess.
 
Yeah that's too bad. Gea is a really nice guy and very helpful. If you need his help go to the Nexenta.org forum. Its pretty quite there, but he seems to monitor that forum pretty often. I think he's been putting more time into the openindiana version lately, but i would shy away from that OS for a little while. I will also add that my Nexenta core OS + Napp-it solution has been running like a champ for the last 2-3weeks with no issues (knock on wood ;). Excellent performance for the money. You basically just pay for the basic hardware costs. Drives obviously being the most expensive part of the build. Again i highly recommend this solution for the basic novice to the IT professional.
 
^ agreed on all points. I spent the weekend tinkering with both OpenIndiana and NexentaCore and I think NexentaCore+NappIt is the way to go for ZFS until FreeNAS and OpenIndiana release their next stable versions. Then there's the excellent work sub.mesa is doing with his WebGUI for FreeBSD, and not to discount it but Napp-It is simply further along in development, at least for the moment.

I had some words with the admins and asked gea to come back and stick to one thread w/ Napp-It, because despite the site pimping that got him in trouble, his software is sound and I think a lot of people stand to benefit - especially people like me with no desire to set up and maintain a commandline-only approach to ZFS.
 
Last edited:
UPDATE:
Added the second batch of 8 drives today, and its was very simple and quick. Its been about 5 weeks now and everything is working great.

Status of NAS from 04.11.2010 09:00

-----------------------------------------------------------
NAME SIZE ALLOC FREE CAP DEDUP HEALTH ALTROOT
MC1 29T 10.2T 18.8T 35% 1.00x ONLINE -
syspool 596G 10.1G 586G 1% 1.00x ONLINE -
-----------------------------------------------------------


pool: MC1
state: ONLINE
scan: scrub repaired 0 in 3h59m with 0 errors on Sat Oct 30 04:00:00 2010
config:

NAME STATE READ WRITE CKSUM
MC1 ONLINE 0 0 0
raidz2-0 ONLINE 0 0 0
c0t5000CCA221E1DCA2d0 ONLINE 0 0 0
c0t5000CCA221E2491Ed0 ONLINE 0 0 0
c0t5000CCA221E285EDd0 ONLINE 0 0 0
c0t5000CCA221E2A7B3d0 ONLINE 0 0 0
c0t5000CCA221E2A7B5d0 ONLINE 0 0 0
c0t5000CCA221E2A7D3d0 ONLINE 0 0 0
c0t5000CCA221E2A7DDd0 ONLINE 0 0 0
c0t5000CCA221E2A805d0 ONLINE 0 0 0
raidz2-2 ONLINE 0 0 0
c0t5000CCA222CF7EAAd0 ONLINE 0 0 0
c0t5000CCA222CF9F29d0 ONLINE 0 0 0
c0t5000CCA222CF9F4Dd0 ONLINE 0 0 0
c0t5000CCA222CFA151d0 ONLINE 0 0 0
c0t5000CCA222CFB26Fd0 ONLINE 0 0 0
c0t5000CCA222CFB381d0 ONLINE 0 0 0
c0t5000CCA222CFB536d0 ONLINE 0 0 0
c0t5000CCA222CFB8DAd0 ONLINE 0 0 0
logs
c1t8d0 ONLINE 0 0 0
spares
c1t3d0 AVAIL

errors: No known data errors

pool: syspool
state: ONLINE
scan: none requested
config:

NAME STATE READ WRITE CKSUM
syspool ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
c1t0d0s0 ONLINE 0 0 0
c1t1d0s0 ONLINE 0 0 0

errors: No known data errors
 
You must log in or register to reply here.
Back
Top