A quick update; I've got writes in samba working (just chmod'ed to allow everything from anyone :s). This is with:
- raidz
- no encryption
- zfs prefetch on
- onboard nic
- samba transfers with AIO_SUPPORT enabled
Seeing the same pauses during writes. Yes, that big pause in the...
[root@bsd /mnt]# sysctl vfs.read_max
vfs.read_max: 64
[root@bsd /mnt]# dd if=/mnt/data/zeros.1 of=/dev/null bs=1m
10000+0 records in
10000+0 records out
10485760000 bytes transferred in 31.877767 secs (328936467 bytes/sec)
Yep, just as you say ;)
My intention here was to make the...
What you describe is exactly what I see, 100% busy on all drives, cpu about 5%:
[root@bsd ~]# cat bw-test.bash
#!/usr/local/bin/bash
dd if=/dev/ada0 of=/dev/null bs=1m count=10000 &
dd if=/dev/ada1 of=/dev/null bs=1m count=10000 &
dd if=/dev/ada2 of=/dev/null bs=1m count=10000 &
dd...
A quick update - Now running a fresh install of freebsd8.0 stable, zfs v14 but sadly still getting the pauses while writing and slow reads as seen in the graph above.
Things have got a bit complicated here, so I'll try to make a cohesive reply :)
Transfer
All transfers are done by ftp (in this whole thread) since I believe this is the simplest method.
Just zfs, no encryption
I think we should concentrate on getting good performance from zfs without...
For nexenta:
http://nexenta.org/ then NCP Stable : NCP 2.0 from the top right corner. (Server is running freebsd at the mo so I can't check)
For freebsd:
bsd# uname -v
FreeBSD 8.0-RELEASE #0: Sat Nov 21 15:02:08 UTC 2009 root@mason.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC
I...
So I tried nexenta which came with zfs v14 and after a bit of work I got it up and running. The good news is that the performance problems I have been seeing have disappeared (see pic). But I have no idea how to do encryption on nexenta.
However, the version of freebsd I am using has zfs v13...
Hi dandragonrage, thanks for your suggestion, I will have a look at look at Nexenta. However, it appears that it is limited to 12GB? I would prefer a solution that is unlimited. I suppose I could go to opensolaris if the difference between zfs v13 and the latest stable is significant.
Here is the read test on the unencrypted disk:
bsd# dd if=/dev/ad6 of=/dev/null bs=1m count=1000
1000+0 records in
1000+0 records out
1048576000 bytes transferred in 9.390797 secs (111659957 bytes/sec)
It is about double as fast than the test on the encrypted disk. However, I reran the...
Hi sub.mesa, many thanks for your reply - no, we haven't spoken before now :)
The server has 4GB ram, sorry for not including that.
Freebsd 64bit
The intel nic is PCI (Intel PRO 1000GT), sata is onboard.
As for the alignment, I'm not exactly sure what I have done... I initialized the...
Hi all,
I've been working on getting a zfs based storage server setup over the last few weeks. I really like the features of zfs and the most important for me is the ability to do scrubs regularly to check data integrity. I also require the data to be encrypted (my previous solution was using...