![[H]ard|Forum](/styles/hardforum/xenforo/logo_dark.png){kind=logo}
Linux versus Windows - bigadv folding results
- Thread starter musky
- Start date
The question should be will I be awake then. Now that I am back, I am back to sitting in the channel 24x7. However, I've been awake for the past 48 hours so there is no guarantee I will be awake.
You'll be fine, just read the help dialogs, there is one for each option (usually), if you aren't familiar with the option.
how is everyone coming... I just got done with all my hardware testing... am about to go help cut a fallen tree of a neighbors fence... oh boy...
will be back later to help with Q....refer to the in house linux expert till then (tobit) ....
will be back later to help with Q....refer to the in house linux expert till then (tobit) ....
I just got back from mtnduey's where I picked up two more Dell 860 1U servers, both are Quad Core X3220's (2.4 GHz).
This afternoon I am going to remote into one of musky's rigs to install Gentoo for him. Hopefully start rebuilding my farm this week.
well my x58 board is deff dead... so I guess I will be playing with the Q6600 and PII 905e x4
Well, operation "musky to too incompetent to do this" is in full effect. My attempt at Ubuntu Server on other SR-2s have lead to client-core communication errors. I do have it running on my dual quad file server - just waiting for something besides a regular smp unit for comparison. Tobit is deligently working on one of the SR-2s now, so we should have some results soon.
rofl.... linux is not always for the faint of heart... sometimes I forget the first few times I used it...
Bigadv is a flag saying the system can take them... not that you will get them... I have seen nothing on folding forum... but then again... stanford sucks at communication...
Tear over at FF has posted the same question, from what is being posted over there the best I can say is that it looks like allocation is patchy, my win7 box got a 6901 though which will keep me going until tomorrow PM
Tear is folding again? WTF? He emo-rage-quit a few months ago. Fuck the drama.
FAH would be much more boring without dramaTear is folding again? WTF? He emo-rage-quit a few months ago. Fuck the drama.
Tear is folding again? WTF? He emo-rage-quit a few months ago. Fuck the drama.
but if we took stanford out of the equation who would we fold for...
Tear is folding again? WTF? He emo-rage-quit a few months ago. Fuck the drama.
Yeah he restarted a couple of weeks ago according to his stats. I even asked him what he was running and he replied that he's still using the remains of his old farm.
may i be worthy
[H]ard|DCer of the Month - December 2010
- Joined
- Aug 17, 2010
- Messages
- 1,186
Doing family/dad/hubby sort of stuff.
But in my imagination I have Linux working on 3 SR2s, running 3 6901s and doing over 600kppd.
But in my imagination I have Linux working on 3 SR2s, running 3 6901s and doing over 600kppd.
This is about as simple as you are going to get.
1. Install Ubuntu Desktop 10.10 64 bit. It will install nicely from a USB drive with unetbootin. The only thing you should change is to use ext3 instead of the default ext4 filesystem when partitioning the drive. I think this is pretty straightforward to do from the installer. HERE are some screenshots of a pretty typical install.
2. Let it update. .
3. Go get a sandwich - 269 updates as of a few hours ago.
4. When it finishes, it will want you to restart. Don't yet.
5. Places - Home Folder
6. Create a new folder called fah.
7. Right-click - Sharing Options - Check the Share This Folder checkbox - it will prompt you to install a package, let it install. It will want you to restart your session, don't yet. Cllick Cancel on the sharing box
8. Open a Terminal (Applications - Accessories - Terminal)
9. Type this:
You will see a bunch of verbiage that probably means something, but don't worry about it
Edit from 10e:
If you get a "command not found" error when running "sudo add-apt-repository ppa:chogydan/ppa && sudo apt-get update"
You need to do:
10. Once it finishes, type this:
Again, more verbiage, blah, blah blah. Just let it finish.
11. Still in the terminal, type;
Change this line:
to this:
Control-X - Y - Enter to save the change
12. Type:
While it is doing its thing, you should see reference to three different kernels plus the safe modes for each.
Look for the ones that ends in -ck. It should be the third and fourth kernels update-grub finds. If it is ("Found linux image: /boot/vmlinuz-2.6.35-25-generic-ck" is the line in the above example, and it is the third), you are set. If it is not, you will have to change your GRUB_DEFAULT setting accordingly - first/second -> GRUB_DEFAULT=0, fifth/sixth -> GRUB_DEFAULT=4, etc.
13. (Optional) in the terminal, type:
Remote access via a terminal emulator - if you don't know what that means, skip this step. You can still have remote access with VNC if needed
14. Now, reboot the system
15. When you log back in, go back to Places - Home Folder, right-click your fah folder and select Sharing options, and check all three checkboxes. You will get something about adding permissions, click OK.
16. Open the terminal again and type:
17. Run F@H config:
Enter all your stuff. I add the -smp -bigadv flags in the configuration to prevent having to make a shortcut with them, but to each his or her own.
18. Run F@H:
I just did exactly this on one of my SR-2s and am seeing almost identical frame times that I see with the Ubuntu Server install on an almost identical machine - around 1:20/frame faster and 24K ppd more than Windows.
Tobit is still trying to beat these times with a more custom Gentoo install - stay tuned. For now, this will get you running in Linux fairly painlessly.
1. Install Ubuntu Desktop 10.10 64 bit. It will install nicely from a USB drive with unetbootin. The only thing you should change is to use ext3 instead of the default ext4 filesystem when partitioning the drive. I think this is pretty straightforward to do from the installer. HERE are some screenshots of a pretty typical install.
2. Let it update. .
3. Go get a sandwich - 269 updates as of a few hours ago.
4. When it finishes, it will want you to restart. Don't yet.
5. Places - Home Folder
6. Create a new folder called fah.
7. Right-click - Sharing Options - Check the Share This Folder checkbox - it will prompt you to install a package, let it install. It will want you to restart your session, don't yet. Cllick Cancel on the sharing box
8. Open a Terminal (Applications - Accessories - Terminal)
9. Type this:
Code:
sudo add-apt-repository ppa:chogydan/ppa && sudo apt-get updateEdit from 10e:
If you get a "command not found" error when running "sudo add-apt-repository ppa:chogydan/ppa && sudo apt-get update"
You need to do:
Code:
sudo apt-get install python-software-properties10. Once it finishes, type this:
Code:
sudo apt-get install linux-image-generic-ck linux-headers-generic-ck11. Still in the terminal, type;
Code:
sudo nano /etc/default/grub
Code:
GRUB_DEFAULT=0
Code:
GRUB_DEFAULT=212. Type:
Code:
sudo update-grub
Code:
ave@bulldawg:/etc$ sudo update-grub
Generating grub.cfg ...
Found linux image: /boot/vmlinuz-2.6.35-27-generic
Found initrd image: /boot/initrd.img-2.6.35-27-generic
Found linux image: /boot/vmlinuz-2.6.35-25-generic-ck
Found initrd image: /boot/initrd.img-2.6.35-25-generic-ck
Found linux image: /boot/vmlinuz-2.6.35-22-generic
Found initrd image: /boot/initrd.img-2.6.35-22-generic
Found memtest86+ image: /boot/memtest86+.bin
Found Windows 7 (loader) on /dev/sda1
doneLook for the ones that ends in -ck. It should be the third and fourth kernels update-grub finds. If it is ("Found linux image: /boot/vmlinuz-2.6.35-25-generic-ck" is the line in the above example, and it is the third), you are set. If it is not, you will have to change your GRUB_DEFAULT setting accordingly - first/second -> GRUB_DEFAULT=0, fifth/sixth -> GRUB_DEFAULT=4, etc.
13. (Optional) in the terminal, type:
Code:
sudo apt-get install openssh-server14. Now, reboot the system
15. When you log back in, go back to Places - Home Folder, right-click your fah folder and select Sharing options, and check all three checkboxes. You will get something about adding permissions, click OK.
16. Open the terminal again and type:
Code:
cd fah
wget "http://www.stanford.edu/group/pandegroup/folding/release/FAH6.34-Linux64-SMP.exe"
mv FAH6*.* fah6
chmod 777 fah617. Run F@H config:
Code:
./fah6 -configonly18. Run F@H:
Code:
./fah6I just did exactly this on one of my SR-2s and am seeing almost identical frame times that I see with the Ubuntu Server install on an almost identical machine - around 1:20/frame faster and 24K ppd more than Windows.
Tobit is still trying to beat these times with a more custom Gentoo install - stay tuned. For now, this will get you running in Linux fairly painlessly.
Last edited:
Drama doesn't have permanent consequences in the folding world it seems.Tear is folding again? WTF? He emo-rage-quit a few months ago. Fuck the drama.
True, and what's also true is folding wouldn't be folding at all without the drama. You can't have one without the other.
Good catch - fixed
may i be worthy
[H]ard|DCer of the Month - December 2010
- Joined
- Aug 17, 2010
- Messages
- 1,186
Thanks a ton Musky for that guide - have setup and am getting FAH set up now.
Took a lot of time, as Ubuntu took a lot of fiddling to install to a USB stick with ext3. Doing it from one usb stick to another would fail, eventually I burnt a CD and it went fine from there. Will post my issues as they ccome up.
Anyone captured a p6901 on linux for benching?
Took a lot of time, as Ubuntu took a lot of fiddling to install to a USB stick with ext3. Doing it from one usb stick to another would fail, eventually I burnt a CD and it went fine from there. Will post my issues as they ccome up.
Anyone captured a p6901 on linux for benching?
Can't thank you fellas enough for running threads like this Currently at 189K ppd on one rig and a whisker away from 200K on the other. The gains have not been equal so I'm hoping it's just a slow 6901 on the latter. A very happy bunny
Sorry mate, I'm not sure how to do this
Currently at 189K ppd on one rig and a whisker away from 200K on the other. The gains have not been equal so I'm hoping it's just a slow 6901 on the latter. A very happy bunny Sorry mate, I'm not sure how to do this
I have three running now, so I'll grab one for you.
In other news, I have non-SR-2 results:
Dual X5550s @ 2.93
Windows - 22:13/frame - 58.5K ppd
Linux - 19:51/frame - 69.5K ppd
Percentage-wise, that is close to what the SR-2s are seeing - ~18% increase.
may i be worthy
[H]ard|DCer of the Month - December 2010
- Joined
- Aug 17, 2010
- Messages
- 1,186
Can't thank you fellas enough for running threads like this
Sorry mate, I'm not sure how to do this
Great to hear more success stories. What is the rig doing 200k?
I am updating mine as we speak and am god knows how far through a million patches.
Capturing a unit is as simple as grabbing a copy of the FAH folder. Deleting your client.cfg with passkey in it. Keep just *.dat files in the work folder, and uploading them in a zip file - making sure the queue.dat and unitinfo.txt from the root folder are there.
Then we run them with asknet=yes and ignoredeadlines=yes in our benchmark configs.
EDIT: @musky - thanks mate - running my first SMP now, but dying to know my bigadv benefit.
It's a 2x5680 SR-2 that I've managed to get up to 4.44GHz (so far
) after recently watercooling it. Under Windows it got a tpf of about 10:36 and 10:48 on 6900s and 6901s respectively. It's now achieving 9:51 on a linux 6901 which is less of a % leap than the two other converted SR-2 and 980X rigs. Capturing a unit is as simple as grabbing a copy of the FAH folder. Deleting your client.cfg with passkey in it. Keep just *.dat files in the work folder, and uploading them in a zip file - making sure the queue.dat and unitinfo.txt from the root folder are there.
Then we run them with asknet=yes and ignoredeadlines=yes in our benchmark configs.
Musky to the rescue thankfully.
may i be worthy
[H]ard|DCer of the Month - December 2010
- Joined
- Aug 17, 2010
- Messages
- 1,186
Interesting results - Ubuntu 10 "Musky's Mix" on SR2#2...
SMP on 6053 unit shows very consistent 58 second frame times - with any NUMA setting.
NUMA disabled: 58 seconds
NUMA enabled: 58 seconds
NUMA: SLES11: 58 seconds
I can't recall if this was the case on windows 7...
bigadv result to follow as soon as I can, but it will have to wait until the morning...
SMP on 6053 unit shows very consistent 58 second frame times - with any NUMA setting.
NUMA disabled: 58 seconds
NUMA enabled: 58 seconds
NUMA: SLES11: 58 seconds
I can't recall if this was the case on windows 7...
bigadv result to follow as soon as I can, but it will have to wait until the morning...
There was a big difference with the NUMA settings in Windows - like a couple minutes/frame difference. This is actually good to know.
58 seconds doesn't sound spectacular for your machines, although I don't own anything that fast. Is it better than Windows?
A P6901 Linux unit is captured. I want to try to run it on my newly converted 970 first, but will make it available later this morning.
When I had my SR-2, I had to explicitly compile the Linux kernel without NUMA otherwise it would run with NUMA regardless of BIOS setting.
I can tell you that this Ubuntu install wasn't explicitly compiled with anything other than whatever it does by default. That may be the difference, but it also doesn't seem to affect the machines I have it running on - both SR-2s with NUMA disabled in the bios and both running 155K - 158K ppd right now.
I'm seeing a 5 second slowdown with NUMA enabled under the 10.10 special mix. This happens on both A5 bigadv and regular A3 smp despite the vast difference in the respective frame times. Very odd.
Is that on your asus dually??
Yep, that's the one.
Hmmm makes me want to try it on mine - must resist as I need to wait until i can get my new case for my main rig so i can move the GPU over, hopefully in a couple of weeks.
did I mention how happy I am that Linux bigadv is back?
If not....
I'M SUPER HAPPY LINUX BIGADV IS BACK!!!
date Points WU's
03-05 490,758 14
03-04 461,605 11
03-03 393,536 11
03-02 545,347 11
that feels so good
If not....
I'M SUPER HAPPY LINUX BIGADV IS BACK!!!
date Points WU's
03-05 490,758 14
03-04 461,605 11
03-03 393,536 11
03-02 545,347 11
that feels so good