Linux Totally Dominates Supercomputers

Megalith

24-bit/48kHz
Joined
Aug 20, 2006
Messages
13,000
You may have read that China now leads the supercomputing race with 202 computers to the US's 144, but did you know that all 500 of the world's top supercomputers are running Linux? The OS originally appeared on the TOP500 Supercomputer list way back in 1998, but it has now completely taken the lead.

"Linux [became] the driving force behind the breakthroughs in computing power that have fueled research and technological innovation," as reported by The Linux Foundation. In other words, Linux is dominant in supercomputing, at least in part, because it is helping researchers push the limits on computing power.
 
Is there a specific flavor of linux they all use, or each one is tailored differently?
 
Is there a specific flavor of linux they all use, or each one is tailored differently?

I imagine the latter. My cousin worked at Oak Ridge National Laboratory in Tennessee, and compiling their own kernels was a necessity in order to make the OS as efficient as possible.
 
Oak Ridge?! Does he give tours? I may know a guy interested. Ha!
 
Im kinda suprised not one is running an entirely proprietary os.
 
Cool. I mean I'm not real surprised. I'm more surprised it's just Linux based and not just general Unix/BSD/etc..
 
Cool. I mean I'm not real surprised. I'm more surprised it's just Linux based and not just general Unix/BSD/etc..

Yeah, I can't imagine someone is going to create a supercomputer running Windows 10. The people who build these things are a tad smarter than that.
 
This is one case where I'd admit Linux is in its place, as long as I don't have to support it.
 
Yeah, I can't imagine someone is going to create a supercomputer running Windows 10. The people who build these things are a tad smarter than that.

Windows HPC Server, maybe. Looks to be discontinued, though.
 
Still, I read something about Linux touch pad gestures being no match for Mac OS X. Why would they cripple themselves like that?
 
I think I'd be more surprised if anything other than Linux was on this list.

I guess I wouldn't be super surprised if some flavor of BSD showed up though.
 
So, I guess they can officially say "2017 is the year of Linux on the Supercomputer!". :) Finally (although, I suspect it's not really a new thing).
 
Yeah, Linux is perfect for Supercomputers.

It already has long-standing support from the graphics companies. Since around 2000, it's been performance-tuned for heavily-loaded servers, with tons of cores supported. And anything you don't like you can tweak yourself at no licensing cost.

It used to be utter pain to tweak things for special-purpose machines, either by contracting it out to the vendor or paying out-the-ass for access to the vendor's source. Either one hurt your pocketbook.

But now you have free access, AND you spend zero spinup time on training people on your OS of choice.
 
  • Like
Reactions: ChadD
like this
Im kinda suprised not one is running an entirely proprietary os.

The Linux kernel has had thousands of large corps... and with no word of a lie millions of developers, work on its creation.

https://www.linuxfoundation.org/pre...ublishes-study-estimating-the-value-of-linux/

This article is now 10 years old, which is hard to believe. Back then they had figured for a company to create a ground up comparable OS would cost north of 10 billion. With the Kernel alone costing almost 1 and a half billion.

" – How Much Does the Linux Kernel Cost?
Applying this test to the Linux kernel included in Fedora 9 found the value to be 6.8 million lines of code worth $1.4 billion. The development effort estimate for the kernel alone exceeds 7500 Person-Years. "

Now 10 years on the kernel has 20+ million lines of code.
https://www.linuxcounter.net/statistics/kernel

So not counting inflation in 2008 pricing... developing an independent kernel on par with the Linux Kernel would cost a min of 4.2 billion. In the US inflation since 2007 is around 28.2%... so in 2017 money aprox 5.4 billion dollars.

Not many people using super computers would spend 5.4 billion just so they could say there kernel is in house. ;)

The kernel is one of the best things to happen to mankind... I know that sounds a bit much. But the kernel will only get better and everyone is FREE to use it for their own purposes. It has allowed the smallest of the small of companies to create their own product without having to worry about the heavy lifting of talking to hardware. The kernel is a modern wonder of the world. In 100 years the kernel will still be around and will I have no doubt run everything as it does today from watches and phones to laptops tablets wall computers cars super computers and anything else people will decide needs a CPU.
 
So, I guess they can officially say "2017 is the year of Linux on the Supercomputer!". :) Finally (although, I suspect it's not really a new thing).


Linux has always been strong with dedicated servers, be it web hosting, super computers, or even some game servers although that seems to be lower now. Which just goes to show that the problem with Linux really is most likely ease of use for non tech savvy users or critical mass and fragmentation. But Linux proponents just never seem to acknowledge that. And in the corporate world people will actually pay for a distro and support as well as many pieces of software to run on it.
 
Linux has always been strong with dedicated servers, be it web hosting, super computers, or even some game servers although that seems to be lower now. Which just goes to show that the problem with Linux really is most likely ease of use for non tech savvy users or critical mass and fragmentation. But Linux proponents just never seem to acknowledge that. And in the corporate world people will actually pay for a distro and support as well as many pieces of software to run on it.

Linux is superior (IMO) on those platforms, too. Web servers, super computers, game servers, etc.. When it comes to Linux, the advice to a lot of newbies is "try a few distros to find the one you like". Or "Try Linux Mint and then move to something different when you get good". That's not how it should be. I'm fine with different distros. But, it's very fragmented right now. With Windows or OSX, you get the latest edition of the OS. There is no "try XP. After you're good, go for 7 or 10. or just install a couple until you find one you like.". That's too much work for the average person.

Now, give them a preinstalled Linux and don't give them a choice, and people seem to do pretty good with it. Until they ask "Why can't I run xx app that's for Windows?" or something. You have to condition them to find alternative software. The masses aren't ready for that level of responsibility yet. They barely know what apps they need as it is.
 
You may have read that China now leads the supercomputing race with 202 computers to the US's 144, but did you know that all 500 of the world's top supercomputers are running Linux? The OS originally appeared on the TOP500 Supercomputer list way back in 1998, but it has now completely taken the lead.

"Linux [became] the driving force behind the breakthroughs in computing power that have fueled research and technological innovation," as reported by The Linux Foundation. In other words, Linux is dominant in supercomputing, at least in part, because it is helping researchers push the limits on computing power.

It's the only thing that could truly do it. Super computers these days are just a series of computers that work together over a network backbone. It would take a custom dedicated open source OS that can be hand modified to realize the potential to divvy out (load balance) that work.
 
Back
Top