Tom's does 16 Intel X25-E, 2.2GB/s

[LYL]Homer

Supreme [H]ardness
Joined
Jun 7, 2004
Messages
4,209
It's Tom's fwiw:

Some months ago, we were informed by A&R Edelman, Samsung’s PR agency in the US, about a YouTube video showing 24 Samsung PB22-J flash SSDs configured in a RAID array using a high-end PC. The guys who produced the video did a great job and reached just beyond 2 GB/s using one Adaptec 5-series controller card and an Areca 1680ix board on an Intel dual-CPU "Skulltrail" system. We felt intrigued by the project and decided to see if we could beat their results.

http://www.tomshardware.com/reviews/x25-e-ssd-performance,2365.html

p.s.

The 64 GB version, featuring 50 nm SLC NAND flash memory, is still Intel’s top model. Next-generation devices will switch to an advanced 34 nm process soon (watch for a review any day!). This will double capacities to 128 GB in the enterprise segment and 320 GB in X25-M consumer drives.

http://digg.com/hardware/Tom_s_16_Intel_X25_Es_do_2_2_GB_s
 
Last edited:
That article is just so sick.

Seeing that many X25-Es and some nice Adaptec cards makes me jealous :(
 
wow, they didn't even do any good test to compare with anything out there, not to mention, NO real world tests like heavy app loading or file copies and make a comparison with their other storage setups.
no, various setups on only one controller, so we see how it would actually scale in real world benefits.

Give those E's to somebody who knows what they are doing and what people want to know, already!
 
Yeah I wish someone would get on it and test SSD stripes with very SMALL stripe sizes, and see how that affects results. Small stripe sizes aren't good for mechanical drives but I imagine SSD's might actually benefit in some scenarios.
 
Lost me at "Tom's." I don't read vendor supplied graphs and performance numbers.
And Adaptec, seriously? Yeah, just completely invalidated every claim on top of being Tom's.
 
Lost me at "Tom's." I don't read vendor supplied graphs and performance numbers.
And Adaptec, seriously? Yeah, just completely invalidated every claim on top of being Tom's.

What raid card do you think would do the X25-E's justice?
 
What raid card do you think would do the X25-E's justice?

I have a host of cards that would do better than the Adaptec. In short, everything else on the market. Shortlist for my tastes? Probably the Areca 1680ix-16 running 10 in a RAID6.

For all out, no holds barred, let's rape some brains performance? LSI MegaRAID SAS 8888ELP. Two of them. 8 X25-E's per card. RAID60 cross-card span.
 
That was an interesting article but I wish a they had provided a few more data points.

I am currently benchmarking a slightly smaller array (12 X25-Ms) across a pair of 1680ixs and am noticing some interesting bottlenecking in terms of IOPS I can sustain based on operating system. I suspect there is a limit based on the number of interrupts issuable per second by the OS. For example, I'm getting far more scalability under Solaris x86 than I am from Server 2008.

I'd love to see what sort of CPU utilization they were getting under that load.
 
That was an interesting article but I wish a they had provided a few more data points.

I am currently benchmarking a slightly smaller array (12 X25-Ms) across a pair of 1680ixs and am noticing some interesting bottlenecking in terms of IOPS I can sustain based on operating system. I suspect there is a limit based on the number of interrupts issuable per second by the OS. For example, I'm getting far more scalability under Solaris x86 than I am from Server 2008.

I'd love to see what sort of CPU utilization they were getting under that load.
Are you doing a write up on your results? If so...when are you posting them? :)
 
This is how it's done!
One DVD per second project! Raid5 "legs" with a hotspare http://jdevelopment.nl/hardware/one-dvd-per-second/
dualraidsetup.png
 
Lost me at "Tom's." I don't read vendor supplied graphs and performance numbers.
And Adaptec, seriously? Yeah, just completely invalidated every claim on top of being Tom's.

Adaptec is good, but their numbers are very conservative, this would explain their lower than expected numbers IMO.
 
This is how it's done!
One DVD per second project! Raid5 "legs" with a hotspare http://jdevelopment.nl/hardware/one-dvd-per-second/
dualraidsetup.png

That's a failure versus an LSI 8888 setup. The LSI 8888 will destroy it, because it builds the stripe across the cards in ASIC. I am trying but cannot remember for the life of me what exactly the card interconnect was on earlier generation SCSI cards, I used to abuse it frequently to build RAID1+1 multi-read beasts (mirror on card then mirror across cards.) I think these days they ride on IOAT.

And Adaptec is crap, period. They haven't made anything 'good' since the 90's. Both LSI and Areca walk all over them with their low end cards.

Either way, people shouldn't be asking for more data points or CPU utilization from Tom's. Their numbers are bought and paid for by Intel, and likely fabricated from whole cloth. Either way, a quick look revealed that their numbers are invalid anyways because as expected, they have absolutely no clue about how to configure for RAID or benchmark whatsoever. If I believed any of their numbers in the least, I could likely walk all over them. But you can't, because it's Tom's, and the numbers are dictated by the manufacturer when they buy the review. In fact, the way they configured it, their numbers aren't even in the realm of believability.
 
Last edited:
I belive you.
I'm a Raid noob, sort to say, can you explain what "ASIC" and other differences why it would be better than these arecas. :)
I remember reading somewere that it would be best if you didn't use SAS capable Raid cards, cause they do something unneeded when paired with sata SSDs...
 
I belive you.
I'm a Raid noob, sort to say, can you explain what "ASIC" and other differences why it would be better than these arecas. :)
I remember reading somewere that it would be best if you didn't use SAS capable Raid cards, cause they do something unneeded when paired with sata SSDs...

Application Specific Integrated Circuit; in this case, what ever handles cross-bus or cross-card communications. A RAID card is comprised of a bus interface IC, a general purpose embedded processor, and a full controller for whatever drive types it supports. Not sure how they're doing cross-card these days though, honestly. I'd have to go look up notes. I haven't done it with the modern stuff.

Never heard anything like that, and that's impossible to believe. The drive signals what type it is - SAS or SATA - and the controller selects the appropriate command set from the drive. Any defect like that is on the drive.
 
I have both a 1680ix and a rocket raid 3520, and eight vertex ssd...they are spread among two rigs, but the wuestion tha ti have is can i make a nested array using two different cards? Also, can you boot from a nested array?
 
If you want to get technical, an ASIC properly describes most of the chips on any RAID card. I think what AreEss is trying to describe is a direct card to card communication not far off from SLI, in order to combine the drives from more than one card into a large array whilst minimizing system overhead.
 
I have both a 1680ix and a rocket raid 3520, and eight vertex ssd...they are spread among two rigs, but the wuestion tha ti have is can i make a nested array using two different cards? Also, can you boot from a nested array?

Two identical cards which support cross-card cross-array spanning? Depends on the card limitations. On LSI, yes. I haven't investigated on other cards.

If you want to get technical, an ASIC properly describes most of the chips on any RAID card. I think what AreEss is trying to describe is a direct card to card communication not far off from SLI, in order to combine the drives from more than one card into a large array whilst minimizing system overhead.

Not so much so. The processor is not an ASIC; the interface also is not really an ASIC. They're general purpose parts, so not Application Specific. But yes, it's like SLI without the retarded aspects of either incarnation. The limitation of any given cross-card span is going to be the communications channel between the two. Carrying it across the bus is fine in some situations, but most, it's not. Part of why the newer LSIs are X0 only is so that there's very little cross-card communication in terms of data. I/O requests go to the correct card, and card status is communicated between the two - but not actual data for disk.
 
New LSI cards: http://www.lsichannelgateway.com/news/2009/20090728.html
The MegaRAID 9200 series controllers, featuring the LSISAS2108 6Gb/s SAS RAID-on-Chip (ROC), double the data transfer rates of their 3Gb/s predecessors to deliver industry-leading performance with up to 2.88 GB/s in sequential reads and 1.87 GB/s in sequential writes. The superior read/write performance makes them ideally suited for a broad range of application workloads, from data center applications such as email and database servers to more compute-intensive applications such as streaming video, OLTP and data archival.

Pricing and availability(1)

Internal ports:

*
MegaRAID SAS 9260-4i (4-port): $389
*
MegaRAID SAS 9260-8i (8-port): $599
*
MegaRAID SAS 9260DE-8i (8-port)(2): $729

External ports:

*
MegaRAID SAS 9280-8e (8-port): $859
*
MegaRAID SAS 9280DE-8e (8-port)(2): $945
 
CLEAN PANTS!
I NEED CLEAN PANTS!

I saw those on the LSI website the other day while checking out the 8888elp. They sure look shiny don't they? :D


o Maximum reads: 2,875MB/s
o Maximum writes: 1,850MB/s

eek.
 
I saw those on the LSI website the other day while checking out the 8888elp. They sure look shiny don't they? :D


o Maximum reads: 2,875MB/s
o Maximum writes: 1,850MB/s

eek.

They weren't up when I last looked the other day! (28th, I swear.)
 
How about a 24 port version? I don't feel like using expanders as they are impossible to get on their own (well, almost).
 
Seeing as how it was just launched, I'm guessing we'll see versions with more ports later on.
 
Will sata 6Gb/s drives be needed to achieve this limit or just enough SSDs??
:D
 
Well each SSD has its own ATA channel, so multiple SSD's dont stress SATA any more than a single, but we are very close. I'm sure the next gen drives will be able to saturate SATA2 and make use of SATA3.
 
didn't someone just do an article with a controller card and onboard raid? I thought it showed onboard was slightly faster, or atleast nothing was to be gained by using a controller card.
 
didn't someone just do an article with a controller card and onboard raid? I thought it showed onboard was slightly faster, or atleast nothing was to be gained by using a controller card.
I would like to see that article
 
This is just ridiculous. I mean it's cool to do something extreme like this to see how far you can push the technology but nobody can afford to practically use this stuff unless they are millionaires or big time companies that need this stuff for their business. Case in point - how do heck do you play to stuff 16 hard drives into your computer case? Yeah...
 
Okay, try to hit everyone's questions as best I can. If I miss it, say so.

First, yes, 6GB drives are required for 6GB throughput. That's kind of a "well duh" thing. No, 6GB drives are not easy to find right now. I have sources, but they're not good sources.

Versions with higher port counts are unlikely. LSI goes out of the gate with the max they're comfortable with. A new model would be introduced to increase port count, e.g. 9400-series. They may change that this time by, but I doubt it. These are the first salvo. The next is probably some months out.

Expanders are less of an issue on this card and more of an issue; a 6GB expander basically will offer you double the count in 3GB drives. Now go find a 6GB expander. Yeah. Exactly. Sigh.

The data transfer rates on these cards are conservative estimates. It's an LSI thing. The nutshell version? First, based on clock rates and features, these cards will fully saturate bus in RAID0 operation modes with fast enough drives. If we presume the testing was done with standard mechanical SAS drives, then you can do the math yourself.
Look at the card. It's external only. Why? SSC and DFE. DFE plays merry hell with EMI/RFI, and external SAS cables are always shielded. Internal SAS cables are not. SSC+DFE internally can cause EMI/RFI disruption, which obviously is not acceptable in an LSI product. It's likely the internal ported version of the cards are still undergoing testing and certification.

These cards are literally a full generation leap over everyone else. The Areca 1680ix was a clock boost, basically. They took the 1280, and threw a faster general processor at it. LSI almost started from scratch on these, and it really shows. These cards are nothing short of insane. Especially when you factor in attaching, say, two 12 packs of SSDs with one card at we'll say 64K soooo about 160MB/s stable per drive in sequential and random reads? :D
 
Less effective ports on the 9260, which is why it's under Value. I'm only comparing like for like; the 9260's smaller than the external only stuff.
 
That is true, fewer effective ports. Still plenty for what I'm shooting for :)
 
Back
Top