![[H]ard|Forum](/styles/hardforum/xenforo/logo_dark.png){kind=logo}
Hi all,
I'm the author of hwbot.org, a community primarly for, but not limited to, the overclockers among us. Over the past 2 years I've developped a webapplication that gathers benchmark results from users (both scanned on request on fora or submitted online), and matches it to known hardware to calculate interesting statistics.
Popularity has risen over the past months, and with over 12.000 benchmark results submitted (3d01-06, superpi, all the favorite benchapps) the data i've got available is getting really interesting, if I may say so.
If you like charts with roundups of 20+ cpu/gpu's, you're going to love the generated charts on hwbot, as they are based upon thousands of benchmark results.
Community based benchmark charts have the drawback of not being done in a controlled environment on 1 testsystem by 1 user, but once you get enough results in the deviation get's really small and the data gets equally as reliable imho. As all results get charted, a 'fake' result gets spotted quickly and can be removed from the db by one of our result moderators.
But, I see 2 huge benefits these community based benchmarks will have that charts made for a review will never be able to offer:
- overclockability. If a reviewer gets his hands on a cpu/gpu and can overclock it to xxx mhz, it means very little. I can be cherry picked, or a bad sample, or... While overclockability charts based on hundreds of submissions give you a very clear insight on the overclockability of the hw piece.
- 'live' charts. As the charts aren't the result of a handmade excel/calc sheet, but based on live data in the database, the charts will always be up to date, whether you visit them today or within a year.
Example 'live' benchmark chart, 3000 superpi benchmark results. lower = better.
Example 'live' overclockability chart. Each dot represent a succesfull benchmark run at x core speed and y memory speed.
Example videocard overclockability roundup chart.
What's your opinion on this? Do you think community based benchmark charts have a future, or do you think they will suffer too much from vandalism (cfr. wikipedia) to be reliable?
more info:
processor specs
processor statistics
example processor info page (E6600)
videocard specs
videocard statistics
example videocard info page (x800 GTO)
world records
team rankings
I'm the author of hwbot.org, a community primarly for, but not limited to, the overclockers among us. Over the past 2 years I've developped a webapplication that gathers benchmark results from users (both scanned on request on fora or submitted online), and matches it to known hardware to calculate interesting statistics.
Popularity has risen over the past months, and with over 12.000 benchmark results submitted (3d01-06, superpi, all the favorite benchapps) the data i've got available is getting really interesting, if I may say so.
If you like charts with roundups of 20+ cpu/gpu's, you're going to love the generated charts on hwbot, as they are based upon thousands of benchmark results.Community based benchmark charts have the drawback of not being done in a controlled environment on 1 testsystem by 1 user, but once you get enough results in the deviation get's really small and the data gets equally as reliable imho. As all results get charted, a 'fake' result gets spotted quickly and can be removed from the db by one of our result moderators.
But, I see 2 huge benefits these community based benchmarks will have that charts made for a review will never be able to offer:
- overclockability. If a reviewer gets his hands on a cpu/gpu and can overclock it to xxx mhz, it means very little. I can be cherry picked, or a bad sample, or... While overclockability charts based on hundreds of submissions give you a very clear insight on the overclockability of the hw piece.
- 'live' charts. As the charts aren't the result of a handmade excel/calc sheet, but based on live data in the database, the charts will always be up to date, whether you visit them today or within a year.
Example 'live' benchmark chart, 3000 superpi benchmark results. lower = better.
Example 'live' overclockability chart. Each dot represent a succesfull benchmark run at x core speed and y memory speed.
Example videocard overclockability roundup chart.
What's your opinion on this? Do you think community based benchmark charts have a future, or do you think they will suffer too much from vandalism (cfr. wikipedia) to be reliable?
more info:
processor specs
processor statistics
example processor info page (E6600)
videocard specs
videocard statistics
example videocard info page (x800 GTO)
world records
team rankings