I think that this whole thread is based on one persons interpretation of a "way of testing/benchmarking. " Ie The [H] Method. From my stand point, I think that yes it is a biased method. BUT, it is a method that someone(the [H] team) stands behind and at this point in time believes is a solid method.
If you count up how many reputable hardware review sites there are, then think that each has a different method for reviewing, you could say that there is a few different approaches. My point here is that in the grand scheme of internet users, There are not that many people proposing a method and using it, doing reviews and sticking behind them. I estimate that there are about 20 -30 independent, reputable hardware site on the net. Thats not very many methods. They stand up to the flame and praise week in week out. Hats off to the sites and teams behind them for doing what they do.
Let me propose a solution:
a) if you dont like the method, dont read the reviews.
b) if you dont like the method propose a new method and do reviews yourself.
c) if you like the method read the reviews and good buying to you.
I personally choose b) since there is no standard, maybe Kyle could proposes a Community standard. A standard of testing by the people for the people. From memory over 8 million plus people read this site a week. Probably more these day. Why dont we run a few surveys and find out what people want from a review. What qualities do we as community think are useful and want to know about? Maybe with the [H] weight we could get the surveys done on a few different sites?? Maybe there could be a user/community voted "Default computer" like an empirical standard in science as to what the average PC is made up of each month. Then reviews of games/hardware are made against that box.
Anyway these are some ideas.
- DESmack
(Just for your note Kyle me chossing b) is not a slant on your method. I actually really enjoy them. ;-)
If you count up how many reputable hardware review sites there are, then think that each has a different method for reviewing, you could say that there is a few different approaches. My point here is that in the grand scheme of internet users, There are not that many people proposing a method and using it, doing reviews and sticking behind them. I estimate that there are about 20 -30 independent, reputable hardware site on the net. Thats not very many methods. They stand up to the flame and praise week in week out. Hats off to the sites and teams behind them for doing what they do.
Let me propose a solution:
a) if you dont like the method, dont read the reviews.
b) if you dont like the method propose a new method and do reviews yourself.
c) if you like the method read the reviews and good buying to you.
I personally choose b) since there is no standard, maybe Kyle could proposes a Community standard. A standard of testing by the people for the people. From memory over 8 million plus people read this site a week. Probably more these day. Why dont we run a few surveys and find out what people want from a review. What qualities do we as community think are useful and want to know about? Maybe with the [H] weight we could get the surveys done on a few different sites?? Maybe there could be a user/community voted "Default computer" like an empirical standard in science as to what the average PC is made up of each month. Then reviews of games/hardware are made against that box.
Anyway these are some ideas.
- DESmack
(Just for your note Kyle me chossing b) is not a slant on your method. I actually really enjoy them. ;-)