I would not be testing with 3 or 4 year old games that everyone has played 2 or 3 times over.
I would test only triple A titles no more than 2 years old.
WHy do people card if a video card can run Crysis 1 or even Metro. If you have not played thoses games by now........jeeeez.
If I'm in the market for a video card , why would I care if it can run Far Cry 1 at 200 fps?
As gaming has become more and more mainstream, we see huge marketing dollars and ultra hype on blockbuster titles. The media industry has found a dead lock grip and structured mainstream gaming so well the billions stack higher and higher each year. These mega game releases are a big deal, the launches are bringing in record revenues which is very impressive. Most of the time a few months is all one needs to declare a game a success or a flop. But not all gaming platforms follow the same pattern, PC gaming differs greatly from the console world in a very important way.
Console releases that dont sell well out the gate usually end up flopping. PC gaming isnt like this. The industry, it seems. is more aware of this now. When Crysis first came out it didnt do well at all! There was a huge fear that it wasnt gonna get close to breaking even. But steady the sales came, instead of decreasing over time the the volume went up. Now this many years later we still see crysis everywhere. It didnt fail, it was a huge success. The PC market is vastly different in the fact that PC gamers tend to faithfully buy yesterdays hit titles. Every gamer is different, but PC is a platform that has sales build over long periods of time.
As far as benchmarking, i must say that its not useful to have only dated games. But just as well, neither is it good to only have the few hits out that month. The larger the sample, the more valuable the data is. You have to understand that while the new games may vary greatly, the more data sampled the better. It becomes less and less skewed. A title from 2yrs ago does nothing to hurt, it only gives more data. If its not a game you care about, why focus on it? The real truth is the larger the sample of data, the better the results are. The more clear the picture becomes. Titles come and go, the engines change over time. Jusyt doing current hits is so limiting. In a month or to things can be very different as the next few hits come out. The bigger the review sample from the start, the more accurate the average will be. This average will continue on as future games will continue to be vary wildly.
I am all for the data. The more there is, it only gets better and better. I hope to see apoppin stay true to the large benchmark samples. this is what makes his reviews so important to me. I think he has a great mix. If all you want to see is the new title results, the just focus on them, as the data will still be there. And the results can be yours to interpret. Of course he will need to update the titles as time goes by. Why ask to not include data? It can only be useful for a more complete picture. It cant hurt anything as it only makes the results more and more complete.