NVIDIA rebuts FutureMark's accusations

Benchmarks "not representative".

NVIDIA has responded angrily to claims that it employed underhand tactics to inflate benchmark scores in 3DMark03. Their response is posted in full and unedited:

Accusations of cheating, tweaking and unfair optimisation have been flying around since 3DMark03 was released. NVIDIA feels that at least some of the furore stems from the fact that the company is no longer a member of FutureMark's benchmarking programme.

Andrew Humber from NVIDIA had this to say on the subject: "Since NVIDIA is not part of the FutureMark beta program (a program which costs of hundreds of thousands of dollars to participate in) we do not get a chance to work with FutureMark on writing the shaders like we would with a real applications developer."

NVIDIA reckons that the best way to judge the performance of the latest GeForce FX cards is through playing the games themselves, rather than "performance factors that are not representative of actual game play", as online hardware independent [H]ard¦OCP pointed out recently.

"Our relative performance on games like Unreal Tournament 2003 and Doom 3 shows that the GeForce FX 5900 is by far the fastest graphics on the market today and we actively encourage benchmarkers to spend more time testing actual games and actual game performance as opposed to synthetic benchmarks. As more DirectX 9.0 games become available, this will become more commonplace and synthetic benchmarks will become less important. At the end of the day, what is most important to the enthusiasts and what do they pay their hard earned money for - cards that look great and run fast on their favourite games or an impressive 3DMark score? I can't help but think, the more the industry and our competitors focus on a non-real world tests such as this, the more the gamers will lose out in my opinion."

Sometimes we include links to online retail stores. If you click on one and make a purchase we may receive a small commission. Read our policy.

Jump to comments (23)

About the author

Tom Bramwell

Tom Bramwell

Contributor  |  tombramwell

Tom worked at Eurogamer from early 2000 to late 2014, including seven years as Editor-in-Chief.

Related

You may also enjoy...

Supporters only

Comments (23)

Comments for this article are now closed. Thanks for taking part!

Hide low-scoring comments
Order
Threading
Eurogamer.net

Buy things with globes on them

And other lovely Eurogamer merch in our official store!

Eurogamer Merch
Explore our store