Zampella: Reviewers should finish games
Respawn bosses discuss games journalism.
Respawn Entertainment founder Vince Zampella feels there's "nothing more frustrating" than games journalists who review games without completing them.
Zampella was addressing QuakeCon as part of a panel on "Building Blockbusters" alongside Respawn co-founder Jason West, id Software's Tim Willits and Bethesda Game Studios' Todd Howard.
"I've seen reviews where people have written things about the game that are untrue - like that feature doesn't exist, so they obviously didn't play through the entire game," Zampella told the audience.
"There's nothing more frustrating than that. It's unfair."
Todd Howard said he thought that the standard of games journalism was improving as games became a bigger medium, and all the panelists agreed that a well-informed review is not only a boon to a game but to developers too.
"There's other reviews where they were critical on a few things and they were probably right, they called it, okay - and you can live with that. And there are some that are just glowing and you eat those up," Zampella said.
"Reviews. Yeah, that's a tough one," said Jason West. "You want to believe the good ones."
Todd Howard agreed with Zampella. "You want informed reviews. You can tell when someone has played your game and when it was an assignment to get the paycheque...
"If I'm going to play Modern Warfare multiplayer, I know that I'm in for 50 hours, so they do a lot of research, so when the research is a review where some guy didn't spend a lot of time playing your game, that's crushing.
"But if they're going to give you criticism and they've obviously played the game and thought about it, which we all get, it's actually helpful."
Towards the end of the panel, West also chimed in about review scores specifically.
"I'll put in a small pitch for what I think would be a better system of metrics, but it will never happen because people love numbers," he said.
"The way Rotten Tomatoes works for movies I think is a lot more accurate reflection of positive or negative, versus 92, versus 91.3, and they all get averaged out and it's pretty random."
Neither of the Respawn men said anything about their new project, which will be published by Electronic Arts, although they said they were evaluating technology at the moment.
At one point a member of the audience asked about handing sequels off to other developers and mentioned Treyarch, with whom West and Zampella used to share Call of Duty development during their former life at Infinity Ward, and West put his head in his hands for comic effect.
Otherwise the "divorce", as one audience member described it, was off limits for the hour-long discussion.
You may also like...
-
Retrospective: Star Wars Episode I Racer
-
Why Devs Owe You Nothing
-
Digital Foundry: PS3 Skyrim Lag Fixed?
-
Game of the Week: Catherine
-
App of the Day: Ascension: Chronicle of the Godslayer
-
Face-Off: The Darkness 2
-
Gotham City Impostors Review
-
Who Killed Rare?
-
Kingdoms of Amalur: Reckoning Review
-
EA evaluating FIFA Street features for FIFA 13
-
App of the Day: Sir Benfro's Brilliant Balloon
-
Grand Slam Tennis 2 Review
-
Ultimate Marvel vs. Capcom 3 Vita Review
-
Sony admits "dropping the ball" with Demon's Souls
-
The Darkness 2 Review
-
Catherine Review
-
CD Projekt: Witcher 2 intro cinematic "the most expensive asset we ever created"
-
One Piece: Unlimited Cruise SP Review
-
Skyrim patch 1.4 now live for Xbox 360
-
King Arthur 2 Review
-
Metal Gear Solid: The "Lost" HD Remasters
-
Skyrim patch 1.4 performance tip: make a new manual save
-
Catherine launch trailer is looking saucy
-
Epic's Sweeney on graphics tech: "the limit really is in sight"
-
App of the Day: Superman









Comments (88) Latest comment 2 years ago
Comments threads automatically close after 30 days, but please feel free to continue chatting on the forum!
Comment below viewing threshold Show
It works both ways though, some games get completely panned, yet on getting further they become something better, or there is some reason for it's short comings early on.
I hate reviews.
Comment below viewing threshold Show
I wouldnt mind if they put a disclaimer on big games (RPG's, MMORPG's etc), but for most others they shouldnt need to, can you imagine the matrix being reviewed without the reviewer having seen Bullet Time?
Cant think of another movie reference to prove my point right now but im sure somebody will know what im talking about!
Comment below viewing threshold Show
Comment below viewing threshold Show
Comment below viewing threshold Show
Comment below viewing threshold Show
Comment below viewing threshold Show
What EG are good at amongst all that though, is often correcting when they are FACTUALLY wrong (not neccessarily when they make a massive arse of themsleves like the above example mind) which is something.
Reviews should always be seen as subjective opinion pieces though. Sites/magazines can barely be consistent with themselves across contributors , the dissapointing part is that sites like Metacritic and Rotten Tomatoes have turned it into an actual measurement of quality. Or at least thats how publishers perceive them. That at least, is their own fault.
Comment below viewing threshold Show
I do think it's difficult for the reviewers to do this in every single case. I just don't see how they would have the time for, say, something like Fallout or Zelda.
Comment below viewing threshold Show
Comment below viewing threshold Show
Comment below viewing threshold Show
Comment below viewing threshold Show
yes but I'd like to base that informed decision on several reviews where the reviewer has finished the bloody game!
Comment below viewing threshold Show
As far as I know only Giant Bomb will finish a game before reviewing it while Kotaku indicate the point they were at when they finished the game plus what difficulty they were on as well.
Comment below viewing threshold Show
And above all else they are opinions, not scientific fact. So in order for them to be of use you need to find a source you trust and have a general idea of thier writting style, reviews pratice and taste. So you know how to take thier opinion and use it to gain the info you need to make a decision. If you know that then even a game scopring low can be usefull, becuase you might feel the things that bothered the reviewer won't irritate you as much.
Comment below viewing threshold Show
I'm sure there's pressure from benefactors for journalists to get reviews done for the game's release, and maybe if they got review code earlier they'd spend the time with the game that it deserves. Another thing I think is worth pointing out: why do ALL the reviews need to be done by launch? People who go and buy it day one probably already know they want it, everyone else might get it a week later. This does conflict with the short-tail marketing of most games, so maybe it's not viable.
Either way, I think if journalists were less pressured in general they'd feel more inclined to spend time with a game rather than constantly thinking "Have I played this enough yet? I really need to move onto something else today." Of course, as with any observer, my insight is limited.
Comment below viewing threshold Show
Now if someone has played a real shitload of these types of games, is 13 mins enough? I don't think so myself.
Comment below viewing threshold Show
Of course, finishing a game is a much harder thing to do, because of the time needed, compared to movies. Especially if the game is long, difficult or shitty (or worst, all of the above), that makes the reviewer's life a little too hard. But it is a job, and as a job, it isn't always about fun.
Comment below viewing threshold Show
Comment below viewing threshold Show
Comment below viewing threshold Show
Comment below viewing threshold Show
Comment below viewing threshold Show
Comment below viewing threshold Show
Comment below viewing threshold Show
Comment below viewing threshold Show
So should developers. AHAHA.
Comment below viewing threshold Show
Comment below viewing threshold Show
Comment below viewing threshold Show
Comment below viewing threshold Show
I jest.
Comment below viewing threshold Show
Comment below viewing threshold Show
How can you judge and review the multiplayer aspect of a game weeks before it's released to the general public?
Comment below viewing threshold Show
The finger of blame could be pointed in three different directions, admittedly, but inside the industry at the moment your studio's average metacritic rating is EVERYTHING. I can't count the number of projects my employers have lost at the last hurdle because a publisher's marketing department went to metacritic and decided our average score was too low.
Bear in mind that metacritic scores are ALREADY an average, so we are talking about an average of an average there... It's insane, but the upshot of all this is that ONE bad review can significantly damage the future of a studio. Is it any wonder that devs get bitter and twisted about reviewers when their one "subjective opinion" can put them out of the industry for good?
Comment below viewing threshold Show
The average games mag or website, will get a good few games per month to plough through. While a review on a full play might seem more credible, gamers will usually consult more than just one review, and summarise afterwards.
Sure, reviewers should finish games, but then so should developers and publishers, who often like to half release games, then sell us the other half via DLC (here's looking at you MW2). Can't say that's fair either, but many of us suck it up, if tempted enough.
Why would Zampella say this? Probably because those making games, want more time to sell their product unchallenged by reviews. Embargos and NDAs (remember when we never had them?) are designed to gag and control info on a game, before a games release, and it would seem they also want the same kind of control after release. That's nice, in a perfect world but no, its not gonna happen. You can't lick both sides of the lollipop, or get weird, telling reviewers how to play/review your game.
Just be glad that there are still websites out there, that can review games, through buying them still, as much of the industry crosses the palms of some websites and reviwers with tainted silver of free games. Some might call that a compromising, conflict of interest situation.
Comment below viewing threshold Show
Multiplayer aspects also have certain issues. You're given a preview code, in what amounts to a complete game... Except you're looking at empty player lobbies. You can wait around for other players, except the preview build is give out to so few journos you're looking at hours of waiting for someone to drop in. Other rules are also peculiar - take Napoleon: Total War. Some review codes could only be played online against members of the development team. The result? Several reviews pointed out they couldn't experience multiplayer because team members were nowhere to be found. Bioshock 2's MP was for several people a ghost town when review copies were sent out, for instance.
Other things are both understandable and terrible, such as workload. If you're working under a strict timeline and are required to post news, write hands-on impressions and a review - all of these for one week - you do your best but it's not always possible to finish a game. Professionally, many reviewers try their best to do this - personally, this means sacrificing just about everything else to get the job done, and "everything else" can (and will) also mean other aspects of the profession.
Both journalists and studios should be more transparent about this, and there should be a better infrastructure in place to keep things in check.
Comment below viewing threshold Show
I can't judge how good your game is if you hold back chunks of it and let it trickle as DLC.
Comment below viewing threshold Show
Reviewers are up against it, there just isn't enough time to review everything to completion, not unless you get something like MW2 which lasts about 2 hours. Don't like it? Complain to the people in charge who are responsible for the excessive workloads of many web site and magazine staff. Until you've worked to a deadline that includes producing x amount of pages per month then you do not have any idea what it's like. If you are absolutely insistent on reviewers who play to completion my suggestion would be to stick to amateur and/or specialist sites.
"In seriousness though, this problem could be so easily eliminated by devs producing review versions of games that require online logins that track the progress through the game of the reviewer. Whenever a reviewer doesn't finish a game and then produces a flawed review, that reviewer can easily be exposed."
This is hilarious.
Comment below viewing threshold Show
Nice one, yeah I forgot to mention the multiplayer aspect. With more games coming with these options, a reviewer can't review that part of the game.
I've done some reviews of books before. While receiveing a review copy might seem nice, it does feel like you are making a deal with the devil.
Perhaps with games, it might be better idea to buy or rent a game. Maybe second opinion updated reviews, might also help, offering a short burst of extra info, that couldn't be covered previously.
Comment below viewing threshold Show
I read a review and see the points that turn the reviewer on, or off, and I think about if I would likely share the same feelings. For instance, all the reviews of Final Fantasy XIII said the combat system and graphics were superb but the the linear nature layout of the game let it down. All valid points and I came to agree with them. On the flip side, people rave about the likes of Crackdown and it's new brother, and I can't stand either one.
It doesn't matter to me if a reviewer finishes a game or not, I just want an honest and informed opinion of it.
For those reviewers who do finish games completely first, I pity the poor sods who had to do Two Worlds..
Comment below viewing threshold Show
Otherwise you should be fired, start up a blogspot thing to spout your fickle whims, and pay for games like the rest of us. Frankly.
Comment below viewing threshold Show
Comment below viewing threshold Show
My ideal review would be to have two people review a game, a fan of the genre, and someone who isn't, and have them both post their likes and dislikes, as opposed to some arbitary score at the end that means nothing. I beleive that games, more than movies and books, etc, are much more subject to personal opinion. One man's 7 is another mans 10. Reviewers should stop trying to peg a game at a certain level, stop trying to be funny in reviews, and come back to just simply telling us, in their opinion, what they liked and what they didn't like.
Surely the EG reviewers would like this, its extra work!
Comment below viewing threshold Show
With movies it's almost the opposite situation. As cinema tickets are a lot cheaper people can just decide on-the-fly, looking at the poster, title, or who's in it. A movie the critics might consider crap can have the most revenue in a given week.
Comment below viewing threshold Show
If "played to completion" is an essential part of a review for you then I would suggest you stop reading reviews, because many have not been played to the end. It's simply not possible.
Comment below viewing threshold Show
Comment below viewing threshold Show
Like it or not, the fact that the vast majority of people expect their games reviews for free (or worse: adblock out the only remaining source of income) means that this situation is not likely to improve in the near future.
Comment below viewing threshold Show
Comment below viewing threshold Show
I'll use an example everyone here can read, UFC 2010 on EG. 8/10. Glowing text. No mention of the fighters getting caught in the sides of cages, or sometimes just refusing to respond to any button presses, or the completely unplayable online mode (which has been unplayable since the day of release), or the broken submission system. That's just one example, there are many better ones elsewhere on the web and indeed on this site, that's just the one that springs to mind.
That's what they should have issue with. Games journalists don't earn a shitload and until they do, they probably need to cover off 4-6 games a month in order get a decent wage, especially if freelance (as many are). Then you also have the time issues enforced on them by the publishers who expect a review within days, sometimes putting pressure on within 48 hours of receipt, in order to get the review published. They (at least some of them) can also take some of the blame for some of the shortcuts.
So finishing I'm not that bothered with, although there is the argument that you could yet meet a game-breaking bug. But by that time even if that game finished brilliant or went downhill rapidly (e.g. Halo and the library section), it's unlikely to make a massive difference to the score or opinion as long as you had put in a decent amount of time. But spend more time making sure each mode of the game works, that online works, that no bugs are present (no major ones anyway) and that it's really as good or as bad as your suggesting, then I think that's fine. When I play aa game, along with countless others, where I find major bugs present or modes not working properly, that the reviewer didn't bother to point out, I often then take their views in the future with a pinch of salt or, in one particular case, never bother reading any of his reviews again as it's clear he doesn't put enough thought or time into what he's reviewing.
Comment below viewing threshold Show
Comment below viewing threshold Show
Think about that, pause, and then you realise how STUPID a comment that is, when EG give games like ODST or MW2 good scores.
2nd thing that pxxxes me off is pretentious journalism, blabbing on like an art critic, its a game.
Most games are similar and have small differences in certain genres, but still love them.
Comment below viewing threshold Show
Comment below viewing threshold Show
As much as i acknowledge the timely, structural and economical constraints of journalistic business, sometimes a little bit more time spent with certain games would do the reviews a favour...... especially considering the constant hype around the time these AAA blockbusters launch.
It's easy to say and hard to be done, but serious journalists should try not to be influenced too much from it.
And the best receipe against hype bias probably is playing it until the initial overexcitment wears off (at least that's the way it works for me, I would have scored many games higher at first but nowadays I'm aware of that and would NEVER give a score after a couple of levels/missions....).
But lofty aims VS bleak reality, I know I know
Comment below viewing threshold Show
"where some guy didn't spend a lot of time playing your game, that's crushing. "
These two have obviously had very sheltered lives...
Comment below viewing threshold Show
Really? So what happens in your life that's so much more frustrating than working on something for 3 years and then having someone write it off without giving it more than a cursory glance?
Comment below viewing threshold Show
I think that using phrases like "nothing more frustrating" to describe this, and words like "crushed" were a bit much.
I think most people would be crushed if all their family was killed, or they were diagnosed with a terminal illness, not for "some" journos not playing your game all the way through.
I thought his comments lacked perspective and were actually slightly belittling, suggesting his customers would not be able to differentiate between reviews. Also, if there are such key features being missed, why aren't THEY advertising them enough to ensure they are covered?
Comment below viewing threshold Show
I once heard a sportsman say they were "crushed" after losing a final. No-one had died, and yet I resisted leaping on my high horse and galloping off at full speed.
It's not like he said he was 'distraught'. There's still some headroom beyond feeling 'crushed' isn't there?
Comment below viewing threshold Show
"I think most people would probably be slightly more than "frustrated" if all their family members died or they were diagnosed with a terminal illness"
I didn't use the "frustrated" quote for that point if you read back, only the "crushed", because none of those things are frustrating, they are potentially devastating, obviously.
Where you made the point above that "frustrated" wouldn't have described those scenarios anywhere near adequately, all my point was that his whining and using words like "crushed" was over-kill.
Comment below viewing threshold Show
Comment below viewing threshold Show
Comment below viewing threshold Show
Not really, but I used to handle complaints from rail passengers who claimed to be "disgusted" (and various other ridiculous overreactions) to their train being 30 minutes late.
Yes, such language is irritating, but welcome to the me me me world.
Comment below viewing threshold Show
They said it was crushing (not they were "crushed"
I'm guessing you've never worked hard on something you cared about.
Comment below viewing threshold Show
Exactly. I really didn't think it was such a big deal to warrant half a page of comments. I just think they were making a big deal of it.
Comment below viewing threshold Show
Clearly we disagree here, and I think there are better things to do than dissecting a largely irellevant quote, so let's forget it.
Comment below viewing threshold Show
Comment below viewing threshold Show
@Gromit: Wouldn't you fee extremelyl bad if someone dismissed 2-5 years of your work as "okay-ish"? You'd probably think "and why did I then spend 5 years of my life for that?" - to me at least it would be 'crushing' at that moment in time.
Also, if my whole family died I would think that the word 'crushing' is a bit... lackluster I guess. It would probably feel more like 'devastated'.
Comment below viewing threshold Show
But I lost faith in game reviews after Fable 2 got 10/10 on Eurogamer.
Comment below viewing threshold Show
Analogy with movies fail.
Comment below viewing threshold Show
Most reviewers are conscientious enough to test all areas of the product and give an informed opinion. A few bad reviews by few bad reviewers, who are probably internet based nobs with an agenda and audience of 2 people, is hardly anything to cry about. Stop being so self important.
If you agree with him, you're probably the kind of person that buys games based on good revieiw scores, or products based on popularity; i.e, an idiot. Make your own mind up and don't buy things because someone said they were good, or even bad for that matter.
Comment below viewing threshold Show
Comment below viewing threshold Show
Games journalism suffers from a similar mindset. A game's 'narrative' style might equate to its genre (ie, first-person shooter), while the standard of writing would equate to aesthetics like graphics, sound, overall presentation and controls. From that perspective, playing half the game is enough to pass judgement on such features.
Unfortunately, unlike books, games can't afford to be 'slow-burners'. Unlike books, we aren't willing to stick with a game in the hope it might surprise us. There's no room for a 'where is this going?' kind of sentiment. If a game hasn't shown its hand in the first hour, there's no hope for it.
Which is a shame I think. But, on the other hand, it leads to tighter pacing and better opening sequences.
Comment below viewing threshold Show
However, that's not to say that I don't read reviews. I do. But not for opinion or rating. I read reviews just to get a little information about what the game is about and some of it's content. I read them like people read The Sun newspaper. It's a bit of light entertainment, an adult comic of you like.
I wish reviews mentioned what framerate a game runs at. A smalll piece of information, yes, but far more interesting to me than knowing whether they liked the game or not. After reading reviews of the all the very biggest selling games, they have proved completely unreliable, some perhaps verging on dishonesty.
I don't need anyone telling me what I will like or what will suit me. I happen to like military shooters. And right now I'm not playing any as every single one of them currently available is anywhere between utter rubbish (Operation Flashpoint, Treyarch-made Call of Duty), or enjoyable for one play-through and holds no long-term interest for me (the rest of them!). As I won't ever read that in a review, nor would expect to, I find their rating system and opinions worthless.
Comment below viewing threshold Show
I don't buy this "Most games players don't finish games" line. And not simply because of the use of the word "fact" as a sentance. I don't need a reviewer to second guess how much of the game I buy I'm going to want to play. I want them to give me the full picture, not the bit of the picture they think I might want to look at.
I accept this is more investment of time than reviewing a movie, but that's also the reason I rarely read movie reviews. I need more pre-purchase information about something I'm going to invest £40/20 hours in than something I'm going to invest £4/2 hours in. If you don't think you can provide that, then don't bother.
I mostly read reviews of games I hadn't heard of to see if I'm missing something. People love to slate reviewers on here (people love to slate everyone on here, event developers' innocent use of language...) but the fact remains that if it wasn't for EuroGamer reviews I read, I wouldn't own Slitherlink. Or Demons Souls. Or Earth Defence Force 2017.
Comment below viewing threshold Show
it is logical, the majority of games need more than 20 hours to finish (some RPGs need more than 50 hours) + multiplayer + some games could be very hard and especially frustrating to finish, especially if the reviewer hate the game....when the boss give a reviewer 5 + games to review per week (especially the christmas period or today the march period) it is impossible to finish all those games...
So the problem is not that : a reviewer must finish the game ! (you cant impose to a reviewer to finish a horrible frustrating game), the problem is : reviewers must be honest and indicate in the review that they didnt finish it, unfortunately this almost doesent happen....it is not honest...
Comment below viewing threshold Show
Comment below viewing threshold Show
Not all reviewers get paid. And just because you get paid by advertising revenue, doesn't mean to say that suddenly nobody has any standards or principles anymore.
There are some dodgy ones, no doubt, and there are some dodgy publications/websites as well (a fairly high profile case only a few years ago with a well-known site), but that doesn't mean to say that the whole industry is bent.
Comment below viewing threshold Show
Great game artistes they are not, sorry. Not with MW2, and even with CoD4 the format was a little old-hat. Hopefully they get a new lease of life with EA, whenever their game arrives.
Comment below viewing threshold Show
Comment below viewing threshold Show
I just go to Metacritic and look at the number.
And if the number is over 90 and I want additional info I'll head to a forum to read actual player comments.
Comment below viewing threshold Show
1. If your game is so shit that the reviewer can't stand to play it for more than two hours, YOU'VE failed, not the reviewer. No gamer should have to wade through hours of crap to get to the good bit, so if you've done that the reviewer is fully entitled to paste you for it. Would you put up with ten hours of trailers before the movie started, or would you walk out?
2. Reviewing multiplayer games before the game's been released is to all intents and purposes entirely impossible and meaningless. Stop moaning, unless you're prepared to read the review six weeks after the game comes out.
3. These days a reviewer might realistically have maybe two days to spend on reviewing a single game if they're staff, or be getting paid perhaps £200 if they're freelance. You want them to put in 50+ hours work for that? Fuck off. Not only is that stupid, it's actually illegal - the national minimum wage is £5.80/hr, and there are laws about maximum working hours too.
Comment below viewing threshold Show
I do a lot of work at home, 'cos I like what I do, and most of all I like to be good at what I do. Don't call the cops, please.
Comment below viewing threshold Show
Comment below viewing threshold Show
There's a flipside as well... plenty of games get a raft of 9s and 10s on review because, yes, the first two hours are great, but they then turn into repetitive pap afterwards. Kung Fu Panda is a great example of this. It was so heavily lauded in the reviews it's become a benchmark of sorts for making a good kids game. Unfortunately, as soon as you are past the third level cut and paste level design, under implemented mechanics and tedious pacing really start to hurt the experience.
I'm sure its hard on reviewers, I'm sure deadlines are too tight and they can't possibly complete every game they are assigned, but then that's surely quite a big problem with games journalism in general, isn't it? It's not unreasonable for developers, who work some brutal hours to vicious deadlines themselves, to want their end result to be judged based on its entirety rather than just the first impressions. Especially when you consider the damage that a poor review can do to their financial returns on that work.
Comment below viewing threshold Show
It also doesn't help that we have things like the 'restrictive review practice' alluded to in the Edge review of ODST. Can a reviewer be expected to give a fair review when they're made to travel to the developer, and play the game with a bunch of other journo's whilst big burly men stand over them?
Comment below viewing threshold Show
Comment below viewing threshold Show
As soon as the mag was with subscribers, someone posted a score thread on a certain forum. Within minutes, the first comment was up, accusing me of either being on crack, not understanding the genre, or not having played the game. "Or all three." All based on one little number. I had to laugh, really.
Comment below viewing threshold Show
Well boo fucking hoo. The developers deadlines are tight too. But do reviewers think of the poor hard done by developers when they're slagging off their hard work? Are you saying the reviewers should be above criticism, because they give criticism? I'd have thought people who criticise other peoples work should be the first to be criticised.
Comment below viewing threshold Show
Rich coming from you.
Comment below viewing threshold Show
Comment below viewing threshold Show