There seem to be bugs on pages with multiple reviews
: the "you scored this review" message always appear on the top review (regardless of whichever review you voted on), reviews get duplicated once voted on...
(Oh, and I can't change/cancel my vote, either.)
The Reviews Index
is paginated. You are looking at Review Activity
, I take it.
It should be paginated, I agree. It's a little more complicated when the sort order can be so many different things, so it will take a little while to figure out a way to do it.
Goal: Clear, Concise and WittyI can't say I've been following the forums, so I don't know if this is the appropriate topic or if there was lots of discussion about its inclusion beforehand (so please forgive me if I'm posting in the wrong place), but I'd like to disagree with the inclusion of this feature.
I think it's going to end up that people will rate up and down reviews based on how much they agree/disagree with them, rather than how helpful they actually are. Fans of a series will rank up reviews that essentially point to "this series rocks! Watch it now!", while down-scoring reviews that discuss problems and troubles with the series.
edited 26th Nov '10 12:58:57 AM by TerminusEst13
![]()
![]()
That's exactly what I'm afraid of. You Tube comment voting often works the same way, but if someone puts a lot of time and effort into a review only to get voted down because the person expressed a (well thought out) unpopular opinion, that would really suck and possibly discourage reviewers from speaking their mind.
![]()
Glad to hear the feature might get zapped if it doesn't work out. I appreciate the fact that you specifically say to score reviews based only on how well written they are. Let's hope that message sticks with people.
Awesome. It works great. Thanks.
edited 26th Nov '10 2:03:55 PM by BonsaiForest
If you look at the top and bottom reviews you can see a definite pattern. The top reviews are almost entirely praising of their subject matter, except for things tropers tend to dislike. The inverse is true for the bottom reviews. There's a few exceptions, but not many.
Probably too early to declare this a failed experiment, but it's not looking good.
Exactly. I thought the negative review of Megamind was well-written, criticizing Dreamworks for the things that I tend to see the company as. And it's voted way down. Apparently the message to score the review on whether or not it "makes good points" or "is well written" was ignored by those who just disagreed with the review.
Personally, I think the "word count" feature is the best, difficult-to-corrupt indicator we could possibly have on whether a review is good or not. Many badly written reviews are also short. It's not perfect, but I trust word count more than I trust people voting based on agreement or taking offense.
I took a look at some of the scored reviews.
- Neon Genesis Evangelion review critiquing the series and even admits he's probably not the majority: Negative scored. (Positive review is scored the highest)
- Kung Fu Panda review praising the visuals but criticizing the plot: Negative scored.
- Warhammer 40k review praising the gameplay and criticizing the plot: Negative scored.
- And of course the Megamind example.
My Touhou review is also negative scored, but I don't think I'm an unbiased avenue to say whether it's good or in-depth or not.
I'm monitoring collateral improvement. That is, now that they know it will be scored — presumptively on the stated criteria — will the quality of the efforts improve, unscored, scored badly, or otherwise.
Looks like the answer is trending toward yes. We're interested in the quality of the reviews improving, not the quality of the scoring.
Now, I'm going on my tastes, which may not be a good metric. Maybe what we need is to appoint an Editorial Board. Select some folks we know will score on concrete merits, and give them a scoring tool. This way, we can display an EB score next to a vox populi score and see what kind of feedback that brings.
Goal: Clear, Concise and WittyThat's easy. We shoot Marioguy128, who would clearly be the party responsible for people not scoring the way they are supposed to.
edited 3rd Dec '10 3:22:20 PM by FastEddie
Goal: Clear, Concise and WittyThis is a thread where we are developing the idea. An editorial board would have to be selected. The EB scoring tool would have to be installed. Convincing arguments might arise for the case of it being an awful idea.
Factoring in all that, I'd say ... a half hour? Fifteen minutes?
An editorial board scoring? I love that idea. Maybe if people see the scores of non-biased editors judging reviews on their actual merit as reviews, they might mature a bit. If not, then a lot of people might start ignoring the "popular" score and pay attention only to the "editorial" score, since it's the only one that would mean anything.

The feature to score reviews is installed.
Goal: Clear, Concise and Witty