Our Judging Process for the Thousand-Year Game Design Challenge



My wife and I are halfway done reviewing, playing and judging the entries to the Thousand-Year Game Design Challenge. (Asterisks note games we've judged so far.) It's been an interesting experience to say the least. I'm glad we've had a few months' time for this phase, because we needed every minute with our busy schedules. Here's an explanation of our judging process so far.

1. Read
Naturally, the first step of the process is reading the rules of the game. If we can understand how to play the game from a direct reading of the rules as written by the designer, then we'll proceed to the next step. We really do give it our best effort to read and comprehend the rules text. Sadly, in a very few cases, some entries do get taken out of contention in this first step simply because we can't figure out how to play from the text.

2. Setup
We gather whatever game components are called for by the text. In some cases, this is as simple as a piece of paper and a pencil. In other cases, the components are extremely specific, unique or numerous. As you might imagine, we have a LOT of game components in our house. If an entry calls for components so specific or so numerous that we can't assemble an adequate play set, that's a red flag for us. If a household with as many game-bits as us can't put together a play set, it's not likely many others would be able to either. Perhaps that policy is harsh, but we have so many entries that create elegant, fun experiences without unique components that we really have to grade based on that context.

3. Play
And then, of course, we play the actual game. We'll play as many times as we can, so that we fully get a sense of how the game feels and to make sure we properly understand the rules. If the game actually stays fun each time we play, that gives us a strong feeling that the entry is a good contender to win the challenge. Throughout play, we take notes in our little journal (seen above, handmade by Sara Hindmarch aka Repaper).

4. Analyze
We ask each other a few questions in a very informal way. – Would you play again? Did you find it more fun the first or second time? Were the rules clear enough at first? How does this entry compare to the other entries so far? Is it more accessible than the others? Is it more sustainable to produce than the others? Is it more fun than the others? – I'm the more abstract player of the two of us. My wife has the strongest sense of elegance and accessibility.

So that's how we're proceeding. We're on track to finish judging the rest of the entries over the next two months. A few of them require three or more players, so I'll rope in some of the local Durhamites to do some playing and judging of their own.

Comments

  1. Hey Daniel,

    In response to your call to provide evidence that others are playing and discussing the entries, I've posted a compendium of links to play stats, pictures, and discussion from around the web. I'll update it periodically as I find more stuff, until the contest is over. Here's the post:

    http://nickbentley.posterous.com/ketchup-popularity-tracker

    ReplyDelete
  2. Hi Nick! Thanks for all the raw data. Apologies if it seems like a popularity contest, but there are sooo many games out there that never really leave the designer's house. We wanted to encourage people to make *and* play long-lasting games, y'know? But anyhoo, your entry definitely has the very strong evidence of a developing community.

    ReplyDelete
  3. Thanks. As I say, overall, I love the contest despite that one little niggle. Also, I agree with the general premise. A game never played is like music never heard - there's not much point to it. In any case endless thanks for running the contest. It seems like a ton of work.

    ReplyDelete
  4. One of my game's fans just wrote a very positive review of the game, with lots of pics, in which he compares it to a Bach Fugue. It's apparently not a joke and I swear on my life I didn't bribe him or anything. He also claims to have played the game 60 times in the last few weeks.

    http://ludocracynow.tumblr.com/post/12601409238/ketchup-a-review#disqus_thread

    ReplyDelete

Post a Comment

Popular posts from this blog

5 Graphic Design and Typography Tips for your Card Game

Troubleshooting: How to fix "Remove Blank Lines for Empty Fields" in InDesign Data Merge

One Thing to Avoid in Game Design