Maintenance
Part of Career Quiz Questions: Four Shapes, Source Checks and Answer Sheet Rules
Career quizzes questions: How to pass the single-answer test
Career quizzes questions pass the single-answer test when the time frame, scope, meaning, and qualifier are clear, leaving no defensible second answer.
Writing fifty questions about people's careers is not fifty times the work of writing one. When writing career quizzes questions, the repeated work is deciding what counts as an answer. Get that decision right and the set writes itself. Get it wrong and you will spend the night arbitrating.
What to take away
- A question is finished when exactly one answer fits the words you actually wrote, not the words you meant.
- The most common failure is not difficulty. It is that the writer already knew the answer and could no longer see the other readings.
- Read every question aloud to somebody who does not know the answer before it goes in the set.
The single-answer test
Take a draft question and try to break it. Not by finding the intended answer, but by finding a second answer that a reasonable person could defend using only the words on the page.
Most drafts break on one of four things:
- Time frame:“Who plays the Doctor?” depends on which era is meant. Ask “Who played the Ninth Doctor in Doctor Who?” to make the period clear; the answer is Christopher Eccleston.
- Scope:“Who played Batman?” has multiple defensible answers, including Michael Keaton and Christian Bale. Name the film to narrow the question to one performance.
- Double meaning:“Who starred in A Star Is Born?” could refer to different films with that title. Specify the version and role: “Who played Ally in the 2018 film A Star Is Born?” The answer is Lady Gaga.
- Hidden qualifier:“Which actor won an Oscar for playing a boxer?” leaves the award category and role unstated. Robert De Niro and Hilary Swank are both defensible answers; specifying “Who won the Academy Award for Best Actor for playing Jake LaMotta in Raging Bull?” leaves Robert De Niro as the answer.
Four Ways Drafts Break
- Unstated time frameadd an as-of date
- Unstated scopewrite down the boundary
- Word doing two jobssplit the meaning
- Hidden qualifiermove the clause into the question
Fixing these makes questions longer, and longer is fine. A short question that starts an argument is worse than a long one that does not. What you are trimming is not words, it is the number of things the sentence could mean.
Applying the test to one career question
Start with the draft: “Who played Batman?” It fails because Michael Keaton played Batman in Tim Burton’s 1989 film Batman, while Christian Bale played Batman in later films. A reasonable reader could defend either answer using the words in the question.
Add a boundary: “Which actor played Batman in Tim Burton’s 1989 film Batman?” The answer is Michael Keaton.
Now check the wording without relying on the writer’s intention. It identifies the actor, character, and film, so another actor’s Batman performance in a different film does not qualify. There is no second defensible answer, and the revised question passes.
The question that only you can answer
One failure mode is common enough to name: the question where the answer is obvious once you know it and unfindable before. The writer reads it back, sees the answer immediately, and concludes it is easy.
That is the curse of knowledge doing its work. Once you hold a fact you cannot model the state of not holding it, and every clue you left looks generous. In a quiz this produces the "guess what I am thinking" question, where the player has to reconstruct the writer's chain of association rather than know something.
The tell is usually in the phrasing. If the question describes a person by a set of features that only make sense once you have identified them, it is not a question, it is a riddle with a person at the end. Riddles are a legitimate format. They just have to be signposted as one, and marked as one.
The other version of this is the leading question, where the wording pushes so hard toward the intended answer that knowing nothing at all is enough. Both errors come from the same place. The writer is thinking about the answer instead of about the person reading.
What a good question feels like from the other side
The test that matters is not whether the question is hard. It is whether hearing the answer is satisfying when you got it wrong.
Reactions After the Reveal
Reaction
- Of course, I knew that
- Found real knowledge
- I nearly had it
- Best possible outcome
- Never heard of them
- Obscure, not hard
- That is not what you asked
- Wording is broken
- Depends what you mean
- Two defensible answers
Meaning
- Of course, I knew that
- Keep it
- I nearly had it
- Keep and write more
- Never heard of them
- Cut or specialist round
- That is not what you asked
- Rewrite, do not reword
- Depends what you mean
- Add qualifier or cut
Action
- Of course, I knew that
- I nearly had it
- Never heard of them
- That is not what you asked
- Depends what you mean
A question passes when players react with "of course." After the fact, they see the route they should have taken. The knowledge was somewhere in the room, and the question was a fair door to it.
A question fails when players react with "how would anyone know that." That reaction is correct, and everyone in the room knows it.
| Reaction after the reveal | What it means | What to do |
|---|---|---|
| Of course, I knew that | The question found real knowledge | Keep it |
| I nearly had it | The best possible outcome | Keep it and write more like it |
| Never heard of them | Obscure rather than hard | Cut or move to a specialist round |
| That is not what you asked | The wording is broken | Rewrite, do not just reword |
| Depends what you mean by that | Two defensible answers | Add the missing qualifier or cut |
Building fifty of them
Do not write fifty questions and then sort them. Write eighty and expect to lose thirty, because the cut is where the quality comes from and you cannot cut what you did not overproduce.
From Eighty Drafts to Fifty
- Write eighty questions, not fifty
- Expect to lose thirty in the cut
- Keep raw material with sources beside each fact
- Write the date you checked beside perishable facts
- Sort survivors by difficulty last
Keep raw material in one place, with the source for each fact beside it. Career facts move: roles change, credits get added, and a claim that someone has done something more than anyone else holds until it does not.
Write the date you checked beside anything that could change. A year later, you can tell settled facts from perishable ones.
That habit is the difference between a bank you can reuse and a pile you have to re-verify from scratch. It applies as much to a set of career quizzes as to anything else.
Sort the survivors by difficulty last, once you know what you have. Sorting first tempts you to keep a weak question because it fills a slot in a curve you invented before the material existed.
Common questions
Should answers be one word?
Aim for it. A one-word answer is easy to mark, easy to say, and hard to half-know. If an answer needs a clause, the question probably has two parts and would be better as two questions.
Are multiple-choice options a good idea?
They change what you are measuring. Options turn recall into recognition, which is a much easier task, and they make guessing worth something. Use them to make a hard round survivable, not as a default.
How do I stop the set from feeling samey?
Vary the shape of the question, not just the subject. Some ask for a name, some for a number, some for a connection between two things. A set where every question is "who did X" reads as one long question, however good each item is.
The same problem shows up when building a round around photo quizzes facts, where the temptation is to write the same question forty times.
What do I do with a question I like but cannot verify?
Leave it out. Not "leave it in and flag it", because flagged questions get used. Verification is separate work and worth its own pass. Only questions that survive it should reach a room. A single unverifiable claim in an awards trivia round costs you more credibility than the question was ever worth.
How do I handle questions grouped by job rather than by person?
Those need a category rule written before the questions, which is a different build with its own failure modes. It is worth treating a guess the celebrity by profession round as a separate exercise rather than as a filter over an existing set.
