Specialty Digest

Global English editionLearners’ Study Dashboard — in development
The Knowledge Library for All

Online Courses / University Track / Study Smarter

Module 8 · Lesson 1 · Core

Designing a fair test of a study method

Turn a question about studying into a fair, delayed test with equal time and questions written in advance.

  • 55 minutes
  • Serves O5, O6
  • Assumes Module 7

Phase 1: Prepare

Step 1 Warm-up recall

From Module 7: how do you work out hours per session?

Private: nothing you type here is sent or stored.

Step 2 Learning goal

By the end of this lesson you can:

  • state a clear question (Foundation);
  • keep time and difficulty fair (Core);
  • write the test before studying (Core).

Phase 2: Teach

Step 3 A familiar example

A cook who changes the oven, the flour and the recipe at once cannot say which change improved the cake. A fair test changes one thing.

Step 4 Clear explanation

In Module 6 you learned to question claims. Now you test one on yourself. Start with one question, such as: does retrieval practice beat rereading for me? Then plan the test.

Two methodsone changeEqual timesame minutesDelayed testquestions set first
A fair self-test changes one thing, keeps time equal and tests later with questions written in advance.
Design choicePlan (invented)Why
QuestionDoes retrieval practice beat rereading for me?One clear question
MethodsRetrieval on topic A, rereading on topic BOne change only
Time3 sessions of 30 minutes each, so 90 minutes per topicEqual effort
Test10 questions per topic, written in advance, one week laterFair and delayed

The plan gives each topic the same time: 3 x 30 = 90 minutes. Write the 10 test questions before you start, so you do not choose easy ones after seeing the results, and test a week later, since a quick test would favour cramming (Module 4). Choose two topics of similar difficulty. If one topic is harder or you knew more about it already, it will distort the result, and you can reduce this by swapping which method goes with which topic in a second round.

This is a test on one person, so it shows what works for you, not for everyone. It cannot be blind: you know which method you are using. Keep the question modest and the plan short. See retrieval practice for the method being tested here.

Step 5 Worked example (4 marks)

You plan 4 sessions of 25 minutes for each of two topics, with 8 test questions per topic. How many minutes per topic, and how many questions in all?

  1. Minutes per topic: 4 x 25 = 100. (1 mark)
  2. Questions per topic: 8. (1 mark)
  3. Questions in all: 2 x 8 = 16. (1 mark)
  4. Answer: 100 minutes per topic and 16 questions in all. (1 mark)

Phase 3: Practise

Step 6 Learner practice (instant-marked)

1. A fair self-test changes:

2. Test questions should be written:

3. 3 sessions of 30 minutes is how many minutes?

4. The test should be delayed because:

Phase 4: Close

Step 7 Recap

  • Ask one clear question and change one thing.
  • Keep time equal and write the test first.
  • Test later and swap topics if you can.

Step 8 Exit ticket (ungraded)

2 topics, 3 sessions of 20 minutes each: minutes per topic?

Private: nothing you type here is sent or stored.

Step 9 Go further (Extension)

Write your own self-test question and design for your next course.

Common mistakes

MistakeWhy it fails
Giving one method more timeKeep time equal.
Writing the test afterwardsWrite it first.
Using topics of different difficultyMatch them or swap.

Limits. A self-test involves one person, cannot be blind and uses short tests, so it gives a hint, not a proof.