The method
1. Specify the comparison
Name the group, approach, comparison and outcome. Add a time frame when it matters. “Does studying help?” is too broad to guide a focused search; a defined comparison makes it clearer what evidence would be relevant.
2. Match the conclusion to the measurement
If a study measures delayed recall, it can inform a question about delayed recall under its conditions. It does not automatically establish clinical performance, lifelong retention or the best method for every learner.
3. Inspect alternative explanations
Ask how people entered groups, what differed between groups and whether the outcome was measured consistently. Missing design information limits confidence. A numerical difference alone is not a causal explanation.
WORKED EXAMPLE
A fictional classroom study
Question: “Among first-year PT students, does a four-week spaced-retrieval routine, compared with rereading, improve a delayed course quiz score?” A fictional abstract reports 24 volunteers who chose their own group. The retrieval group averaged 8/10 and the rereading group 7/10. The observed difference is one point. Self-selection and possible baseline differences remain. The abstract does not show that the routine caused the difference or improved clinical competence.
PUT IT INTO PRACTICE
Your workshop
Your answers stay in this open page unless you choose to save on this device or download. Use fictional or de-identified learning examples; leave out patient and other people’s private information.
Check the reasoning
Choose an answer to see an explanation. These are learning checks, not an official exam or score prediction.
Build your worksheet
Try a changed situation
Suppose the same study measured confidence but not quiz scores. Could it answer the original question? Explain.
Take away: The question, design, measurement and conclusion should refer to the same claim.
Answer both learning checks to enable your review record.
Marking reviewed records your own activity. It does not establish mastery or readiness.