What Ninety Years of Toastmasters Data Gets Right About Feedback
By Noam Shemla · Data & Method
Toastmasters International was founded in 1924, when Ralph Smedley started a speaking club at a YMCA in Santa Ana, California, and it has run a structured public-speaking evaluation process, largely unchanged in its core mechanics, for a century. It's worth taking seriously as a case study. It is not a controlled experiment, but it's arguably the largest, longest-running natural experiment in structured peer feedback on public speaking that exists, and its core design choices anticipated things behavioral research would later examine independently.
The design: a speech, followed by a structured evaluation, from a peer
The Toastmasters model pairs every speech with an evaluation delivered by a fellow member (rather than a distant instructor, the speaker's own self-assessment, or an anonymous score), following a defined structure that requires the evaluator to name specific strengths and specific, actionable areas to work on, tied to concrete moments in the speech rather than general impressions. The method is written down in the organisation's member manuals, from the older Competent Communication track to the current Pathways program.
Three of these design choices line up with research on feedback and skill acquisition, whether or not the organization ever framed them that way in 1924. One of them lines up less well than its supporters tend to assume.
Feedback is not automatically good
Start with the finding that should temper anyone's enthusiasm for feedback of any kind. In 1996, Avraham Kluger and Angelo DeNisi pulled together decades of studies on feedback interventions: 607 effect sizes from 23,663 observations. On average, feedback improved performance, by a moderate amount. But in more than a third of cases it made performance worse, and that could not be put down to chance or to whether the feedback was positive or negative.1
Their explanation is the useful part. Feedback helps less as it pulls attention away from the task and towards the self. A comment about what you did with your second point keeps you on the task. A comment about what kind of speaker you are invites you to think about yourself, and that is where feedback starts to backfire.
Specific beats general
That is the strongest case for the Toastmasters structure. Specific, behaviour-anchored feedback ("your pace slowed noticeably and effectively right before your key point in the second half") is about the task. Global feedback ("good job", "you're a natural", "needs work") is about the person, and it also requires the recipient to guess which of dozens of things they did is being referred to. A format that forces the evaluator to point at moments in the speech keeps the feedback where the research says it works.
Evaluated by a peer
Peer feedback carries a credibility advantage a purely top-down instructor evaluation doesn't: the evaluator was recently or is currently working through the same skill gap, which changes how the feedback is received. Requiring members to rotate into the evaluator role adds a second skill: learning to analyse a speech as well as deliver one. A review of two decades of research on teaching presentation skills found peer assessment argued for on exactly those grounds: it teaches the criteria by making people apply them.2
Here is where the evidence is less flattering. When the same research team built presentation courses and varied only who gave the feedback, every group improved, but students given feedback by a teacher gained about one point on a ten-point scale, against about half a point for those given feedback by peers, whether or not a tutor guided the peers. Self-assessment from video gained least.3 The teacher also scored the talks, which may have helped that group, but the result is a fair warning. Peer feedback works; expert feedback, in that study, worked better.
Feedback the same evening
The evaluation happens the same session, while the speech is still fresh for both the speaker and the room, rather than being written up and returned later. The research on feedback timing is more mixed than this suggests, so the honest case for it is a practical one: the specific moment being discussed is still available in memory for both people to reconstruct, and a comment the speaker can connect to a moment is the kind that stays on the task.
The limits of peer evaluation
Peer evaluation quality varies with the evaluator's own skill and training. An inexperienced evaluator can give confidently wrong feedback, and a structured format reduces but doesn't eliminate this. It's also inherently qualitative and unstandardized across chapters; there's no controlled comparison showing Toastmasters-style evaluation outperforms other structured feedback models, only strong consistency with what feedback research separately suggests should work.
Why we still lean on it
We combine this model (real, human, specific peer feedback on real speeches) with the measurable metrics described elsewhere in this series. Neither replaces the other; they answer different questions. The metrics tell you what happened, measurably. The peer evaluation tells you whether it worked, for a real audience.
In practice, members who watch a battle rate each speaker from one to five on five axes. Those votes feed a speaker's Signature only on the three axes a listener can judge from the room, Tonality, Structure and Energy, and they are trusted less than a measured recording. That is a deliberate echo of the findings above: the room's judgement matters, and it is not the only judgement. How Exprea scores a speaker has the detail, and feedback someone can actually use covers how to give it.
If you are the evaluator
Point at moments, not at the person. Name one thing to keep and one thing to change, each tied to a place in the speech. Leave out the verdict on what kind of speaker they are; the research suggests it is the part most likely to do harm.
References
- Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2), 254–284. https://doi.org/10.1037/0033-2909.119.2.254
- Van Ginkel, S., Gulikers, J., Biemans, H., & Mulder, M. (2015). Towards a set of design principles for developing oral presentation competence: a synthesis of research in higher education. Educational Research Review, 14, 62–80. https://doi.org/10.1016/j.edurev.2015.02.002
- Van Ginkel, S., Gulikers, J., Biemans, H., & Mulder, M. (2017). The impact of the feedback source on developing oral presentation competence. Studies in Higher Education, 42(9), 1671–1685. https://doi.org/10.1080/03075079.2015.1117064
Go deeper: Online Public Speaking Clubs: Count Your Speaking Minutes