Direct Instruction: A Half Century of Research Shows Superior Results

What if I told you that there is a method of education which significantly raises achievement, has been shown to work for students of a wide range of abilities, races, and socio-economic levels and has been shown to be superior to other methods of instruction in hundreds of tests? Well, the method is Direct Instruction and I first told you about it in Heroes are Not Replicable. I am reminded of this by the just-published, The Effectiveness of Direct Instruction Curricula: A Meta-Analysis of a Half Century of Research which, based on an analysis of 328 studies using 413 study designs examining outcomes in reading, math, language, other academic subjects, and affective measures (such as self-esteem), concludes:

…Our results support earlier reviews of the DI effectiveness literature. The estimated effects were consistently positive. Most estimates would be considered medium to large using the criteria generally used in the psychological literature and substantially larger than the criterion of .25 typically used in education research (Tallmadge, 1977). Using the criteria recently suggested by Lipsey et al. (2012), 6 of the 10 baseline estimates and 8 of the 10 adjusted estimates in the reduced models would be considered huge. All but one of the remaining six estimates would be considered large. Only 1 of the 20 estimates, although positive, might be seen as educationally insignificant.

…The strong positive results were similar across the 50 years of data; in articles, dissertations, and gray literature; across different types of research designs, assessments, outcome measures, and methods of calculating effects; across different types of samples and locales, student poverty status, race-ethnicity, at-risk status, and grade; across subjects and programs; after the intervention ceased; with researchers or teachers delivering the intervention; with experimental or usual comparison programs; and when other analytic methods, a broader sample, or other control variables were used.

It is very unusual to see an educational method successfully replicate across such a long period of time and across so many different margins.

Direct Instruction was pioneered by Siegfried Engelmann in the 1960s and is a scientific approach to teaching. First, a skill such as reading or subtraction is broken down into simple components, then a method to teach that component is developed and tested in lab and field. The method must be explicitly codified and when used must be free of vagueness so students are reliably led to the correct interpretation. Materials, methods and scripts are then produced for teachers to follow very closely. Students are ability not age-grouped and no student advances before mastery. The lessons are fast-paced and feedback and assessment are quick. You can get an idea of how it works in the classroom in this Thales Academy promotional video. Here is a math lesson on counting. It looks odd but it works.

Even though Direct Instruction has been shown to work in hundreds of tests it is not widely used. It’s almost as if education is not about educating.

Some people object that DI is like mass-production. This is a feature not a bug. Mass-production is one of the few ways yet discovered to produce quality on a mass scale. Any method will probably work if a heroic teacher puts in enough blood, sweat and tears but those methods don’t scale. DI scales when used by mortals which is why it consistently beats other methods in large scale tests.

Many teachers don’t like DI when first exposed to it because it requires teacher training and discipline. Teachers are not free to make up their own lesson plans. But why should they be? Lesson plans should be developed by teams of cognitive psychologists, educational researchers and other experts who test them using randomized controlled trials; not made up by amateurs who are subject to small-sample and confirmation bias. Contrary to the critics, however, DI does leave room for teachers to be creative. Actors also follow a script but some are much better than others. Instructors who use DI enjoy being effective.

Quoting the authors of the meta-analysis:

Many current curriculum recommendations, such as those included within the Common Core, promote student-led and inquiry-based approaches with substantial ambiguity in instructional practices. The strong pattern of results presented in this article, appearing across all subject matters, student populations, settings, and age levels, should, at the least, imply a need for serious examination and reconsideration of these recommendations (see also Engelmann, 2014a; Morgan, Farkas, & Maczuga, 2015; Zhang, 2016). It is clear that students make sense of and interpret the information that they are given—but their learning is enhanced only when the information presented is explicit, logically organized, and clearly sequenced. To do anything less shirks the responsibility of effective instruction.
Hat tip: Robert Pondiscio at Education Next.

Comments

Comments for this post are closed