Friday, 13 September 2013

How Do We Ensure That Students Remember What We Teach Them? (Part 3 of 3)



Minimizing the Forgetting Curve and Improving Learner Retention (2)

Forgetting, or more correctly minimising the rate at which we forget, is a function of several facets of learning. To maximise retention your design should:

  • Ensure the student is engaged by the subject matter.
  • Know what you want the student to remember.
  • Design in-built course motivation.
  • Create cohesive, linked content.
  • Design to use a range of content delivery styles.
  • Provide pre-course preparatory content.
  • Enable discovery learning.
  • Provide effective knowledge checks.
  • Provide post-course performance support content.
The first points were covered in my previous blog, How Do We Ensure That Students Remember What We Teach Them? (Part 2 of 3).   


Pre-Learning Preparation

The Ebbinghaus approach to memory retention analysis was based on new and random information, which enabled him to abstract the tests from as much pre-learned information as possible. Had he used three letter sets that were all common words, such as CAT or DOG rather than GIW or QOH (he didn’t publish the exact letter sets that he used), he would have found it far easier to memorise the sets. This is because the memory will fix on familiar patterns or create picture mnemonics to aid memory. 

In most circumstances, you need to employ the reverse methodology, by incorporating pre-learning preparatory content for students, both in classroom or digital learning environments. You have to determine what a student needs know to get the most benefit from the upcoming training. Do not fall into the trap of just sending out the complete course prior to the training event. This can produce two unhelpful results; the student doesn’t bother to do the prerequisite learning because they know it will be covered in the training, or the student will go through the course and be bored by the repetition.
I would recommend that you tell the students that there will be a review of the pre-course content and then make sure that it is reviewed. This may be a discussion or a set of review questions. There will always be some students who do not complete the preparation (for legitimate or other reasons) but a kick-off review will ensure that this group will prepare thoroughly for your training in future.

 

Enable Personal Discovery

Discovery learning is an effective way to help students to retain what they learn through, perhaps because of the enhanced strength of episodic memories as discussed in A Theoretical Foundation for Discovery Learning (Svinicki, 1998); of course you have to make sure that they discover what you want them to learn as part of this. The search for a solution creates an enriched experience for the learner and will improve the level of retention by increasing the level of engagement and creating memory links around the topic.  In a moderated environment, such as a classroom or virtual learning (vlearning) environment, this is managed by a teacher or facilitator. In such a managed situation, the teacher can use spontaneous events to trigger such research. 

In a digital environment the use of discovery learning has to be driven by the student, but you must insert these opportunities into your design. The Internet is, to all intents and purposes, an unlimited source of discovery. Where possible, you should include research options in your training content; “Click here to find out more about …” or “You may want to look on the Web for more information on this. A good place to start is …” This approach has inherent dangers in self-study world of elearning, as the student may find browsing the Internet more intriguing than completing your course. Here are some practical options for mitigating this danger:
  • Your links should open a browser that does not include an address bar, so that students are not encouraged to wander off on their own.
  • Your links should always open in a separate window, so that the training materials remain on screen.
  • You should suggested a time limit or start time outside the current training: “You may want to spend five minutes reviewing …” or “When you have finished this section, try looking at …”

 

Provide Assessment and Knowledge Check Feedback

Assessment is important in any measurement of knowledge retention; if you don’t ask questions about the learning how will you know how much has been retained and for how long? Assessment can vary from in-course knowledge checks to accreditation or certification exams, where answers are tracked and maintained in a learning management system (LMS). In this section I will concentrate on knowledge checks, as these are designed to encourage, rather than test, knowledge retention.
We can differentiate between moderated training and self-study. In a moderated environment we must assume that the teacher provides on-going assessment through questioning and discussion. In an instructor-led course, you should include suggested questions or discussion topics and key learning points to ensure that the students are assessed on the information that you have identified as being key to the learning.

In the self-study world the onus for assessment is on you, the course designer. You should include knowledge checks, in the form of questions, social media discussion topics, or games in all training. Without these it is harder for the student to assess their own understanding and retention of the content.

You should always provide feedback on any question or task, as it provides reinforcement and an opportunity to review content. When a student does not provide the required answer I recommend that you tell them it is not correct, tell them the correct answer and identify where in your training they can find the information necessary to answer the question. If possible, provide a link to the page or section where they can review the content. If a student gives a correct answer you must also provide feedback. “That’s right. Well done” is fine, but you can reinforce learning by providing some additional information on the question topic or a link to some external content related to the topic. The latter provides an implicit reward—a sort of “You have done so well that you are ready to do some discovery learning on the topic”.

 

Provide Post-Event Learning

Many practitioners suggest that to avoid the dangers of the Forgetting Curve you should provide revision sessions or additional information to keeping the content in memory. While this may work neatly for remembering a series of random letter sets in a research study, it is less applicable for the world of training. Realistically, can you see a student reviewing everything from a training event with this regularity? Even if they did, do you really imagine that this will maintain 95% recall for anything but the most basic of knowledge? 

It is a good idea to provide post-course reinforcement to encourage knowledge retention. When you do this, you have to make sure that it is attractive to students, as there is seldom an on-going element of compulsion in attending post-training events. To encourage continued learning and reinforcement you can continue to provide additional revision content or you get the students to interact with each other about the topic. The former will require effort from you, while the latter is not as easy to track, so you cannot be certain of success. 

If you decide to create additional materials—and remember that just providing the same materials that were in the training is almost certain to be ignored by students—you must ensure that they focus on the key learning requirements, but with the flexibility to encourage additional research. The research has to be challenging but achievable, if there is no instructor to support student efforts.
Providing a social, learning community has the advantage of being self-sustaining. You can do something as simple as creating a common Twitter hash tag or a Pinterest or Google+ community and let it flourish or wither as the students see fit. The outcome of this approach is very much dependent on the students’ attitude towards such environments.

The third option is to provide a moderated revision area, where an instructor is present, synchronously or asynchronously, to help and advise the students. This is possible in the sphere of education (universities and colleges) but it can be expensive for businesses, though it has potential to encourage an acceptance of a life-long learning philosophy.

 

And in conclusion…

Retention is not simply a matter of telling students the same thing on a recurring basis, because being told the same thing every day is dull. You need to inspire your students by making your learning content:
  • Applicable to their working lives.
  • Focused on what you need them to know.
  • Linkable, so that the students mind can build complex information into a manageable and memorable story.
  • Multi-modal.
  • Part of a learning and subject continuum—pre- and post-event.
  • Motivating.
  • Extensible through their own effort.
  • Supported by checks and feedback.

How Do We Ensure That Students Remember What We Teach Them? (Part 2 of 3)

Minimizing the Forgetting Curve and Improving Learner Retention 1

Forgetting, or more correctly minimising the rate at which we forget, is a function of several facets of learning. To maximise retention, your design should:

  •  Ensure the student is engaged by the subject matter.
  • Know what you want the student to remember.
  • Design in-built course motivation.
  • Create cohesive, linked content.
  • Design to use a range of content delivery styles.
  • Provide pre-course preparatory content.
  • Enable discovery learning.
  • Provide effective knowledge checks.
  • Provide post-course performance support content.
I have split the discussion of these solutions over a couple of blogs.

Design learning that is pertinent

You need to make sure that what you teach is pertinent to your students. It sounds obvious, but have you ever been asked to design or write a five-day training course with three or four modules per day? I have, and that means that I am developing a training event on a topic that is defined by the length of time that the customer wants students to be studying. 

As elearning and mlearning begin to dominate the learning landscape, we find that our learning design is more focused on providing the right information, at the right level, at the right time, rather than the amount to fill an arbitrary duration. 

You should develop a course syllabus (let’s call it a course, though I am well aware of the argument that there are no courses any more, just  topics that can be linked together as required) based on the information that you need the students to study. This may mean that a course may be shorter (or longer) than the prescribed length, but it only contains information that is relevant to students. Of course, not all content is relevant to all students, but this exercise should weed out the content that, with the best will in the world, is relevant to no one.

 

Ensure you know what you want students to remember

Even when we provide training that is pertinent, it is important that we know what we want students to remember. Knowledge workers today are far more comfortable with finding out information, rather than holding it all in their heads (as you can see in this interesting article http://clomedia.com/articles/view/the_new_knowledge_worker_enabling_the_next_generation/print:1) so it is important to identify those elements (if any) that you want them to remember. 

If you are concerned with students retaining information, rather than just knowing that information exists and having a good idea how to find it, you need to identify which information you want them to remember. Do this in discussion with the training stakeholders, but be prepared to challenge them if they say that everything in the course is important and needs to be remembered. If you can gather the core elements that students absolutely need to remember there is a good chance that your design can ensure an acceptable retention rate.

You should note that you may need to provide evidence of this success. This will require some level of post-course assessment. I am not going to cover examinations or tests of this sort here, as they are a function of testing memory, rather than encouraging information retention.

 

Provide motivation within the training

Reward is one of the oldest motivational stimulus. In the classroom it may be something as simple as praise. We are all motivated by “winning”, as discussed by Jere Brophy in Motivating Students to Learn (Brophy, 2010). You need to understand what winning means for your students, so that you can identify motivational options. The best way to find this out is to ask a sample of the target audience.
Rewards must be linked to the information covered from your training. This may be deductive, where you pose a scenario or ask a question where the student must extrapolate information to deduce a solution, or retentive, where you ask the student to answer a question on the subject matter previously covered. If possible, you should use a variety of approaches. The reward itself can be anything from a simple “well done” to providing additional content or options; a technique widely used in games-based learning.

Behaviourist educational psychologists broadly emphasise motivation based on positive reinforcement from the “teacher” (an external motivation) while constructivists encourage the development of learning content that triggers an internal motivation, where the student congratulates themselves on a job well done. This is a rather basic description, but for us in the practical world, the type of motivation is not as important as the fact that we motivate our students.

 

Design in-course links

One of the key methods of remembering is by turning single pieces of data into a related map of information. For example, remembering the steps in a process is easier if the student has a context for the process. If you explain a process in the framework of a scenario, the student is more likely to remember the steps. A good scenario, especially one that runs throughout a training event, makes it possible for students to trigger recall of individual details by remembering the overall story. This is the basic philosophy of memory maps, as discussed in Tony Buzan’s Use Both Sides of Your Brain (Buzan, 1976). These links also provide the opportunity to revise previously learned information, without obviously going over it again. For self-study, such as elearning and mlearning, any lack of subtlety in revision can cause the student to lose interest and move to the next topic.

 

Design for Multi-modal, Multi-layered Content

The Learning Pyramid premise may not be completely true, but it has elements that are well worth noting. Passive study is generally not as effective as active learning, with regards to memory. This means that the top four sections (lecture, read, listen and watch demonstration) are less effective than bottom three sections (group discussion, practice, teaching others). However, it doesn’t take much analysis to realise that without the top four any group discussion, practice or teaching will be short lived. The use of multi-layered learning, with the students learning from a subject authority then putting what they have learnt into some sort of practice, offers the information reinforcement to build stronger memories. 

In addition to this, a mix of content styles, when used to reinforce common information, will deliver greater knowledge retention. This being the case, you should design content that offers as wide a range of delivery styles as possible. In classroom scenarios this is done by the instructor or teacher, who varies their delivery by using lecture, visual aids, demonstrations and discussion to explain and explore a topic. They will also encourage collaborative learning, where the students work together, teaching and learning from each other, to enhance the learning process.

In digital learning (elearning, mlearning, and so forth) the designer must incorporate a rich variety of content delivery styles to emulate what the teacher does in the classroom. This can service the preferred learning styles of students and engage students by offering content in different and challenging formats. This may be a video, a hands-on simulation, or even games. The use of social media for collaborative or group learning should also be a standard for all digital learning designers.

How Do We Ensure That Students Remember What We Teach Them? (Part 1 of 3)



Popular Truisms Concerning Memory and Learning - some background

Getting students to remember what we teach them has been a challenge for instructional designers, teachers, and mentors since time began. The whole issue is bound up in the in the science or art of memory. In this blog, I look at a couple of the more widely quoted philosophies of information retention.

Ebbinghaus and the Forgetting Curve

Ever since Hermann Ebbinghaus published Memory: A Contribution to Experimental Psychology (Ebbinghaus, 1885) we have felt able to put a factor on how quickly people forget. The Forgetting Curve diagram, which is essentially based on Ebbinghaus’ study of his own ability to remember, indicates that people forget new information rapidly after they first learn it. This study remained the de facto standard for the best part of a century and is still found across the Internet. There are some fairly basic criticisms of Ebbinghaus’ research methodology, with the obvious one being that his analysis was of himself only—a pretty small test group and one that does not allow for scientific distance. A second, and arguably more telling shortcoming of the research is the fact that he chose to try to remember random letter patterns, which had no meaning or relevance to him, beyond the test itself. Ebbinghaus knew the letters of the alphabet, but the letter patterns had no significance which means that he would be unable to identify patterns, such as words.
This can be seen as a uniquely abstract approach but, when we extrapolate the findings to the real world, it becomes difficult to use as an effective baseline; it is seldom, if ever, the case that we teach something where the students have no previous experience or even terms of reference for the subject matter. By definition, the random, meaningless letter patterns had no relevance to the learner.


The Forgetting Curve Diagram
This, perhaps, explains the almost frightening speed with which Ebbinghaus forgot over 50% of what he had “learned”; a matter of minutes. It has also led to some educationalists to declare that only through constant revision of content is it possible to hold back the Canutesque tide of forgetfulness.

The Learning Pyramid

More widely quoted than the Forgetting Curve, based on a quick Google search, is the Learning Pyramid. This has become something of an urban myth in education and training. It is cited as originating from the National Training Laboratories (NTL) for Applied Behavioral Science, but search their site and there is not even a reference to it. The popular tale is that the research from the 1950s has been lost. No matter. The pyramid proposes that different learning experiences or styles engender different levels of knowledge retention, as shown in the diagram. Students only remember 5% of what they hear in a lecture, 10% of something that they read, and so forth.


The Learning Pyramid
The empirical value of the Learning Pyramid has been questioned—more realistically, discredited—in a number of papers and articles available on the Web, such as Will Thalheimer’s blog Learning Pyramid Debunked (Thalheimer, 2006). I won’t jump on the bandwagon here, but my instinct is to doubt any statistical research that delivers such rounded numbers for a study of a function as complex and nuanced as memory. It appears to be an effort to categorise study options against Edgar Dale's Cone of Experience (Dale, 1946) in an easy to use format; a rule-of-thumb, if you like.

So where does this leave the instructional designer?

With these two popular standards in instructional design called into question, how can we have any hope of helping our students to remember what we teach them? The answer may be by looking at elements of these two, rather than assuming that a study or image that appears across the Internet must be accurate in its entirety.
The beauty of both the Forgetting Curve and the Learning Pyramid is that they are intuitively correct in two areas:

  • Memory Fades. Can you remember all of the information that you have ever known? Unless you have an eidetic memory, the answer is no.
  • Practice Makes Perfect. If you take a car engine apart you will have more experience of taking a car engine apart than someone who hasn’t.

The problem is that since these two statements are so obviously true, that we treat both the curve and the pyramid as truisms. 

Both theories ignore the complexity of the brain and the neurological differences between people. It is also the case that both of these studies assume no, or unrealistically limited, prior experience; Ebbinghaus knew the alphabet but the random nature of the letters meant that this had no bearing on what he was memorising, while the learning curve assumes that only one means of study is used in a learning event. In his defence (not that he needs me to defend him) Ebbinghaus meant this to be the case, but it is very unlikely that you will ever design a course for, or teach, a student who has no understanding of, or even context for, the subject that they are studying. More strikingly, the idea that the best way to learn about successfully dismantling and reassembling an engine is by giving a completely inexperienced person a car and a socket set is laughable (disassembly is easy, putting it back together in working order is the trick). I am sure that anyone who has done any (successful) work on their own car began by doing so under the guidance with someone who had car maintenance experience or by getting hold of a manual; I fondly remember my first Haynes.

If you want to look at some practical solutions to the memory challenge, have a look at my next blog on How Do We Ensure That Students Remember What We Teach Them? (Part 2 of 3)
.