The Rapid Elearning Blog

Articulate Rapid E-Learning Blog - provide effective feedback through decisions

Good online courses provide feedback throughout the course. The trick is making sure that it is meaningful and effective feedback.

Here’s an approach that’s typical of a lot of elearning courses. We provide a few screens of information then a quick knowledge check to see what they know. Then provide some more screens of information with another quick knowledge check. At the end of it all, we have them complete a multiple choice quiz.

Articulate Rapid E-Learning Blog - slide, slide, quiz basic elearning

That’s how many of us learned to build elearning courses. I call it the “slide-slide-quiz” technique. It’s not necessarily a bad process depending on the context of the course, but often it’s just a massive information dump with screen after screen of bullet points and simplistic quiz questions.

And then when it comes to feedback it’s usually not very effective because the knowledge checks and quizzes tend to be simple and at best provide basic incorrect and correct prompts. However, life isn’t like that. It’s a lot more nuanced and right and wrong decisions have meaningful consequences to what we do. Which means that simple correct and incorrect prompts may not be the most effective feedback you can provide.

Here are a few tips on providing more meaningful and effective feedback.

Replaces Quiz Questions with Activities to Create Effective Feedback

You can still use the slide-slide-quiz technique. But replace the quiz question with a meaningful activity. The key with the activity is that you’re not just testing knowledge. Instead you get them to apply what they learned in a relevant context.

This lets you ascertain their current level of understanding and the learner can feel confident that they’re learning and moving forward. It’s also a way of directing them to remedial content sooner than later.

Articulate Rapid E-Learning Blog - create practice activities for effective feedback

Real World Consequences Provide Effective Feedback

With performance-based courses I like to place the learner in a position that mirrors what they encounter in the real world. Most likely they’re not sitting around reading manuals and bullet point slides. Instead they interact with people and the work environment making decisions that produce all sorts of consequences.

Articulate Rapid E-Learning Blog - practice activities should mirro real world context

So the first step is to frame the learning experience in a real world context where they make meaningful decisions. And then the next step is to provide feedback that shows the impact of the decisions and actions a person makes. In the real world there are consequences to what we do and they tend to impact the world around us for good or bad. Build your feedback to reflect that type of consequence.

Make a good decision and sales go up or a customer relationship is repaired. However, making a poor decision costs the organization money or perhaps something like a work place injury.

Exaggerate the Consequences for Effective Feedback

Because it’s an online course you may have to amplify or over dramatize the activities, feedback and consequences. For example, in the real world an angry customer may leave the store if you make a wrong decision. Sure, you lost a potential sale, but odds are the company is not going to go bankrupt and most likely not even be aware of the lost sale.

Articulate Rapid E-Learning Blog - compress decisions to provide effective feedback

However, in an online training environment, you have to compress the events and exaggerate their impact. Compressing also allows more decisions to be made than might happen in a real world environment. And exaggerating the consequence amplifies the impact of the decisions made.

As an aside, exaggerated consequences can also be an effective way to bring humor into the course.

If you’re building simple, information-based courses with no performance impact you can probably get away with simple knowledge checks and minimal feedback. However, if your course is designed to change behaviors and improve performance then you’ll need to find ways to provide meaningful and effective feedback.

What are some ways you provide effective feedback in your elearning courses?

Events

Free E-Learning Resources

Want to learn more? Check out these articles and free resources in the community.

Here’s a great job board for e-learning, instructional design, and training jobs

Participate in the weekly e-learning challenges to sharpen your skills

Get your free PowerPoint templates and free graphics & stock images.

Lots of cool e-learning examples to check out and find inspiration.

Getting Started? This e-learning 101 series and the free e-books will help.



7 responses to “Tips to Give Effective Feedback for Online Courses”

July 29th, 2014

This is a hilariously vague article. What does it mean to “compress the events and exaggerate their impact”? Without examples, statements like “So the first step is to frame the learning experience in a real world context where they make meaningful decisions” is painfully interpretive, and means nothing. Is there any way you can provide examples for this? None of the points you make are clearly explained with respect to how they can be implemented, or even what they’d look like once used.

@Karim: it’s a blog post and not a research article. 🙂

With that said, the blog has a number of posts regarding how to convert information to performance-based courses.

Real world context: many elearning courses are merely focused on sharing information such as company policies. This is typical of a lot of compliance training. Reframing the course so that it puts the content in context and provides practice activities for the learner to make real world decisions is a common approach to make the course more performance-focused.

Compressing: given the aforementioned policy training, a manager in the real world may only have limited touches on that policy when it comes to making decisions. Thus, you’d need to compress the events and create multiple touches, giving him more opportunities.

100% agree that the classic “bore and score” doesn’t get the user what they need.

Easiest way to get “real” experiences, compressed:
Ask the field for war stories, repackage and represent them, presenting key, salient issues, no filler.

Real experiences, real consequences (good and bad) as feedback.

Another benefit?

Stops the pre-test/post-test model from being a “we test, then we teach to the test, then retest and check lift”.

You test up front- see where user performs well, and where they don’t. Provide content to support performance areas where they need to improve. More practice. Remeasures, repeat.

This means more scenarios in the same “family” of issues to allow adequate practice and feedback. Spend more time on making these experiences, and much less on content dump.

Good points, Tom. The points you outlined jibe well with a NY Times op-ed (http://sco.lt/9DKdLF ) I recently came across about the retention value of “low-” or “no-stakes” quizzing. In the article, the author discussed how some learning activities (e.g., lectures, text reading, [and I’ll add “page-turner” eLearning 😉 ]) are designed for knowledge acquisition and storage. Whereas, quizzing and other activities you describe above tend to exercise knowledge retrieval which, in their study, seemed to indicate better retention in the long run.

Thanks for the great reminder, Tom. I started off doing those “slide-slide-check” courses but have really been pushing myself to focus more on performance-based task, as you describe. This fits really well with your suggestion of eliminating bulleted objective lists in favor of immersing people in experiences that will get them to understand the objectives. I’ve been trying that, too, whether face-to-face or online.

Karim, there’s a lot of great stuff here and in the user community. Sorry you misunderstood the article. Statements like, “So the first step is to frame the learning experience in a real world context where they make meaningful decisions” is painfully interpretive, but it means EVERYTHING, not nothing. That’s the crux of a good instructional designer’s job, and it’s up to us to figure out just what those contexts are along with the potential meaningful decisions. You won’t find that in any blog.

July 31st, 2014

I agree with Tom as well, great points- and David- incorporating the field “war stories” is the way to go. I just finished a course/study guide in Storyline that is entirely practice based, critical thinking through decision making for case studies, using real world field scenarios for their role. After each scenario, the learner receives feedback and rationale, pointing to available support resources documenting the rationale as needed. After it is followed by classroom debrief discussions/q&a.

Hello

Effective feedback is crucial for not just to check learning has taken place, but gives an opportunity for learners to ask further questions and receive helpful guidance for improvement. Using real life examples to reinforce learning I used in school and college classes. I have also studied by distance and online learning, where effective feedback was lacking. Providing an opportunity for group feedback is much more difficult.