Many Instructional Systems Designers Are Missing the Mark

Why are ISDs not designing virtual learning for application and impact?

by Patti P. Phillips, Ph.D., CEO, ROI Institute, and Jack J. Phillips, Ph.D., Chairman, ROI Institute

Just a few days ago, we recorded a podcast interview with a learning and development firm in South Africa called Elevate Learning. They plan to use the podcast to help educate the L&D professional community in the country. The first question we were asked was, “Instructional systems designers think their work is done when they achieve learning. They don’t design for application and impact. Why do you think that is the case?”

This is an interesting question, and we have encountered it many times. Maybe it is because they are developing a learning program, and when learning is achieved, they consider the program successful. But those who fund, support, and sponsor virtual learning programs clearly see it otherwise. They want to make sure that the learning is used and has an impact.

The success of a virtual learning program is reflected in five levels of outcomes, as shown in the figure below.

For a major program, an ISD team does not reach the desired success until the program has made a difference in the organization. To make a difference requires application and impact (application without impact is just being busy). To know that success was achieved requires measurement at those levels. Although resources may not be available to evaluate many programs at levels 3, 4, and 5, some programs need those levels of accountability. Important, expensive, and strategic programs need to be evaluated for impact and ROI. Even if the results are not evaluated at those levels, it would be comforting to funders and sponsors to know that it has been designed to make a difference.

Now, back to the question: Why are ISDs not designing for application and impact? It’s always a problem in L&D, but it is more pronounced with virtual learning designers when they are charged with designing a new program. Why is this so? Here’s what we have concluded.

No. 1: A virtual designer realizes the biggest challenge is to get people to use the virtual format and keep them engaged. They know the challenge is there, so they put all their energy into ensuring the participants are engaged, involved, motivated, and essentially happy with the process. This takes time away from thinking beyond the learning issue.
No. 2: Some classic books and important resources are available to show L&D professionals how to transfer learning to the job, and they have made a difference. Many seasoned designers clearly understand the learning transfer issues. Virtual designers are perhaps newer to the profession and often think that what they are doing is very different and, therefore, they don’t necessarily use these resources. Instead, they go to virtual design books and find them almost void of design for application and impact.
No. 3: Designing for application and impact usually involves efforts to get the participant’s manager involved in some way, supporting the program and influencing the results of the program. This is an added dimension that many designers do not want to pursue.
No. 4: Some virtual designers perhaps are thinking logically: If participants are learning, they will use it. These designers are probably not aware of the many barriers and obstacles that inhibit use of the content.
No. 5: Virtual designers indicate that the client doesn’t want to fund the effort for this approach. Designing for application and impact will cost more, and the client is not willing to pay for it.
No. 6: Virtual designers perceive that application and impact are out of their control. They can control what happens in the virtual learning program, but not what happens on the job.

Not designing for application and impact is disastrous. The key is to explore actions that can be taken:

  • Before the program (e.g., setting objectives for application and impact or having managers of the participants create expectations in advance of the program)
  • During the program (e.g., having participants develop an action plan of what they will do and having facilitators teaching to the level 3 and level 4 objectives)
  • After the program (e.g., creating expectations with the manager, sharing successes, and providing coaching)

Designing for application and impact is possible, and it is needed now more than ever. When the pandemic is over, the challenge will be to make sure that virtual is still a very dominant platform for learning. It will be if the results are there. It’s really up to all of us, but in particular, it’s up to the instructional designers. For more information, download our report, “Thirty Techniques to Design Virtual Learning to Deliver Impact and a Positive ROI.”

This article was originally published on August 2, 2021, on ChiefLearningOfficer.com