I advocate informal and social learning vehicles when appropriate and get as excited about their uses as you likely do, but it’s not a panacea for all our learning woes.  The current zeal around social learning solutions can distract from real performance needs (we’ve been distracted before).  Social learning gets positioned as the enlightened and “correct” solution for the modern workplace. Formal learning is old, tired, and reluctantly tolerated for the vestiges of the traditional, mechanistic workplace.

But, set aside your biases one way or the other for the moment and simply think of the roles and functions you support in your organization.  It will vary by industry of course, but your list is going to be some subset of the following:

..Please visit my new blog Performance X Design to read the remainder of this post and others.

Note: The Gram Consulting blog has been discontinued. I post blog introductions here to encourage former Gram Consulting readers to visit the new blog. All the Gram Consulting content, plus a bunch of new posts are on the new blog. Please come on over…

…Please visit my new blog Performance X Design to read the remainder of this post and others.

Note: The Gram Consulting blog has been discontinued. I post blog introductions here to encourage former Gram Consulting readers to visit the new blog. All the Gram Consulting content, plus a bunch of new posts are on the new blog. Please come on over…

About the Success Case Method

The method was developed by Robert Brinkerhoff as an alternative (or supplement) to the Kirkpatrick approach and its derivatives. It is very simple and fast (which is part of it’s appeal) and goes something like this:…

…Please visit my new blog Performance X Design to read the remainder of this post and others.

Note:  The Gram Consulting blog has been discontinued…I post blog introductions here  to encourage Gram Consulting readers to visit the new blog.   Please come on over…

I’ll paraphrase Dan and (Wendy) Kirkpatrick to summarize the positions (probably incorrectly but this debate happens so often I’ll use Dan and Christy more as archetypal voices for both sides of the argument)…..

Please visit my new blog Performance X Design to read the remainder of this post and others.

Note:  The Gram Consulting blog has been discontinued…I post blog introductions here  to encourage Gram Consulting readers to visit the new blog.   Please come on over…

A few years ago the UPS driver training unit had a mini-revolt on its hands from younger drivers who were unhappy with the long traditional classroom-based training program required for new drivers.  The program was experiencing increasingly higher failure rates and the number of tasks that had to be learned was becoming too much for classroom delivery.  Peggy Emmart, corporate schools coordinator of UPS corporate training and development department commented “while in the early ’90s our DSPs (drivers) may have needed to concentrate on eight key tasks each day, they now routinely perform 30 to 40 major tasks within the same time frame.”

UPS responded by completely overhauling the driver training program into a simulation and immersion based experience called UPS Integrad.  It included a training facility that incorporated a mix of e-learning, simulations, virtual learning, and immersive learn by doing.

Here is a video feature from ABC news on the program. Click the image to take you to the video. There is a short ad first–be patient (sorry I couldn’t embed it).

UPS Integrad Video profile (click to link)

Results

The Integrad program has “exceeded expectations” in all three of the program’s primary goal areas, which include enhanced DSP safety, decreased new driver turnover, and accelerated time to proficiency.

“It wasn’t about video games, it was about providing hands-on application and allowing trainees to learn by doing in a way that connects unambiguously with their jobs”.

When UPS originally started the re-design effort they thought the answer to training younger workers was going to be video game-type training.  Through additional research, they learned it wasn’t about video games, it was about “providing hands-on application and allowing trainees to learn by doing in a way that connects unambiguously with their jobs”.  I think this is a useful caution to e-learning designers moving down the path video game style instruction.

Here’s an article that describes the program in more detail:  UPS Moves Driver Training From the Classroom to the Simulator

But is it appropriate for knowledge workers?

The UPS program is an example of mostly physical or psychomotor learning,  but the lessons hold true for knowledge work as well.  For managers to learn “problem solving and decision making” they need to make decisions and solve real work problems first in a simulated setting and then in real work context with feedback and coaching.   New consultants need to consult; learning designers need to design learning, engineers need to design and test solutions all within safe, feedback rich, immersive work contexts.

As UPS summarized so simply, “The point of all this hands-on instruction is to simulate-as closely as possible-exactly what it’s like to be a…”fill in the blank“.

Just say no

Even if you haven’t read Outliers yet you probably know that it sets out to dispel myths that intelligence or innate ability are the primary predictors of success.  Instead,  Gladwell summarizes research and provides examples to show that it is hours and hours of practice (10,000 to be exact) and a “practical intelligence” (similar in concept to emotional intelligence) acquired through experience that are the real determinants of success.

Gladwell covers similar territory (and draws on the same research) as Geoff Colvin’s Talent is Overrated: What Really Separates world Class Performers from Everybody Else, another excellent book that elaborates on an article Colvin wrote for Fortune magazine a few years ago: “What it Takes To Be Great”.

Both books debunk the assumption that “gifted” skill and great performance comes from innate talent, personal traits or hard wired competencies and ability.  The research Galdwell and Colvin draw on is impressive.  Both point to the extensive work of K. Anders Ericsson at Florida State University.  Ericsson has conducted years of rock solid research on the role of “deliberate practice” in the acquisition of expert performance.  If you like to seek out source research as I do, then you’ll enjoy Ericsson’s (and others) impressive work that has been collected in the Cambridge Handbook of Expertise and Expert Performance. Here is an earlier (and less hefty) review on some of the same research: “Deliberate practice” in the acquisition of expert performance.

At the core of these works is the concept of “deliberate practice” over longs periods of time (up to ten years).  While impossible to boil down the theory into a few points, here it is…uh…boiled down into a few points.   Highly skilled performance in all aspects of life and work can be developed by the rough equivalent of 10,000  hours (10 years or so) of increasing specific, targeted and mindful practice in a domain of expertise. The practice must be:

• Specific & technique-oriented
• Self regulated
• Involve high-repetition
• Paired with immediate feedback on results
• Isn’t necessarily “fun”, (in fact can be grueling hard work)

“Deliberate practice is activity designed specifically to improve performance, often with a teacher’s help; it can be repeated a lot; feedback on results is continuously available; it’s highly demanding mentally, whether the activity is purely intellectual, such as chess or business-related activities, or heavily physical, such as sports; and it isn’t much fun.
From: Talent Is Overrated: What Really Separates World-Class Performers from Everybody Else .

Where Gladwell and Colvin focus on how an individual (you!) can use deliberate practice to improve and achieve the success you want,  Learning Professionals should be thinking about how to use the ideas to help others develop and grow the expertise needed by the organizations we support.  Ericsson has something to say here as well, having recently published a new book on how to design learning environments to develop and measure expertise– Development of Professional Expertise: Toward Measurement of Expert Performance and Design of Optimal Learning Environments.  In a time when learning/instructional design has become generalized and de-professionalized to the point of non-existence, it’s refreshing to see a serious treatment that moves the profession forward.

Using “Deliberate Practice” to Improve Workplace Performance

Here are 10 ideas that just scratch the surface on how Learning Professionals can use “deliberate practice” to improve workplace skill and performance.

1. Move from “mastery learning” to designing practice with feedback over longer periods of time (from learning events to a learning process). Deliberate Practice differs from the concept of ‘Mastery Learning” at the heart of much instructional design.  Mastery learning assumes a skill is perfected (or at least brought to a defined standard) in a fairly short period of time often within the scope of a single course. The complex professional skills of modern knowledge workers and managers demand a stronger focus on long term practice and feedback and building learning around long term objectives.
2. Develop the person. Time, practice and individualized feedback imply a long term focus on individuals rather than on jobs or roles.
3. Informal learning efforts like action learning, coaching and are cognitive apprenticeships are critical but they must be focused on practice and immediate feedback and extend over long periods of time.
4. Relevant, frequent and varied practice must be the dominant and most important element in all formal training programs.
5. Practice opportunities must extend far beyond initial training programs, to allow people to hone their skills through experimentation with immediate feedback.
6. Create practice sandboxes and simulation centres for key organizational skills where people can practice their skills and experience immediate feedback in safe environment.
7. Design visual feedback directly into jobs so professional can immediately see the results of their work.  In this way working IS deliberate practice.
8. Turn training events into the first step of a learning journey that will continue to provide opportunities to practice and refine skills throughout a career.
9. Identify the interests and strengths of people nurture them through opportunities for deliberate practice. Provide resources and support that encourage early effort and achievement.
10. Ensure social media environments provide opportunities for coaching and mindful reflection on performance.

9. Design jobs for natural learning

Most of us accept that we learn through experience,  whether that experience is structured into a training program or simply the “experience” of working.   But what is it about experience that results in learning?  There are a number of factors,  but most powerful among them is the feedback we receive (or don’t receive) on the results of our actions.  We intuitively use that feedback to adjust our actions, decisions, methods etc. to try to get it right the next time…in other words we use feedback to learn…to get better at what we do and accomplish.

Left to our own devices we seek out feedback to determine how well our actions worked at accomplishing our goal.   Jobs with effective feedback mechanisms available result in much more rapid learning, improved results and higher levels of motivation.  Designing a job with an effective feedback system is the equivalent of designing a job as an effective learning system.

A useful performance feedback system need the following elements to produce the kind of information needed for an employee to learn and perform:

• A clear understanding of the requirements both in terms of the outputs they are expected to produce and the standards of quality, cost and time they are expected to meet.

• An accurate and objective measurement system. Job outputs must be easily measured and compared to the standard.   It can include both qualitative and quantitative data.

• A visual display of the performance data against the standard. Charting and graphing performance data is much more effective than text, tables and spreadsheets.  It adds a level of interpretation and visual comparison that people readily accept.  There are many visual performance charting tools available, most of them automated.  They include line graphs, control charts, bar charts, pie charts and many others.

A sample line graph

• It must be timely, relevant and specific to the employee of team.

System thinking has also taught us that feedback is also important for identifying the downstream consequences of our actions. This feedback will typically be delayed, especially in knowledge work contexts when our output is part of a larger solution that can take months or even years before results are fully realized.  Sometimes unintended or undesired consequences can be the result.

immediate and delayed feedback

Other learning uses of performance feedback systems

Once an effective feedback system is in place it can be the basis for other learning interventions like coaching, performance appraisal, team development, and process improvement.  It should also be used to provide data to evaluate the effectiveness for formal training.  In many ways formal training is meant to compress and accelerate the learning that an individual might naturally get on the job.  Training should result in improvements that register on the performance feedback tool.   Formal training is our last an final strategy for integrating learning and work.

10. Bring the job to learning

Integrating learning and working implies building learning into jobs and processes–and that has certainly been the focus of the first nine strategies.  But greater integration can also be achieved by bringing jobs and processes into formal learning design.

Broadly speaking the goal formal training is to compress on the job experience to bring people to competency as quickly as possible.  Somehow over the years that goal been reduced to lots of telling and very little “doing”.   So my last strategy is an appeal to bring structured experience back to formal learning.  I don’t mean generic structured experience (like a management outdoor education or abstract team building exercises for example) but experiences based on authentic learning tasks.

We know how to do it.  The formal learning strategies that result in superior learning include business and process simulations, decision case learning, anchored instruction and the whole task learning design methods found in Jeroen van Merrienboer’s  4C/ID work.   Here are some links to design approaches that are based on real world learning tasks:

• Situated Learning
• Anchored Instruction
• Cognitive Apprenticeship
• Goal Based Scenarios
• First Principles Method
• 4C/ID

Some organizations are starting to turn their training functions into simulation centres and learning “studios” that use a combination of physical and knowledge based simulations of actual work processes and tasks.  For example Sick Kids Hospital in Toronto has developed a simulation centre.

For a very interesting academic experiment in a studio based approach to learning that I think would translate well to business settings see MIT’s Technology Enabled Active Learning Project.  It is based on a studio approach to learning that moves seamlessly between lecture, experimentation and discussion and individual design projects in one large technology enabled room.  Remote technologies could easily be used for dispersed employees.

This takes us full circle back to strategy #1.   If you use appropriate analysis tools to understand the job for which training is being developed, the quality of that training will be dramatically improved and the skills employees learn will be immediately useful.   Performance-based learning and Learning-based performance.  Two worthy and achievable goals for the learning professional.

Posts in the “10 Strategies for Integrating Learning and Work” series:

Part 1:

• Strategy 1:  Understand the job
• Strategy 2:  Link Learning to business process
• Strategy 3:  Build a performance support system

Part 2:

• Strategy 4:  Build a community of practice
• Strategy 5:  Use social media to facilitate informal learning

Part 3:

• Strategy 6:   Implement a continuous improvement framework
• Strategy 7:   Use action learning

Part 4:

• Strategy 8:  Use Organizational Learning practices

Part 5:

• Strategy 9:  Design jobs for natural learning
• Strategy 10:  Bring the job to the learning

In a series of following posts I’ll share some practices and approaches that have worked for me.  There is incredible variety in the business settings where we work, the jobs we support and the latitude we have to build our solutions.  Hopefully some of the following suggestions will be relevant in your situation.

Each of the 10 strategies on the list in the highlight box on the right, have helped me to improve performance through learning without pulling people way from the job for formal (classroom or e-learning) training.  I’d love to hear some of your suggestions and experiences.

In this post I’ll discuss practices 1 through 3.

1. Understand the job

If your going to integrate learning with work you had better understand the work.  Watch people, talk to people, use appropriate analysis tools, and think like the performer.  Understand their world, day to day pressures, tools they use (or could use) and how they use them.  Understand the job inputs, processes and feedback mechanisms for job incumbents.

Learn and use the many analysis tools appropriate for different kinds of performance–task analysis for visible work, Cognitive walk-through for knowledge work and output focused performance analysis for both.  Process analysis and value stream analysis are useful for seeing work in the context of the broader system. These and other analysis methods are critical tools if you are to find ways to build learning into a job without burdening the learner (employee) with irrelevant or unwieldy tools and programs that don’t fit in the flow of their day to day work.

It’s unfortunate that some job/role analysis efforts have been overly cumbersome or time consuming (analysis paralysis!).  They don’t need to be.  Often they can simply be a good mental model or filter through which to rapidly examine a job or process for learning and improvement opportunities.  A good analysis is part of the solution not a barrier to it.

2. Link information and learning to business process

We often talk about linking training to business strategy and of course that’s critical, but a key link to strategy is cross functional business process.  Well designed business processes are structured to accomplish business objectives.  Every job is driven by a process, implicit or explicit.   If it so implicit as to be almost imperceptible (as if often the case with knowledge and creative work) there is some improvement you can offer before you even start to think about learning.

Once business processes have been identified (or made visible), process phases can be used to effectively embed relevant learning resources. All business processes contain “knowledge leverage points”-those points in the process where key information is needed for optimal performance. These could be key decision points, data collection points requirements, planning requirements etc. and will vary by type of job and process. And knowledge generation is as important in modern knowledge work as knowledge delivery so it’s also important to examine how knowledge can be accumulated through practice and made available to the wider group at those same knowledge leverage points. Here’s a sample cross functional process (sales) with knowledge leverage points identified.

With knowledge leverage points identified, learning and knowledge can be made available at it’s most relevant place, and most relevant form in the work flow.

3. Build a Performance Support System

A Performance Support System is a concept more that a specific solution.   Whatever configuration it takes, the core idea is to reduce the need for training (or eliminate it, altogether) by proving information, decision tools, performance aids and learning on-demand, using tools available at the moment they are needed.  An excellent performance system becomes part of the task and complements human abilities (compensate for weaknesses and enhance strengths).

They can be as simple as a job aid or reference and as complex as the panel of airplane cockpit.  It can include decision tools, searchable information resources, e-learning objects, simple software apps, help systems, advisory systems, video and media based reference material, procedural guidance, job aids, demonstration animations, simulations and anything else that supports performance.  They can be as useful for management and professional work as they are for procedural and administrative work.

Research support for performance support can be found in the area of “distributed cognition” which argues that tasks (mental and otherwise) can be dramatically improved through the aid of external tools that intimately aid thinking and performance.  It is embodied in Don Norman’s distinction between the personal and system point of view regarding performance support tools (“cognitive artifacts” as he labels them in Things that Make us Smart):

“there are two views of a cognitive artifact. The personal point of view (the impact the artifact has for the individual person and the system point of view (how the artifact + the person, as a system are different than the abilities of the person alone).

The personal point of view:
Artifacts (performance tools) change the task

The system point of view:
The person + artifact is smarter than either alone

The point is that a well designed performance support system becomes an integral part of the task.  Performance support systems can include small amounts of structured e-learning if the task requires some conceptual understanding or routine practice before application but generally performance support tools are designed to replace reliance on memory.

Business Process Guidance is an emerging term for performance support more directly linked to business processes.  Panviva and Tata Interactive Systems have adopted the term for their tools.

Posts in the “10 Strategies for Integrating Learning and Work” series:

Part 1:

• Strategy 1:  Understand the job
• Strategy 2:  Link Learning to business process
• Strategy 3:  Build a performance support system

Part 2:

• Strategy 4:  Build a community of practice
• Strategy 5:  Use social media to facilitate informal learning

Part 3:

• Strategy 6:  Implement a continuous improvement framework
• Strategy 7:  Use action learning

Part 4:

• Strategy 8:  Use Organizational Learning practices

Part 5:

• Strategy 9:  Design jobs for natural learning
• Strategy 10:  Bring the job to the learning

Learning methods that are embedded in authentic situations are not merely useful; they are essential Brown, Collins & Duguid. 1989

While this approach can be effective for learning discreet tasks, it struggles when trying to teach more complex skills which almost always contain elements from all domains.   Modern approaches are based more on designing learning in it’s the full social, cognitive and skilled based context.  This implies a more holistic approach rather than the deconstruction approaches of the past (although, the vast majority of instructional design continues to use traditional approaches).

This new wave of learning design models come in a many variations and each has slightly differing methods, philosophies and approaches.   Here are a few:

• Situated Learning
• Anchored Instruction
• Cognitive Apprenticeship
• Goal Based Scenarios
• First Principles Method
• 4C/ID

How to design authentic learning tasks

Authentic learning tasks are whole-task experiences based on real life (work) tasks that integrate skills, knowledge attitude and social context.  Instruction is organized around the whole task, usually in an easy to difficult progression, which “scaffolds” learning support from “lots to little” as learners progress.

Identifying what an authentic learning task can be challenging.  The term is often used without any real guidance on how to identify whole tasks and then transfer them to a training context.  I stumbled on the following framework from Authentic Task Design, a research project of the University of Wollongong in Australia.  They suggest 10 research based elements for the design of authentic tasks in web-based learning environments. I thought it was a useful guide.  Hope you do to.

1. Authentic tasks have real-world relevance

Activities match as nearly as possible the real-world tasks of professionals in practice rather than decontextualised or classroom-based tasks.

2. Authentic tasks are ill-defined, requiring students to define the tasks and sub-tasks needed to complete the activity

Problems inherent in the tasks are ill-defined and open to multiple interpretations rather than easily solved by the application of existing algorithms. Learners must identify their own unique tasks and sub-tasks in order to complete the major task.

3. Authentic tasks comprise complex tasks to be investigated by students over a sustained period of time
Tasks are completed in days, weeks and months rather than minutes or hours, requiring significant investment of time and intellectual resources.

4. Authentic tasks provide the opportunity for students to examine the task from different perspectives, using a variety of resources
The task affords learners the opportunity to examine the problem from a variety of theoretical and practical perspectives, rather than a single perspective that learners must imitate to be successful. The use of a variety of resources rather than a limited number of preselected references requires students to detect relevant from irrelevant information.

5. Authentic tasks provide the opportunity to collaborate
Collaboration is integral to the task, both within the course and the real world, rather than achievable by an individual learner.

6. Authentic tasks provide the opportunity to reflect
Tasks need to enable learners to make choices and reflect on their learning both individually and socially.

7. Authentic tasks can be integrated and applied across different subject areas and lead beyond domain-specific outcomes
Tasks encourage interdisciplinary perspectives and enable diverse roles and expertise rather than a single well-defined field or domain.

8. Authentic tasks are seamlessly integrated with assessment
Assessment of tasks is seamlessly integrated with the major task in a manner that reflects real world assessment, rather than separate artificial assessment removed from the nature of the task.

9. Authentic tasks create polished products valuable in their own right rather than as preparation for something else
Tasks culminate in the creation of a whole product rather than an exercise or sub-step in preparation for something else.

10. Authentic tasks allow competing solutions and diversity of outcome
Tasks allow a range and diversity of outcomes open to multiple solutions of an original nature, rather than a single correct response obtained by the application of rules and procedures.

Tony Karrer in his e-learning technology blog recently wondered about social networking participation –”it’s different when it’s a natural part of how we work”.  Some insight is provided in a popular article from the McKinsey Quarterly Report.  In Six Ways to Make Web 2.0 Work, company analysts suggest some tactics that are instructive for encouraging participation in social media for e-learning or in communities of practice.  One of their “six ways” that resonated with my own experience they labeled “What’s in the workflow is what gets used”.  From the report:

What’s in the workflow is what gets used

“Perhaps because of the novelty of Web 2.0 initiatives, they’re often considered separate from mainstream work. Earlier generations of technologies, by contrast, often explicitly replaced the tools employees used to accomplish tasks. Thus, using Web 2.0 and participating in online work communities often becomes just another “to do” on an already crowded list of tasks.

Participatory technologies have the highest chance of success when incorporated into a user’s daily workflow. The importance of this principle is sometimes masked by short-term success when technologies are unveiled with great fanfare; with the excitement of the launch, contributions seem to flourish. As normal daily workloads pile up, however, the energy and attention surrounding the rollout decline, as does participation. One professional-services firm introduced a wiki-based knowledge-management system, to which employees were expected to contribute, in addition to their daily tasks. Immediately following the launch, a group of enthusiasts used the wikis vigorously, but as time passed they gave the effort less personal time-outside their daily workflow-and participation levels fell”

As enthusiastic as early adopters are with new technologies,  each new wave teaches us that unless they add value to how work get accomplished,  the novelty can wear off quickly.   I think the lesson here for organizational learning and e-learning practitioners is to be careful not to simply roll out social media (for learning or otherwise) and expect widespread adoption similar to what we have seen in the public arena.

Also, management will be making a mistake if they feel they are best suited to make the decision regarding how to best use web 2.0 tools. That decision should be a participatory exercise with end users and it should be grounded in workflow or knowledge flow improvement efforts.  Chances for successful adoption will be much greater when employees analyze and improve their business processes building in web 2.0 tools as integral elements to that workflow.  There will also be lots of trail and error involved.  One of the other interesting findings of the McKinsey report was was intended uses sometimes failed but were replaced by unintended successes that emerged from grass roots use of the tools in pilot projects.