…Please visit my new blog Performance X Design to read the remainder of this post and others.

Note: The Gram Consulting blog has been discontinued. I post blog introductions here to encourage former Gram Consulting readers to visit the new blog. All the Gram Consulting content, plus a bunch of new posts are on the new blog. Please come on over…

It’s a venture of Fast Company Magazine.  Leaders and entrepreneurs from a variety of industries are asked to describe their approach to various leadership problems and topics in 30 seconds or less (ticking clock and all).  The site describes their mission like this:….

…Please visit my new blog Performance X Design to read the remainder of this post and others.

Note:  The Gram Consulting blog has been discontinued.   I post blog introductions here  to encourage former Gram Consulting readers to visit the new blog. All the Gram Consulting content, plus a bunch of new ones are on the new blog. Please come on over…

Communities of practice are dynamic social structures that require both initial design and ongoing cultivation so they can emerge and grow.  However, through a series of steps, learning professionals and community members can design a community environment, foster the formalization of the community, and plan activities to help grow and sustain the community. But ultimately, the members of the community will define and sustain it over time.

Here are most of the activities listed from the session.  Some are slightly edited for consistency or to merge with similar items to create a single list.

Please visit my new blog Performance X Design to see the list.

Note:  The Gram Consulting blog has been discontinued…I post blog introductions here  to encourage Gram Consulting readers to subscribe to the new blog.   Please come on over…

Tuesday (Oct 19) is dedicated to “Research into Practice”, a topic near and dear to me. All presentations  on Tuesday are based on the theme.   Allison Rosset will discuss the importance of research in guiding instructional practice,  Harold Stolovich on performance improvement research,  Traci Sitzmann on e-learning research and Christine Wihak on what we research tells us about informal learning.

I will be presenting a Trading Post session on Tuesday at 2:00 pm titled Getting Informal: Merging learning and Work through Informal Learning. It will be based on many of the concepts I have presented in this blog, particularly Leveraging the full Learning Continuum and the 10 Strategies for Integrating Learning and Work series.

A Thought Leaders series begins on Wednesday which will include sessions by Marc Rosenberg (on Learning 2.0), Patti Shank (on common errors in learning design) and Bob Morton (on change management).  My new employer (Nexient Learning) is also presenting a case study with Deliotte on Managerial Effectiveness that I’m looking forward to.

I will be presenting on a Learning Technology Thought Leaders panel session on Thursday (20th) titled: Enterprise Solutions, Managing the Training Function.   I’ll be on the panel with Harold Jarche, Sheryl Herle, Sheri Philips and Gary Woodill (from the Brandon Hall team) We will thrash around the pros and cons of Learning Management Systems. The session is moderated by Saul Carliner from Concordia University.  No lack of opinion in that group!  Should be interesting.

Thursday also includes a keynote by Peter Senge whose work I admire and have posted on in the past.

If you happen to be there please stop by one of my sessions and say hello.

CSTD and IFTDO World Conference from CSTD and IFTDO on Vimeo.

If you have enjoyed the posts on Gram Consulting, you’ll find more of the same at the new blog.  I’ve moved all the posts and comments from Gram Consulting to the new blog and have borrowed my business tag line from the gram consulting logo for the new name: Performance by Design

Performance X Design will appeal to learning professionals, performance consultants, e-learning developers, organizational development and HR professionals with a keen interest in improving real performance through their efforts.  Like Gram Consulting, posts will span these disciplines with a common thread how they can be used to create more effective organizations.

• Designing learning and knowledge systems
• Designing performance
• Designing effective organizations

I hope you can take a couple of minutes now and subscribe to the new site.

Click here to visit Performance X Design

Click here to subscribe to Performance X Design in your reader (RSS feed)

Click here to have  Performance X Design posts delivered to you via e-mail

I’m still working on correcting some broken links as I find them, but the site functions and ready for your comments.

I look forward to keeping the conversation going!

Cheers,

Tom

Ellen’s post focused on how Learning Designers on a twitter discussion got  “cranky” at the first mention of the ADDIE process (Analysis, Design, Development, Implementation and Evaluation).  On the Twitter #Lrnchat session  participants had a gag response to the to the mere mention of ADDIE (sound familiar?).  Don responded with some great comments on how ISD (ADDIE) has evolved and adapted.

Much of my career has been involved in applying ADDIE in some form or other and I’ve landed on a conflicted LOVE/HATE relationship with it that that you, lucky reader, will now be subjected to .

HATE (Phase A, Step 3.2.6)

Throughout the 90’s many Instructional Designers and e-Learning Developers (me included) grew disgruntled with ADDIE (and its mother process Instructional Systems Design—ISD) as training struggled to keep up with business demands for speed and quality and as we  observed process innovations in software and product development field (Rapid Application Development, Iterative prototyping etc).

In 2001 that frustration was given voice in the seminal article “The Attack on ISD” by Jack Gordon and Ron Zemke in Training Magazine.

The article cited four main concerns:

• ISD is too slow and clumsy to meet today’s training challenges
• There’s no “there” there. (It aspires to be a science but fails on many fronts)
• Used as directed, it produces bad solutions
• It clings to the wrong world view

I have memories of early projects, driven by mindless adherence to ISD, where I learned the hard way, the truth in each of these assertions.  As an example of what not to do and a guard against blowing my brains out in future projects,  for years I have kept an old Gagne style “instructional objective” from an early military project that would make your eyes burn.

Early ISD/ADDIE aspired to be an engineering model.  Follow it precisely and you would produce repeatable outcomes.  The engineering model assumes a “one best way” and the one best way of the time was grounded in the science of behavioral psychology and general systems theory.  The “one best way” thinking appealed to the bureaucratic style of the times but it couldn’t be more of an anathema to the current crop of learning designers, especially those focused on more social and constructivist approaches to learning.  And they are right.

Another criticism of ADDIE I have parallels Ellen’s comments.  Adherents and crankites alike view ADDIE as an “instructional design” methodology when in fact it should be viewed more as a project management process for learning projects.  Viewing  Instructional Design as synonymous with ADDIE does both a disservice.  There is loads of ID going on inside ADDIE but it is primarily in the Design phase of the process, and it can be much more creative than the original model prescribes.

In the end, the Achilles heel of formal ISD/ADDIE rests in its prescriptive posture and foundation in behavioural psychology.  Behavioural psychology and performance technology–its extension in the workplace–have added greatly to our understanding how to improve human learning at work, but we have learned much since then, and technology has provided tools to both designers and learners that profoundly change the need for a process like ADDIE.

Of course the ADDIE process was (and is) not unique to the learning design profession.  For many years the five broad phases of ADDIE were the foundation for the design of most systems.  Software engineering, product development, interactive/multimedia development are all based on some variation of the model.   Most however have evolved from the linear “waterfall” approach of early models (can’t start the next phase until the previous has been done and approved) to iterative design cycles based on rapid prototyping, customer participation in the process and loads of feedback loops built into the process.  And learning/e-learning is no different.  It has evolved and continues to evolve to meet the needs of the marketplace. Much of the current gag reaction to ADDIE, like that experienced by Ellen, is based on the old waterfall-linear approach and the assumed instructivist nature of the model.  And again the gag is entirely valid.

However, if you can break free from the history, preconceptions and robotic application of ADDIE, you may find room for something approaching…

LOVE (Phase B, Step 2.3.7)

I can’t say I ever use ADDIE in its purest form any longer.  For e-learning and performance applications, I prefer processes with iterative design and development cycles that are usually a variation of rapid application development process like this one from DSDM.

Or for an example specific to e-learning,  this process from Cyber Media Creations nicely visualizes the iterative approach:

Source: http://myonlineelearning.blogspot.com/

Or for the Michael Allen fans out there, his Rapid Development approach described in Creating Successful e-Learning is very good.  There is a respectful chapter in the book on the ADDIE limitations and how his system evolved from it.

But at the heart of all these processes are the familiar phases of analysis, design, development, implementation and evaluation,  albeit cycling through them many times along the way.

For me ADDIE has become a useful heuristic,  not even a process really, but a framework for thinking,  coaching instructional designers,  and managing learning and e-learning projects.  Many e-learning designers these days are not formally trained in Instructional Design and initially think of it as instructional “writing” more than the holistic and systemic approach at the heart of ADDIE.   Likewise customers and subject matter experts are much easier to work with once they understand the broad project process that ADDIE represents.  For these two purposes alone I am thankful for ADDIE as a framework .  ADDIE has staying power because of it’s simplicity.  Purists will say it has been watered down too much but in many ways that’s what keeps it alive.

ADDIE phases are also a useful way to think about organization design and structure of a learning function.  They are the major processes that need to be managed and measured by most learning functions.  Just think of the functionality of most LMS systems have added since their inception.

In the end ADDIE (and its more current modifications) is probably most valuable because it makes the work of learning design visible. This is an essential feature of productive knowledge work of all kinds.   Almost every learning/training group uses a ADDIE as a start point to design a customized process that can be communicated,  executed,  measured and repeated with some level of consistency.  Equally important in knowledge work is the discipline of continually improving processes and breaking through to better ways of working.  This has resulted in the many innovations and improvement to the ADDIE process since its inception.

SUMMATIVE EVALUATION (Phase E, Step 5.2.3)

I’ve come to believe that the power of ADDIE/ISD lies in the mind and artful hands of the user.  In my experience Rapid Application Development processes can become just as rigid and prescriptive under the watch of inflexible and bureaucratic leaders as ADDIE did.

There’s an intellectual fashion and political correctness at work in some of the outright rejection of ADDIE.  It’s just not cool to associate with the stodgy old process.  Add Web 2.0, informal and social learning to the mix and some will argue we shouldn’t be designing anything.

For the organizations I work with, there is no end on the horizon to formal learning (adjustments in volume and quality would be nice!).  Formal learning will always require intelligent authentic learning design, and a process to make it happen as quickly and effectively as possible. If instead of  the irrelevant old geezer in the corner waving a disapproving finger,  we think of ADDIE more like a character from Mad Men, maybe we can refresh the image a bit.

A few years ago the UPS driver training unit had a mini-revolt on its hands from younger drivers who were unhappy with the long traditional classroom-based training program required for new drivers.  The program was experiencing increasingly higher failure rates and the number of tasks that had to be learned was becoming too much for classroom delivery.  Peggy Emmart, corporate schools coordinator of UPS corporate training and development department commented “while in the early ’90s our DSPs (drivers) may have needed to concentrate on eight key tasks each day, they now routinely perform 30 to 40 major tasks within the same time frame.”

UPS responded by completely overhauling the driver training program into a simulation and immersion based experience called UPS Integrad.  It included a training facility that incorporated a mix of e-learning, simulations, virtual learning, and immersive learn by doing.

Here is a video feature from ABC news on the program. Click the image to take you to the video. There is a short ad first–be patient (sorry I couldn’t embed it).

UPS Integrad Video profile (click to link)

Results

The Integrad program has “exceeded expectations” in all three of the program’s primary goal areas, which include enhanced DSP safety, decreased new driver turnover, and accelerated time to proficiency.

“It wasn’t about video games, it was about providing hands-on application and allowing trainees to learn by doing in a way that connects unambiguously with their jobs”.

When UPS originally started the re-design effort they thought the answer to training younger workers was going to be video game-type training.  Through additional research, they learned it wasn’t about video games, it was about “providing hands-on application and allowing trainees to learn by doing in a way that connects unambiguously with their jobs”.  I think this is a useful caution to e-learning designers moving down the path video game style instruction.

Here’s an article that describes the program in more detail:  UPS Moves Driver Training From the Classroom to the Simulator

But is it appropriate for knowledge workers?

The UPS program is an example of mostly physical or psychomotor learning,  but the lessons hold true for knowledge work as well.  For managers to learn “problem solving and decision making” they need to make decisions and solve real work problems first in a simulated setting and then in real work context with feedback and coaching.   New consultants need to consult; learning designers need to design learning, engineers need to design and test solutions all within safe, feedback rich, immersive work contexts.

As UPS summarized so simply, “The point of all this hands-on instruction is to simulate-as closely as possible-exactly what it’s like to be a…”fill in the blank“.

Just say no

9. Design jobs for natural learning

Most of us accept that we learn through experience,  whether that experience is structured into a training program or simply the “experience” of working.   But what is it about experience that results in learning?  There are a number of factors,  but most powerful among them is the feedback we receive (or don’t receive) on the results of our actions.  We intuitively use that feedback to adjust our actions, decisions, methods etc. to try to get it right the next time…in other words we use feedback to learn…to get better at what we do and accomplish.

Left to our own devices we seek out feedback to determine how well our actions worked at accomplishing our goal.   Jobs with effective feedback mechanisms available result in much more rapid learning, improved results and higher levels of motivation.  Designing a job with an effective feedback system is the equivalent of designing a job as an effective learning system.

A useful performance feedback system need the following elements to produce the kind of information needed for an employee to learn and perform:

• A clear understanding of the requirements both in terms of the outputs they are expected to produce and the standards of quality, cost and time they are expected to meet.

• An accurate and objective measurement system. Job outputs must be easily measured and compared to the standard.   It can include both qualitative and quantitative data.

• A visual display of the performance data against the standard. Charting and graphing performance data is much more effective than text, tables and spreadsheets.  It adds a level of interpretation and visual comparison that people readily accept.  There are many visual performance charting tools available, most of them automated.  They include line graphs, control charts, bar charts, pie charts and many others.

A sample line graph

• It must be timely, relevant and specific to the employee of team.

System thinking has also taught us that feedback is also important for identifying the downstream consequences of our actions. This feedback will typically be delayed, especially in knowledge work contexts when our output is part of a larger solution that can take months or even years before results are fully realized.  Sometimes unintended or undesired consequences can be the result.

immediate and delayed feedback

Other learning uses of performance feedback systems

Once an effective feedback system is in place it can be the basis for other learning interventions like coaching, performance appraisal, team development, and process improvement.  It should also be used to provide data to evaluate the effectiveness for formal training.  In many ways formal training is meant to compress and accelerate the learning that an individual might naturally get on the job.  Training should result in improvements that register on the performance feedback tool.   Formal training is our last an final strategy for integrating learning and work.

10. Bring the job to learning

Integrating learning and working implies building learning into jobs and processes–and that has certainly been the focus of the first nine strategies.  But greater integration can also be achieved by bringing jobs and processes into formal learning design.

Broadly speaking the goal formal training is to compress on the job experience to bring people to competency as quickly as possible.  Somehow over the years that goal been reduced to lots of telling and very little “doing”.   So my last strategy is an appeal to bring structured experience back to formal learning.  I don’t mean generic structured experience (like a management outdoor education or abstract team building exercises for example) but experiences based on authentic learning tasks.

We know how to do it.  The formal learning strategies that result in superior learning include business and process simulations, decision case learning, anchored instruction and the whole task learning design methods found in Jeroen van Merrienboer’s  4C/ID work.   Here are some links to design approaches that are based on real world learning tasks:

• Situated Learning
• Anchored Instruction
• Cognitive Apprenticeship
• Goal Based Scenarios
• First Principles Method
• 4C/ID

Some organizations are starting to turn their training functions into simulation centres and learning “studios” that use a combination of physical and knowledge based simulations of actual work processes and tasks.  For example Sick Kids Hospital in Toronto has developed a simulation centre.

For a very interesting academic experiment in a studio based approach to learning that I think would translate well to business settings see MIT’s Technology Enabled Active Learning Project.  It is based on a studio approach to learning that moves seamlessly between lecture, experimentation and discussion and individual design projects in one large technology enabled room.  Remote technologies could easily be used for dispersed employees.

This takes us full circle back to strategy #1.   If you use appropriate analysis tools to understand the job for which training is being developed, the quality of that training will be dramatically improved and the skills employees learn will be immediately useful.   Performance-based learning and Learning-based performance.  Two worthy and achievable goals for the learning professional.

Posts in the “10 Strategies for Integrating Learning and Work” series:

Part 1:

• Strategy 1:  Understand the job
• Strategy 2:  Link Learning to business process
• Strategy 3:  Build a performance support system

Part 2:

• Strategy 4:  Build a community of practice
• Strategy 5:  Use social media to facilitate informal learning

Part 3:

• Strategy 6:   Implement a continuous improvement framework
• Strategy 7:   Use action learning

Part 4:

• Strategy 8:  Use Organizational Learning practices

Part 5:

• Strategy 9:  Design jobs for natural learning
• Strategy 10:  Bring the job to the learning

Are you ready for Bio-Optic Organized Knowledge (B.O.O.K)?  Apparently “thousands of content creators have committed to the platform and investors are reported flocking to the medium”

I learned about the new device through this B.O.O.K MARK while browsing a local supplier of B.O.O.K on the weekend.

In a Learning 2.0 world, where learning and performance solutions take on a wider variety of forms and where churn happens at a much more rapid pace, what new skills and knowledge are required for learning professionals?” ASTD Learning Circuits big question for July

The Learning Circuits big question this month is an important one, but there seems to be a few questions embedded in it.  Does it ask what new skills are needed by learning professionals due to a wider variety of learning solutions?…or due to more rapid churn?…or due to the implied technology knowledge of the “learning 2.0 world”?  They are related of course, but they do each point to different skill requirements.  As a result answers to the question so far have been enjoyable but a bit a bit helter-skelter.

Harold Jarche nails the “learning 2.0″ aspects of the question with his update of last year’s excellent Skills 2.0 article–especially from a personal learning perspective.  Nancy White highlights general competencies that would be of value to any knowledge worker in today’s workplace.  Mohamed Amine Chatti identifies knowledge networking and double loop learning as critical. I like those.  But again not necessarily specific to the learning professional.  Natalie Laderas-Kilkenny gets closer to skills that are important for the learning professional and says that a learning culture is an important precursor for successful learning 2.0. Right on!

Michael Hanley layers a business view on the question (thank you!) and charts some necessary skills.  I also like Clive Sheppard’s view that we don’t need to tear up the rule book and start again–that our mission remains (organizational performance) but we need to ramp up more quickly on current technology and methods.  Couldn’t agree more.

What Learning Professional?

The question also lumps “learning professionals” into a single group.  Most large training functions have many specialized roles and their skill requirements vary.  So here’s another layer to the big question discussion based on different slices of the “learning professional” roles that are out there.

Generally, most learning professionals will need a combination of these three skills to thrive in the learning 2.0 world.

• User level knowledge of web 2.0 tools and their applications

• Open attitude towards sharing, collaborating, contributing, and personal knowledge management that underlie their effective use.

• Facilitating non-formal and informal learning solutions (technology assisted or otherwise)

How these skills take shape in various learning roles will vary by responsibility.    Here are a few:

Instructors

With over 60% of corporate learning still delivered in the classroom (ASTD 2008 State of the Industry report) there are a lot of instructors out there.  They need to develop sophisticated skills in the facilitating, coaching and mentoring using on-line and web 2.0 tools.  As classroom programs are extended or moved into on-line communities and action learning programs (see couching ourselves for a good example) coaching and facilitating skills will be essential.  Since these communities will focus as much on work as on learning, facilitators will also need a serious understanding of their organizations to maintain credibility in these contexts.

New skills:

• Online facilitation and coaching using web 2.0 and other collaborative tools
• Action learning coaching
• Organizational knowledge and experience

Analysts and Performance Consultants

The long and ponderous needs assessment is dead.  Speed is essential.  Web 2.0 tools can help the analyst. First, the social media environments that communities now operate in can be a rich source of performance data to mine for skill and knowledge gaps and to signal when a team needs to bring more focus to capturing learning and knowledge. There are also many useful web 2.0 orientated tools for data gathering and internal “crowdsourcing” that can be used to collect employee feedback, replace old flipchart voting methods and set priorities.  See UserVoice for example.

Also performance consultants will need to breakdown the traditional “training vs. non-training” solution duo into more nuanced solutions that integrate learning and work. There are powerful levers on the non-training side of that equation than need to be part of the future solution set rather than a casual handoff to another department.

Evaluation takes a different shape in the web 2.0 world as well.  It’s easy to determine performance impact for hard skill programs but the softer learning and knowledge sharing associated with communities and natural learning methods is a bit of a measurement bugaboo.  New ways of measuring learning need to be developed and incorporated into the toolkit.  I think Binkerhoff’s success case method has great promise here.

New skills:

• Web 2.0 tools for data collection and analysis
• Broader understanding of non-formal and informal learning solutions when recommending “non-training solutions”
• Building learning roadmaps and curriculum design efforts to include social learning activities
• Success case method for measuring informal learning programs

Relationship Managers

Most large training functions have generalists that maintain relationships with internal client groups to assess high level needs and assemble teams to meet those needs.   I see opportunities for this role to use web 2.0 tools to both maintain their internal client relationships and to share knowledge with the solution end of their training organization (The matrix model I suggest is here). Possibly one happy community? They will often be the initial discussion regarding learning 2.0 and social networking related solutions.

New skills:

• awareness of the benefits and appropriate use of new web 2.0 tools
• recognize genuine opportunities for learning communities and social media
• educate internal clients on the learning advantages of web 2.0 (and shift mindsets away from traditional learning)

Instructional Designers and e-Learning Developers

I’m not a member of the instructional design is dead clan.  But ID pros certainly need to evolve and incorporate more discovery oriented and natural learning benefits of Learning 2.0.  There is no prescription for learning 2.0 designs as there is for e-learning 1.0 which makes some ID’s uncomfortable, but there are certainly principles and best practices that need to be learned by any ID that wants to stay relevant.

Not all are e-learning developers are instructional designers (and visa versa).  With their stronger technical skills, developers need to up their game in the integration of 2.0 and 1.0 technologies to enable more creative solutions.   Rather than defaulting to a rapid development tool for example, e-learning developers need the skill to develop an effective performance support environment, or to use simple tools to create realistic simulations.  Mobile learning is also growing and is an essential developer skill.

New skills:

• building learning environments vs. courses
• design communities of practice (Can communities of practice be designed?)
• build collaboration into formal programs using web 2.0 tools.
• design formal learning that supports communities of practice
• improved simulation design in order to better integrate learning and work.
• design support for non-formal and informal learning solutions
• build interactive elements into collaborative learning 2.0 designs
• simple but creative simulation technologies
• designs for mobile learning

Learning and Organizational Effectiveness Consultants

More than the technology of web 2.0 it’s the methods of informal and social learning that they support that have the most potential to change organizations.  Learning consultants and OD specialist are at the heart of this.  They need to work together more under a common umbrella. My idea of a learning consultant is more akin to the OD or Organizational Learning professional that get inside the organization and facilitate change and learning through workflow re-design, change management efforts and action learning.

New skills:

• action learning
• systems thinking and improvement tools
• building communities of practice
• Senge styled organizational learning
• social media tools to support the above

Learning Unit Directors and Leaders

Learning department leaders need to provide the resources to develop their team in line with the above.  The learning unit is a team of knowledge workers that must model the solutions they are recommending to their internal clients.  Learning unit leaders need the skills to make this happen.  More than providing web 2.0 tools they need to encourage and participate in their own learning communities.  They also need to manage their unit as a system.  Since their team (like most knowledge workers) will know more than they do about learning and performance, they need to learn how to manage the “system” and provide vision and direction more than the manage the “people”.  That means building workflow, measures and structures with their team that produces real results from the unit.

New skills:

• manage the learning organization as a system
• leadership (not micromanagement)
• resources to model, experiment and innovate new learning approaches with in the learning unit.
• web 2.0 tools

e-Learning Suppliers and Vendors

e-Learning vendors (authoring tools, LMS/LCMS, consulting services) have started to add social media tools as wrappers for their web 1.0 offerings but there are few native web 2.0 applications and solutions.   Whether we like it or not, the vendor world plays a big role in shaping technology based learning solutions.

Vendors, suppliers and consultants need new skills in recognizing market opportunities and provide solutions that push the envelop.  Where is the content designed for use within learning communities for example, or a community platform for leadership team development?  People are throwing them together using standard open source or proprietary social media tools but it would be nice to see some platforms/service that offer unique service by skill type the way we see traditional training program offerings.

New skills:

• recognizing new learning 2.0 market opportunities
• solutions and offerings built on web 2.0 values and platforms
• external cross-industry learning communities
• flexible content for role or discipline based communities (ex. Management communities, consulting communities, technical communities etc)

Summary

As Clive Sheppard said, our mission is still improving performance.  Web 2.0 focused discussions like this tend to put technology out front, which is a mistake we’ve made before. Web 2.0 and social media (more importantly the collaboration and sharing they enable) offers us genuine new opportunities for improving performance but they are just one of many important skills needed by learning professionals today.