Instructional Design: Science, Art and Craft

2010 January 6
by Tom Gram

Happy New Year!

I’ve was reading some Henry Mintzberg over the holidays.  His recent books–Managing and Managers Not MBA’s–both question prevailing thinking on management and leadership and present alternatives for effective management practice and development.  Both books include a model of management as a balancing act between science, art and craft. His argument is that effective management requires all three and an overemphasis on any one results in dysfunction.

I think it also offers some insight to effective Instructional Design.  Much of the recent debate regarding Instructional Design models and practice (see my own view here) seem to revolve around the prescriptive, process based models of ADDIE (and like models) versus  more open constructivist approaches, presumably more relevant for our networked and collaborative work environments.   The arguments tend to get unnecessarily polarized.  The following table is adapted from a similar one Mintzberg created for defined management styles.  I believe it works equally well for for Instructional Design practice.

Please visit Performance X Design to read the full post….

e-Learning: What’s Hot and What’s Not

2009 November 18

the-computer-demands-a-blog

It’s been a challenge to get back to the blog as I have been finishing Gram Consulting work,  closing out the business and transitioning into a new full time position. Things are starting to settle down and I now hope to get back to posting more regularly. Thanks for the well wishes and inquiries from regular readers since I started the blog.   Onward…

e-Learning: What’s hot, what’s not

I received a request from a colleague last week who is helping a company put together a learning strategy, part of which will focus on e-learning. Her question was this:

what’s hot and what’s not in e-learning these days ?

I gave it a bit of thought and came up with the following lists. I would love to hear your additions or deletions from the list (as would my colleague).

Please visit Performance X Design to read the full article….

CSTD and IFTDO Conference Presentations

2009 October 20
by Tom Gram

This year the Canadian Society for Training and Development (CSTD) and the International Federation of Training and Development Organisations (IFTDO) are combining for a single conference event in Toronto that I’m looking forward to, both as a participant and presenter. Here are some highlights and the dates for my own presentations. I hope some of you can make it!

Tuesday (Oct 19) is dedicated to “Research into Practice”, a topic near and dear to me. All presentations  on Tuesday are based on the theme.   Allison Rosset will discuss the importance of research in guiding instructional practice,  Harold Stolovich on performance improvement research,  Traci Sitzmann on e-learning research and Christine Wihak on what we research tells us about informal learning.

I will be presenting a Trading Post session on Tuesday at 2:00 pm titled Getting Informal: Merging learning and Work through Informal Learning. It will be based on many of the concepts I have presented in this blog, particularly Leveraging the full Learning Continuum and the 10 Strategies for Integrating Learning and Work series.

A Thought Leaders series begins on Wednesday which will include sessions by Marc Rosenberg (on Learning 2.0), Patti Shank (on common errors in learning design) and Bob Morton (on change management).  My new employer (Nexient Learning) is also presenting a case study with Deliotte on Managerial Effectiveness that I’m looking forward to.

I will be presenting on a Learning Technology Thought Leaders panel session on Thursday (20th) titled: Enterprise Solutions, Managing the Training Function.   I’ll be on the panel with Harold Jarche, Sheryl Herle, Sheri Philips and Gary Woodill (from the Brandon Hall team) We will thrash around the pros and cons of Learning Management Systems. The session is moderated by Saul Carliner from Concordia University.  No lack of opinion in that group!  Should be interesting.

Thursday also includes a keynote by Peter Senge whose work I admire and have posted on in the past.

If you happen to be there please stop by one of my sessions and say hello.

CSTD and IFTDO World Conference from CSTD and IFTDO on Vimeo.

New Blog is Up: Performance X Design

2009 October 20

Well I finally have the new blog site up and running over at Wordpress.com.

If you have enjoyed the posts on Gram Consulting, you’ll find more of the same at the new blog.  I’ve moved all the posts and comments from Gram Consulting to the new blog and have borrowed my business tag line from the gram consulting logo for the new name: Performance by Design

pxd_header_lower_

Performance X Design will appeal to learning professionals, performance consultants, e-learning developers, organizational development and HR professionals with a keen interest in improving real performance through their efforts.  Like Gram Consulting, posts will span these disciplines with a common thread how they can be used to create more effective organizations.

  • Designing learning and knowledge systems
  • Designing performance
  • Designing effective organizations

I hope you can take a couple of minutes now and subscribe to the new site.

Click here to visit Performance X Design

Click here to subscribe to Performance X Design in your reader (RSS feed)

Click here to have  Performance X Design posts delivered to you via e-mail

I’m still working on correcting some broken links as I find them, but the site functions and ready for your comments.

I look forward to keeping the conversation going!

Cheers,

Tom

Moving on…but the blog stays.

2009 September 27
by Tom Gram

You’ll notice I’ve stripped my web site down to only the blog entries this week.  This is because I’ve decided to take a full time position and close out Gram Consulting as a business.  I have enjoyed my work over the last few years with clients and associates, so the decision was not an easy one.  I hope to work with many of them again in the future.

The new position however, offers broader opportunity and challenge, including working for an industry leader in corporate learning and development and a great team of people.  My new role is Vice President, Leadership and Business Solutions with Nexient Learning Inc. I ‘ll be managing the consulting, design and development of custom e-learning and performance improvement projects as well as a portfolio of excellent leadership and business skills development programs.

I’m planning to keep the blog alive.  In the next few weeks I plan to move  it to a new home and adjust the format and branding a bit.   It will cover similar ground,  so if you like what you’ve read so far, I hope you follow the new blog after the transition.   I’ll be bringing all the existing posts to the new site.   In the meantime I’ll likely post a few more items to this location.

I’ve truly enjoyed your comments both through the blog and personal connections.  The blog has enjoyed a steady increase in readership since I started a little less than a year ago.  Thank you for that.   I’ve enjoyed the conversation.  I hope we can keep it going.

Cheers,

Tom

Web 2.0 Helping to Generate Measurable Business Value

2009 September 17
by Tom Gram

In an earlier post (For Web 2.0 What’s in the Workflow is What Gets Used), I refered to some ongoing research McKinsey&Company is doing in web 2.0 adoption in the workplace– how and where it is being used and the impact it is having on business.

The research is based an an annual survey of 1700 companies from across the globe in a range of industries and functional areas and has been ongoing now for about three years running.  The Mckinsey Quarterly recently summarized results in an interactive visual chart and as a full article in the McKinsey Quarterly titled How companies are benefiting from Web 2.0: McKinsey Global Survey Results (The article is free but you have to join the free membership to see it in full).

The following chart from the interactive feature summarizes how web 2.0 technologies are being used for some internal purposes including managing knowledge and training.   Internal blogs and wikis are being used significantly for Managing Knowledge. For Training uses the highest categories are Podcasts and Video Sharing (unfortunately the most  presentation oriented technologies of the bunch).   Social Networking is being used extensively for fostering collaboration and identifying and recruiting talent.

McKinsey_chart_knowledge

Click to access the McKinsey interactive chart

If you go to the interactive feature be sure to listen to the “about this research” audio snippet.  It provides a brief summary of the research and findings across three years.   Some conclusions McKinsey draws:

  • an increasing number companies are adopting web 2.0 technologies
  • more companies will start to use them for wider purposes including customers, internal employees and suppliers
  • uses will continue to evolve and get better at deriving business value

the striking result is that 2/3 of the companies are deriving measurable business value.

McKinsey summarizes:

“This year’s survey turned up strong evidence that these advantages are translating into measurable business gains.  When we asked respondents about the business benefits their companies have gained as a result of using Web 2.0 technologies, they most often report greater ability to share ideas; improved access to knowledge experts; and reduced costs of communications, travel, and operations.  Many respondents also say Web 2.0 tools have decreased the time to market for products and have had the effect of improving employee satisfaction”.

Poor Scholar’s Soliloquy

2009 September 14

Here’s an article written in 1944 by Stephan M. Cory (University of Chicago January 1944 edition of Childhood Education).   It is a classic satire written in the first person of a seventh grade student discussing his experiences in elementary school.

I think it’s a great example of the contrast of learning in rigid formal environments and learning in the context of meaningful problems and authentic tasks.   The focus is public education but it’s not a stretch to extend to classroom training in the workplace.

—————————————————–

No, I’m not very good in school. This is my second year in the seventh grade, and I’m bigger and taller than the other kids. They like me all right, though, even if I don’t say much in the classroom, because outside I can tell them how to do a lot of things. They tag me around and that sort of makes up for what goes on in school.

I don’t know why the teachers don’t like me. They never have very much. Seems like they don’t think you know anything unless you can name the books it comes out of. I’ve got a lot of books in my room at home-books like Popular Science Mechanical Encyclopedia, and the Sears & Wards catalogues–but I don’t sit down and read them like they make us do in school. I use my books when I want to find something out, like whenever mom buys anything second-hand I look it up in Sears or Wards first and tell her if she’s getting stung or not. I can use the index in a hurry.

In school, though, we’ve got to learn whatever is in the book and I just can’t memorize the stuff. Last year I stayed after school every night for two weeks trying to learn the names of the presidents. Of course, I knew some of them–like Washington and Jefferson and Lincoln, but there must have been thirty altogether, and I never did get them straight. I’m not too sorry though, because the kids who learned the presidents had to turn right around and learn all the vice-presidents. I am taking the seventh grade over, but our teacher this year isn’t so interested in the names of the presidents. She has us trying to learn the names of all the great American inventors.

I guess I just can’t remember the names in history. Anyway, this year I’ve been trying to learn about trucks because my uncle owns three, and he says I can drive one when I’m sixteen. I already know the horsepower and number of forward and backward speeds of twenty-six American trucks, some of them Diesels, and I can spot each make a long way off. It’s funny how that Diesel works. I started to tell my teacher about it last Wednesday in science class when the pump we were using to make a vacuum in a bell jar got hot, but she, didn’t see what a Diesel engine had to do with our experiment on air pressure, so I just kept still. The kids seemed interested though. I took four of them around to my uncle’s garage after school, and we saw the mechanic, Gus, tear a big truck Diesel down. Boy does he know his stuff!

I’m not very good in geography either. They call it economic geography this year. We’ve been studying the imports and exports of Chile all week, but I couldn’t tell what they are. Maybe the reason is I had to miss school yesterday because my uncle took me and his big truck down and we brought almost 10 tons of livestock to the Chicago market.

He had told me where we were going, and I had to figure out the highways to take and also the mileage. He didn’t do anything but drive and turn where I told him to, Was that fun. I sat with a map in my lap, and told him to turn south, or southeast, or some other direction. We made seven stops, and drove over 500 miles round trip. I’m figuring now what his oil cost, and also the wear and tear on the truck–he calls it depreciation–so we’ll know how much we made.

I even write out all the bills and send letters to the farmers about what their pigs and beef cattle brought at the stockyards. I only made three mistakes in 17 letters last time, my aunt said, all commas. She’s been through high school and reads them over. I wish I could write school themes that way. The last one I had to write was on, “What a Daffodil Thinks of Spring,” and I just couldn’t get going.

I don’t do very well in school in arithmetic either. Seems I just can’t keep my mind on the problems. We had one the other day like this:

If a 57 foot telephone pole falls across a cement highway so that 17 3/6 feet extended from one side and 14 9/17 feet from the other how wide is the highway?

That seemed to me like an awfully silly way to get the width of a highway. I didn’t even try to answer it because it didn’t say whether the pole had fallen straight across or not.

Even in shop I don’t get very good grades. All of us kids made a broom holder and bookend this term, and mine were sloppy. I just couldn’t get interested. Mom doesn’t use a broom anymore with her vacuum cleaner, and all our books are in a bookcase with glass doors in the living room. Anyway, I wanted to make an end gate for my uncle’s trailer, but the shop teacher said that meant using metal and wood both, and I’d have to learn how to work with wood first. I didn’t see why, but I kept still and made a tie rack at school and the tail gate after school at my uncle’s garage. He said I saved him ten dollars.

Civics is hard for me, too. I’ve been staying after school trying to learn the “Articles of Confederation” for almost a week, because the teacher said we couldn’t be a good citizen unless we did. I really tried, though, because I want to be a good citizen. I did hate to stay after school because a bunch of boys from the south end of town have been cleaning up the old lot across from Taylor’s Machine Shop to make a playground out of it for the little kids from the Methodist home. I made the jungle gym from old pipe. We raised enough money collecting scrap this month to build a wire fence clear around the lot.

Dad says I can quit school when I am sixteen, and I am sort of anxious because there are a lot of things I have to learn–and as my uncle says, I’m not getting any younger.

ADDIE is dead! Long live ADDIE!

2009 September 9

flogging-dead-horseI’m at risk of flogging a very dead horse here, but some recent posts from Ellen Wagner (What is it about ADDIE that makes people so cranky?) and Donald Clark (The evolving dynamics of ISD and Extending ISD through Plug and Play) got me thinking about instructional design process and ADDIE in particular (please  don’t run away!).

Ellen’s post focused on how Learning Designers on a twitter discussion got  “cranky” at the first mention of the ADDIE process (Analysis, Design, Development, Implementation and Evaluation).  On the Twitter #Lrnchat session  participants had a gag response to the to the mere mention of ADDIE (sound familiar?).  Don responded with some great comments on how ISD (ADDIE) has evolved and adapted.

Much of my career has been involved in applying ADDIE in some form or other and I’ve landed on a conflicted LOVE/HATE relationship with it that that you, lucky reader, will now be subjected to .

addie_model

HATE (Phase A, Step 3.2.6)

Throughout the 90’s many Instructional Designers and e-Learning Developers (me included) grew disgruntled with ADDIE (and its mother process Instructional Systems Design—ISD) as training struggled to keep up with business demands for speed and quality and as we  observed process innovations in software and product development field (Rapid Application Development, Iterative prototyping etc).

In 2001 that frustration was given voice in the seminal article “The Attack on ISD” by Jack Gordon and Ron Zemke in Training Magazine.

The article cited four main concerns:

  • ISD is too slow and clumsy to meet today’s training challenges
  • There’s no “there” there. (It aspires to be a science but fails on many fronts)
  • Used as directed, it produces bad solutions
  • It clings to the wrong world view

I have memories of early projects, driven by mindless adherence to ISD, where I learned the hard way, the truth in each of these assertions.  As an example of what not to do and a guard against blowing my brains out in future projects,  for years I have kept an old Gagne style “instructional objective” from an early military project that would make your eyes burn.

Early ISD/ADDIE aspired to be an engineering model.  Follow it precisely and you would produce repeatable outcomes.  The engineering model assumes a “one best way” and the one best way of the time was grounded in the science of behavioral psychology and general systems theory.  The “one best way” thinking appealed to the bureaucratic style of the times but it couldn’t be more of an anathema to the current crop of learning designers, especially those focused on more social and constructivist approaches to learning.  And they are right.

Another criticism of ADDIE I have parallels Ellen’s comments.  Adherents and crankites alike view ADDIE as an “instructional design” methodology when in fact it should be viewed more as a project management process for learning projects.  Viewing  Instructional Design as synonymous with ADDIE does both a disservice.  There is loads of ID going on inside ADDIE but it is primarily in the Design phase of the process, and it can be much more creative than the original model prescribes.

In the end, the Achilles heel of formal ISD/ADDIE rests in its prescriptive posture and foundation in behavioural psychology.  Behavioural psychology and performance technology–its extension in the workplace–have added greatly to our understanding how to improve human learning at work, but we have learned much since then, and technology has provided tools to both designers and learners that profoundly change the need for a process like ADDIE.

Of course the ADDIE process was (and is) not unique to the learning design profession.  For many years the five broad phases of ADDIE were the foundation for the design of most systems.  Software engineering, product development, interactive/multimedia development are all based on some variation of the model.   Most however have evolved from the linear “waterfall” approach of early models (can’t start the next phase until the previous has been done and approved) to iterative design cycles based on rapid prototyping, customer participation in the process and loads of feedback loops built into the process.  And learning/e-learning is no different.  It has evolved and continues to evolve to meet the needs of the marketplace. Much of the current gag reaction to ADDIE, like that experienced by Ellen, is based on the old waterfall-linear approach and the assumed instructivist nature of the model.  And again the gag is entirely valid.

However, if you can break free from the history, preconceptions and robotic application of ADDIE, you may find room for something approaching…

LOVE (Phase B, Step 2.3.7)

I can’t say I ever use ADDIE in its purest form any longer.  For e-learning and performance applications, I prefer processes with iterative design and development cycles that are usually a variation of rapid application development process like this one from DSDM.

DSDM_lifecycle

Or for an example specific to e-learning,  this process from Cyber Media Creations nicely visualizes the iterative approach:

Rapid Development Cycle

Source: http://myonlineelearning.blogspot.com/

Or for the Michael Allen fans out there, his Rapid Development approach described in Creating Successful e-Learning is very good.  There is a respectful chapter in the book on the ADDIE limitations and how his system evolved from it.

But at the heart of all these processes are the familiar phases of analysis, design, development, implementation and evaluation,  albeit cycling through them many times along the way.

For me ADDIE has become a useful heuristic,  not even a process really, but a framework for thinking,  coaching instructional designers,  and managing learning and e-learning projects.  Many e-learning designers these days are not formally trained in Instructional Design and initially think of it as instructional “writing” more than the holistic and systemic approach at the heart of ADDIE.   Likewise customers and subject matter experts are much easier to work with once they understand the broad project process that ADDIE represents.  For these two purposes alone I am thankful for ADDIE as a framework .  ADDIE has staying power because of it’s simplicity.  Purists will say it has been watered down too much but in many ways that’s what keeps it alive.

ADDIE phases are also a useful way to think about organization design and structure of a learning function.  They are the major processes that need to be managed and measured by most learning functions.  Just think of the functionality of most LMS systems have added since their inception.

In the end ADDIE (and its more current modifications) is probably most valuable because it makes the work of learning design visible. This is an essential feature of productive knowledge work of all kinds.   Almost every learning/training group uses a ADDIE as a start point to design a customized process that can be communicated,  executed,  measured and repeated with some level of consistency.  Equally important in knowledge work is the discipline of continually improving processes and breaking through to better ways of working.  This has resulted in the many innovations and improvement to the ADDIE process since its inception.

SUMMATIVE EVALUATION (Phase E, Step 5.2.3)

I’ve come to believe that the power of ADDIE/ISD lies in the mind and artful hands of the user.  In my experience Rapid Application Development processes can become just as rigid and prescriptive under the watch of inflexible and bureaucratic leaders as ADDIE did.

There’s an intellectual fashion and political correctness at work in some of the outright rejection of ADDIE.  It’s just not cool to associate with the stodgy old process.  Add Web 2.0, informal and social learning to the mix and some will argue we shouldn’t be designing anything.

For the organizations I work with, there is no end on the horizon to formal learning (adjustments in volume and quality would be nice!).  Formal learning will always require intelligent authentic learning design, and a process to make it happen as quickly and effectively as possible. If instead of  the irrelevant old geezer in the corner waving a disapproving finger,  we think of ADDIE more like a character from Mad Men, maybe we can refresh the image a bit.

Simulation and Immersive Learning

2009 August 24

Here’s a nice example I stumbled on this week that illustrates the transition that training needs to make.

A few years ago the UPS driver training unit had a mini-revolt on its hands from younger drivers who were unhappy with the long traditional classroom-based training program required for new drivers.  The program was experiencing increasingly higher failure rates and the number of tasks that had to be learned was becoming too much for classroom delivery.  Peggy Emmart, corporate schools coordinator of UPS corporate training and development department commented “while in the early ’90s our DSPs (drivers) may have needed to concentrate on eight key tasks each day, they now routinely perform 30 to 40 major tasks within the same time frame.”

UPS responded by completely overhauling the driver training program into a simulation and immersion based experience called UPS Integrad.  It included a training facility that incorporated a mix of e-learning, simulations, virtual learning, and immersive learn by doing.

Here is a video feature from ABC news on the program. Click the image to take you to the video. There is a short ad first–be patient (sorry I couldn’t embed it).

UPS Integrad ABC News Video profile (click to link)

UPS Integrad Video profile (click to link)

Results

The Integrad program has “exceeded expectations” in all three of the program’s primary goal areas, which include enhanced DSP safety, decreased new driver turnover, and accelerated time to proficiency.

“It wasn’t about video games, it was about providing hands-on application and allowing trainees to learn by doing in a way that connects unambiguously with their jobs”.

When UPS originally started the re-design effort they thought the answer to training younger workers was going to be video game-type training.  Through additional research, they learned it wasn’t about video games, it was about “providing hands-on application and allowing trainees to learn by doing in a way that connects unambiguously with their jobs”.  I think this is a useful caution to e-learning designers moving down the path video game style instruction.

Here’s an article that describes the program in more detail:  UPS Moves Driver Training From the Classroom to the Simulator

But is it appropriate for knowledge workers?

The UPS program is an example of mostly physical or psychomotor learning,  but the lessons hold true for knowledge work as well.  For managers to learn “problem solving and decision making” they need to make decisions and solve real work problems first in a simulated setting and then in real work context with feedback and coaching.   New consultants need to consult; learning designers need to design learning, engineers need to design and test solutions all within safe, feedback rich, immersive work contexts.

As UPS summarized so simply, “The point of all this hands-on instruction is to simulate-as closely as possible-exactly what it’s like to be a…”fill in the blank“.

just say no :)

Just say no :)

Deliberate Practice, Learning and Expertise

2009 August 14

I’m back from some vacation where I read Malcolm Gladwell’s Outliers on the beach at our cottage (along with some very funny David Sedaris).

Even if you haven’t read Outliers yet you probably know that it sets out to dispel myths that intelligence or innate ability are the primary predictors of success.  Instead,  Gladwell summarizes research and provides examples to show that it is hours and hours of practice (10,000 to be exact) and a “practical intelligence” (similar in concept to emotional intelligence) acquired through experience that are the real determinants of success.

Gladwell covers similar territory (and draws on the same research) as Geoff Colvin’s Talent is Overrated: What Really Separates world Class Performers from Everybody Else, another excellent book that elaborates on an article Colvin wrote for Fortune magazine a few years ago: “What it Takes To Be Great”.

Both books debunk the assumption that “gifted” skill and great performance comes from innate talent, personal traits or hard wired competencies and ability.  The research Galdwell and Colvin draw on is impressive.  Both point to the extensive work of K. Anders Ericsson at Florida State University.  Ericsson has conducted years of rock solid research on the role of “deliberate practice” in the acquisition of expert performance.  If you like to seek out source research as I do, then you’ll enjoy Ericsson’s (and others) impressive work that has been collected in the Cambridge Handbook of Expertise and Expert Performance. Here is an earlier (and less hefty) review on some of the same research: “Deliberate practice” in the acquisition of expert performance.

At the core of these works is the concept of “deliberate practice” over longs periods of time (up to ten years).  While impossible to boil down the theory into a few points, here it is…uh…boiled down into a few points.   Highly skilled performance in all aspects of life and work can be developed by the rough equivalent of 10,000  hours (10 years or so) of increasing specific, targeted and mindful practice in a domain of expertise. The practice must be:

  • Specific & technique-oriented
  • Self regulated
  • Involve high-repetition
  • Paired with immediate feedback on results
  • Isn’t necessarily “fun”, (in fact can be grueling hard work)

“Deliberate practice is activity designed specifically to improve performance, often with a teacher’s help; it can be repeated a lot; feedback on results is continuously available; it’s highly demanding mentally, whether the activity is purely intellectual, such as chess or business-related activities, or heavily physical, such as sports; and it isn’t much fun.
From: Talent Is Overrated: What Really Separates World-Class Performers from Everybody Else .

Where Gladwell and Colvin focus on how an individual (you!) can use deliberate practice to improve and achieve the success you want,  Learning Professionals should be thinking about how to use the ideas to help others develop and grow the expertise needed by the organizations we support.  Ericsson has something to say here as well, having recently published a new book on how to design learning environments to develop and measure expertise– Development of Professional Expertise: Toward Measurement of Expert Performance and Design of Optimal Learning Environments.  In a time when learning/instructional design has become generalized and de-professionalized to the point of non-existence, it’s refreshing to see a serious treatment that moves the profession forward.

Using “Deliberate Practice” to Improve Workplace Performance

Here are 10 ideas that just scratch the surface on how Learning Professionals can use “deliberate practice” to improve workplace skill and performance.

  1. Move from “mastery learning” to designing practice with feedback over longer periods of time (from learning events to a learning process). Deliberate Practice differs from the concept of ‘Mastery Learning” at the heart of much instructional design.  Mastery learning assumes a skill is perfected (or at least brought to a defined standard) in a fairly short period of time often within the scope of a single course. The complex professional skills of modern knowledge workers and managers demand a stronger focus on long term practice and feedback and building learning around long term objectives.
  2. Develop the person. Time, practice and individualized feedback imply a long term focus on individuals rather than on jobs or roles.
  3. Informal learning efforts like action learning, coaching and are cognitive apprenticeships are critical but they must be focused on practice and immediate feedback and extend over long periods of time.
  4. Relevant, frequent and varied practice must be the dominant and most important element in all formal training programs.
  5. Practice opportunities must extend far beyond initial training programs, to allow people to hone their skills through experimentation with immediate feedback.
  6. Create practice sandboxes and simulation centres for key organizational skills where people can practice their skills and experience immediate feedback in safe environment.
  7. Design visual feedback directly into jobs so professional can immediately see the results of their work.  In this way working IS deliberate practice.
  8. Turn training events into the first step of a learning journey that will continue to provide opportunities to practice and refine skills throughout a career.
  9. Identify the interests and strengths of people nurture them through opportunities for deliberate practice. Provide resources and support that encourage early effort and achievement.
  10. Ensure social media environments provide opportunities for coaching and mindful reflection on performance.