AI on L&D

I interviewed ChatGPT on its view of L&D’s biggest issues. The answers were what you expect from any new boss; diplomatic, helpful and kinda good.

You can’t open a news feed, newspaper or magazine without seeing ChatGPT discussed, reviled, lauded or feared. As a person whose currency is words in the form of product ideas, business analysis, innovative concepts and learning strategies, I was very curious to see how ChatGPT might be impacting learning development in the coming year. ChatGPT has already been used to create movie scripts, music videos, novels written in the style of our favorite authors, research papers and test exams. It certainly won’t be long until others like me begin to use the tool to create learning experiences.

Full transcript of my interview with ChatGPT can be found below

The immediate implications are similar to what musicians have seen with ProTools and doctors have experienced with WebMD. ProTools allows anyone to make studio quality music. Not necessarily good music, but studio quality. This has caused a glut of new music to appear, pushing the perceived value of content towards zero while adding to the value of curation, critics and marketers.  WebMD democratizes information creating challenges to a doctor’s expertise. WebMD makes every patient feel as if they know as much as their physician about diagnosis and treatment.  Both of these dynamics will be on display for all domains that traffic in content. 

For L&D this means that the amplification of the pre-existing perception of business leaders that they know what learning they need combined with SME’s ability to create pro “quality” learning via a few prompts will exacerbate the internal challenges faced by L&D organizations.

Overall, I find GPT to be a game changer when it comes to my personal workflow. It has allowed me to move rapidly from idea to strawman as well as providing me with solid documentation of my journeys down various rabbit holes. What was formerly a simple sketch and a handful of thoughts in a notebook is now instantly transformed into shareable, testable, and even monetizable ideas. I am currently experimenting with ChatGPT as an assistant to my learning design process. More on that in the coming days.

With all this potential and buzz I thought it would be fun to ask ChatGPT what its thoughts were on learning development. Below are some highlights.

The similarities between how AI and employees learn

“AI models are able to learn through self-directed experimentation and exploration, and employees can also benefit from being given the freedom and resources to take a self-directed approach to learning.”

The use of learning in games

“Players reflect on their experiences and decisions, analyzing what worked well and what didn’t. They might compare their performance to others, read game guides, or use trial and error to understand the game mechanics better.”

The value of DE&I

“…diversity can also lead to a deeper understanding of the topic being studied and a more meaningful learning experience.”

Which “Friends” character would L&D be

“Workforce Development could be seen as Ross…”

How can we use AI? How important is L&D? Are you coming for our jobs?                 full transcript below

Let’s be honest. The typical job description role for a learning and development pro contains a number of bullet points that are likely to be replaced by AI in the coming years. L&D, like all workers, needs to take a hard look at what they do that adds differentiated value and quickly turn its focus away from the rest. I have written about the power of range before. This power is magnified by AI. As an industry, our Canva and Articulate skills are going to mean little in a world powered by AI created learning experiences. Our curiosity, creativity, and critical thinking skills will mean much more.

Please enjoy my conversation on L&D with ChatGPT. – j.

Project Dragonfly

Last fall a client asked me to write a quick brief on the book Range. With permission from the client, I am sharing it here.  You can read it below and download it here Dragonfly Concept Design

Enjoy. – j.

Dragonfly

named for an insect whose eye contains thousands of “eyes”, giving it a wide range of perspectives from which its brain constructs its reality and actions.

Project Genesis

Sparked by the release of David Epstein’s book Range, the question that launched the quest was crafted as follows:

“Is there a way to predict employee high performance, and therefore company high performance, by examining the degree to which their path to performance (P2P) is in alignment with the principles outlined in Range?”

Contributing questions include:

  • What performance does business need from its employees?
  • What is the traditional/current/accepted P2P for employees?
  • What are the principles that define the Range P2P?
  • How can we objectively measure the alignment of a company’s current P2P?
  • What are the barriers to organizations adopting a “Range-driven” approach to talent management?

What performance does business need from its employees?

Today’s business environment has been termed and widely accepted as VUCA (volatile, uncertain, complex, ambiguous.)  This environment has placed a premium on organizations that are:

  • Agile – able to quickly deploy and redeploy human capital to emerging needs and opportunities.
  • Experimental – have a culture and resources able to conceive, test and iterate of new hypotheses.
  • Innovative – ability to generate and execute new ideas in order to capture business opportunities.
  • Data powered – human capital is augmented by data for management (ie. performance tracking, succession planning) and the delivery of the above capabilities.

Today’s business environment is as being what Robin Hogarth calls a “wicked domain.”  Wicked domains are defined as having problems that are not readily computable and have feedback loops that are long and may not provide accurate feedback. The answers to wicked problems are unknown at the outset and need to be created. Examples of wicked domains include improvisational jazz, and cancer research.

Net: Today’s business environment requires a P2P that makes human capital “wicked smart” (Boston joke)

 

What is the traditional/current/accepted P2P for employees?

Today’s development paths generally follow two paths depending n the employee.  Designated high potential employees are often provided a wide ranging development path early on in their careers. Business units rotations, projects and even mentorship expose this employee to all aspects of the company as a means of preparing them for future leadership positions. This cohort is typically extremely small relative to the employee base.  

The second path serves the typical employee.  On this path employes, who have been hired for a specific domain experience are funneled into deeper knowledge of that domain.  Sales people receive sales and product training, an operations employee may receive task management and process training wile operators might attend equipment and safety courses.  These trainings, limited to a single domain are associated with the assumption of a kind domain and problems.  

Kind problems are domain-constrained with tight and accurate feedback loops. Unlike the wicked variety, answers to kind problems are known and simply need to be found. Kind doesn’t mean easy, a sport can be kind because you quickly know if you executed the correct stroke. Examples of kind domains include classical music, hernia surgery and chess. Kind domains are are often the best targets for automation. 

Range principles, where existing, are often found in the initial hiring process. In 1991 David Guest introduced the concept of t-shaped skills. The vertical bar of the T refers to expert knowledge and experience in a particular area, while the top of the T refers to an ability to collaborate with experts in other disciplines and a willingness to use the knowledge gained from this collaboration. This concept was further popularised by Tim Brown, CEO of design firm IDEO. While the concept was seen to have value  and gained momentum with HR the concept of developing t-shaped employees never took hold. The priority for most recruiting and promotions involves an emphasis on the vertical domain of the individual.

T-shaped employees provide companies with increased talent agility and mobility. Having an agile workforce can spell the difference between being an industry leader or falling behind. PwC reports that when businesses have development programs that increase agility, 86 percent respond rapidly to changes in the business environment. Without these kinds of programs, only about half do. A Forbes article from earlier this year stated  that talent mobility enables organizations to rapidly adapt to changing environments, with the ability to deploy and move key skills across projects, across the business and across borders when needed. Mobility provides avenues for staff to progress and evolve within an organization, and can lead to 30% better processes and 23% more productivity.

Epstein captures it this way. “Facing uncertain environments and wicked problems, breadth of experience is invaluable.  Facing kind problems, narrow specialization can be remarkably efficient. The problem is that we often expect the hyperspecialist, because of their expertise in a narrow area, to magically be able to extend their skills to wicked problems.  The results can be disastrous.”

Net: Today’s P2P does not fit business to a “T” (I am on a roll)

 

What are the principles that define the Range P2P?

First it is important to acknowledge, as Epstein does multiple times in the book, that while Range-enabled generalists are critical to business success the value of specialists is not diminished.  A multitude of examples are provided showing how generalists draw on the deep expertise of specialists in order to achieve the results delivered. Distilling the book’s insights and translating them to corporate talent management creates three levels of guidance.  The first contains the characteristics of a Rangey(?) path-to-performance (rP2P). The second, is guidance on keys to rangey teams. The final level is focused on the organizations itself.

 

rP2P

The goal of the rP2P is to build polymaths.  Polymaths differ from T-shaped employees in that the emphasis is on the horizontal dimension. A polymath’s breadth is greater than T-shaped human capital while their vertical depth may be less than traditional T-shapes. The polymath’s superpower comes from a range of transferable thinking skills (conceptual, computational, lateral, and ambidextrous for example) that allow for innovative problem solving across multiple domains.  It also includes more tangible skills such as communication, collaboration and anticipatory competencies that drive higher value solutions. The final element of a range-y employee is attitudinal with value-adding polymaths displaying active open mindedness and scientific curiosity. 

The first two principles associated with a Range-aligned P2P focus on the structure and focus of the developmental path. The rP2P contains:

  • A sampling period – This is characterized by what experts often call “unstructured play.”  This feature of the developmental path allows for individuals to experiment in domains other than their own.  In the corporate environment this may be a rotational program or project-based. The unstructured element forces participants to improvise first before learning existing rules.  This is analogous to the way in which humans learn language. We learn the sounds first before we learn the rules of grammar. This element should be designed to provide the participant with experiences that allow them to better understand alternative domains giving them knowledge of resources that may be valuable when facing later challenges as well as exposure and personal knowledge of their interest and proclivity for other areas. 
  • Mechanisms for improving “match quality” – The rP2P should include opportunities for individuals and organizations to re-deploy individuals to domains better suited to their skills, interests, and proclivities. Short-term assignments, internal internships and project participation can be used to serve this purpose.  Up or out development paths serve neither the individual or organization.

The final two principles associated with a Range-aligned P2P focus on the content and presentation of that content on the developmental path. The rP2P contains:

  • Flexible content – Flexible content is content that is both sticky (retained over the long-term) and broadly applicable. Retention of rP2P content is driven by two key factors.  The first is the use of testing. rP2P test questions are connection making in nature versus procedural. Testing should focus on cross domain application, pattern recognition, categorization and decision making. Procedural questions such as “what are the four steps in handling a customer objection?” are minimized in far of questions such as, “what other uses for the customer objection handling process are there?” Stickiness is also enhanced by the use of spacing. Delaying the testing process forces the knowledge to be placed into long-term memory.  End of class assessments are less indicative of future performance than follow up assessments given at a later date.
  • Difficult learning experiences – Learning should include what Nate Kornell calls “desirable difficulties.”  These productive difficulties include creating a generational effect, where participants produce their own answers exclusive of guidance.  Learners benefit greatly from this self-reliant process even if the answer generated is incorrect. Instructors should also be creating environments in which learners struggle. This may include problems beyond learners’ capabilities, mixing multiple areas of new knowledge together to prohibit “block” learning (aka memorization) and assessments in which few learners achieve a passing score.  While this often results in lower instructor/session ratings from participants it has been shown to have significant long-term benefits in retention and performance.

Rangey Groups

While the book focuses primarily on the individual, Epstein highlights two characteristics of high performing groups.

  • Diverse –  High performing groups included a wide variety of participants.  This includes range in:
    • Geography/World view
    • Demographic
    • Experience in domain from novice to expert
    • Domain, but still polymaths not a collection of specialists  
  • Porous boundaries – Groups that performed well were also not walled off from the rest of the organization.  Groups frequently showed improved value when they were able to reach out to specialists across the organization and even outside the organization. 

Rangey Organizations

Example such as 3M are cited in the book as examples of an organization that supports its range-y individuals and teams.  From creating an internal award for innovation to the ways it allows individuals to follow their passions (increased match quality) 3M regularly produces significant innovations across a wide range of domains.  Epstein touches on a few organizational keys.

  • Culture –  3M’s internal award and its talent management approach are operational examples of a culture that sees the value of supporting its rangey employees. By celebrating, facilitating and empowering range, 3M has created a culture that makes it values more than just an annual statement cliche.  
  • Long-term focus – Because range often does not show immediate results the organizations that embrace it must have a longer view.  Think of the innovations that emerged from Amazon and the newly approved LTSE (long-term stock exchange) that clearly states that “Companies that operate with a long-term mindset tend to outperform their peers over time. But going public can pressure even the most visionary founder into a short-term mindset.” 
  • Risk tolerant – Creating new solutions that work often means finding many more that don’t.  Acceptance, even encouragement of failure, and the adoption of an experimental scientific mindset are cornerstones of organizations that deliver higher performance over the long-term.

 

Net: The principles of Range have implications for a number of areas in talent management including; candidate selection, onboarding, development, succession planning and leadership. In order to drive success in today’s wicked environment organizations, and talent management functions that support them, must become an integrated farm (egg-to-soup) for free-range talent. (the roll continues)

 

How can we objectively measure the alignment of a company’s current P2P?

Standard measures for HR practices are in limited supply and often not publicly available. The table below captures some initial thoughts regarding potential metrics/proxies for the various elements of range. Primary research in collaboration with one or more of the partner listed at the end of this section and/or analyst-like interviews focused on HR leaders may also prove useful in the development and testing of a quantitative range “score”. 

 

Dimension Metric/Area of Inquiry
rP2P Sampling
  • Onboarding process
  • Use of project assignments
  • Cross domain rotations 
Match Quality
  • Internal lateral transfers versus upward promotions
  • Use of project assignments
  • Cross domain rotations
  • Former employees now working in another domain
  • Employee satisfaction
  • Employee retention
  • Employee engagement
  • Employee development plans
Flexible Content
  • Learning experience (LXP) design
  • LXP satisfaction scores
  • Cross functional applicability of LXP (multi-audience)
  • Layoffs
Difficult Learning XP
  • Learning experience (LXP) design
  • LXP assessment timing
  • LXP pre/post assessments
  • Instructor ratings
  • Post-LXP performance reviews  
rGroup Diversity
  • Employee census
  • Recruitment procedures
  • Job requirements (narrow/broad)
Porous Boundaries
  • Resource sharing policies
  • Use of outside experts/consultants
rOrg Culture
  • Employee survey
  • Leadership characteristics
Long-term Focus
  • Strategic plan
  • R&D spend

What are the barriers to organizations adopting a “Range-driven” approach to talent management?

While the value of rangey practices are widely documented, adoption of the proven practices face a number of challenges.  Some of these challenges are documented below.  This list is not meant to be all-inclusive as it excludes any number of organizational structure, compensation and process barriers.

  • Slow thinking requires a longer payback period – As is the case in spacing of testing where immediate results may be poor while results produced further out exceed the current P2P so it is with much of the range principles.  Organizations and other stakeholders (HR, Management) may find it difficult to “stay the course” without near-term ROI.
  • Spacing assessments is less rewarding to learners – Individuals often do not receive the immediate gratification of progress and success when participating in a rP2P. Without buy-in from individuals to the range approach and the safety of knowing that their immediate performance will not be seen as a negative by the broader organization individuals may not actively engage in the path.
  • The result of increased match quality (job switching) can make individuals feel like they are falling behind – Job switching, often the result of seeking improved match quality may leave individuals feeling behind their peers.  The concept of sunk cost, time and energy committed to a pre-switch domain, may make individuals and organizations reluctant to follow through with match optimization. 
  • Misaligned metrics (learner satisfaction, post-assessment scoring) reward non-rangey principles – Current P2P metrics are short-term oriented and in many cases run contrary to effective implementation of range principles. Changes to how rP2P facilitators (recruitment, development, management) are necessary in order to properly measure range-y progress.
  • Lack of obvious linkage to near-term business results – Rangey performance often delivers value in unexpected areas/was.  Measurement and management of impact on wicked problems must be different than on kind ones.  New product development (connected/wicked) should have a set of metrics distinct from new store openings (procedural/kind).  
  • Short-term perception of poor performance – Public company cadence (quarterly) may inhibit the longer term investment in a rP2P.

Net: Lots of fences between the herd of sheep and the range. “Just let me know if you wanna go to that home out on the range. They got a lot of nice girls.” – ZZ Top

 

Final Thoughts

After reviewing the publicly available research used for the compilation of this document I believe the following to be true:

  • “Wicked” is an accurate description for an ever increasing portion of the business environments and the “kind” portion will increasing face the pressures of automation and commoditization.
  • The companies that win in a wicked world win exhibit a significantly higher degree of “range”.
  • Adoption of range positive dimensions require significant change for both the individual seeking to increase their personal range and companies seeking to provide a range-enabling organization.
  • The current structure for talent development and management is designed for the creation of specialists and ill-prepared for a shift to polymath focused human capital.
  • With additional work there exists an opportunity to capture or create qualitative and quantitative metrics for assessing range on both the individual and organization levels.

 

DOWNLOAD BRIEF: Dragonfly Concept Design

Open Source

I just re-read Walter Isaacson’s “The Innovators”, a wonderful history of the people and events that made the digital age possible. In it he describes the creation of the software industry and the early formation of two camps. One thought that software should be free, describing the hobbyists that openly shared code between another. He even noted that that Wozniack’s early schematics for what would become the core of the Apple 1 computer were given away free by Woz at community meetings. The second camp, characterized best by Bill Gates, saw the protection of intellectual property as key to supporting future innovation.

For the open community, allowing innovations to be shared allowed for rapid adoption and accelerated advancement. Innovators didn’t need to recreate a solution that had already been found and could instead focus on building upon it. Also, by adopting an open approach an entire community became an extension to the development team. The opposing camp felt that without compensation innovation could not be supported. I see both sides and as a former interim-CEO for a music technology company, an industry where rights are front and center, feel strongly that the creator has the right to choose, and that choice must be respected.

As I came to complete the book Running Training Like a Startup I realized that I now had to make this choice. I could publish the book, thereby monetizing my efforts or I could give it away. When I work with startups I often refer back to a presentation on startup success that I saw during the first dotcom run that simply stated CFIMITYM. Cash flow is more important than your mother. Without cash flow, a startups life is on the clock. Many startups, even those so-called “unicorns” that are now going public, often chose another path. Monetization slows growth and adoption. “We can always monetize once we have a million users,” they say. And so, the freemium model, where there is a free tier of services available, was born. Once a user has seen the value of the product, they can upgrade to a paid tier later. When I was at Forum we called this “earning the right” in our sales training.

I believe strongly in the value that Running Training Like a Startup can contribute to the industry. I think that upskilling is the number one challenges facing the world. I believe that more minds, not a select few, will accelerate our industry’s ability to overcome this challenge. I also know that at the pace of business today reinventing the wheel will not cut it. For this reason, I have decided to open source the book. Feel free to download it, share it, discuss it, build on and improve its concepts with your own. I will be doing the same. This blog will continue to document my evolving thoughts on the concepts presented in v1 and I am committed to sharing my learnings with our community. All I ask is that you do the same.

Open source book here

Pull Versus Push

In order to deliver more value, Learning & Development organizations should adapt from supporting learning in a “push” environment to supporting learning in a “pull” environment.  For the book I explored what we can learn from successful startups.  This includes some of the new competencies required of a L&D team in order to deliver unmistakable value.  One of these new competencies is marketing.  In a world where learners are often pulling support from sources like YouTube or other resources on the web, L&D needs to ensure that its solutions have the attention of its learners too.

Historically, organizational learning was pushed to learners via compliance requirements, development plans and corporate-wide initiatives. Today’s environment requires L&D to make its solutions desirable for learners to pull.  This means more than having another table in the cafeteria or sending out another email.  For learners to want to pull L&D’s solutions they, like any consumer, must see that the value outweighs the cost. Time is money to employees, managers and executives alike.  They will decide where to spend it.

This shift requires L&D to look at all aspects of its solutions and the tools they use to ensure that they are both relevant to the business and appealing to learners. Everything from the descriptions in the LMS to the structure of the solutions themselves will need to be reconsidered. The low utilization rates for elearning catalogs, frequently available to all employees on demand, are a solid proof point that more than access is needed for learning solutions to to be “pulled” by the learners that need it.

We do not see marketing as a necessary evil.  Rather we see it as a required value creator. L&D is doing a disservice to its customers if the higher quality learning solution does not win the battle for the learner’s investment. Salespeople are known to say that you do not sell something.  Rather, you help the customer buy the right solution.  L&D has to get better at helping its learners buy smarter. Today L&D is trying to come up to speed on new technologies, data and more.  As learning professionals, we are being asked to learn a lot of new tricks.  But learning is what we do best, right?