How I Use AI to Understand Humans (and Cut Research Time by 80%)

How I Use AI to Understand Humans (and Cut Research Time by 80%)

AI is NOT a substitute for person-to-person discovery conversations or Jobs to be Done interviews.

But it is a freakin’ fantastic place to start…if you do the work before you start.

Get smart about what’s possible

When ChatGPT debuted, I had a lot of fun playing with it, but never once worried that it would replace qualitative research.  Deep insights, social and emotional Jobs to be Done, and game-changing surprises only ever emerge through personal conversation.  No matter how good the Large Language Model (LLM) is, it can’t tell you how feelings, aspirations, and motivations drive their decisions.

Then I watched JTBD Untangled’s video with Evan Shore, WalMart’s Senior Director of Product for Health & Wellness, sharing the tests, prompts, and results his team used to compare insights from AI and traditional research approaches.

In a few hours, he generated 80% of the insights that took nine months to gather using traditional methods.

Get clear about what you want and need.

Before getting sucked into the latest shiny AI tools, get clear about what you expect the tool to do for you.  For example:

  • Provide a starting point for research: I used the free version of ChatGPT to build JTBD Canvas 2.0 for four distinct consumer personas.  The results weren’t great, but they provided a helpful starting point.  I also like Perplexity because even the free version links to sources.
  • Conduct qualitative research for me: I haven’t used it yet, but a trusted colleague recommended Outset.ai, a service that promises to get to the Why behind the What because of its ability to “conduct and synthesize video, audio, and text conversations.”
  • Synthesize my research and identify insights: An AI platform built explicitly for Jobs to be Done Research?  Yes, please!  That’s precisely what JobLens claims to be, and while I haven’t used it in a live research project, I’ve been impressed by the results of my experiments.  For non-JTBD research, Otter.ai is the original and still my favorite tool for recording, live transcription, and AI-generated summaries and key takeaways.
  • Visualize insights:  Mural, Miro, and FigJam are the most widely known and used collaborative whiteboards, all offering hundreds of pre-formatted templates for personas, journey maps, and other consumer research templates.  Another colleague recently sang the praises of theydo, an AI tool designed specifically for customer journey mapping.

Practice your prompts

“Garbage in.  Garbage out.” Has never been truer than with AI.  Your prompts determine the accuracy and richness of the insights you’ll get, so don’t wait until you’ve started researching to hone them.  If you want to start from scratch, you can learn how to write super-effective prompts here and here.  If you’d rather build on someone else’s work, Brian at JobsLens has great prompt resources. 

Spend time testing and refining your prompts by using a previous project as a starting point.  Because you know what the output should be (or at least the output you got), you can keep refining until you get a prompt that returns what you expect.    It can take hours, days, or even weeks to craft effective prompts, but once you have them, you can re-use them for future projects.

Defend your budget

Using AI for customer research will save you time and money, but it is not free. It’s also not just the cost of the subscription or license for your chosen tool(s).  

Remember the 80% of insights that AI surfaced in the JTBD Untangled video?  The other 20% of insights came solely from in-person conversations but comprised almost 100% of the insights that inspired innovative products and services.

AI can only tell you what everyone already knows. You need to discover what no one knows, but everyone feels.  That still takes time, money, and the ability to connect with humans.

Run small experiments before making big promises

People react to change differently.  Some will love the idea of using AI for customer research, while others will resist with.  Everyone, however, will pounce on any evidence that they’re right.  So be prepared.  Take advantage of free trials to play with tools.  Test tools on friends, family, and colleagues.  Then underpromise and overdeliver.

AI is a starting point.  It is not the ending point. 

I’m curious, have you tried using AI for customer research?  What tools have you tried? Which ones do you recommend?

The Positive Power of ‘Negative’ Emotions in Driving Change

The Positive Power of ‘Negative’ Emotions in Driving Change

You want to make life better for others. This desire is reflected in the optimism and positivity of your language – create value, love the problem, and delight the customer.  But making life better requires change, and, as the adage goes, “People want change, but they don’t want to be changed.”

You are confident that the solution you created will make life better and that the change people need to make is quite small and painless, well worth the dramatic improvement you offer.  Yet they resist.  No amount of explaining, showing, convincing, or cajoling changes their mind.  What else can you do?

To quote Darth Vader, “Give yourself to the Dark Side.  It is the only way to save your friends.”

“If only you knew the power of the Dark Side…”

The Dark Side is populated by “negative” emotions like anger, fear, and frustration, which are incredibly powerful.

Consider that:

Unfortunately, these are also some of the first emotions experienced when confronting change.   

Change requires people to let go of what they know in exchange for the promise of something better.  This immediately triggers Loss Aversion, the cognitive bias in which the pain of losing is psychologically twice as powerful as the pleasure of gaining. 

As a result, people won’t let go of what they know until the pain of holding on becomes unbearable.  When you point out the problems and pain of the current situation, you help people understand and experience the unbearableness of the current situation. 

“Anger, fear, aggression; the Dark Side of the Force are they”

Not every “negative” emotion elicits the same behavior, so carefully choose the one to tap into.

Fear motivates people to seek safety, which can be good if your solution truly offers a safer alternative.  It’s a motivator used well by companies such as Volvo, SimpliSafe, and Graco.  But lean on it too much, and people may feel overwhelmed and remain frozen to the status quo.

Anger motivates people to take risks, which can be good when the change requires bold decisions and dogged persistence.  It can be great when it bonds people together to achieve a shared goal or protect a common value.  Apple used this emotion to brilliant effect in its famous “1984” commercial announcing the launch of Macintosh.  But incite too much anger, and things can get broken and not in a helpful way like Apple’s ad.

Frustration, one of the emotions that often drives aggression, is anger’s polite little sister.  When people feel frustrated, they’re likely to act, persistently pursue solutions, and creatively approach and overcome obstacles.  But if the change is big, feels scary, and puts their sense of self at risk, frustration isn’t powerful enough to convince people to let go of the old and embrace the new.

“If you start down the dark path, forever will it dominate your destiny.”

Yoda is incredibly wise, but he gets this one wrong.  Using the Dark Side to speak to people’s “negative” emotions doesn’t doom you to a life or career of fear-mongering or inciting violence.  Start here, don’t stay here.

Multiple research studies show that positive emotions, like hope and joy, are more powerful than negative ones in maintaining motivation and even enable more creative thinking and problem-solving.  By speaking to both negative and positive emotions, the Dark Side and the Light, you enable change by giving people a reason to let go of the past and a future worth reaching for.

When people stop resisting and start reaching to the future you’re offering, change happens, and you realize that Yoda was right, “Luminous beings are we, not this crude matter.”

New Data Shows that Good Intentions Pave the Way to Innovation Hell

New Data Shows that Good Intentions Pave the Way to Innovation Hell

The road to hell is paved with good intentions, and nowhere is that more true than in innovation.

That’s one of the insights I took away from InnoLead’s Q1 report on corporate innovation priorities.  The report is an eye-opening look at the impact of AI on corporate innovation as experienced by corporate entrepreneurs themselves.  But before deep diving into that topic, the report’s authors shared intriguing data about member companies’ innovation structure, leadership engagement, organizational connections, and results. Nestled amongst the charts were several that, when taken together, got my Spidey senses tingling.

61.0% of innovation teams are “directly under a high-visibility leader with a broad company focus.”

This is great because innovation needs senior leaders’ support and active engagement to survive, let alone survive for long enough to produce meaningful results. Add this to the fact that 45% of senior leadership teams frequently discuss the “progress and value of the innovation program,” and all signs point to innovation as a strategic priority.

But (you knew there was a but, didn’t you)…

If “broad company focus” means “no P&L responsibility,” we have a problem.  In every for-profit company I’ve worked for and with, people with P&L responsibility have greater power, influence, and access to resources than people without a P&L.  This division may not feel fair, but it makes sense – the people who bring in profit and revenue will always be more influential than people who represent “cost centers.”

You can see the impact of P&L owners who are, understandably, focused entirely on delivering short-term results throughout the report – 75% of companies have shifted their focus more towards near-term priorities, and 61% shifted their innovation portfolio away from Horizon 3 (also known as radical, breakthrough, or disruptive innovation).

As for all those discussions, it’d be great if they focused on walking the talk of innovation. But suppose it’s only innovation platitudes or, worse, questioning innovation’s ROI. That doesn’t bode well for the “high-visibility leader with broad company focus,” the innovation team, or the company’s culture.

71.2% of innovation teams’ customers or business partners are unaware of the team’s existence, don’t engage, or engage only occasionally.

Welcome to Innovation Island!  Where the cool people work on cool things in cool offices while all you drones slave away doing the same thing you’ve always done and making the money that pays for the cool people to do cool things in their cool offices.

I’m sure this isn’t the message the innovation team intends to send, but it’s the one received by most organizations.

When arguing for Innovation Island, managers often point to the organizational antibodies likely to swarm and kill H3/radical/breakthrough innovation and even some H2/adjacent innovations.  They’re right, and those innovations must be “protected.” But not every innovation needs protection.  H2 and certainly H1 innovations, where most portfolios are now, should be shared with the core business because the core business will eventually run them.

The bigger problem, in my opinion, is that innovation teams don’t seem to be reaching out to others in the organization.  Like the P&L owners they report to, people in the core business are busy running the business and generating revenue.  Very few have the time or energy to seek out the innovation team to discuss and explore innovation.  Companies that want to build a culture of innovation need to turn their innovators into evangelists, not residents of an island connected to the mainland by a single drawbridge.

23.4% of innovation teams are considered outsiders or actively undermined by other functions and business units.

This may not sound bad, but add to it the 55.0% that are “somewhat integrated with occasional collaboration” with other departments and business units, and you may be tempted to believe that Innovation Island would be wise to invest in a surface-to-air missile defense system.

Sadly, this perception of the innovation team as “The Others” isn’t surprising when considering that the most important tactic for building a relationship between innovation and the functions or business units is already having strong relationships and interpersonal trust (75.3% of respondents).  The least effective (4.7% of respondents) is “writing down shared objectives and expectations.”  So, no, the email you sent is not enough to win friends and influence people.

Bottom line

Well-intended companies appoint a senior executive to lead the innovation team because they’ve been told that doing so is powerful proof that innovation is a strategic priority.  They hire outsiders to inject new thinking into the organization because they know that “what got you here won’t get you there.”  They cordon the team and their work off from the rest of the organization because they read that separation is essential to preserving innovation’s disruptive nature. 

But if the senior executive doesn’t have the organizational power and influence that comes with P&L ownership, the team doesn’t have strong personal relationships with others in the business, and other functions and business units don’t know the team exists or how to interact with it, innovation will go nowhere.

But that’s better than where it could go.

3 Lessons for Corporate Innovators, Courtesy of The Departed

3 Lessons for Corporate Innovators, Courtesy of The Departed

It’s award season, which means that, as a resident of Boston, I have the responsibility and privilege to talk about The Departed (pronounced: The Dep-ah-ted).  The film won the Oscar for Best Picture in 2007 and earned Martin Scorsese his first, and to date only, Academy Award for Best Director.  It is also chock-full of great lessons for corporate innovators.

Quick Synopsis

If you’ve seen The Departed, you can skip this part.  If you haven’t, why not and read on.

The Departed is loosely based on notorious Boston crime boss Whitey Bulger and features three main characters:

  1. Frank Costello (Jack Nicholson), a vicious and slightly unhinged Irish mob boss
  2. Colin Sullivan (Matt Damon), a Massachusetts State Trooper in the Special Investigation Unit (SIU) formed to catch Costello, who, in his spare time, is a spy for Costello.
  3. Billy Costigan (Leonardo DiCaprio), a police academy recruit who goes undercover to infiltrate Costello’s organization

But wait!  There’s more.  Alec Baldwin plays Colin’s SIU boss, George Ellerby.  Martin Sheen and Mark Wahlberg (who received an Oscar nomination for this role) play Billy’s Mass State Police (MSP) bosses, Captain Queenan and Staff Sergeant Dignam, respectively.  Completing the chaos is Vera Farmiga, who plays Madolyn Madden, Colin’s girlfriend and Billy’s court-ordered psychiatrist.

There’s a lot of other stuff going on, but that gives you enough context for the following quotes to hopefully make sense.

Listen to the words people use.

Colin (after Dignam refuses to hand over undercover files): I need those passwords.

Ellerby: No, you want those passwords

It’s not often that Ellerby says something useful, let alone wise, but he nails it with this one.  Colin wants the passwords to Dignam’s files on undercover agents because it will make both Colin’s official job of finding Costello’s rat in the MSP and his unofficial job of finding the MSP officer in Costello’s crew easier.  He doesn’t need the passwords, however, because, with enough time and effort, he can find the rats he’s looking for.

When we hear from customers that they want something, it’s tempting to run off and create it.  But as Ellerby points out, wants and needs are different.  Just because customers want something doesn’t mean they are willing to pay for or change their behavior to get and use it. 

Figuring out what a customer needs is difficult because it requires them to trust you enough to admit they have a problem they can’t solve.  It’s also difficult because most of us have access to solutions to our functional needs (think the bottom few layers of Maslow’s hierarchy).  As a result, the needs consumers grapple with tend to be emotional and social, and it’s far more challenging to admit those to a stranger, especially in a focus group or product-focused interview.

How you feel impacts everyone around you

Madolyn (after a counseling session): Why is the last patient of the day always the hardest?

Billy: Because you’re tired, and you don’t give a sh*t.  It’s not super-natural.

Billy and Madolyn get off to a rough start in their first counseling session, culminating in Billy asking for a prescription for Valium.  Madolyn calls him out for “drug-seeking behavior” and throws two Valiums across the desk before Billy storms out.  A few minutes later, Madolyn catches up with Billy, hands him a prescription for Valium, and asks the above question.

Being a corporate innovator can be difficult, sometimes soul-crushing work (ask the good people at Store 8).  It can also be thrilling and inspiring.  It can even be all those things in one day.  That’s what makes it tiring, even when you give a sh*t. 

Managing your energy and monitoring your behavior are leadership qualities we don’t discuss often enough.  It’s okay to be exhausted after a day of facilitating ideation sessions or intense strategic meetings.  It’s normal to be frustrated after a contentious conversation or demotivated when you get bad news.  But leaders usually find a way to not take those emotions out on their teams.  And, in the rare instance when they punish the team for someone else’s sin, they apologize and explain. 

Your job is not your identity.

Billy: Look, I just want my identity back, all right?  That’s all.

Colin: All right, I understand.  You want to be a cop again.

Billy: No, no, being a cop’s not an identity.  I want my identity back.

Towards the end of the film, Billy is tired of working undercover and reports to MSP headquarters to complete the paperwork required to expunge his criminal record and get his identity back.  That’s when Colin makes the same mistake most of us make and confuses Billy’s job with his identity.

We spend so much time at work.  We rely on our paychecks for so much.  We even introduce ourselves to new people using our job titles.  It’s easy for your job to feel like your identity, especially when your job aligns so closely with your deeply held beliefs and values.  But your job is not your identity.  You are still a Tempered Radical, even without your corporate title.   You are still an optimistic problem-solver, even when it’s been months since your last brainstorming session. 

You are an innovator, even if you don’t have a business card to prove it.

3 Steps to a Truly Terrific Innovation Team

3 Steps to a Truly Terrific Innovation Team

“What had a bigger impact on the project?  The process you introduced or the people on the team?”

As much as I wanted to give all the credit to my brilliant process, I had to tell the truth.

“People.  It’s always people.”

The right people doing the right work in the right way at the right time can do incredible, even impossible, things.  But replace any “right” in the previous sentence, and even the smallest things can feel impossible.  A process can increase the odds of doing the right work in the right way, but it’s no guarantee.  It’s powerless in the hands of the wrong people.

But how do you assemble the right group of people?  Start with the 3 Ts.

Type of Innovation

We’re all guilty of using “innovation” to describe anything that is even a little bit new and different.  And we’ve probably all been punished for it.

Finding the right people for innovation start with defining what type of innovation they’ll work on

  • Incremental: updating/modifying existing offerings that serve existing customers
  • Adjacent: creating new offerings for existing customers OR re-positioning existing offerings to serve new customers
  • Radical: new offerings or business models for new customers

Different innovation types require teams to grapple with different levels of ambiguity and uncertainty.  Teams working on incremental innovations face low levels of ambiguity because they are modifying something that already exists, and they have relative certainty around cause and effect.  However, teams working on radical innovations spend months grappling with ambiguity, certain only that they don’t know what they don’t know.

Time to launch

Regardless of the type of innovation, each innovation goes through roughly the same four steps:

  1. Discover a problem to be solved
  2. Design solutions
  3. Develop and test prototypes
  4. Launch and measure

The time allotted to work through all four steps determines the pace of the team’s work and, more importantly, how stakeholders make decisions.    For example, the more time you have between the project start and the expected launch, the more time you have to explore, play, create, experiment, and gather robust data to inform decisions.  But if you’re expected to go from project start to project launch in a year or less, you need to work quickly and make decisions based on available (rather than ideal) data.

Tasks to accomplish

Within each step of the innovation process are different tasks, and different people have different abilities and comfort levels with each.  This is why there is growing evidence that experience in the phase of work is more important than industry or functional expertise for startups.

There are similar data for corporate innovators.  In a study of over 100,000 people, researchers identified the type and prevalence of four types of innovators every organization needs:

  1. Generators (17% of the sample): Find new problems and ideate based on their own experience.
  2. Conceptualizers (19%): Define the problem and understand it through abstract analysis, most comfortable in early phases of innovation (e.g., Discover and Design)
  3. Implementers (41%): Put solutions to work through experiments and adjustments, most comfortable in later stages of innovation (Develop and Launch)
  4. Optimizers (23%):  Systematically examine all alternatives to implement the best possible solution

Generators and Conceptualizers are most comfortable in the early stages of innovation (i.e., Discover and Design).  Implementers and Optimizers are most comfortable in the later stages (e.g., Develop and Launch).  The challenge for companies is that only 36% of employees fall into one of those two categories, and most tend to be senior managers and executives.

Taking Action

Putting high performers on innovation teams is tempting, and top talent often perceives such assignments as essential to promotion.  But no one enjoys or benefits when the work they’re doing isn’t the work they’re good at.  Instead, take time to work through the 3Ts, and you’ll assemble a truly terrific innovation team.