Judgement: The skill AI can't replace
Free masterclass page 1 of 3
As AI becomes better at producing answers, human judgement becomes increasingly defined by the questions we ask, the assumptions we challenge, the values we uphold, and the conclusions we are willing, or unwilling, to accept. The competitive advantage shifts from generating options to exercising discernment. In fact, as AI makes analysis cheaper and more abundant, human judgement becomes the scarcer and more valuable capability.
This is a free mini masterclass for building judgement, with and without AI.
Let's begin.
Before anything else, find out where you're starting from.
How good is your judgement?
What follows is a diagnostic built on peer-reviewed research. It covers four dimensions of judgement that matter at work. Twenty-eight questions, about 10–15 minutes. At the end you'll get a profile: where your judgement is strongest, where it's most exposed, and what that means for the kinds of decisions you face every day.
This isn't a personality quiz. It's the kind of instrument we use with senior professionals and teams, adapted here for individual use. There are no good or bad profiles, only honest ones.
Answer as you actually are. The profile is only useful if it's true.
Once you have your profile, continue below.
Popularly misused tools
For most of us, school taught problem-solving, the kind with certain answers in the back of the book and grading scales. Judgement, which is reasoning under uncertainty with incomplete information alongside other people, was left to experience. We've been building habits for years, under real pressure, without ever really checking whether those habits are good ones.
The fastest progress usually doesn't come from learning something new. It comes from correcting something you already do. Several of the most widely used decision tools are also widely misused, and small adjustments, tiny tweaks, to how we apply them make a disproportionate difference.
Here are two you've almost certainly reached for. Let’s see how details matter.
The Pros and Cons list
Joanna is one of those people who makes you recalibrate your definition of a tough job. A uniquely qualified specialist who takes on missions with NGOs in conflict zones, the kinds of places most people only read about. She had just finished a two-year contract in a particularly demanding location and was weighing two offers for what came next.
She was making a pros and cons list.
One of the hazards of being a decision scientist is getting asked for help at the last moment, when someone is tired, under pressure, and facing a choice with real trade-offs and no clean answer. Such an occasion was Joanna's situation. She wasn't choosing between two good options. She was choosing between two forms of compromise, under time pressure, with incomplete information about both.
I asked her to put the list aside.
The pros and cons list is one of the oldest decision tools we have. Benjamin Franklin recommended a version in 1772 in a letter to a friend, and his was more rigorous than what most of us do today. He advised spreading the process over several days, letting considerations surface that aren't immediately salient, and then weighing items against each other: find a pro and a con of roughly equal importance and cross both out, continuing until only the unmatched items remain. The structured weighing, done slowly and deliberately, was the entire point. What most of us do today strips nearly everything useful out.
We jot down whatever comes to mind in a single sitting, look at the two columns, and try to get a feeling from the result. But the problems go deeper than skipping the deilberation and weighing steps. The list quietly assumes there are only two options, or at most two sides, accepting whatever landed on the table as the entire decision space. Items are treated as independent when they rarely are (a higher salary and a longer commute aren't separate factors; one may erode the other's value over time). If you already have a preference, even one you haven't admitted to yourself, you'll generate more cons for the option you quietly don't want and be more generous with the one that appeals. And perhaps most importantly, a pros and cons list produces all the reasons you think something should be right or wrong, without ever asking whether it's right or wrong for you, and why.
Here is where this connects to the world you're operating in right now. Your AI tools can generate a flawless pros and cons analysis in seconds, weighted, scored, cross-referenced. And it will have every one of these same problems. Narrow problem definition. False independence. No capacity to surface the factors that are hardest to name, and the factors that matter to you. The output will look more rigorous. The judgement behind it won't be better. If anything, the polish makes it harder to question.
If you're going to use a pros and cons list, upgrade it.
Widen the frame before you start writing. Are these really the only options? What would a third alternative look like? What would you do if none of these existed?
Weigh every item, a number from one to ten, and total each side. Entrepreneur Seymour Schulich adds a useful rule: for a choice to genuinely favour the pros, the positive score should be at least double the negative. That gap corrects for our reliable tendency to overweight the upside.
Don't finish it in one sitting. Come back over several days, adding, reconsidering, noticing what shifts. Franklin built this into his method for a reason. A list built over time is more honest than one built in a single anxious session.
When I asked Joanna to set the list aside, this is what we did instead. We widened the decision frame. We spent time on the factors she'd left off because they felt too personal to put in a column. And we gave it time. The decision she made wasn't the one the original list pointed to. And she was far more confident in it.
Brainstorming in meetings
Shortly after I founded Meta-decisions in 2020, I was invited to meet with a prestigious organisation. The brief was to "brainstorm on ways the team can perform better." For a new founder, that's a meaningful invitation.
I asked for background before the meeting. What projects were they working on? What problems were they trying to solve? The reply was firm: "Just come and we will brainstorm on the spot."
This happens constantly, and not only with outside consultants. People within teams face the same dynamic every day. We call a meeting. We expect ideas to emerge. We don't ask whether the conditions for good ideas are actually in place.
Brainstorming became popular in the 1950s with a clear promise: groups produce more and better ideas than individuals working alone. The promise was never quite kept. No study has shown that group brainstorming outperforms individuals working alone first and then coming together. On average, individuals generate more ideas and more original ones. Groups feel more productive, but that feeling is itself a trap.
Here's what goes wrong. Whoever speaks first sets the frame. Every idea that follows is evaluated against that anchor, consciously or not. If the first idea is mediocre, the session trends mediocre. If it's the boss's idea, the problem compounds. Extroverts speak more than introverts, senior people speak more than junior ones, and people who are tired, anxious, or simply less verbally dominant stay quiet. Not because they have less to contribute, but because the format doesn't make space for them.
And the people who know a problem most intimately find it hardest to step outside what they know and see it fresh. That's what I walked into. The team knew their problems intimately. They didn't share the context. Without it, I couldn't see what they were too close to see. We both lost.
Now add AI to this room. An AI-produced briefing document framing the discussion before it starts. An AI tool generating ideas alongside your team. The anchoring effect doesn't shrink. It gets worse. An AI-generated framing carries the authority of "the data says," which makes it even harder for the person with the genuinely different perspective to voice it.
The fix starts before the meeting, not in it.
If you're bringing someone in, from inside or outside your organisation, give them the context. What's the actual problem? What are the parameters? What solutions have already been considered? The time spent briefing is returned tenfold once you give people time to think and jot down ideas independently, before the meeting.
For the meeting itself, the single most important shift is separating idea generation from idea evaluation. These are different cognitive tasks. Doing them simultaneously, which is what traditional brainstorming demands, compromises both.
The most powerful version of this I've seen in practice: everyone writes for five minutes before anyone speaks. No discussion, no peeking. Then share. That single move removes anchoring, levels the room between introverts and extroverts, and captures unique knowledge before group dynamics can suppress it. Hal Gregersen at the MIT Leadership Center takes it further with the Question Burst method, where instead of generating solutions, you spend four minutes generating nothing but questions about the challenge. No answers, no justifications. The constraint is uncomfortable and productive. Four out of five times, a question surfaces that reframes the problem entirely. Tony McCaffrey's BrainSwarming replaces talking with writing on a structured graph. The goal at the top of a board, known resources at the bottom, the group working in silence, adding notes and drawing connections. Where the top-down thinking meets the bottom-up thinking is where the solutions live. The numbers are striking: up to 115 ideas in 15 minutes, compared to roughly 100 per hour in traditional brainstorming. Silence turns out to be more productive than conversation.
One last thing about meetings. They tend to suffer not because everyone behaves poorly, but because one person does. One dominant voice, one anchoring comment, one person deferring to the most senior person in the room. Good meeting design isn't optimistic about human nature. It's built to work even when someone in the room is beign difficult or has an off day.
Takeaway #1: Sometimes it's a matter of small tweaks
What do these two tools have in common? Both widely used. Both subtly broken in ways that compound over time. And in both cases, the fix isn't a new tool. It's a small adjustment to how you use the one you've already got.
This is the first layer of sharpening your judgement: small tweaks in the tools and techniques you already use. Places where your process has drifted from what actually works, and a specific tweak brings it back.
These two are examples. Most professionals have a dozen tools and habits they reach for regularly, each with its own quiet drift from what actually works.
What you just saw were problems with the tools themselves: a method that drifts, a format that suppresses what it should surface. Use the tool in the right way and the problem goes away.
But there is a different kind of problem, one that has nothing to do with how you use a tool, and everything to do with what your mind does before you reach for one. That is where tools stop being optional and start being essential.