· Education · 11 min read

Who Gets to Decide Who Is Qualified?

A driving test tells you whether you can drive. A waiting list tells you someone got there first. What happens when the institutions checking qualifications also get to decide how many people qualify?

A driving test tells you whether you can drive. A waiting list tells you someone got there first.
What happens when the institutions checking qualifications also get to decide how many people qualify?

We started with gym bros and a bell curve. The bell curve did very little wrong. The trouble started when simplification became an excuse for getting things wrong. Then Kate from marketing built a useful tool with Claude, and management nearly mistook access to a chatbot for a succession plan for the engineering department.

Now you need to hire someone precisely because they know things you don’t. You could ask a third party to check their qualifications. Sensible enough. Then somebody gives that third party the power to decide who gets to work at all, and before long you may need permission to prove you’re qualified to ask for permission.

You Can’t Interview Your Surgeon

Suppose you need an operation and get to choose the surgeon. You can ask how often they perform the procedure, what complications they see and how they handle them. These are sensible questions. The awkward part comes when you have to decide whether the answers are good. A careful surgeon might spend ten minutes explaining the uncertainty. Another might tell you there’s nothing to worry about. The second consultation will probably be more relaxing. Unfortunately, the skill you came to evaluate involves a scalpel, and the only instrument you’ve seen either of them use is a reassuring tone of voice.

Economists call this information asymmetry. The provider knows far more about the work than the customer, who may struggle to assess it even afterwards. A favourable outcome can owe something to luck. An unfavourable one can happen despite excellent work. I’d prefer some evidence before the operation. The customer satisfaction survey arrives at a rather unhelpful point in the process.

What Did the Exam Actually Test?

I’m a bit weird. At one point I earned more than two dozen IT certifications. If you must know, it started with an unusual bet and too much free time. It did leave me with some firsthand experience of how these exams work, so let’s call that a win and move on before anyone feels the need to assess my mental state.

The exams varied enormously. Some wanted me to recall a particular bit of documentation. Others gave me a scenario complicated enough that I had to sketch it out before I could see what was going on, then design part of a solution. A few put me in a test environment and asked me to get something working. My LinkedIn profile rewarded all three with another acronym. At a sufficient density of capital letters, I assume recruiters just infer a working knowledge of the alphabet.

Practical exams show how someone solves a problem under specified conditions. Knowledge tests can check facts that matter. Certificates of attendance establish that someone showed up. A sufficiently handsome frame makes all three look like the same achievement. I’d ask what was assessed and give a candidate with equivalent skills a chance to demonstrate them.

Then there’s the bill. A fully automated, two-hour exam at 300,300, 400 or even $500 may look reasonably priced from the offices of a hyperscaler. To someone trying to enter the profession, it’s a substantial sum to spend on the chance to prove they know what the company itself put in its documentation. I’d pay for an assessment that tells me something I couldn’t establish more cheaply. For that money, though, I’d like the exam to require at least one skill beyond being able to afford it. Having sat exams at both ends of the quality spectrum, I’ve learned to take some of my own collection with a generous pinch of salt.

I mention hyperscalers because cloud computing is a big part of what I do. It makes sense for a company to test whether people know how to use the tools it builds. Then there are organisations whose entire business is running exams and issuing certificates and digital badges. At some point the badge starts to look like the product and the exam like the checkout process. One of the more absurd examples got its own section in IT Dictionary. Some badges are worth more as material for a satirical book.

The Certificate, the Licence and the Waiting List

Certification tells you that someone met a specified standard. A licence grants permission to perform work that would otherwise be legally restricted. A numerical cap goes a step further. Once the places are taken, an equally qualified applicant can be turned away. Same exam, same score, different career prospects because someone else got to the desk first. Each decision needs its own justification. An exam can tell us something about whether a person can do the work. A legal restriction on who can do it needs an argument about what could happen to the people affected.

These mechanisms can overlap. A licensing authority might accept a certificate and also require supervised practice. An employer might insist on a particular certificate for a role anyone can legally perform. Try applying for a few jobs that all demand the same supposedly voluntary badge and see how optional it feels.

When Protection Becomes Protectionism

Suppose an experienced practitioner can demonstrate the relevant skills under the same conditions as everyone else, but can only sit the exam after paying for a particular course. The course might provide useful training. Making it mandatory still needs an explanation. What would the examiner miss if the candidate had acquired the same skills elsewhere? If the only thing anyone would miss is the tuition fee, the rule is doing a fine job of protecting somebody. It’s worth checking whether that somebody is the customer.

An association that represents practitioners and helps decide who can join their ranks faces a conflict. Practitioners have knowledge a regulator needs. They may also discover that the ideal number of competitors is, quite by coincidence, the number they already have. That is one route to regulatory capture, where regulation starts serving the interests of the industry it governs at the expense of the people it is meant to protect. A pricey process or a board full of practitioners warrants questions. To establish capture, look at who benefits from the rules and what happens when someone proposes a credible alternative.

Imagine capping the number of driving licences to ease congestion. You passed the test, but the road is full, so please come back when someone retires from driving. We’d be using a test of whether you can drive to allocate space on the road.

A cap on publicly funded medical school places can reflect a limited budget or a shortage of clinical placements and supervisors. Training another cohort takes money and people who have time to teach. Swiss cantons can also limit how many doctors bill compulsory health insurance for outpatient care in particular specialties or regions. That’s a separate decision about who gets to bill the insurer. Neither limit tells you how many people are competent to practise medicine.

Now take the bar exam. In South Korea, the Ministry of Justice set the number of successful candidates at 1,714 in 2026. The committee considered exam results alongside factors such as the supply of and demand for lawyers. There’s a case for making would-be lawyers demonstrate that they can do the job. Once the desired size of the profession helps determine who passes, I’d like to hear the case for that part too. If I’m struggling to find a lawyer I can afford, what exactly am I being protected from by having fewer people to call?

I can see a case for a cap when the permit grants access to a scarce resource. Imagine a fishery where the stock can’t support every boat that wants in. Limiting access can make sense even if every skipper is competent. I’d still ask why we were limiting boats instead of catches. The number of people who know how to fish is a peculiar thing to manage if what you’re worried about is running out of fish.

Some Gates Exist for Very Good Reasons

If you want to drive a two-tonne machine past people who are protected mainly by trousers, I’m quite happy for you to demonstrate that you can control it. Whether you should have to spend several thousand euros on a prescribed number of lessons with a paid instructor is a separate question. If you could get the same practice safely with a parent, an uncle or a suitably patient neighbour, I’d want to know what the compulsory lessons add. The examiner can still make you parallel park. There’ll be plenty of suffering to go round.

Supervised practice has a stronger case where a short exam can’t show how someone handles the range of situations they’ll face on the job. A surgical trainee, for instance, needs time working with real patients under supervision before taking full responsibility for their care. An exam can sample what the trainee knows and can do. A placement lets someone observe their judgement over time, including when the day refuses to follow the exam script.

Imagine you’re driving across a bridge. You didn’t commission it and probably have no idea who checked the calculations. You could let the market gather evidence. Speaking as a potential data point, I’d prefer someone check the calculations first. Require the person signing off on the design to demonstrate competence. Junior engineers can still do real work under supervision while someone qualified checks and takes responsibility for decisions that carry serious risk.

Where the finished work can be inspected, an independent check can catch defects before it goes into service. Insurance can help compensate people after a loss. During the actual collapse, the policy document has very little load-bearing capacity. And licensing can establish accountability after the initial assessment. A body that can investigate complaints and suspend someone’s right to carry out specific work after a serious breach can protect future clients in a way that an exam taken years earlier cannot. That power also gives the body a substantial influence over someone’s livelihood, which is a good reason to require clear rules and a meaningful appeal.

Who Watches the Gatekeepers?

Ask the examiners what a candidate must demonstrate and why. An orthopaedic surgeon’s qualifications don’t tell me much about whether I’d want them operating on my brain. The technology version is a badge that says ‘architect’ when the test covered one vendor’s product catalogue. I’d like to know what the person was actually asked to design. Clear scope helps customers interpret the credential and gives candidates a way to challenge requirements that have drifted away from the work.

Time matters, too. An exam that did a good job twenty years ago may now reward knowledge of procedures the profession has abandoned. Equally, a new tool doesn’t invalidate years of sound judgement. If practitioners must renew their credentials, what has changed that they need to demonstrate? A refresher may be worthwhile. Paying to watch the same slides every few years also counts as continuing professional development, at least for the organisation selling the slides.

I’d want to know who sets the criteria, how a candidate can appeal and whether people outside the profession have a say. Can people report unsafe work and get a response? Are competent applicants being excluded for reasons unrelated to the work? The authority can probably tell you exactly how many forms it processed. Forms are considerate that way. They come numbered and rarely ask whether they ought to exist.

Trust, but Make It Verifiable

I’d like to be able to trust the surgeon without having to become one. That takes someone who can assess the relevant skills, explain what the assessment covers and act if there are serious grounds to question whether the surgeon should still be practising. It also takes a system willing to accept equally convincing evidence from someone who took a different route to the profession. The greater the power to keep that person out, the more I’d want to know whom the restriction protects and how we can tell.

If a licensing body can explain in detail why an applicant may never sit the exam, I’d like it to explain with equal care how that decision makes the patient safer. Show your working. I believe that’s still considered good practice in an exam.

Part of series: Access Is Not Expertise

Professional licensing and limits on entry

Official sources for the Swiss outpatient billing limits and the South Korean bar exam.

2 sources
Back to Blog

Related Posts

View All Posts »
Removing the Gate Doesn't Remove the Requirements

Removing the Gate Doesn't Remove the Requirements

Removing unnecessary barriers helps more people become competent. Giving Kate from marketing an AI tool does not make engineering competence obsolete — even when the buttons work and there is a login screen.

Good Enough for My Gym Bros

Good Enough for My Gym Bros

Explaining a statistical idea is not the same as explaining AI. But the bigger problem starts when “good enough for my audience” becomes an excuse for giving people a misleading picture of what they know.