AI Broke the Coding Interview — Anthropic Rewrote Its Own Questions

CNN says the software engineering interview is broken — banned-AI rules clash with on-the-job AI dependence, and Anthropic admits it had to rewrite its own technical questions.

AI Broke the Coding Interview — Anthropic Rewrote Its Own Questions

The most honest sentence in CNN’s May 28 piece on the state of the software engineering interview is buried in the middle of the article: Anthropic, a company whose entire product is an AI that writes code, had to rewrite its own technical interview questions because candidates were using Claude to pass them. The maker of the cheating tool got cheated.

That single fact is the whole story.

The shape of the problem

The traditional software engineering interview has three stages: screen, take-home, and onsite whiteboard. All three were designed for a world where the job was writing code from a blank editor. In 2026, the job is mostly editing AI-generated code, validating it, fitting it into larger systems, and making architectural calls about what to ask the model to do next. The skill the interview tests and the skill the job requires have decoupled.

The result, per CNN’s reporting, is a hiring process where:

  • Most companies still run the traditional pattern — invert a binary tree, find the longest substring, here’s an algorithm question from 2014.
  • A growing minority forbid AI tools during the interview entirely. Some now require candidates to share their full desktop during a coding round to prove they aren’t running a co-pilot tool like Cluely on a second machine.
  • A small but visible counter-trend allows AI explicitly — “show us how you use it” — on the grounds that the way a candidate prompts and corrects an AI model is the actual skill the job requires.

These three approaches contradict each other, and a candidate routing through five companies in 2026 has to perform a different hiring ritual at each one without knowing in advance which one is in force.

What the data says about cheating

A Fabric analysis of more than 50,000 candidates found that the share of candidates using AI tools during live interviews more than doubled in six months: 15% in June 2025, 35% by December 2025. The 2026 trajectory is implicitly higher — every interview-cheating tool that exists today did not exist eighteen months ago. Cluely is the headline name; a dozen others sit behind it.

Anthropic’s quiet admission that it had to rewrite its questions is the cleanest signal that the existing question bank no longer works. The company’s recruiting team is presumably as well-informed about Claude’s capabilities as anyone on earth, and Claude was solving their interview questions for them. If their questions are no longer hard enough to filter, no one else’s are either.

Why the “ban AI” answer is a dead end

The pure ban approach — share your desktop, no copilots, write it from scratch — fails for two reasons.

First, it doesn’t actually catch the careful cheater. As the HackerEarth survey of online assessment vectors makes clear, the modern playbook is two devices: candidate runs the screen-share laptop with the test, second laptop or phone runs the AI off-camera, candidate reads the answer with their eyes and types it. Webcam tracking, lockdown browsers, and keystroke biometrics each have countermeasures within weeks of deployment.

Second, and more importantly, the ban contradicts the job. Salesforce announced earlier this year that it would hire zero new engineers in FY2026, because Benioff says AI-powered coding tools have made the work of additional engineers redundant — and then a month later announced 1,000 new-grad “AI-native” hires for the Builder Program, the implicit message being that the hires are valuable because they will use AI. Internal Cloudflare data, disclosed in the same May 7 memo that announced its 1,100 layoffs, put internal AI usage growth at 600% in three months. If you ban AI in the interview and then mandate AI on day one of the job, the interview tests a skill the candidate will never use again.

The interesting answers

The reform that’s gaining traction in the CNN piece and in adjacent literature is the “audit” style interview: hand the candidate a block of functioning-but-flawed AI-generated code and ask them to find the bugs, harden it, integrate it with a contrived API, and defend their decisions. This tests the actual 2026 skill — reasoning about AI output — and is very hard to fake live, because the bugs are unique to the session and there is no canonical answer to look up.

A more aggressive variant is the conversational AI interviewer: the candidate talks through their reasoning with an AI agent that probes follow-ups in real time, and the transcript becomes the artefact rather than the code. The cheating workaround for this style requires the candidate to fake reasoning end-to-end, which their copilot cannot do convincingly under structured probing.

Neither approach is widespread. Both will be, within twelve months, because the existing approach has stopped functioning.

Where this hits the displacement story

CNN frames its piece as a hiring-process story. The labor-market consequence sits underneath it.

There are roughly 144,832 tech layoffs YTD in 2026 across 349 announced events, with software engineering the most-affected role category. Entry-level engineering postings have dropped roughly 35% since early 2023. Of the candidates still in the funnel, more than a third are cheating with AI, and the companies that catch them put them on do-not-hire lists for life.

That is not a labor market with a “use the latest tools” friction problem. That is a labor market where the testing infrastructure for the dominant white-collar profession of the past twenty years has stopped functioning, and the workers it was meant to filter are split between two cohorts: those who used AI to pass the test (and may be blackballed), and those who didn’t (and may be unhirable because they don’t fluently use AI on the job).

The interview is the bottleneck. Whoever rewrites it well — Anthropic, in classic embarrassed-by-our-own-tool fashion, is at least openly trying — runs the next decade of engineering hiring.

What to watch

  • The Anthropic question bank. When their rewritten technical interview leaks (it will), it becomes the new canonical 2026 question set, the way Google’s old “manhole cover” questions became the 2000s canon.
  • Cluely’s enterprise pivot. Cluely and its clones currently sell to candidates. The interesting moment is when one of them flips to selling anti-cheating services to the same companies whose interviews their tool defeats.
  • Whether the “AI-allowed” interview format scales. The honest version of the modern engineering interview is “show us how you work with the model.” If three or four prominent companies commit to that openly, the ban-AI approach loses the argument.

The CNN headline is mild: the interview process can’t keep up. The actual condition the piece describes is more specific. The interview is broken, the candidates know it, the companies know it, and the company best positioned to fix it had to fix its own first.