Map

Code review throughput limits

Wiki conceptcode-reviewagentic-codingllm-skepticism โ†ณ show in map Markdown
title
Code review throughput limits
type
concept
summary
The empirical caps on effective code review (~400 LOC/h, ~1h sessions, no parallelism) and why they put a hard ceiling on "just review the AI's output"
tags
code-review, agentic-coding, llm-skepticism
created
2026-07-18
updated
2026-07-18

Code review has measured limits, and they don't move with effort or tooling. Two findings from the review literature recur (see reviewing-ai-code for Depierre's use of them):

  • Effective speed caps around 400 LOC/hour. Above that, defect-finding drops off sharply. Actual speed varies with the code's context, kind, and the reviewer's experience, but ~400 LOC/h is the ceiling where review still reliably flags defects.
  • A review session hits diminishing returns past ~1 hour. This is an attention limit, not a code-coverage one โ€” sustained review degrades after an hour regardless of how much is left, so a reviewer manages only a couple of effective hour-long sessions a day, separated by recovery time of unknown but nonzero length.

The consequence that matters for LLM-assisted development: review does not parallelize inside one head and does not speed up on demand. If the answer to "LLMs get things wrong a lot" is "review everything like an intern's code," then generation throughput is bounded by review throughput, which is fixed low. Every ~400 LOC of generated code costs about a senior developer-hour, and a developer has maybe 10โ€“40 such hours a week that also compete with meetings, design, and incidents. The realistic ceiling lands under ~1k reviewed LOC/day including boilerplate, tests, and config. The bottleneck moves from writing to reviewing, and the writing tool can't relieve it.

The overconfidence multiplier

The caps above come from research on humans reviewing human code. Applied to LLM output, the early (limited) evidence is worse on two counts: reviewers of LLM-generated code find fewer defects while reporting higher confidence that they found them all. So the human+LLM pair can ship lower-quality code than human+human while the reviewer feels more assured โ€” the throughput ceiling doesn't even buy the correctness it promises. This is the measured version of the trust problem framed qualitatively in credibility-as-slop-test and reported first-hand in know-thine-enemy.

Relationship to other framings