Video summary
Should AI Engineers Still Read Code in 2026? The Z/L Continuum — Alex Volkov, ThursdAI
Main summary
Key takeaways
Summary of technological concepts, product features, and analysis
-
AI engineering shifted from hand-written code to agent-generated code
- The speaker argues that “code got cheap, attention didn’t,” describing a world where engineers increasingly supervise rather than manually implement.
- Examples:
- Boris Cherny / Anthropic “Cloud Code”: claims Cloud Code authored 100% of his code at the time. He still ships many PRs, implying the engineering role shifts upward in abstraction.
- Anthropic codegen proportion: cited ~80% of Anthropic’s code is AI-written (noted as a few months old; likely higher now).
- GitHub commit growth: GitHub is projected to reach ~14B commits in a year, up from ~1B the previous year—attributed largely to AI-assisted coding.
-
A specific “break point” in AI engineering (December 2025)
- The talk claims that in Dec 2025, models began completing tasks that previously required >16 hours of engineer time, after which performance and throughput increased further (“way up the curve”).
- Mentions an evidence hub: wtfhappened2025.com (described as humorous but used as documentation).
-
Conflicting viewpoints on whether to read code (the “Z/L Continuum”)
- The talk frames a tension with two viewpoints from the same AI Engineer EU conference:
- “Code is free” / don’t get hung up on implementation (OpenAI speaker Ryan LeFebvre)
- Tools are high-quality and can write real production code.
- The priority is not the code itself, but prompting + guardrails to prevent “slop.”
- Still requires short-term diligence: double-click when agents struggle.
- “Read every line of code” / critical-path scrutiny (Pi creator Mario Zechner)
- Agents can compound repeated errors (“compounding booboos”) without learning.
- For critical code, read every line; for non-critical code, “write slop ahead.”
- “Code is free” / don’t get hung up on implementation (OpenAI speaker Ryan LeFebvre)
- Speaker’s framing: the question shouldn’t be “Should we read code at all?” but rather “What proof does this specific change need?”
- The talk frames a tension with two viewpoints from the same AI Engineer EU conference:
-
Empirical/metrics concerns: speed without review harms quality
- Cites multiple engineering survey/analysis results (including a survey said to be from April 2026; “Acceleration Whiplash”):
- +861% increase in code deletion per PR (interpreted as teams aggressively iterating and removing code with agents).
- +31% increase in merged PRs with no review (human or agentic), presented as a warning not to do this.
- +242% increase in incidents per PR.
- Bugs per developer up ~6x vs 2025.
- Real-world example: Anthropic’s status page described as “Christmas tree”-like (because it was down at screenshot time), used to illustrate that heavy AI codegen at scale can correlate with stability/incident noise.
- Core warning: “Output does not mean stability.”
- Cites multiple engineering survey/analysis results (including a survey said to be from April 2026; “Acceleration Whiplash”):
-
Key resolution: route review effort to “proof” that matters
- The speaker’s central method is a routing table / “Monday artifact”:
- For authentication, money movement, permissions, irreversible data: read every line / inspect critical path personally.
- For other changes: rely more on system-level checks rather than line-by-line human review.
- Emphasizes that the continuum is about tasks, not people:
- The same engineer might be “hands-off” on some tasks and “read everything” on others.
- The speaker’s central method is a routing table / “Monday artifact”:
-
Actionable review/process techniques (tutorial/guide-like guidance)
- Distilled advice into several practices:
- Decompose / split large PRs into small, reviewable chunks (agents can help with decomposition).
- Traces, evals, shadow mode (instrumentation and testing modes) to validate behavior.
- Separate roles: avoid a single agent that both writes code, inspects outputs, and writes tests—because it can become self-confirming (“like grading your own exam”).
- Observability, rollback, engineer the guardrails (“engineer makes the system remember” after humans review once).
- Meta-guidance:
- Use AI “clankers” (described as strong at scanning repos) to highlight which lines/areas are critical, then focus human attention there.
- Distilled advice into several practices:
-
Capability drift changes where “proof” must occur
- Mentions that as model capabilities increase (e.g., “Fable,” “Mythos,” “Claude code”), evaluation focus shifts:
- From checking “work is correct” → to checking “work is the right thing.”
- Warns: even with more capable systems, don’t stop reviewing in production.
- Introduces the idea of a “capability drift arrow”: review focus migrates (outputs → tasks → potentially loops), but the need for proof remains.
- Mentions that as model capabilities increase (e.g., “Fable,” “Mythos,” “Claude code”), evaluation focus shifts:
-
“Loops” as the next primitive (automation that self-verifies)
- Describes loops as a shift from one-shot prompting to system design:
- “Fancy cron jobs” that run on a schedule.
- They discover tasks, generate prompts from plans, execute, and crucially verify themselves; if verification fails, they retry.
- Framing: loops reduce human involvement, but don’t eliminate judgment—they can hide review by letting the same system both build and grade.
- References an Adi Olsmanyu point: if you let automated loops handle everything when a bug arises, quality can spiral downward because your product team may miss deeper quality degradation.
- Describes loops as a shift from one-shot prompting to system design:
-
Future-facing conclusion
- The talk argues flexibility is required due to fast-changing agent/model ecosystems (e.g., coding agents, tools at OpenAI/Anthropic, “generalized agent” trend).
- Final takeaway: not every line needs human eyes, but every system still needs human judgment.
Main speakers / sources mentioned
- Alex Volkov — host of Thursday AI podcast/newsletter; talk moderator
- Ryan LeFebvre (OpenAI) — “Code is free” viewpoint
- Mario Zechner (Pi creator) — “Read every line for critical code” viewpoint
- Andrejs Karpathy — quoted about temptation to stop looking at code, but not in production
- Jared S. Chipar (Anthropic) — quoted about checking “right work” with Fable
- Adi Olsmanyu (Google) — quoted about quality spiral risk with fully automated loop fixes
- Peter Steinberger — creator of Open Cloud; mentioned in loops context
- Boris Cherny (Anthropic) — mentioned in Cloud Code and loops context