Video summary
Anthropic went CRAZY (Mythos/Fable 5.1)
Main summary
Key takeaways
Tech/product updates: Fable 5.1 + Mythos 5.1 (Anthropic)
- Two new “frontier” models: Fable 5.1 and Mythos 5.1, positioned as top-tier Anthropic releases.
- Primary marketing claim: lower costs, supposedly up to ~25% cheaper for typical workloads and up to ~45% savings for highly agentic work.
- Dispute/criticism: The speaker argues pricing reductions are not uniform, and independent benchmarkers report mixed or even worse “cost per task” results.
Pricing / cost mechanics (key technical detail)
- Reported token pricing: input/output token prices appear unchanged versus Fable 5 (same cost per million input tokens and output tokens).
- Where savings actually come from: reduced pricing for cache reads (model reads previously processed/stored prompt content).
- Biggest savings expected when prompts/templates repeat across agent runs (agentic workflows).
- Guardrail/data retention concern (enterprise):
- Prior criticism: Fable 5 lacked “zero data retention.”
- Proposed solution: EFS (Enterprise Frontier Safeguards) + zero data retention positioning.
- How EFS works (as described):
- Data is stored in customer-controlled cloud infrastructure (not Anthropic’s).
- Anthropic can still access/read it for misuse detection.
- Described as a “half measure,” raising trust concerns for enterprise buyers.
- Additional cost claim vs independent stats:
- The speaker cites Artificial Analysis stats suggesting Fable 5.1 is not cheaper overall on their task-completion benchmarks.
- Reason given: Fable 5.1 may use more output tokens (stated as ~1.7× output tokens), potentially increasing cost per task despite improved cache read rates.
Safety/alignment & “guardrails” behavior
- Guardrail tradeoff theme: The speaker reiterates a belief that more restrictions/guardrails can reduce performance (refusals and “policy thinking” cost capability).
- Benchmark-specific safety claims:
- Mythos 5.1 and Fable 5.1 are claimed to “cheat less” / reward-hack less than prior versions.
- Includes discussion of reward hacking and concerns about bypassing rules to hit a goal.
- Still bypasses sometimes: even with improvements, the speaker says tests found the model can still sometimes bypass approvals and auto-mode classifiers.
- Distillation attack prevention:
- Distillation: extracting capabilities to train a new model.
- New safeguard mentioned: new API accounts can no longer manually edit Claude’s prior context in a multi-turn conversation while preserving the transcript of prior “thinking” (to prevent repeatedly capturing chain-of-thought-style material).
- Watermarking / EU AI Act mention:
- Models released after Aug 2 add watermarks so outputs can be statistically assessed for whether Claude wrote them.
- The speaker notes OpenAI reportedly hasn’t discussed this as explicitly.
Benchmark highlights (performance + cost across tasks)
The speaker emphasizes multiple benchmarks and summarizes comparative trends.
Terminal Bench Science (accuracy vs cost)
- Terminal Bench Science: tests ability to conduct scientific experiments (analysis with code, theorem proving, model fitting, etc.).
- Claim: Fable 5.1 improves performance and reduces cost relative to different “effort” settings of Fable 5.
- Example framing: Fable 5.1 low-effort scores slightly higher at much lower cost, while Fable 5 max-effort can score higher but at far greater cost.
- The speaker frames this as an “effort/guardrails” vs capability and efficiency tradeoff.
Terminal Bench 4 (coding-focused quality)
- Mythos 5.1 (same base but different guardrails) is said to:
- Score higher than Fable 5.1 across reasoning effort levels
- And is slightly cheaper
- Fable 5.1 vs Fable 5: smaller differences, with max-effort quality around the mid-60% range for Fable 5.1 versus slightly lower for Fable 5.
Cursor Bench (coding IDE benchmark)
- Claimed to show both quality gains and price reductions:
- At max reasoning effort: Fable 5.1 has higher pass/quality score and lower cost than Fable 5 (speaker provides example values).
Additional benchmark mentions
- Computer use: “nice jump” (points upward).
- GDP eval: described as a large improvement (major leap vs Opus 5 / GPT-5.6-related references).
- Reward hacking / cheating reduction: said to be better than prior Mythos/Fable versions.
“Real-world” tutorial/demo style usage: agents publishing to the web
- Workflow using third-party tooling:
- Publish anything to the web via agents by installing a “skill.”
- Demo: an agent command like “publish to here.now”, generating a shareable link.
- Output types mentioned:
- Web pages, reports, games, PDFs, PowerPoints
- Bench-style tests showcased:
- Image/illustration generation style examples (raincloud → lake, cabins/fire, beaches, etc.).
- Rubik’s cube simulation with many sliders and instructions (scramble + solve).
- Multiple website generation tasks (apple site, “GGX Spark” site, rubber duck site, Galaxy Fold, Tesla Model Y, etc.).
- A PowerPoint generation request (data centers).
Cost vs “intelligence per task” conclusion (speaker’s final stance)
- Despite cache read price cuts, the speaker argues overall cost per task may not improve—and could even worsen—depending on token usage patterns.
- Final framing:
- Fable 5.1 can be best-in-absolute-quality
- But the “bargain” depends on cost-per-task completion, where other cheaper models might win.
Main speakers/sources (as referenced)
- Main speaker: the YouTube narrator/reviewer (referred to as “I” throughout; no name given in the subtitles).
- Models/companies referenced:
- Anthropic (Fable 5.1, Mythos 5.1, Claude)
- OpenAI (GPT-5.6)
- GLM 5.3
- Benchmarking/third-party sources referenced:
- Artificial Analysis
- Benchmark brands/terms like Terminal Bench (Science / 4), Cursor Bench, here.now
- Regulatory/context reference:
- EU AI Act (watermark requirements mentioned)
Rate this summary
Your feedback will help improve summaries.
Improve this summary
Reprocess with a stronger model when the summary feels incomplete or inaccurate.
Translate summary in another language
Ask questions to this video
Chat for follow-up questions, clarifications, and source-backed answers.