📊 Full opportunity report: When AI Builds Itself: Inside Anthropic’s Evidence on Recursive Self-Improvement on ThorstenMeyerAI.com — validation score, market gap, and execution plan.
TL;DR
Anthropic presents data indicating AI systems are increasingly capable of automating parts of their own development, raising the possibility of recursive self-improvement. However, significant gaps remain in autonomous goal-setting.
Anthropic has published new evidence suggesting that AI systems are now capable of significantly accelerating their own development processes, a step toward what is known as recursive self-improvement. The report, from The Anthropic Institute, states that AI is already automating many aspects of research and engineering, though key human decision points remain. This development matters because it could lead to rapid, autonomous progression of AI capabilities if certain bottlenecks are eliminated. Learn more about recursive self-improvement.
The report is based on internal data from Anthropic and public benchmarks showing that AI models like Claude have dramatically increased their ability to generate code, run experiments, and solve complex tasks. For example, the amount of code produced by Claude has grown from single digits to over 80% of Anthropic’s codebase within 15 months, and benchmark tasks have shown exponential improvements in AI problem-solving abilities.
Public data from metrics like METR indicates that AI’s capacity to handle longer, more complex tasks has doubled roughly every four months, with models now capable of performing tasks that previously required days or weeks in hours or minutes. Internal data further reveals that AI systems are already executing research tasks, such as debugging and reproducing experimental results, at levels approaching or surpassing skilled humans.
Despite these advances, the report emphasizes that the critical bottleneck—autonomous decision-making about which problems to pursue—remains largely human-controlled. The authors highlight that while AI can now automate much of the ‘doing,’ the ‘deciding’ still depends on human judgment, and it is not yet clear when or if this will change.
When AI builds itself
Anthropic is delegating a growing share of AI development to AI. Taken far enough, that points to a system that designs its own successor — recursive self-improvement. Not here yet, not inevitable. But the case isn’t speculation: it’s data on what AI is doing to AI development right now.
The curve that hasn’t bent
METR tracks the length of tasks AI can reliably complete on its own. That horizon is doubling roughly every four months — up from every seven. Anyone can check this in public data.
Task horizon — how long a job AI can handle solo
Each model handles dramatically longer tasks than the one a year before. The line keeps going up.
AI-Assisted Coding: A Practical Guide to Boosting Software Development with ChatGPT, GitHub Copilot, Ollama, Aider, and Beyond (Rheinwerk Computing)
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Two kinds of work, one persistent gap
Building a frontier model splits into engineering and research. Across both, the pattern is the same — and so is the one thing AI still can’t do well.
Code, infrastructure, training
Claude can take an underspecified problem and find a method. Humans supply the goal; they no longer need to supply the method.
Which experiments, what they mean
Claude can match or outperform skilled humans at executing a well-specified experiment. But choosing which experiment still needs a human.
The same ladder Anthropic employees climb with experience
Manus AI User Guide: A Practical Step-by-Step Guide to AI Agents, Prompt Engineering, Workflow Automation, Research, Content Creation, Coding, and Productivity
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Watch the human share shrink, rung by rung
Walk up the four stages of AI development. At each, the human/AI split shifts — and the real internal numbers show exactly where AI has reached parity, gone superhuman, or still trails. Tap a rung.
The human role across the development loop
The doing now costs almost nothing in human time. What’s left is the deciding.
Architecting Data and Machine Learning Platforms: Enable Analytics and AI-Driven Innovation in the Cloud
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Agents ran an open research project end to end
April 2026: the first demonstration of Claude running an open-ended research project from hypotheses to findings — on a real AI-safety problem.
Can a weaker model reliably supervise a stronger one?
Agents were left to solve it: proposing hypotheses, testing them, sharing findings across parallel agents, iterating. Measured against the gap between a “floor” (weak supervisor alone) and “ceiling” (strong model trained on correct answers).
(humans: ~23% in a week)
· ~$18,000 compute
the agents themselves
AI Coding with VS Code: Build Full-Stack Apps Faster Using GitHub Copilot, Agentic Workflows, Custom AI Assistants, and Prompt Engineering (Quick Start Developer Series)
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Picking a better next step than the human
Real research sessions where a human took a wrong turn. Models saw only the work before the detour and proposed a next step; a judge that knew the outcome scored them. The day-to-day of research is this chain of next-step calls.
“Can the model pick a better next step than the human?”
Share of moments where the model’s next step was judged better. The amber line is the practical ceiling (an ideal answer that could see the whole session).
It depends on whether the trend continues — and what we do
The piece refuses a single prediction. It lays out three scenarios, and is clear about which it finds most likely.
The exponentials turn out to be S-curves
Maybe taste can’t be scaled into existence; maybe the constraint is the supply chain — chips, grid, interconnect — not intelligence. Even so, the world still changes: Glasswing’s Mythos found 10,000+ critical vulnerabilities in weeks, and a 100-person firm does the work of 1,000.
included for completeness · they doubt itDevelopment automates; humans still steer
100-person companies doing the work of tens of thousands — revolutionary, but turnable to harm (population-scale surveillance, tailored manipulation). Bound by Amdahl’s law: speeding one part shifts the bottleneck — which is exactly why human code review became Anthropic’s new chokepoint.
★ they think we’re likely heading hereAI designs and refines its own successors
Progress paced only by compute. Humans move to oversight of an expanding “virtual lab.” The future they understand least — especially whether alignment holds, or whether rare misalignments compound as models build successors, until control slips.
the one they’re most uncertain aboutBuild the option to slow down — verifiably
The piece ends on policy, not product. A unilateral pause just changes who leads; what’s missing is the ability to verify others have actually slowed.
Why a credible pause is hard — and worth building toward
A slowdown that only lets the least cautious catch up leaves everyone less safe. So the goal is the option: systems that let frontier labs verify others have genuinely stopped. Anthropic says if such systems existed and peers paused verifiably, it expects it would too.
Detection beats verification — and even that’s tough
Training runs are easier to conceal than missile silos, inputs are general-purpose, and whoever continues while others pause inherits the lead.
We’ve done it before — slowly
Regimes like the INF Treaty built verification and trust over decades. The authors’ blunt line: “We don’t have that long.”
Reading it in proportion
- This is one lab’s account of its own internal data — much previously unreported, not independently audited.
- The soft spots are stated in the original: lines-of-code overstates productivity; the self-reported 4× is probably high; the headline research result didn’t transfer to production scale; the next-step test used cherry-picked moments.
- “More autonomous” is not “fully autonomous” — every standout result still had a human framing the problem and defining success.
- That the authors surface these caveats themselves — against their own incentive — is part of what makes the document serious.
Potential for Rapid Autonomous AI Development
This evidence suggests that AI systems could soon reach a point where they can autonomously improve their own architecture and algorithms, possibly leading to a rapid escalation in capabilities. Such a shift could accelerate AI progress beyond current expectations, raising questions about safety, control, and regulation. The findings challenge the assumption that human oversight will always be necessary for AI development, emphasizing the importance of monitoring these technological trends.
Current State of AI Self-Development Capabilities
Prior to this report, discussions about AI self-improvement were largely speculative, based on theoretical models or future projections. Public benchmarks have shown steady progress, but concrete internal data from labs like Anthropic has been scarce. The recent publication marks a rare instance of transparent, data-driven evidence indicating that AI systems are already automating significant parts of their own development cycle, with measurable acceleration over recent years. Read about AI self-development capabilities.
Anthropic’s findings build on earlier trends of exponential improvement in AI benchmarks, now extended by internal metrics showing AI’s increasing ability to generate code, troubleshoot, and reproduce research results without human intervention. These developments have sparked debate about the timeline and risks of autonomous AI evolution.
“The data from Anthropic provides a rare, concrete glimpse into how fast AI capabilities are growing internally, not just in benchmarks.”
— Thorsten Meyer, AI researcher
Unresolved Questions About Autonomous Goal-Setting
It remains unclear when or if AI systems will be capable of fully autonomous goal-setting and design, leading to true recursive self-improvement. The report emphasizes that the ‘deciding’ aspect is still human-driven, and whether this bottleneck can be overcome is an open question. Additionally, the implications for safety and control are still under active discussion and investigation.
Monitoring AI Progress and Preparing for Autonomous Development
Researchers and policymakers will likely focus on tracking internal AI capabilities and developing safety protocols to manage potential runaway self-improvement. Further transparency from labs and continued benchmarking will be crucial to understanding the pace of progress. The next milestones include observing whether AI can autonomously select and pursue research goals without human input.
Key Questions
What is recursive self-improvement in AI?
Recursive self-improvement refers to AI systems improving their own architecture, algorithms, or capabilities without human intervention, potentially leading to rapid, exponential growth in intelligence.
How does Anthropic measure AI’s ability to develop itself?
Anthropic uses internal data on code generation, experimental automation, and benchmark performance to assess how much AI can independently perform research and engineering tasks.
Are AI systems currently capable of fully autonomous self-improvement?
No, current evidence indicates that while AI can automate many tasks, the critical decision-making aspects still rely heavily on humans. Fully autonomous self-improvement remains a future possibility, not a present reality.
Why is this development significant for AI safety?
If AI systems can autonomously improve themselves, controlling and predicting their behavior becomes more complex, raising safety and ethical concerns that need urgent attention.
What are the next steps for researchers studying AI self-improvement?
Next steps include tracking internal capabilities, developing safety measures, and observing if AI can independently set and pursue research goals, moving toward autonomous self-improvement.
Source: ThorstenMeyerAI.com
