Research
Anthropic publishes three internal metrics for tracking the pace of AI development
Anthropic released figures on how much of its own AI research is led by AI, how closely it monitors autonomous agents, and how much computing power goes to safety work. It said outside parties could use the measures to judge how fast frontier labs are moving.
By the company's own index, Claude led 26 percent of Anthropic's AI research and development work in August, with more than 90 percent of the measured work involving some degree of AI collaboration and none of it running fully autonomously. Anthropic said roughly 30,000 agents were operating on its main internal platform, that automated monitors covered every action, and that about 0.002 percent of actions were blocked. A snapshot taken between July 13 and 20 put safety research at 6 percent of AI research compute.
The company presented the exercise as a way to narrow the distance between what frontier laboratories know and what the public can see, and listed caveats of its own: the ratings depend on a judge model, the task baseline is frozen, agent monitoring is only months old, and compute is an imperfect proxy for safety effort. The numbers are Anthropic's own measurements and were not independently audited. The release followed chief executive Dario Amodei's call for coordinated pacing of frontier development.
Source details
- Source
- Anthropic
Source reporting
Read the original reporting and research behind this briefing.