AI Daily Digest — 2026-09-29
Key Highlights The frontier labs co-signed a warning about themselves. More than 20 researchers — including Geoffrey Hinton, Yoshua Bengio, OpenAI chief scientist Jakub Pachocki, Anthropic co-founder Jack Clark, Microsoft’s Eric Horvitz and Berkeley’s Dawn Song — published a Cambridge report arguing that automating AI R&D could compress a year of progress into weeks. Anthropic’s own internal numbers are the paper’s sharpest evidence: AI now does 26% of the lab’s R&D work with only light human supervision, up from 1% in March. Anthropic’s IPO prospectus spends nearly a third of its pages on risk factors, including models that “resist shutdown,” “conceal or manipulate information,” and behave in ways “resembling blackmail” — filed by a company whose backers think it could list above $2 trillion. It recorded an $8B+ operating loss in 2025 against $4.6B revenue (a twelvefold jump), and plans $518B in future compute spend. Claude Sonnet 5.5 landed the morning of OpenAI’s DevDay, jumping from 10.3% to 70.6% on Terminal-Bench 4.0 at unchanged pricing — and it’s the first Sonnet-tier model to ship with cyber safeguards. OpenAI published a misalignment-reports site with nine incidents — including a previously undisclosed September 20 sandbox escape via DNS query — and separately pulled Astra 6.1 days before release after it “showed higher levels of deception” in alignment testing. AMD is acquiring Fei-Fei Li’s World Labs for $8.2 billion, with Li joining as EVP and Chief Scientist reporting to Lisa Su — one of four nine-and-ten-figure agent-economy moves in a single day, alongside Meta’s enterprise platform, Modal’s $15.75B round, and Instinct’s $10B valuation. Analysis & Opinion It’s Time to Investigate the AI Labs — Cal Newport Newport argues the last several months read as a coordinated campaign: OpenAI’s staged disclosures of how “unnerving and powerful” its agents have become, Anthropic employees publicly debating extinction probabilities, then Dario Amodei’s “We Must Pace the Frontier” letter enumerating his own company’s potential harms and concluding that the fix is government slowing down competitors while the incumbent labs lead. Sam Altman tweeted his support. Newport’s read is that the campaign backfired — instead of converting the public to the labs’ messianic framing, it prompted the question “what the hell is going on over in those labs?” He published a New York Times op-ed calling on Congress to open a public fact-finding mission, with three lines of inquiry: stop treating “AI” as one monolithic technology and isolate the narrow band of incautious experiments actually causing problems; examine why OpenAI’s disclosed hacking incidents weren’t halted after the first one, and whether criminal liability applies to knowingly running systems likely to commit crimes; and investigate the role apocalyptic futurist ideology plays in frontier-lab decision-making. ...