Full Archive · Page 68

Research archive, page 68

Browse entries 1609–1632 of 1636. Return to the first page to search and filter the complete collection.

Build for the Memo, Not the Demo — Shawn Chan, China Resources Holdings video thumbnail Play video
AI Engineer July 30, 2026 video

Build for the Memo, Not the Demo — Shawn Chan, China Resources Holdings

When a company is about to spend $100 million, Shawn Chan is the person in the room deciding whether it happens, and after fifteen years and roughly 200 investment committees he can spot the flaw fast. Now some of the decks in front of him are AI generated: cleaner formatting, never defensive, and confidently wrong.

METR November 22, 2024 analysis

RE-Bench compares research agents and human experts under explicit compute budgets

METR’s November 2024 RE-Bench release provides seven research-engineering environments, human-expert attempts and agent transcripts. Tasks involve objectives such as optimizing kernels, recovering model performance and fitting scaling laws under specified resources. Results depend strongly on time allocation: agents often benefit from selecting the best of many short attempts, while humans benefit from longer continuous work.