AI Engineer · July 24, 2025

Benchmarks Are Memes: How What We Measure Shapes AI — and Us - Alex Duffy, Every.to

Benchmarks Are Memes: How What We Measure Shapes AI — and Us - Alex Duffy, Every.to video thumbnail
Why it matters

AI Engineer session on Benchmarks Are Memes: How What We Measure Shapes AI, presented by and Us - Alex Duffy, Every.to. It adds practical context for how teams are building and operating AI systems in production.

My takeaway: Useful for model evaluation because it ties capability claims to benchmarks, training decisions, or deployment tradeoffs instead of relying on surface-level demos.