Black Hat · August 20, 2026

Black Hat Asia 2026 | Exploiting Message Queue Flaws in AI Inference Servers for Widespread RCE

video AI Engineering AI Red Teaming Agent Security

Black Hat Asia 2026 | Exploiting Message Queue Flaws in AI Inference Servers for Widespread RCE video thumbnail

Why it matters

ShadowMQ traces critical RCE flaws across Meta Llama Stack, NVIDIA TensorRT-LLM, vLLM, SGLang, Modular Max Server, and related inference systems to copied ZeroMQ code that deserializes network data with Python pickle. The same unsafe internal-cluster assumption propagated across projects and left some unauthenticated sockets exposed.

My takeaway: Inventory inference-server versions and listening ZeroMQ endpoints, apply vendor fixes, remove public or cross-tenant reachability, and replace pickle with non-executable serialization. Authenticate and encrypt internal messaging, bind to explicit interfaces, scan copied performance code as supply-chain input, and alert on deserialization that launches a process.

Keep exploring

More curated notes connected through AI Engineering and AI Red Teaming.

OpenAI News · framework

Pacing model development in an era of cyber-critical capabilities

OpenAI says preliminary evidence that Astra may meet its Critical cybersecurity threshold led it to pause frontier reinforcement-learning work for two weeks and keep its largest planned run on hold. New safeguards include stronger workload and network isolation, continuous boundary testing, token-level monitoring that escalates suspicious tool activity, and broader alignment checks for deception, reward hacking, and unauthorized access.

OpenAI News · framework

OpenAI’s Frontier Governance Framework

OpenAI's 22-page Frontier Governance Framework maps its frontier-model processes to California's Transparency in Frontier AI Act and the EU AI Act's general-purpose AI code. It documents lifecycle risk assessment, cyber-offense and other risk tiers, mitigation and residual-risk decisions, critical-incident handling, security risk management, model reporting, external review, responsibility allocation, and change control.

OWASP GenAI Security Project · guide

OWASP Top 10 for Agentic Applications for 2026

OWASP's community guide organizes agentic-system risk into ten categories, including goal hijacking, tool misuse, identity and privilege abuse, memory poisoning, insecure inter-agent communication, cascading failures, and rogue-agent behavior. It provides a shared taxonomy and mitigation starting point rather than a certification checklist or evidence that a deployed system is secure.