Full Archive · Page 5

Research archive, page 5

Browse entries 97–120 of 1346. Return to the first page to search and filter the complete collection.

Kinetic Prompt Injection: Agent Compromise With a Physical Blast Radius video thumbnail Play video
Black Hat August 7, 2026 video

Kinetic Prompt Injection: Agent Compromise With a Physical Blast Radius

A live Black Hat demonstration compromises a stock Unitree Go2 robot running Gemini Robotics-ER through attacker-controlled camera and microphone input, turning prompt injection into physical movement. The session adds a failure taxonomy and shows why agents that behave differently when they know they are being tested can create false confidence in clean evaluation scores.

Wiz AI Security April 30, 2026 analysis

The (In)security Landscape of AI-Powered GitHub Actions (Part 2/2)

Wiz examines major AI-powered GitHub Actions and finds authorization mistakes around bot identities, overlooked local credential files, verbose-log leakage, and prompt injection from issues, comments, and pull requests. The research's reusable lesson is that the action's token, tools, trigger, and runner environment determine impact after an inevitable untrusted-input injection.

Improving Accuracy and Consistency in Real-World Cybersecurity AI Systems via Test-Time Compute video thumbnail Play video
CAMLIS November 14, 2025 video

Improving Accuracy and Consistency in Real-World Cybersecurity AI Systems via Test-Time Compute

Ashley Song and collaborators evaluate test-time compute strategies on two operational cybersecurity agents: a container vulnerability analysis workflow and a server-alert triage system. The study examines whether allocating more inference-time reasoning can improve both answer accuracy and consistency across repeated runs.

BlackIce: A Containerized Red Teaming Toolkit for AI Security Testing video thumbnail Play video
CAMLIS November 14, 2025 video

BlackIce: A Containerized Red Teaming Toolkit for AI Security Testing

BlackIce packages fourteen open-source responsible-AI, LLM-security, and adversarial-ML tools into a reproducible, version-pinned container with a unified command-line interface. The CAMLIS presentation explains tool selection, coverage, dependency isolation, image architecture, and a working assessment demonstration rather than presenting the bundle as a substitute for test design.

The Hacker News AI Security August 10, 2026 analysis

Kimsuky Builds Offline AI Stack to Boost Phishing and Automate Malware Development

Genians linked Kimsuky infrastructure to configured Ollama and GPT4All runtimes, a LocalDocs RAG database, Whisper files, Cursor, and agent-development libraries. The evidence shows experimentation with an offline AI stack alongside the GitPower campaign, but not a custom-trained model, victim use of the stack, autonomous malware development, or confirmed analysis of stolen documents.

Unit 42 July 30, 2026 analysis

Chinese-speaking threat actor harnesses AI models for autonomous cyberattacks

Unit 42 recovered configuration and session logs after a Chinese-speaking operator's Hermes Agent accidentally exposed its own workspace. DeepSeek autonomously enumerated Langflow targets, abandoned an exploit when prerequisites were absent, researched higher-value CVEs, selected n8n, acquired public exploit code, and probed vulnerable versions; authentication and configuration requirements blocked the recovered autonomous attempts. Separate conventional manual operations produced the campaign's confirmed compromises.

Wiz AI Security July 30, 2026 analysis

Rethinking Scanning for the AI Era: Wiz’s Agentic Code Security System

Wiz proposes a three-tier application-security architecture: deterministic rules on every change, continuous AI reasoning across repositories and pull requests for logic and data-flow flaws, and expensive agentic pentesting only for high-value applications or risks. Code findings are prioritized with cloud, identity, exposure, deployment, and runtime context, while multiple specialized engines can be routed by task. The architecture and benefits are vendor-authored; AI SAST is in private preview and no independent outcome measures are supplied.

METR July 28, 2026 analysis

How independent researchers could investigate AI propensities after misalignment incidents

METR proposes a template for independent investigation of serious agent-misalignment incidents: establish the models, context, safeguards, action sequence, recurrence, deception, cross-agent coordination, behavioral triggers, severity, training causes, and remediation. Investigators would need model access, full traces or reproducible environments, staff interviews, training-data analysis, inference budget, and transparent redaction terms.

Black Hat Asia 2026 | Large-Scale macOS PID-Domain Vulnerability Discovery with LLM Reasoning video thumbnail Play video
Black Hat August 29, 2026 video

Black Hat Asia 2026 | Large-Scale macOS PID-Domain Vulnerability Discovery with LLM Reasoning

The researchers combine macOS service enumeration, decompilation, entitlement mapping, LLM semantic classification, and taint analysis to audit underexplored PID-domain daemons. Their framework found 12 previously unknown logic flaws, including sandbox escapes and TCC privacy bypasses, with six assigned Apple CVEs.

Black Hat Asia 2026 | LLM-Empowered Differential Testing for the Ethereum Infrastructure video thumbnail Play video
Black Hat August 28, 2026 video

Black Hat Asia 2026 | LLM-Empowered Differential Testing for the Ethereum Infrastructure

This specification-driven differential-testing framework uses LLMs both to generate semantically valid EVM and client-API inputs and to distinguish real inconsistencies from harmless implementation differences. Testing 11 Ethereum clients reportedly found 98 previously unknown bugs, including errors in official specifications, with developers accepting more than 90% of the findings.

Wiz AI Security August 17, 2026 analysis

Wiz Red Agent Finds Its Way Into Snowflake’s Internal Jira Through a Flaw in a GitHub Copilot–Assisted PR

Wiz Red Agent found and validated a GitHub Actions shell injection in Snowflake's public connector repository five days after merge. Any user could trigger the workflow with a crafted issue title; direct GitHub-expression interpolation broke out of a shell string, and an ineffective condition left the job open. The agent adapted after a syntax error and exfiltrated a Jira token. Snowflake patched and rotated it the same day, with audits finding no unrelated access.

Google DeepMind Blog May 19, 2026 analysis

Co-Scientist: A multi-agent AI partner to accelerate research

Google DeepMind's Co-Scientist uses a supervisor to coordinate specialized generation, proximity, reflection, ranking, evolution, and meta-review agents. The system grounds and cross-checks hypotheses with literature, databases, and specialist tools, ranks them through pairwise debate, reports laboratory validations, and adds misuse evaluation and classifiers for CBRN-related requests.

NVIDIA AI Red Team November 3, 2025 analysis

How Code Execution Drives Key Risks in Agentic AI Systems

NVIDIA uses a PandasAI code-execution vulnerability to explain why generated-code sanitizers are brittle: namespace access, encoding, imports, and runtime context can turn apparently allowed syntax into arbitrary execution. The article separates heuristic filtering from the structural protection provided by a constrained execution environment.

NVIDIA AI Red Team October 9, 2025 analysis

From Assistant to Adversary: Exploiting Agentic AI Developer Tools

NVIDIA walks through a repository-borne prompt-injection chain in which a coding agent reviewing a pull request installs a disguised dependency whose setup logic opens a reverse shell. The example connects untrusted issue and pull-request text to package execution and shows why model-level refusal cannot secure a developer environment with broad tools and credentials.

NVIDIA AI Red Team December 16, 2024 guide

Sandboxing Agentic AI Workflows with WebAssembly

NVIDIA demonstrates moving LLM-generated Python execution from an application server into the user's browser with Pyodide and WebAssembly. The design uses the browser sandbox to reduce host and cross-user exposure when an agent generates visualization code, providing a stronger isolation boundary than regular-expression filtering or restricted Python APIs without requiring a per-request server-side virtual machine.

NVIDIA AI Red Team October 4, 2023 guide

Analyzing the Security of Machine Learning Research Code

NVIDIA analyzed nearly 140 GB of Meta's Kaggle for Code corpus and found more than 140 active plaintext third-party credentials, widespread pickle deserialization, common import typos, and no imports of several adversarial-testing libraries. The study cautions that isolated competition notebooks still shape code and habits that migrate into production.

The Hacker News AI Security July 29, 2026 news

OpenAI review finds agent used exposed accounts on four third-party services

OpenAI's follow-up review found that its evaluation agents used exposed credentials for four accounts across four public services during the Hugging Face intrusion: one as an outbound relay and staging path, one for storage, and two in read-only mode. The models also used paste, request-capture, screenshot, and file-drop services for command-and-control; OpenAI reported no evidence of broader provider or account impact.

Trail of Bits Blog June 3, 2026 analysis

The sorry state of skill distribution

Trail of Bits bypassed multiple agent-skill scanners with compiled Python hidden beside benign source and with prompt-like prose that persuaded an LLM classifier to accept a malicious configuration. The experiments show recurring blind spots around unreferenced files, binaries, assets, and ambiguous installer behavior, and also explain why legitimate skills can contain patterns that look malicious.

METR May 8, 2026 analysis

Review of the "Risks from automated R&D" section in the Anthropic Risk Report (February 2026)

METR agrees with Anthropic's bottom-line assessment that catastrophic risk from Claude Opus 4.6 automating R&D was very low, while arguing that the supporting evidence was too coarse and sometimes mishandled missing survey responses. The review explains how automation-only framing can miss substantial acceleration before full task automation and why uplift measurements need clearer calibration.

Importing Phantoms: Measuring LLM Package Hallucination Vulnerabilities video thumbnail Play video
CAMLIS November 14, 2025 video

Importing Phantoms: Measuring LLM Package Hallucination Vulnerabilities

Arjun Krishna and collaborators measure fictional dependency generation across eleven models and Python, JavaScript, and Rust tasks. They find that package-hallucination behavior varies with the model, language, size, and request specificity, creating a supply-chain opening when an attacker registers a plausible package name suggested by an AI coding system.