Skip to main content
Search

# Agent Security

12 related articles

Subscribe to updates
  1. arXiv

    SecureGARD puts a semantic gate on tool calls: zero observed attack success across three benchmarks and two backbones

    Tool-using LLM agents turn model output into real actions, making indirect prompt injection an execution-security problem. SecureGARD inserts an executable ontology between planning and tool execution, grounding heterogeneous tool calls into shared semantic actions and judging each as ready, waiting, or forbidden against the current task state. Under benign and indirect-injection settings on AgentDojo, ASB, and AgentDyn, the observed attack success rate is 0% on both backbones, with higher task utility under attack than the compared baselines.

  2. NVIDIA puts AI agent security on BlueField-4: monitoring and containment keep running in silicon even if the host is compromised

    NVIDIA announced NVIDIA Sentry at GTC Berlin, a security framework that runs on BlueField-4 DPUs and places monitoring and policy enforcement for AI agents' access to models, tools and data in a separate hardware trust domain beyond host software. Earlier agent security relied on software runtime boundaries, so an agent that escaped its sandbox could alter or disable its own restrictions; Sentry inspects agent-to-model traffic through the DOCA Tower transparent proxy and reads runtime state outside the host with DOCA Argus, containing agents at millisecond scale. The framework is planned for availability early next year, and developers can begin with DOCA Argus, DOCA Flow and other libraries and microservices to experiment with out-of-band observability and infrastructure enforcement.

  3. Same refund call, different authority: separating purpose from effect cuts worst-case direct-harm pass-through from 100% to 34.5% under mislabelled channels

    When an institutional AI agent proposes a tool call, the same refund may come from an authorised tax officer or from an instruction hidden in the petition it was asked to summarise. This authorisation guard keeps separate neutrosophic triples for effect and for purpose, discounts evidence by channel trust, fuses it, and then authorises, escalates or denies. On 1,054 InjecAgent attack cases, retaining ambivalence about an unrequested call lowered worst-case direct-harm pass-through after channel mislabelling from 100% to 34.5%, and to 25.0% on synthetic e-government scenarios.

  4. arXiv

    Phone agents fall to cross-modal injection: same payload in screenshot and UI text hits 85.4% attack success, single-channel repeats lag

    For multimodal-LLM phone agents, MobileInject places one malicious objective in both the screenshot and the interface text and runs 108 executable risk instances on a resettable Android emulator. Prior evaluations mostly watched a single text channel or judged only whether an attack succeeded; with exposure counts matched, one appearance per channel reached 85.4% attack success and 0% benign completion, while repeating within one channel reached only 72.9% or 27.8%. In 30 of 108 paired instances, neither single channel succeeded but the aligned pair did.

  5. arXiv

    Agent memory poisoning moves past stored content: which experiences are kept, and in what order they merge, can flip decisions

    MemForm splits how an LLM agent's long-term memory is formed into five intervenable interfaces, and across six models and two response formats all five showed behavior being rewritten.

  6. arXiv

    ASPIRE uses a behavior graph and dual explore-exploit experts to find agent prompt-injection vulnerabilities, reaching 54.1% attack success on AgentDojo

    ASPIRE is an open-ended prompt-injection red-teaming framework for LLM agents that maintains an evolving Agent Security Behavior Graph, uses complementary Explore and Exploit experts to propose consequence-centric test skeletons, has a separate realizer build concrete payloads and trigger queries, and updates the graph and cross-run strategy memory from trajectory evidence; on AgentDojo and AgentDyn it raises attack success to as high as 54.1% while covering more consequences, injection methods, environments, and behavior paths.

  7. arXiv

    CredLeak-Bench: All seven tested LLM agents leaked credentials to phishing, with recovery topping out at 24.2%

    The authors introduce CredLeak-Bench, a sandboxed benchmark that measures leakage through actual submissions of synthetic credentials across directed authentication, autonomous inbox monitoring, and recovery settings with paired legitimate controls; evaluating seven models, they find every model leaks in both primary settings, phishing can induce disclosure without any authentication request, most leakage-reducing mitigations also impair legitimate task completion, and recovery ranges only from 0% to 24.2%.

  8. arXiv

    HarnessSecurity-Bench tests six coding agents: enabling auto-approve raises attack success from 29.2% to 95.6%

    The work builds a ten-mechanism taxonomy across 40 coding agent harnesses and rates 400 harness–mechanism cells (205 confirmed implemented, 83 confirmed absent, 112 unresolved), then introduces HarnessSecurity-Bench, which runs 2,500 trials under GLM-5.2 on 23 tasks across five attack surfaces with separate deterministic oracles for six harnesses, finding that enabling auto-approve raises attack success from 29.2% to 95.6%, that network isolation and read-only mode cut attack success from 57.1% and 8.3% to 0.8% at utility losses of 24.5 and 34.0 percentage points, and that command allowlisting and denylisting reduce attack effects with a small utility loss and a utility gain respectively.

  9. arXiv

    SRFT lets LLM agents learn from their own failures, cutting AgentDojo attack success from 7.59% to 1.26%

    The work proposes Self-Reflection Fine-Tuning (SRFT): it injects attack instructions into clean expert trajectories, samples the agent's own potentially failing actions under the attacked context, and has an expert model generate structured self-reflection reasoning that contrasts unsafe and optimal actions, which then supervises fine-tuning; instantiated as SR-Agent on Llama-3.1-8B-Instruct and Qwen3-8B, it reduces AgentDojo attack success rate from 7.59% to 1.26% and from 16.97% to 1.05% respectively, and keeps a low attack success rate under the RL-Hammer adaptive attack.

  10. arXiv

    CorrGRPO swaps covariance for Pearson correlation in the normalization denominator, beating GRPO on code generation, tool calling, and agent security

    The work observes that when GRPO trains with multiple rewards it normalizes the summed reward by its within-group standard deviation, whose variance equals the sum of all pairwise reward covariances, so large-scale rewards can dominate the normalization and suppress smaller-scale reward signals; the authors propose CorrGRPO, which replaces pairwise covariances in the denominator with Pearson correlation coefficients while keeping the centered total reward unchanged, and compare it with GRPO and variants such as GDPO on code generation, tool calling, and agent utility versus security across models from 0.5B to 8B parameters, reporting improvements in all three domains and an outward expansion of the empirical Pareto frontier between competing objectives.