Research Radar
Daily · November 5, 2026
0 peer-reviewed · 10 preprints · 0 forum/blog · 10 items
AI Safety · Alignment · Mech Interp
01
AI security agent security IPI defense preprint

Securing Web Agents with the Compile-Then-Execute Paradigm

ReAct web agents are vulnerable to prompt injection because the planning model must read live page content — the attack surface. Baya eliminates this by compiling the user's task into a Python program against a Trusted Website API before touching the live site, so injected instructions can influence values but cannot redirect the task or introduce new operations. The result: 0% attack success on WASP, 77.8% utility on WebArena Verified — beating both ReAct baselines on both dimensions simultaneously.

Baya: Compile-Then-Execute ① Compile (offline) Planning model reads Trusted API schema Compiles task → Python program Never sees live webpage content ② Execute (runtime) Program runs against live site Injected text → affects values only Cannot add new operations WebArena Verified (581 tasks) · WASP Security Benchmark Baya: 77.8% utility Browser ReAct: 55.1% API ReAct: 66.7% Baya: 0% ASR Browser ReAct: 25.5% ASR API ReAct: 16.2% ASR
Figure 1: Baya's compile-then-execute architecture. The planner sees only the Trusted Website API schema — not live page content — and compiles the task into a program. At runtime, only the program processes untrusted web content, so injected instructions cannot create new operations or redirect the task. 77.8% utility on WebArena Verified vs 55.1% (browser ReAct) and 66.7% (API ReAct); 0% ASR on WASP vs 25.5% and 16.2%.

Chow et al. argue that the ReAct paradigm is structurally vulnerable because every action is grounded in live, untrusted observations. Baya introduces the Trusted Website API as a unified, action-rich abstraction; the planner receives its schema but never sees live webpage content. The compiled program calls this API at runtime, and untrusted page data can only affect variable values or select among compile-time-fixed branches — it cannot introduce new API operations or change the task goal. On 581 valid WebArena Verified tasks, Baya achieves 77.8% aggregate utility vs 55.1% (browser-only ReAct) and 66.7% (API-enabled ReAct). On the WASP security benchmark, Baya achieves 0% attack success rate vs 16.2% and 25.5% for the baselines. The main limitation noted by the authors is that a Trusted Website API must be implemented per web application.


02
AI security agent security supply chain preprint

Beyond Prompt Injection: The Tool Update Gap in LLM Agent Security

Every context-window defense — prompt-injection detectors, sandwiching, spotlighting — inspects what the model sees. Tool update attacks bypass this by design: malicious code ships inside a tool's update and runs outside the model's context window entirely. Evaluated on seven major agentic frameworks including Gemini CLI, Codex CLI, and Claude Code, the ETUDE attack achieves 97.6% success while maintaining 95.9% legitimate task completion — and no existing defense detects it.

ETUDE: The Tool Update Gap Malicious Tool Update Keeps benign interface Embeds hidden payload No prompt-visible syntax Model Context Window Prompt-injection detectors ✓ (miss it) Tool call output (normal-looking) Payload executes outside context window 7 frameworks · 3 attack workloads Attack success: 97.6% · Legit task completion: 95.9% Frameworks: Gemini CLI, Codex CLI, Claude Code + 4 others — no defense detects it
Figure 1: The ETUDE attack ships malicious logic inside a tool update while keeping the tool's visible interface intact. Because the payload runs outside the model's context window, it is invisible to all defenses that work on model-visible content. 97.6% attack success rate; 95.9% legitimate task completion; no tested defense detects it.

Kan et al. demonstrate that the security perimeter defined by prompt injection defenses stops at the edge of the model's context window — and tool code runs outside it. ETUDE (Exploiting Tool Updates for Direct Execution) embeds malicious functionality into tool update code while keeping the original benign behavior intact, requiring no adversarial text in any prompt. Evaluated across three attack workloads on seven agentic frameworks, ETUDE achieves 97.6% attack success rate and 95.9% legitimate task completion. The authors test all major existing defenses (input sanitization, instruction hierarchy, spotlighting, sandwiching) and report none provide protection. They call for a tool-integrity verification layer at the execution boundary that checks tool code authenticity before each invocation.


03
AI security alignment safety robustness preprint

Addition by Subtraction: Toward Mitigating Fragile Safety Alignment in Large Language Models

Safety alignment is fragile because it concentrates in a few critical neurons or a single low-rank direction; remove those and the model is fully misaligned. This paper fights sparsity with sparsity: it identifies those neurons and removes them during preference optimization, forcing safety behavior to redistribute across the network. The result resists pruning attacks, refusal-direction ablation, and many black-box jailbreaks — with up to 90% attack success rate reduction.

Addition by Subtraction — Redistributing Safety Baseline Model Safety in sparse critical neurons Prune → misaligned Subtraction Phase Identify safety-critical neurons iteratively Remove + pref. optim. Robust Model Safety distributed across network Resistant to pruning Results — 4 models, 3 vendors Up to 90% ASR reduction on pruning & refusal-direction ablation attacks Generalizes to many black-box jailbreaks Improved truthfulness · General capabilities mostly preserved
Figure 1: Addition by Subtraction deliberately removes identified safety-critical neurons during preference optimization, forcing the model to re-install safe behavior through distributed weights. This load-balances safety representations and makes them resistant to pruning-based, ablation-based, and many black-box jailbreaks — up to 90% ASR reduction across 4 models from 3 vendors.

Dashtbani and Dmitrienko start from the well-established observation that safety alignment is sparse: pruning a few safety-critical neurons or ablating a single refusal direction reliably removes alignment. Their approach deliberately exploits this by identifying those neurons via gradients and iteratively removing them during the preference optimization loop, then forcing alignment to recover through other, non-critical weights. Applied to four models from three vendors, the resulting models are substantially more robust to pruning attacks and refusal-direction ablation, with attack success rate reductions of up to 90% on some attacks. These gains transfer to many black-box jailbreaks that do not target specific neurons. The authors also report improved truthfulness and mostly preserved general capabilities, suggesting that redistributed safety representations are not merely harder to remove but are of higher quality.


Items 4 – 10 · Also notable
04
alignment evaluation deception preprint

Alignment Faking Depends on the Value, Not Just the Model

Compliance Gaps: Monitored vs. Unmonitored 0.0 0.1 0.2 0.3 0.5 0.50 Model-Value Pairings (32 ValueBench dims × 10 models; representative)
Figure 1: Compliance gaps (monitored minus unmonitored compliance) vary by model-value pairing, not by model alone. Gaps range from 0.05 to 0.50; a 70B distilled model outperforms a ~675B model on this measure, underscoring that scale does not predict behavioral consistency.

Ray et al. extend alignment faking evaluation beyond narrow harm-avoidance to 32 ValueBench dimensions across 10 open- and closed-weight models (8B–675B), scoring each model-value pair under bare, unmonitored, and monitored conditions. Compliance gaps range from 0.05 to 0.50; most structural variance comes from the model-value pairing, not either alone. Under monitoring, training-signal reasoning dominates traces; without monitoring, value-conflict reasoning takes over. Per-model results are packaged as "value cards" extending standard model cards with behavioral-disposition information.


05
AI security agent security MCP preprint

Signed, Sealed, Leaked: Trust Beyond Signature for MCP Toolchains

Germline Execution for MCP Security Germline Process data-free baseline Copy A (benign tool) data for dest. A only leaks ≤ authorized Copy B (benign tool) data for dest. B only leaks ≤ authorized Copy C (malicious) tries to exfiltrate only holds authorized data 153 attack runs: 0% unauthorized disclosure · 10–49 ms/invocation · formal proof
Figure 2: Germline execution model. Each MCP tool call forks from a data-free parent and receives only the data authorized for its destination. Even if a signed tool carries malicious code, it cannot leak data it was never given. 0% unauthorized disclosure in 153 attack runs; baselines leaked in 5.9–74.5%.

Aun et al. demonstrate that a signed MCP tool can covertly exfiltrate data by embedding secrets in permitted outbound traffic, bypassing MCPGuard-Dynamic in some trials. The germline defense forks each tool invocation from a data-free process, filling the copy only with data authorized for its destination; malicious code is limited to leaking what it was given. Across 153 attack runs, germline execution produces 0% unauthorized disclosure (vs 5.9–74.5% for baselines). Invocations complete in 10–49 ms; the authors provide a formal proof of sink noninterference under stated copy-confinement and data-free-germline assumptions.


06
mech-interp AI security alignment preprint

Does Context Compression Preserve Refusal Alignment?

Compression Weakens Refusal Direction Uncompressed Input → LLM Refusal direction fully activated Encoder Compressed High fidelity ✓ Refusal direction suppressed + Memory Steering In-space intervention No retraining Near-baseline refusal Semantic preservation ≠ behavioral preservation Effect holds across model families and compression architectures
Figure 1: Encoder-based compression suppresses the refusal direction even with high reconstruction fidelity. Memory Steering, an inference-time intervention operating entirely in compressed representation space, restores near-baseline refusal rates without retraining. Semantic preservation does not guarantee behavioral preservation.

Nguyen and Lin find that encoder-based context compression reduces refusal behavior in instruction-tuned LLMs even when reconstruction fidelity is high, because compression suppresses activation magnitude along the learned refusal direction. This effect holds across model families and compression architectures. Memory Steering — a lightweight inference-time correction that works entirely in compressed representation space and requires no retraining — restores refusal rates to near-baseline levels. The practical implication: systems using KV-cache compression or long-context compression for efficiency must separately verify that alignment-relevant features are preserved.


07
AI security agent security IPI defense preprint

SecureGARD: Dynamic Ontology-Guided Governance for Secure Tool-Using LLM Agents

SecureGARD: Ontology-Guided Action Classification Executable Ontology Tool semantics State dependencies LLM-refined + validated Action Classifier READY → execute WAITING → replan FORBIDDEN → block Results 0% ASR AgentDojo ASB · AgentDyn Ontology refined offline via LLM proposals → consistency checks → held-out validation → frozen Better utility under attack than existing baselines · "waiting" enables bounded replanning
Figure 2: SecureGARD's ontology-guided classification pipeline. Each proposed agent action is classified as ready, waiting, or forbidden using an executable ontology refined offline. 0% attack success rate on AgentDojo, ASB, and AgentDyn; improved utility under attack vs baselines.

Xiong et al. encode tool call semantics and episode-level state dependencies in an executable ontology, refining it offline using LLM-proposed rules that must pass consistency checks and held-out validation before freezing. At runtime, SecureGARD classifies each proposed action as ready (execute), waiting (prerequisite missing but recoverable), or forbidden (block). The waiting verdict enables bounded replanning without widening permissions. On AgentDojo, ASB, and AgentDyn under indirect prompt injection, SecureGARD reports 0% attack success rate and higher task utility than existing defenses.


08
AI security agent security preprint

When File Ingestion Misleads Language Models: Measuring and Mitigating Divergences in Office Documents

OOXML Extractor / Human-View Divergence Human View Sees: visible text A Doesn't see: hidden content in XML Normal reading order Model / Extractor View Reads: hidden XML 19 hidden channels Drops: 12 visible Reordered reading 5 Attacks No injection syntax Invisible to reviewer All 4 assistants (ChatGPT, Claude, Gemini, 365 Copilot) + 4 coding agents misled by ≥1 attack
Figure 1: OOXML extractors read content humans can't see (19 channels) and drop content humans can see (12 channels), enabling attacks that reorder document reading without injection syntax. All 4 tested chat assistants and 4 coding agents (Codex, Claude Code, Antigravity, GitHub Copilot CLI) are affected by at least one attack.

Li identifies 19 OOXML channels where extractors give models hidden content humans cannot see, and 12 channels where visible content is dropped; five attacks exploit this divergence without embedding explicit injection instructions. All four chat assistants and four coding agents tested are misled by at least one attack. The Prism defense rebuilds the human-visible view from the OOXML specification before extracting text, and generalizes to attacks outside its training distribution.


09
mech-interp unlearning alignment preprint

Do unlearning algorithms learn the right features?

Output Matching ≠ Feature Recovery Standard Output Metric Unlearned ≈ Retrained (outputs) ✓ PASS Hidden: different features → fails under relearning Feature Recovery Metric Scores missing features Scores extraneous features Predicts downstream failures Applied to 8 methods Formal: identical outputs ≠ identical features; one gradient step on head can break output agreement
Figure 1: Standard output-based unlearning metrics provably miss feature-level divergence. The new feature recovery metric separates missing and extraneous features; applied to 8 methods, it predicts which models will fail under relearning and downstream adaptation — unlike output metrics.

Dolgova et al. prove formally that two models with identical outputs can encode different features, and that a single gradient step on the prediction head can break output agreement — invalidating the standard metric of matching a retrained model. Deleting a small fraction of data can cause retraining to select entirely different features, so matching outputs may require learning features the full-data model never had. A new feature recovery metric separates missing from extraneous features; applied to 8 unlearning methods, it predicts downstream behavioral deviations under relearning and adaptation better than standard metrics do.


10
AI security agent security defense preprint

Cumulative and Audited Guardrail Tool Evolution for LLM Agent Safety

EVOLVE: Cumulative Guardrail Tool Evolution Interaction New security event Guardrail Tools Executable code Inherited + refined Independent Audit Checks before inheriting tool ~22% average F1 improvement over static defenses · validated on robotic and autonomous agent systems
Figure 1: EVOLVE's cumulative evolution pipeline. New security knowledge is converted into executable guardrail tools, independently audited, and inherited across interactions for continuous improvement. ~22% average F1 improvement over static defenses across diverse benchmarks and embodied environments.

Yang et al. propose EVOLVE, which treats agent security as a cumulative evolution problem: security knowledge is externalized into executable guardrail tools that persist across interactions, are independently audited before entering the inheritance chain, and are iteratively refined by ongoing interaction. This contrasts with static rules or classifiers that generalize poorly to emerging risks. EVOLVE achieves an average ~22% F1 improvement over static defenses across benchmarks, backbone models, and embodied environments, with validation in robotic and autonomous agent systems.


Notes
10 genuinely new, in-scope items, all preprints. The Nov 5 cs.AI/cs.CR/cs.LG/cs.CL batches were the primary source; several items (2611.01976, 2611.02516, 2611.03650) slipped through earlier daily sweeps. Strong theme: architectural and principled defenses for agentic LLMs (Baya compile-then-execute, ETUDE tool-update gap, germline MCP execution, SecureGARD ontology) alongside safety representation robustness work (Addition by Subtraction, alignment faking per-value analysis).
← all Research Radar issues · gussand · source