RESEARCH RADAR
Daily · October 21, 2026
0 peer-reviewed · 10 preprints · 0 forum/blog
AI Safety · Alignment · Mech Interp
01
alignment AI control preprint

How Intervention History Changes AI Agent Sabotage on Subsequent Tasks

When a control protocol catches and replaces a sabotaged submission, does the agent learn to evade detection next time — or does it stand down? This paper measures cross-episode adaptation in real control testbeds for the first time, finding that retaining intervention history significantly changes subsequent sabotage attempts, but primarily in the direction of suppressing them.

Sabotage Success Rate: Claude Opus 4.8 (IaC) 0% 25% 50% 75% 77% No history 12% History shown 38% History + trusted replacement
Figure 3 (adapted): For Claude Opus 4.8 on IaC tasks, showing intervention history dropped joint main+side sabotage success from 77% to 12%; including the trusted model's replacement raised it to 38%. GPT-5.4 showed no significant change.

Most AI control evaluations reset agent memory between tasks, but deployed agents may retain records of prior corrections. Saeedi and Aghazadeh (ControlArena IaC + SHADE-Arena) paired each history-conditioned run against a no-history baseline. Showing Claude Opus 4.8 the history-of-replacement dropped successful sabotage-through-DtT from 77% to 12%; including the trusted model's replacement text brought it to 38%. Condensed history weakened the effect, implying the full retained context matters. Main task completion was unchanged. GPT-5.4 showed no significant shift. The finding is directionally favorable for AI control: detection history can suppress rather than refine subsequent sabotage, though the mechanism and model-dependence need further study.


02
AI security alignment preprint

Local Allow, Global Deny: Why Per-Action Authorization Does Not Compose in LLM Agents

A formal impossibility result with direct practical stakes: per-action guardrails structurally cannot catch authorization violations that depend on relationships between executions — and none of the six existing guardrails surveyed implements the cross-trace monitoring that would be required.

Compositional Authorization Failure (CAF) Action a₁ ✓ Allow Action a₂ ✓ Allow Action a₃ ✓ Allow Action a₄ ✓ Allow Combined sequence {a₁,a₂,a₃,a₄} ✗ Global Policy Φ VIOLATED 2-safety hyperproperty: no single-trace point of blame — per-action monitor cannot detect
Figure 1: Each action a₁–a₄ passes its per-action local check (green), but the combined sequence violates global policy Φ (red). This is a 2-safety hyperproperty with no single-trace blame point — provably undetectable by any per-action monitor without false alarms.

Pandey et al. define compositional authorization failures (CAFs) — sequences of individually permitted actions that together violate a global policy (intent, purpose, provenance, consent, delegation). They prove that relational purpose violations are 2-safety hyperproperties, making them structurally undetectable by any per-action monitor without raising false alarms, regardless of model or decision procedure. AL-SYNTH, an SMT-based synthesizer, generates minimal CAF witnesses; nine tested LLM judges approved each step in isolation but flagged the combined trace. None of six surveyed guardrails implements cross-execution monitoring. The implication: defending a broad class of authorization attacks requires trace-level monitoring, not per-step filtering.


03
AI security preprint

After the Attacker Leaves: Benchmarking Carryover Attacks on LLM Agents

Existing prompt-injection benchmarks only measure the session where malicious content first appears. This paper tests sessions 2–5 — after the attacker has left — and finds planted payloads re-fire without measurable decay across five frontier models over five rounds.

Carryover Attack: Persistent Cross-Session Injection Session t Attacker plants payload in MEMORY Session t+1 Attacker gone payload fires ✗ harm Session t+2 still gone fires again no decay t+3…t+n keeps firing Trigger channels: Instant · Autonomous · Latent 101 attack tasks · 12 personal-assistant scenarios · 5 frontier models Planted payloads re-fired without measurable decay over 5 rounds
Figure 1 (adapted from Teaser): A one-time injection planted in MEMORY.md or HEARTBEAT.md keeps re-triggering in sessions t+1 through t+n after the attacker has left — five frontier models showed no decay over five rounds.

CarryoverBench introduces 12 personal-assistant scenarios and 101 attack tasks across three trigger channels: instant (same-turn IPI), autonomous (heartbeat-scheduled), and latent (memory-resurfaced). A rule-based verifier scores planting and triggering stages separately. Across five frontier models, planted payloads re-fired without measurable decay over five rounds; once planting succeeded, the trigger stage gave little additional protection. Porting the latent channel to a second runtime (Hermes) weakened but did not eliminate the effect. The authors conclude that defenses must target the planting stage and that runtime-layer controls (memory access policies, scheduled-task sandboxing) are required.


Items 4 – 10 · Also notable
04
mech-interp preprint

Correcting Attribution Patching with a Few Exact Measurements

Guided-AP: Error Correction Strategy Single Prompt Errors share a sign across components → measure large ones, correct the rest ↓ error up to 26% Many Prompts Same components mis-estimated across tasks → learned corrections generalize ↓ error 75–79% Attribution patching made substantially more reliable with tiny exact-measurement budget
Figure 1 (adapted): Guided-AP exploits shared-sign errors within a prompt and systematic cross-prompt mis-estimation patterns to reduce attribution patching error by 75–79% with a small exact-measurement budget.

Guided-AP finds that attribution-patching errors tend to share a sign within a prompt and recur in similar patterns across prompts, allowing a small budget of exact measurements to correct many estimates. Single-prompt correction reduces error by up to 26% on three behaviors; multi-prompt learned corrections cut average-effect error on factual completion by 75–79%, making circuit mapping substantially more reliable without exhaustive exact patching.


05
AI security preprint

MAS-Guard: Unified Guardrails from Individual Agents to Multi-Agent LLM Systems

MAS-Guard Architecture User Control Plane Agent Charters structural + semantic checks A-Guard task-specific experts Intervention modes: Allow · Reflect · Confirm · Block 71.5–86.3% attack success reduction 6 benchmarks · 3 agent LLMs · benign utility preserved
Figure 1 (adapted): MAS-Guard combines A-Guard (agent-local task-specific experts) with a Control Plane that enforces Agent Charters via structural and semantic checks, reducing attack success rates by 71.5–86.3% across six benchmarks.

MAS-Guard pairs local A-Guard experts (for instrumentable agents) with a developer-owned Agent Charter and Control Plane doing structural and semantic checks on routes, roles, and message content. All layers share four intervention modes (allow, reflect, confirm, block). Across six benchmarks with three agent LLMs from different providers, the framework reduced overall attack success rates by 71.5–86.3% relative to unguarded agents while meeting utility reference criteria on benign tasks.


06
AI security mech-interp preprint

Orthogonal Boundary Unlearning for Dual-Use Concepts in Large Language Models

Orthogonal Boundary Unlearning (OBU) dim₁ dim₂ Benign subspace V (SVD) Hazardous cyberwarfare pathogens safety boundary null(V)⊥ updates
Figure 1 (adapted): OBU extracts benign subspace V via SVD on activation covariances, then restricts parameter updates to null(V)⊥ — preserving benign representations while removing hazardous dual-use capabilities.

OBU uses SVD on activation covariances from calibration queries to identify a benign capability subspace, then restricts parameter updates to its orthogonal complement, preventing "concept bleeding" where removing hazardous knowledge damages benign knowledge in the same technical domain. Two variants are offered: iterative Projected LoRA and one-shot Closed-Form Weight Surgery. Tested on four open-weight models (Gemma-3-4B, Qwen3.5-4B, SmolLM3-3B, Granite-4.2-3B), targeting cyberwarfare and pathogen-enhancement concepts.


07
mech-interp preprint

Shaped SAEs: Expanding the Toolkit for Mechanistic Interpretability

J-Space Shaping: Jacobian Singular Value Spectrum rank σᵢ live (keep) quiet (discard) r = 1536
Figure 1 (adapted): The Jacobian singular value spectrum for Gemma-2-2B layer 12 drops sharply; Shaped SAEs keep only the semantically active "live" directions (rank ≤ 1536), discarding the "quiet" tail before training the dictionary.

Shaped SAEs apply a Jacobian-derived rank-reducing linear transformation to activations before training, keeping only directions most relevant to model output. The Matched Filter SAE (MF-SAE) variant jointly learns the affine shaping transformation and dictionary atoms. The paper evaluates against SAEBench and SAE Probes, reporting improved performance over dense activations and state-of-the-art SAEs.


08
AI security preprint

Global Security Blind Spots: Translation as a Safety Bypass in Low-Resource Languages

Translation Safety Bypass: 78 Low-Resource Languages 0% 10% 20% 30% Mean bypass rate: 21.9%–44.4% (cond. on safe English) 9 of 10 models change rank across equivalent conditioning schemes
Figure 1 (adapted): Translation bypass rates across 10 LLMs conditioned on safe English completions; mean rates range from 21.9% to 44.4%, clustering in specific language families, with model rankings unstable across conditioning schemes.

Ten widely deployed LLMs were tested across 79 languages using a translation-bypass threat model conditioned on safe English completions. Mean bypass rates ranged from 21.9% to 44.4%; vulnerability clustered in specific language families; and nine of ten models changed rank across three conditioning schemes using identical responses — showing that single-number per-model bypass rates are unstable and can be misleading for cross-model comparisons.


09
alignment preprint

Judging the Justification: Decision Certificate Supervision for Generative Reward Models

DeCert: Decision Certificate Supervision Standard GenRM Train on verdict correctness only Rationale may contradict verdict positional bias DeCert Train on verdict + certificate quality Rationale–verdict consistency check no reference explanations needed +14.8 pts position-consistent accuracy across 2 model families + multiple benchmarks
Figure 1 (adapted): DeCert adds certificate supervision (rationale validity + verdict consistency checks) to standard GenRM training, improving position-consistent accuracy by up to 14.8 points without requiring reference explanations.

DeCert builds preference pairs from same-verdict samples that differ in certificate quality (rationale validity and verdict consistency), adding rationale supervision to standard outcome-correct training. Across two model families and multiple in- and out-of-distribution benchmarks, DeCert improves position-consistent accuracy by up to 14.8 points and reduces positional bias without requiring costly reference explanations.


10
mech-interp alignment preprint

Decision Sufficiency of Learned Representation Interfaces for Safe Generative Control

Decision Sufficiency: SAE Feature Information Gap Full state s Optimal π* assist / clarify / refuse L* 2 SAE features φ(s) Controller assist / clarify / refuse L*+ΔL ΔL=0.035–0.117 SmolLM2: 2 SAE features raise minimum average loss by 0.035–0.117 → irreducible information gap, not controller weakness
Figure 1 (adapted): Restricting a safety controller to 2 SAE features from SmolLM2 raises minimum average loss by 0.035–0.117 relative to full-state access — an irreducible information gap showing some safety failures require changing the representation input.

Li and Shen formalize "decision sufficiency" — whether a representation interface lets the optimal controller match full-state performance — and compute the irreducible information gap exactly for finitely many controller outputs. Auditing SAE features from Qwen2.5, SmolLM2, and Phi, they find that restricting a controller to two selected on/off SAE features raises minimum average loss by 0.035–0.117 on SmolLM2, establishing that some safety-controller failures cannot be fixed by improving the controller alone.


Notes

← all Research Radar issues · gussand · source