LATIDIA · Ciberseguridad

Sensibilidad de representación de preservación de amenazas en puntos de referencia de seguridad de agentes

arXiv: 2610.03585v1Tipo de anuncio: nuevo Resumen: Los puntos de referencia de seguridad para agentes basados en LLM a menudo informan la tasa de éxito de ataque (ASR) como una medida de la solidez del modelo y utilizan estas puntuaciones para comparar diferentes modelos y de

La noticia

arXiv:2610.03585v1 Announce Type: new Abstract: Security benchmarks for LLM-based agents often report the attack success rate (ASR) as a measure of model robustness and use these scores to compare different models and defense mechanisms, assuming that they describe the security of the agent. In this paper, we explore whether it also influences the benchmark's measurement. To measure the effect of the benchmark representation, we introduce threat-preserving representation sensitivity (TPRS), which measures how much the ASR changes when we change the agent-visible representation while holding the underlying task, harmful action, security policy, ground truth, environment, and the evaluation criteria fixed. On Agent Security Bench (ASB), replacing threat-related tool names with threat-neutral