LATIDIA · Ciberseguridad
VAST: Compilación de escenarios de vulnerabilidad fundamentados en entornos verificables de varios pasos para evaluar los agentes de «red team» de los LLM
arXiv:2611.19465v1 Tipo de anuncio: nuevo Resumen: La evaluación de los agentes de seguridad de los grandes modelos de lenguaje (LLM) requiere entornos reproducibles cuya dificultad de flujo de trabajo pueda variar y cuyos fallos puedan diagnosticarse. Hemos
WhatsApp ↗Telegram ↗
La noticia
arXiv:2611.19465v1 Announce Type: new Abstract: Evaluating Large Language Model (LLM) security agents requires reproducible environments whose workflow difficulty can be varied and whose failures can be diagnosed. We present VAST (Verifiable Adversarial Scenario Training & Evaluation), a declarative range compiler separating vulnerability scenarios from a compiler-introduced workflow-hardening layer. Following a post-hoc code and AST audit across all topics, the main benchmark retains 109 seed edges (45 with strict upstream CVE annotations), 72 family identifiers (62 under shared-HMAC relay grouping), 81 topic configurations (76 core plus 5 bounded execution models), and 1,387 instances (359 canonical four-gate-revalidated specs plus 1,028 seed variants) in a 42:39 partition. On the TopicServer compiler stratum, a