LATIDIA · Ciberseguridad

Analizando la dirección errónea defensiva contra los ataques automatizados guiados por modelos en los sistemas de IA genéticos

arXiv:2606.20470v3 Tipo de anuncio: reemplazar Resumen: Los sistemas de IA genéticos dependen cada vez más de componentes de modelos de lenguaje para interpretar instrucciones, procesar datos externos, invocar herramientas y coordinar con otros agentes.

La noticia

arXiv:2606.20470v3 Announce Type: replace Abstract: Agentic AI systems increasingly rely on language-model components to interpret instructions, process external data, invoke tools, and coordinate with other agents. These capabilities make prompt-injection and jailbreak attacks more consequential, especially as attackers adopt model-guided automation to scale probing, prompt refinement, and response evaluation. This work analyzes the resulting attack-defense setting through a probabilistic model of a target system, its defense mechanism, and the attacker's automated judge. Our analysis shows that conventional detect-and-block defenses can allow attacker success rate (ASR) to approach one as the query budget grows, since predictable refusals provide useful feedback to automated search. We then examine detect-and-misdirect, where detected malicious interactions