LATIDIA · Ciberseguridad
ReconPotBench: Evaluación de honeypots de LLM en reconocimientos de Linux de varias rondas
arXiv:2611.20528v1 Tipo de anuncio: nuevo Resumen: Los grandes modelos de lenguaje (LLM) se utilizan cada vez más para crear «honeypots» interactivos, pero las evaluaciones existentes analizan principalmente los resultados de comandos aislados y no pueden determinar si
WhatsApp ↗Telegram ↗
La noticia
arXiv:2611.20528v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used to build interactive honeypots, yet existing evaluations mainly assess isolated command outputs and cannot determine whether a system remains believable when later commands depend on earlier results. We present ReconPotBench, a multi-round benchmark for Linux reconnaissance honeypots. It contains 1{,}032 three-round reconnaissance interactions across eight reconnaissance categories, with reference outputs collected from a real Linux environment. Under a unified testing protocol, we compare Cowrie, open-source LLMs, and closed-source LLMs along three dimensions: round-level authenticity, cross-round contextual consistency, and hacker-oriented reconnaissance value. Results show that multi-round evaluation exposes failures hidden by single-round testing, as authenticity declines with interaction depth