LATIDIA · Robótica

CAPSafe: un punto de referencia para la acción contextual y el razonamiento de seguridad del plan en agentes incorporados

arXiv:2610.28381v1 Tipo de anuncio: nuevo Resumen: El razonamiento sobre la seguridad es esencial para los agentes incorporados impulsados por modelos de lenguaje grandes (LLM). Presentamos el punto de referencia de Acción Contextual y Plan de Seguridad (CAPSafe), des

La noticia

arXiv:2610.28381v1 Announce Type: new Abstract: Reasoning about safety is essential for embodied agents powered by large language models (LLMs). We introduce the Contextual Action and Plan Safety benchmark (CAPSafe), designed to evaluate safety reasoning at two levels: (1) an action-level dataset that tests whether a single action is safe given its environmental context, and (2) a plan-level dataset that evaluates whether agents can generate safe long-horizon plans for complex hazardous household tasks. CAPSafe models safety conditions where hazards are situational (inferred from object properties), multiple hazards can co-occur within the same environment, and each is annotated with a relative severity level for fine-grained analysis. Evaluating nine closed and open-source LLMs