LATIDIA · Robótica

A TRAVÉS de: Agente de interfaz visual para control de robots

arXiv:2607.11119v2 Tipo de anuncio: reemplazar Resumen: La manipulación de robots es una tarea compleja que requiere percepción visual, razonamiento físico, planificación y control de bucle cerrado. Modelos de cimentación de propósito general (FM) hav

La noticia

arXiv:2607.11119v2 Announce Type: replace Abstract: Robot manipulation is a complex task that requires visual perception, physical reasoning, planning, and closed-loop control. General-purpose foundation models (FMs) have grown remarkably capable of some of these, especially perception and reasoning. Inspired by the growing ability of FM-powered agents to operate software through visual interfaces, we ask whether that same competence suffices to control a robot directly given the right interface. We present VIA (Visual Interface Agent), a framework that recasts robot control as an agentic task where an off-the-shelf agent drives a manipulator directly through an interface. The interface is a virtual workspace of interactable visual components where the agent can probe pixels