LATIDIA · Robótica

MRPilot: Supervisión e intervención de equipos de robots múltiples basados en LLM a través de la realidad mixta

arXiv: 2610.07477v1Tipo de anuncio: Cross Resumen: Los modelos de lenguaje grandes (LLM) permiten a los usuarios dirigir sistemas multirobot heterogéneos (MRS) a través del lenguaje natural, pero hacer interpretación de tareas, asignación de robots y coordi

La noticia

arXiv:2610.07477v1 Announce Type: cross Abstract: Large language models (LLMs) let users direct heterogeneous multi-robot systems (MRS) through natural language, but make task interpretation, robot assignment, and coordination difficult to inspect and change. Based on a formative study with 12 non-expert users, we developed MRPilot, a mixed reality system organized around four stages of supervision and intervention. MRPilot represents robot-team plans and execution states as structured commitments shared across synchronized situated and overview views. Across four stages, it helps users resolve ambiguous references (Forming), review plans before execution (Reviewing), monitor distributed execution (Following), and make robot-level or team-level changes when problems arise (Repairing). In a within-subjects study with 20 participants in