LATIDIA · Investigación

Fiabilidad de Claude Code como sistema de calificación de IA agéntica para exámenes universitarios escritos a mano

arXiv:2611.13217v1 Tipo de anuncio: nuevo Resumen: Este estudio examina la confiabilidad de Claude Code, un despliegue agéntico del modelo de lenguaje grande Claude Opus 4.6, como un sistema de calificación para exámenes universitarios escritos a mano.

La noticia

arXiv:2611.13217v1 Announce Type: new Abstract: This study examines the reliability of Claude Code, an agentic deployment of the Claude Opus 4.6 large language model, as a grading system for handwritten university exams. Four research questions addressed agreement with expert human grading on total scores (RQ1), agreement across five question types from multiple choice to evaluative judgement (RQ2), consistency across two independent grading sessions one week apart (RQ3), and the accuracy of AI-generated feedback (RQ4). Claude Code graded the 20-mark mid-term papers of 60 consenting students in a Saudi computer graphics course in a single agentic session, guided by three rubric files. Reliability was estimated on disjoint samples: 20 papers for