METIS：审慎探询与解决方案的智能指导引擎

摘要

许多本科生难以获得专业的研究指导。我们探究人工智能导师能否协助学生从构思到完成论文。为此我们开发了METIS——一个具备文献检索、定制指南、方法校验和记忆功能的工具增强型分阶段智能助手。通过LLM作为评判者的两两偏好比较、学生视角量规、短对话辅导及证据/合规性检查，我们在六个写作阶段将METIS与GPT-5和Claude Sonnet 4.5进行对比评估。针对90个单轮提示，LLM评判者更偏好METIS的比例相较于Claude Sonnet 4.5达71%，相较于GPT-5达54%。分阶段评估显示（清晰度/可操作性/约束匹配度；90提示×3评委），METIS的学生评分全面领先。在多轮对话场景中（五种情境/智能体），METIS的最终成果质量略高于GPT-5。优势集中体现在文档依赖阶段（D-F），这与分阶段路由和事实 grounding 机制相符；不足之处包括工具过早路由、事实 grounding 深度不足及偶发的阶段误判。

English

Many students lack access to expert research mentorship. We ask whether an AI mentor can move undergraduates from an idea to a paper. We build METIS, a tool-augmented, stage-aware assistant with literature search, curated guidelines, methodology checks, and memory. We evaluate METIS against GPT-5 and Claude Sonnet 4.5 across six writing stages using LLM-as-a-judge pairwise preferences, student-persona rubrics, short multi-turn tutoring, and evidence/compliance checks. On 90 single-turn prompts, LLM judges preferred METIS to Claude Sonnet 4.5 in 71% and to GPT-5 in 54%. Student scores (clarity/actionability/constraint-fit; 90 prompts x 3 judges) are higher across stages. In multi-turn sessions (five scenarios/agent), METIS yields slightly higher final quality than GPT-5. Gains concentrate in document-grounded stages (D-F), consistent with stage-aware routing and groundings failure modes include premature tool routing, shallow grounding, and occasional stage misclassification.

METIS：审慎探询与解决方案的智能指导引擎

METIS: Mentoring Engine for Thoughtful Inquiry & Solutions

摘要

Support