了解评估设计方法的模型评分更安全

摘要

AI安全评估的有效性取决于模型在受控环境和部署环境中行为的一致性。先前的研究发现，测试时上下文线索（例如假设性场景）会导致模型明确表达评估意识，并进而引发行为变化。本文探讨了这一现象的一个潜在解释：评估元知识，即关于评估结构性特征的参数化知识。与数据集污染（基准测试暴露通过记忆化导致性能提升）类似，我们假设在描述评估实践的文本（例如涉及AI基准测试的科学文章或社交媒体帖子）上训练的模型可能隐含地学会识别和响应类似评估的上下文。为验证这一假设，我们在描述评估特征（如可验证结构或道德困境）的合成文档上对模型进行微调。针对六个安全基准测试的评估结果显示，该微调模型的安全性显著高于基础模型和对照模型。即便将分析限制在未明确表达评估意识的回答中，这种行为变化依然存在。我们的研究表明，评估元知识可能人为提升安全基准测试性能，引入了一种独立于显式记忆或明确评估意识表达的新型混杂因素，因此难以检测。这些发现对AI安全评估的设计与解读具有重要意义。我们的代码和模型已公开于 https://github.com/compass-group-tue/arxiv2026_evaluation_meta_knowledge。

English

The validity of AI safety evaluations depends on models behaving consistently across controlled and deployment settings. Prior work has identified test-time contextual cues, such as hypothetical scenarios, as a source of verbalized evaluation awareness and subsequent behavioral shift. In this paper, we investigate a potential explanation of this phenomenon: evaluation meta-knowledge, defined as parametric knowledge about the structural traits that characterize evaluations. Similar to dataset contamination, where benchmark exposure leads to higher performance through memorization, we hypothesize that models trained on texts describing evaluation practices may implicitly learn to recognize and respond to evaluation-like contexts, for instance, through exposure to scientific articles or social media posts about AI benchmarking. To test this, we fine-tune models on synthetic documents describing evaluation traits such as verifiable structures or moral dilemmas. Evaluating this fine-tuned model on six safety benchmarks, we find that it is significantly safer than the base model and control model. This behavioral shift persists even when restricting the analysis to responses lacking explicit verbalization of evaluation awareness. Our results demonstrate that evaluation meta-knowledge may inflate safety benchmark performance, introducing a novel confounder that is independent of explicit memorization or verbalized evaluation awareness, thus, challenging to detect. These findings have important implications for the design and interpretation of AI safety evaluations. Our code and models are available at https://github.com/compass-group-tue/arxiv2026_evaluation_meta_knowledge.