ENTLORE：一個以圖結構為基礎的企業問答潛在組織推理基準

摘要

企業問答被定義為檢索內部文件並生成有根據的答案。然而，常規企業記錄是工作副產品，其中所需的組織關係在不同異質來源之間仍然隱含。現有基準提供了真實的多來源證據，但往往實現預先定義的答案路徑，因此測試的是對陳述事實的組合，而非恢復語料庫中不存在的目標關係。我們將後一種能力稱為潛在組織推理。我們介紹 ENTLORE，一個基於圖譜的基準構建框架，從常規文件、權威組織表和營運記錄中重建一個經稽核的企業世界。具版本管理的組織慣例在真實圖譜中認證推導出的關係，從而提供完整的黃金答案和證明憑證。對齊的匿名化發布僅公開文件語料庫，同時隱藏私有結構和目標關係。ENTLORE 包含來自三種來源類型的 2,341 份文件和 907 個問題，涵蓋明確查找、跨來源組合和潛在組織推理，並在 56 種模型和存取配置上進行評估。將發布的世界建構為誘導實體圖或可導航知識庫可帶來最強的可部署結果。然而，即使提供黃金文件，仍有 30.4% 的潛在問題未被回答，而明確問題和組合問題分別為 12.6% 和 6.2%。因此，企業問答不僅依賴於文件召回，還取決於隱含的組織關係是否變得可用。該基準、數據和程式碼已在 ENTLORE 公開。

English

Enterprise question answering is framed as retrieving internal documents and generating grounded answers. Routine enterprise records, however, are work by-products in which required organizational relations remain implicit across heterogeneous sources. Existing benchmarks provide realistic multi-source evidence, but often materialize a predefined answer path and therefore test the composition of stated facts rather than recovery of a target relation absent from the corpus. We call the latter capability latent organizational reasoning. We introduce ENTLORE, a graph-grounded benchmark construction framework that reconstructs an audited enterprise world from routine documents, authoritative organizational tables, and operational records. Versioned organizational conventions certify derived relations in a truth graph, enabling complete golden answers and proof certificates. The aligned anonymized release exposes only the document corpus while withholding private structure and target relations. ENTLORE contains 2,341 documents from three source types and 907 questions spanning explicit lookup, cross-source composition, and latent organizational reasoning, evaluated across 56 model and access configurations. Structuring the released world as an induced entity graph or navigable knowledge base gives the strongest deployable results. Yet supplying gold documents still leaves 30.4% of latent questions unanswered, versus 12.6% and 6.2% for explicit and compositional questions. Enterprise QA therefore depends not only on document recall, but also on whether implicit organizational relations become usable. The benchmark, data, and code are publicly available at ENTLORE.