基于区块链保障信源可靠性的去中心化检索增强生成系统

摘要

现有的检索增强生成（RAG）系统通常采用集中式架构，导致数据收集、整合与管理成本高昂，并引发隐私担忧。业界亟需一种去中心化的RAG系统，使基础模型能够直接从数据所有者处获取信息，同时确保数据源完全由所有者掌控。然而去中心化带来了一项挑战：大量独立数据源的可靠性差异显著，可能降低检索精度和响应质量。为此，我们提出的去中心化RAG系统创新性地引入了可信度评分机制，该机制根据各数据源对生成响应的贡献质量进行动态评估，并在检索过程中优先选择高质量数据源。为确保透明度和可信度，评分流程通过基于区块链的智能合约进行安全管理，无需中央机构即可生成可验证、防篡改的可信度记录。我们使用两个Llama模型（3B和8B）在模拟环境中评估系统性能，其中六个数据源具有不同可信度。在模拟真实世界不可靠数据环境时，本系统相较集中式系统实现了10.7%的性能提升；在理想可靠数据环境下，其性能更接近集中式系统的理论上限。该去中心化基础设施通过批量更新操作实现了约56%的边际成本节约，同时保障了评分管理的安全可信。我们的代码与系统已在github.com/yining610/Reliable-dRAG开源。

English

Existing retrieval-augmented generation (RAG) systems typically use a centralized architecture, causing a high cost of data collection, integration, and management, as well as privacy concerns. There is a great need for a decentralized RAG system that enables foundation models to utilize information directly from data owners who maintain full control over their sources. However, decentralization brings a challenge: the numerous independent data sources vary significantly in reliability, which can diminish retrieval accuracy and response quality. To address this, our decentralized RAG system has a novel reliability scoring mechanism that dynamically evaluates each source based on the quality of responses it contributes to generate and prioritizes high-quality sources during retrieval. To ensure transparency and trust, the scoring process is securely managed through blockchain-based smart contracts, creating verifiable and tamper-proof reliability records without relying on a central authority. We evaluate our decentralized system with two Llama models (3B and 8B) in two simulated environments where six data sources have different levels of reliability. Our system achieves a +10.7\% performance improvement over its centralized counterpart in the real world-like unreliable data environments. Notably, it approaches the upper-bound performance of centralized systems under ideally reliable data environments. The decentralized infrastructure enables secure and trustworthy scoring management, achieving approximately 56\% marginal cost savings through batched update operations. Our code and system are open-sourced at github.com/yining610/Reliable-dRAG.

基于区块链保障信源可靠性的去中心化检索增强生成系统

A Decentralized Retrieval Augmented Generation System with Source Reliabilities Secured on Blockchain

摘要

Support