ReLMXEL：基于自适应强化学习的可解释性能耗与延迟优化内存控制器

摘要

降低延迟与能耗对提升现代计算中存储系统效率至关重要。本文提出ReLMXEL（基于可解释性能耗与延迟优化的强化学习存储控制器）——一种可解释的多智能体在线强化学习框架，通过奖励分解机制动态优化存储控制器参数。该框架在存储控制器内部运行，利用细粒度内存行为指标指导决策。多场景工作负载测试表明，该框架在基准配置基础上实现了持续性能提升，且能根据特定工作负载的内存访问特征进行精细化调整。通过将可解释性融入学习过程，ReLMXEL在提升性能的同时增强了控制决策的透明度，为构建更具可问责性和自适应能力的存储系统设计开辟了新路径。

English

Reducing latency and energy consumption is critical to improving the efficiency of memory systems in modern computing. This work introduces ReLMXEL (Reinforcement Learning for Memory Controller with Explainable Energy and Latency Optimization), a explainable multi-agent online reinforcement learning framework that dynamically optimizes memory controller parameters using reward decomposition. ReLMXEL operates within the memory controller, leveraging detailed memory behavior metrics to guide decision-making. Experimental evaluations across diverse workloads demonstrate consistent performance gains over baseline configurations, with refinements driven by workload-specific memory access behaviour. By incorporating explainability into the learning process, ReLMXEL not only enhances performance but also increases the transparency of control decisions, paving the way for more accountable and adaptive memory system designs.

ReLMXEL：基于自适应强化学习的可解释性能耗与延迟优化内存控制器

ReLMXEL: Adaptive RL-Based Memory Controller with Explainable Energy and Latency Optimization

摘要

Support