Offline-to-online RL on locomotion and Humanoid
Reproduced RLPD in PyTorch across three MuJoCo locomotion tasks, then tested replay composition on Humanoid-v5 with matched architecture and online interaction budgets.
Tools PyTorch · Gymnasium · MuJoCo · Minari · W&B

Online-only minus 50/50 replay at the 495k-step evaluation; three seeds per condition.
Limit Descriptive difference with substantial seed variance. Minari-v5 normalization is project-specific.









