The perils of trial-and-error reward design: misdesign through overfitting and invalid task specifications

摘要: In reinforcement learning (RL), a reward function that aligns exactly with a task's true performance metric is often sparse. For example, a true task metric might encode a reward of …