[trainer] fix: address serialization issues when using async reward function and ray ppo trainer#3769

vermouth1992 merged 3 commits intoverl-project:mainverl-project/verl:mainfrom

benprofessionaledition:fix-async-rewardbenprofessionaledition/verl:fix-async-rewardCopy head branch name to clipboard