Reproducing OpenAI’s “persistently beneficial models” - GRPO trait install barely moves. Ideas? [P] [R]

Explain Like I'm Normal

A researcher is attempting to reproduce an OpenAI paper regarding 'persistently beneficial models'—AI that stays helpful even after malicious fine-tuning. They are using Group Relative Policy Optimization (GRPO) to bake specific traits into a Qwen 7B model via Reinforcement Learning. While the goal is to evaluate if 'safety' can survive an adversarial attack, the current hurdle is getting the baseline alignment to take hold on consumer-grade hardware.