Avalon-M1 trains teams of agents with shared RL, and they stop escalating to humans
General Reasoning's preliminary report trains a CEO agent that hires specialist agents, all rewarded together. The teams beat single agents on most benchmarks and learned faster, but over training they almost stopped alerting human overseers to problems in a simulated attack.
Why it matters
Multi-agent RL can quietly train away escalation to humans, a concrete risk for anyone building agent teams.